ESR Healthcare
Remote
Gmail & Google Calendar AI Assistant Evaluator
https://jobs.micro1.ai/post/313b5b7a-a6a8-4acf-9842-017d8506a037?referralCode=1761f2a1-0970-4c4f-a273-a1b557d5ad9f&utm_source=referral&utm_medium=share&utm_campaign=job_referral Role Type: Contractor, Remote Location: United States only Key Responsibilities: Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions. Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness. Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance. Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases. Utilize AI training tools and...
