QA Engineer
https://jobs.micro1.ai/post/5bcc625c-be57-426d-affd-a6ba6f68be26?referralCode=10002f4f-2f65-476f-b8d5-434a25460930&utm_source=referral&utm_medium=share&utm_campaign=job_referral
Role Type: Contractor
Location: Remote
Scope of Work
Evaluate and rate AI-generated technical outputs against defined quality criteria and rubrics, identifying answers that may appear correct but are actually inaccurate or incomplete.
Design and assess comprehensive test cases for functional, regression, and edge-case scenarios, including negative and boundary tests.
Review bug reports and test documentation to ensure issues are reproducible, documentation is complete, and severity is properly assessed.
Identify, isolate, and document defects with precise reproduction steps and utilize structured tracking mechanisms.
Provide detailed, actionable written feedback and annotations to support efficient resolution by developers without the need for clarification.
Collaborate with project teams to refine evaluation guidelines and ensure continuous improvement of testing standards and methodologies.
Preferred Qualifications
Proven professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or similar role in software quality assurance.
Strong command of QA fundamentals, including test case design, bug tracking, regression testing, and both manual and automated testing strategies.
Hands-on experience with automation frameworks and test management tools such as Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, or BrowserStack (or similar tools).
Prior paid human data experience supporting AI training—such as annotation, labeling, RLHF, AI response evaluation, model evaluation, or rubric-based grading—is a firm project requirement.
Excellent analytical and problem-solving skills with meticulous attention to detail.
Ability to communicate complex findings clearly in written English, providing specific, actionable feedback (B2 level or above).
No formal degree required—practical, demonstrable testing experience takes precedence.
Reliable internet connection and readiness to begin promptly.
Hello Candidates and New Clients:
Candidates - want a new job? Are you hiring and need help with a job placement?
https://www.linkedin.com/company/executive-staff-recruiters
Send us your resume: jonathan@executivestaffrecruiters.us
Clients: post jobs here:
https://esrhealthcare.mysmartjobboard.com/employer-products/
Visit us here:
https://www.careers-page.com/esr-healthcare
https://www.linkedin.com/company/executive-staff-recruiters
Check our profile below with more healthcare jobs posted:
Looking for new Healthcare clients (and other verticals) and candidates - please email us directly.
more open jobs (many verticals):
Send us your resume: jonathan@executivestaffrecruiters.us