Lead QA Engineer at Alivo is responsible for owning testing, release validation, and AI conversation quality across the Alivo platform. You will develop, run, and maintain automated test suites, perform manual testing of new features, validate usability and edge cases across staging and production-like environments, and execute structured test plans to ensure consistent quality. You will drive product quality and release readiness by reviewing feature implementations, coordinating with Engineering to mitigate risks, and producing clear, reproducible bug reports. A core focus is evaluating AI-powered phone and chat conversations for natural, accurate, and helpful interactions, identifying failure modes and hallucinations, and defining quality standards and acceptance criteria. You will build and maintain AI evaluation datasets, scoring rubrics, and tracking quality over time, providing actionable recommendations to improve prompts and workflows. You will collaborate with Engineering, Product, Customer Success, and Leadership to improve product quality and customer outcomes. Qualifications include 2–5+ years in QA or software testing, strong attention to detail, excellent written and verbal communication, ability to identify edge cases, and experience with bug reporting. Bonus points for experience evaluating AI/LLM or conversational AI, with tools like Jira, TestRail, Postman, and basic SQL or scripting. A background in SaaS or high-growth startups and customer-facing roles is a plus.
Track similar jobs
Get email alerts when new roles like this are posted.
Based on: Lead QA Engineer
See how this role matches your resume
Sign in to get an AI match score and personalized feed.
Lead QA Engineer at Alivo is responsible for owning testing, release validation, and AI conversation quality across the Alivo platform. You will develop, run, and maintain automated test suites, perform manual testing of new features, validate usability and edge cases across staging and production-like environments, and execute structured test plans to ensure consistent quality. You will drive product quality and release readiness by reviewing feature implementations, coordinating with Engineering to mitigate risks, and producing clear, reproducible bug reports. A core focus is evaluating AI-powered phone and chat conversations for natural, accurate, and helpful interactions, identifying failure modes and hallucinations, and defining quality standards and acceptance criteria. You will build and maintain AI evaluation datasets, scoring rubrics, and tracking quality over time, providing actionable recommendations to improve prompts and workflows. You will collaborate with Engineering, Product, Customer Success, and Leadership to improve product quality and customer outcomes. Qualifications include 2–5+ years in QA or software testing, strong attention to detail, excellent written and verbal communication, ability to identify edge cases, and experience with bug reporting. Bonus points for experience evaluating AI/LLM or conversational AI, with tools like Jira, TestRail, Postman, and basic SQL or scripting. A background in SaaS or high-growth startups and customer-facing roles is a plus.
Track similar jobs
Get email alerts when new roles like this are posted.
Based on: Lead QA Engineer
See how this role matches your resume
Sign in to get an AI match score and personalized feed.
© 2026 JobMatcher. All rights reserved.
© 2026 JobMatcher. All rights reserved.
1 active role from this employer in the JobMatcher catalog.
1 active role from this employer in the JobMatcher catalog.
Digital PR Manager
Single Grain
Technical Delivery Manager
Stevens
B2B Account Executive
Fastest Labs of Boise & Meridian
Staff Software Engineer
Valon
Project Manager
The Brandon Green Management Group (BGMG)
Contract Technical Recruiter
Blue Acorn iCi
Associate Recruiter
Blue Acorn iCi
Talent Acquisition Partner
Vanderbilt Health
Account Manager
National Marrow Donor Program (NMDP)
Technical Sales Manager
Computype
Digital PR Manager
Single Grain
Technical Delivery Manager
Stevens
B2B Account Executive
Fastest Labs of Boise & Meridian
Staff Software Engineer
Valon
Project Manager
The Brandon Green Management Group (BGMG)
Contract Technical Recruiter
Blue Acorn iCi
Associate Recruiter
Blue Acorn iCi
Talent Acquisition Partner
Vanderbilt Health
Account Manager
National Marrow Donor Program (NMDP)
Technical Sales Manager
Computype