Lead QA Engineer at Alivo is responsible for owning testing, release validation, and AI conversation quality across the Alivo platform. You will develop, run, and maintain automated test suites, perform manual testing of new features, validate usability and edge cases across staging and production-like environments, and execute structured test plans to ensure consistent quality. You will drive product quality and release readiness by reviewing feature implementations, coordinating with Engineering to mitigate risks, and producing clear, reproducible bug reports. A core focus is evaluating AI-powered phone and chat conversations for natural, accurate, and helpful interactions, identifying failure modes and hallucinations, and defining quality standards and acceptance criteria. You will build and maintain AI evaluation datasets, scoring rubrics, and tracking quality over time, providing actionable recommendations to improve prompts and workflows. You will collaborate with Engineering, Product, Customer Success, and Leadership to improve product quality and customer outcomes. Qualifications include 2–5+ years in QA or software testing, strong attention to detail, excellent written and verbal communication, ability to identify edge cases, and experience with bug reporting. Bonus points for experience evaluating AI/LLM or conversational AI, with tools like Jira, TestRail, Postman, and basic SQL or scripting. A background in SaaS or high-growth startups and customer-facing roles is a plus.
Track similar jobs
Get email alerts when new roles like this are posted.
Based on: Lead QA Engineer
Насколько эта вакансия подходит вашему резюме
Войдите, чтобы увидеть AI match score и персональную ленту.
Lead QA Engineer at Alivo is responsible for owning testing, release validation, and AI conversation quality across the Alivo platform. You will develop, run, and maintain automated test suites, perform manual testing of new features, validate usability and edge cases across staging and production-like environments, and execute structured test plans to ensure consistent quality. You will drive product quality and release readiness by reviewing feature implementations, coordinating with Engineering to mitigate risks, and producing clear, reproducible bug reports. A core focus is evaluating AI-powered phone and chat conversations for natural, accurate, and helpful interactions, identifying failure modes and hallucinations, and defining quality standards and acceptance criteria. You will build and maintain AI evaluation datasets, scoring rubrics, and tracking quality over time, providing actionable recommendations to improve prompts and workflows. You will collaborate with Engineering, Product, Customer Success, and Leadership to improve product quality and customer outcomes. Qualifications include 2–5+ years in QA or software testing, strong attention to detail, excellent written and verbal communication, ability to identify edge cases, and experience with bug reporting. Bonus points for experience evaluating AI/LLM or conversational AI, with tools like Jira, TestRail, Postman, and basic SQL or scripting. A background in SaaS or high-growth startups and customer-facing roles is a plus.
Track similar jobs
Get email alerts when new roles like this are posted.
Based on: Lead QA Engineer
Насколько эта вакансия подходит вашему резюме
Войдите, чтобы увидеть AI match score и персональную ленту.
© 2026 JobMatcher. Все права защищены.
© 2026 JobMatcher. Все права защищены.
Digital PR Manager
Single Grain
Technical Delivery Manager
Stevens
B2B Account Executive
Fastest Labs of Boise & Meridian
Staff Software Engineer
Valon
Project Manager
The Brandon Green Management Group (BGMG)
Contract Technical Recruiter
Blue Acorn iCi
Associate Recruiter
Blue Acorn iCi
Talent Acquisition Partner
Vanderbilt Health
Account Manager
National Marrow Donor Program (NMDP)
Technical Sales Manager
Computype
Digital PR Manager
Single Grain
Technical Delivery Manager
Stevens
B2B Account Executive
Fastest Labs of Boise & Meridian
Staff Software Engineer
Valon
Project Manager
The Brandon Green Management Group (BGMG)
Contract Technical Recruiter
Blue Acorn iCi
Associate Recruiter
Blue Acorn iCi
Talent Acquisition Partner
Vanderbilt Health
Account Manager
National Marrow Donor Program (NMDP)
Technical Sales Manager
Computype
Открытые роли в этой компании — 1 в каталоге JobMatcher.
Открытые роли в этой компании — 1 в каталоге JobMatcher.