Remote in the United States, a Senior AI Systems Quality Engineer is sought to design automated testing frameworks, evaluation pipelines, and scalable quality practices for AI systems used in mission-critical healthcare environments. You will build production-grade automated validation platforms and integrate with Databricks and MLflow to enable traceability, lineage, and auditability. The role emphasizes quality-by-design, safe failure behavior, measurable evaluation signals, and continuous validation across the development lifecycle. Responsibilities include creating large-scale, scenario-based test suites, validating agentic orchestration behaviors, and embedding automated quality gates into CI/CD pipelines. You will collaborate with AI engineering, platform, security, and delivery teams to translate requirements into clear quality criteria, make release-readiness decisions, and drive operational confidence. Requirements include 7+ years of backend or platform software experience, hands-on experience with automated AI testing at scale, proficiency in Python and/or TypeScript, experience with AI-powered systems (LLMs, agentic workflows), knowledge of CI/CD and AWS, and familiarity with Databricks, MLflow, and observability tools. Benefits include compensation based on experience and location, unlimited paid time off, work-from-anywhere flexibility, comprehensive health coverage, equity, and home office setup support.

Remote in the United States, a Senior AI Systems Quality Engineer is sought to design automated testing frameworks, evaluation pipelines, and scalable quality practices for AI systems used in mission-critical healthcare environments. You will build production-grade automated validation platforms and integrate with Databricks and MLflow to enable traceability, lineage, and auditability. The role emphasizes quality-by-design, safe failure behavior, measurable evaluation signals, and continuous validation across the development lifecycle. Responsibilities include creating large-scale, scenario-based test suites, validating agentic orchestration behaviors, and embedding automated quality gates into CI/CD pipelines. You will collaborate with AI engineering, platform, security, and delivery teams to translate requirements into clear quality criteria, make release-readiness decisions, and drive operational confidence. Requirements include 7+ years of backend or platform software experience, hands-on experience with automated AI testing at scale, proficiency in Python and/or TypeScript, experience with AI-powered systems (LLMs, agentic workflows), knowledge of CI/CD and AWS, and familiarity with Databricks, MLflow, and observability tools. Benefits include compensation based on experience and location, unlimited paid time off, work-from-anywhere flexibility, comprehensive health coverage, equity, and home office setup support.