Director, AI Quality & Reliability Engineering

Vizient, Inc

Lead operational execution and scaling of enterprise AI Quality Engineering capabilities at Vizient. Drive AI validation strategies and develop high-performing teams in an inclusive environment.

Posted 6/18/2026full-timeEdina • Illinois, Minnesota, Texas • 🇺🇸 United StatesLead💰 $117,600 - $206,000 per yearWebsite

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

quality engineeringtest automationAI validation strategiesfunctional testingregression testingruntime quality assuranceobservabilitytelemetryrisk mitigationscalable delivery processes

Soft Skills

leadershipmentoringorganizational planninginnovationaccountabilitycontinuous improvementteam developmentcollaborationcommunicationexecution governance

Tools & Technologies

AI-assisted testing toolstest automation platformsobservability solutionstelemetry platformscloud-native platformsenterprise AI platformsAI governance frameworksmodel risk management toolsquality engineering technologiesintelligent automation solutions

Certifications & Qualifications

Quality EngineeringSoftware TestingAgileCloud TechnologiesAI

Industry Keywords

Generative AILarge Language Modelsagentic AI systemshealthcareregulated industriescompliance requirementsauditability practicesAIOpsLLMOpsMLOps

Tech Stack

Tools & technologies

Cloud

About the role

Key responsibilities & impact

Lead and scale enterprise AI Quality Engineering capabilities supporting AI-powered applications, LLM-enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
Establish and operationalize AI-native quality engineering frameworks, validation methodologies, testing standards, runtime assurance practices, and scalable delivery processes.
Drive modernization of traditional quality engineering and test automation practices to support AI-enabled workflows, probabilistic systems, intelligent orchestration, and evolving healthcare business processes.
Lead AI validation strategies, including functional testing, prompt testing, workflow validation, regression testing, release readiness, runtime quality assurance, and production reliability.
Partner with AI Engineering, Data, Security, Governance, Clinical, and Operational teams to ensure quality, reliability, scalability, and successful deployment of enterprise AI solutions.
Implement quality controls, governance-aligned testing practices, validation evidence processes, and risk mitigation strategies that support responsible AI adoption and regulatory compliance.
Advance enterprise observability, telemetry, monitoring, and runtime quality practices to improve traceability, reliability, and confidence across AI-enabled systems.
Lead AI Quality Engineering delivery activities, including organizational planning, vendor and contractor management, execution governance, tooling strategy, and capability development.
Build, mentor, and develop high-performing quality engineering teams while fostering a culture of innovation, accountability, continuous improvement, and engineering excellence.
Research and evaluate emerging AI quality engineering, testing, automation, observability, and runtime assurance technologies to drive continuous improvement and organizational maturity.

Requirements

What you’ll need

10 + years experience implementing quality engineering practices for Generative AI, Large Language Models (LLMs), agentic AI systems, or intelligent automation solutions.
Relevant degree, Bachelor’s degree preferred.
Experience working within healthcare, payer, provider, life sciences, or other regulated industries.
Familiarity with AI governance, responsible AI frameworks, model risk management, compliance requirements, and auditability practices.
Experience with AI-assisted testing tools, test automation platforms, observability solutions, telemetry platforms, and modern quality engineering technologies.
Knowledge of AIOps, LLMOps, MLOps, cloud-native platforms, and enterprise-scale AI deployment models.
Relevant certifications in Quality Engineering, Software Testing, Agile, Cloud Technologies, AI, or related disciplines.
Experience building and scaling organizational capabilities, operating models, and quality engineering centers of excellence.

Benefits

Comp & perks

Vizient has a comprehensive benefits plan! Please view our benefits here: http://www.vizientinc.com/about-us/careers