Manager, Quality Engineering & AI Validation

📋 Description

• • Lead Accordion’s centralized Quality Engineering and AI Validation function across all software delivery pods, defining firm-wide quality strategy, release gates, and validation standards for both traditional software and AI-enabled solutions.
• • Establish a risk-based quality model that determines when pod-level validation is sufficient versus when independent QA validation is required for high-risk workflows.
• • Build and operationalize the AI validation framework, including benchmark datasets, scoring rubrics, regression comparisons, and grounded-output validation to ensure reliability of AI-driven products.
• • Define testing expectations for AI outputs covering instruction adherence, consistency, business correctness, control compliance, and hallucination risk.
• • Partner with Engineering and Product leaders to assess quality implications of prompt changes, model updates, workflow modifications, and tooling integrations.
• • Lead, develop, and mentor a team of quality engineers, AI quality analysts, and domain-oriented QA resources to improve automation maturity, test evidence standards, and release discipline.
• • Design a scalable central quality model that supports delivery pods without becoming a bottleneck, ensuring consistent quality across geographically distributed teams.
• • Collaborate with Finance and practice SMEs to align quality controls with real business use cases, materiality thresholds, and regulatory control expectations.
• • Ensure high-risk financial workflows undergo appropriate domain review before production release, with clear traceability of validation decisions.
• • Define production quality monitoring frameworks to track escaped defects, output-quality degradation, reviewer overrides, and control failures.
• • Create visibility into quality trends, release readiness metrics, and recurring failure patterns for Engineering leadership and executive stakeholders.
• • Translate complex finance workflows into actionable quality controls and release criteria, ensuring solutions meet both technical and business requirements.
• • Maintain a strong focus on trust, traceability, and scalable execution across all quality initiatives.
• • Communicate complex quality issues and risk assessments clearly to Engineering, Product, and business stakeholders with credibility and structure.
• • Drive continuous improvement in automation, evaluation routines, and release discipline while balancing hands-on execution with strategic leadership.
• • Operate in a hybrid model with flexibility to work remotely up to two days per week, based in one of Accordion’s U.S. offices: Atlanta, Boston, Charlotte, Chicago, Dallas, Los Angeles, New York, or San Francisco.
• • Serve as a trusted advisor on quality and risk, asking tough questions about readiness, evidence, and compliance to prevent defects from reaching production.
• • Foster a culture of ownership, mentoring, and collaborative problem-solving across teams while embodying Accordion’s entrepreneurial and flat organizational values.