Director of Quality Assurance
The Director of Quality Assurance leads Ludi Inc .'s quality assurance function, setting the strategy, standards, and processes that ensure every product meets the highest bar for reliability and performance. This role builds, manages, and mentors the QA team, partners closely with engineering and product leadership to embed quality throughout the development lifecycle, and reports directly to the Chief Technology Officer.
This role operates in a high-velocity environment where coding agents generate a large share of production code. The Director of QA is accountable for scaling verification to match agent output rather than human commit cadence, and for designing the guardrails that let agent-generated code ship safely.
Key Responsibilities:
- Lead the QA team and set the overall test strategy, quality standards, and processes needed to meet client targets and performance goals.
- Own Ludi's quality roadmap: evaluate current practices, identify gaps, and drive a comprehensive test strategy across manual and automated testing.
- Build, manage, and mentor a high-performing QA team, including hiring, coaching, and career development for QA Engineers.
- Partner with engineering and product leadership to embed quality practices early in the development lifecycle and align QA priorities with product roadmaps.
- Oversee the design and implementation of automated and manual test frameworks, ensuring comprehensive coverage across all products.
- Establish and track quality metrics and KPIs, reporting on product quality, defect trends, and testing effectiveness to the CTO and executive team.
- Own the bug tracking and triage process within Ludi's agile project management tooling, ensuring issues are documented, prioritized, and resolved efficiently.
- Ensure thorough regression testing practices are followed across the team when bugs are resolved.
- Design automated quality gates and pre-merge guardrails that permit agent-generated code to ship at speed without regression leakage.
- Drive test authoring as an agent-assisted workflow: use coding agents to generate and maintain test suites and set the standards for doing so.
- Critically review agent-generated tests, preventing suites that codify existing bugs, pass trivially, or mirror the implementation instead of the requirement.
- Own the evaluation strategy for AI-driven product features: non-deterministic output handling, eval harnesses, and regression detection for model behavior.
- This position is 100% remote and candidate must be located in the United States.
Education, Experience & Skills:
Required:
- Bachelor's degree, preferably in business or computer science; advanced degree a plus.
- 7+ years' experience in QA within SaaS, ideally in healthcare, including at least 3 years in a QA leadership or management capacity.
- 5+ years' experience with automated testing tools and strategy; hands-on experience with Playwright/JavaScript or similar toolsets (Cypress, Selenium).
- Proven track record building and scaling QA practices, tools, and frameworks for large-scale SaaS applications.
- Proven track record hiring, managing, and developing QA talent.
- Direct experience running or scaling QA in an environment that uses coding agents (Claude Code, Codex, Cursor, or equivalent). Strong candidates can articulate how agentic development changes test strategy, not just tooling.
- Demonstrated ability to distinguish genuine coverage from agent-produced test theater — suites that inflate metrics without exercising real behavior.
- Ability to scale verification throughput against high-frequency, agent-driven merge volume.
Preferred:
- Experience using agents to write and maintain Playwright suites, not purely manual authoring.
- Familiarity with evaluating non-deterministic and LLM-driven systems: eval frameworks, output regression, LLM-as-judge approaches.
- Work history at smaller early-stage companies; exposure to Agile development shops.
Leadership &