[Remote] QA Lead Engineer (AI-First Engineering Organization)

Note: The job is a remote job and is open to candidates in USA. Finite State is a fast-growing series-B company focused on securing connected devices and supply chains. They are seeking an experienced QA Lead Engineer to drive quality strategy and execution within an AI-first development organization, focusing on architecting and implementing automated quality frameworks that integrate AI technology.

Responsibilities
• Define and own the end-to-end QA strategy for an AI-first engineering team
• Architect scalable, fully automated testing frameworks across backend, frontend, APIs, and AI-powered features
• Lead the transition from traditional QA practices to AI-driven quality engineering
• Establish quality metrics, SLAs, and measurable standards across the product lifecycle
• Serve as the technical authority on testing architecture, tooling, and best practices
• Design and implement AI-agent-driven QA workflows (e.g., autonomous test generation, regression validation, autonomous testing agents)
• Integrate LLM-based or AI-assisted tooling into CI/CD pipelines
• Leverage AI to improve test coverage, defect detection, root cause analysis, and release confidence
• Evaluate and introduce emerging AI QA tooling and frameworks
• Develop strategies for testing AI-based product features (e.g., model behavior validation, output consistency, guardrail enforcement)
• Partner closely with Product to define acceptance criteria, quality gates, and risk assessments
• Work with Engineering leadership to embed quality earlier in the development lifecycle
• Drive a culture where developers co-own quality and automation
• Lead post-incident quality reviews and implement systemic improvements
• Define and standardize quality processes across squads
• Leverage AI to build autonomous QA systems that understand the context of product decisions, and use that context to drive the highest quality
• Build frameworks and reusable testing infrastructure
• Mentor engineers on best practices in automation and AI-driven testing

Skills
• 10+ years of experience in QA engineering, with deep expertise in automation
• Demonstrated thought leadership and hands on implementation experience with creating AI-driven Agentic quality systems
• Proven experience designing and implementing automated test frameworks at scale
• Strong programming skills (e.g., Python, JavaScript/TypeScript, Java, or similar)
• Experience with Cloud based CI/CD systems and modern DevOps practices
• Demonstrated technical leadership in cross-functional teams
• Experience using AI tools and agents in development workflows
• Deep experience with AI Agents and LLMs and how to test AI-driven systems
• Strong communication skills with the ability to influence Product and Engineering leaders
• Experience driving process improvements across teams
• Ability to operate strategically while remaining hands-on
• A mindset focused on systems thinking, scalability, and continuous improvement
• Experience with autonomous test generation or AI-assisted test maintenance is highly desirable
• Understanding of challenges specific to testing AI systems (non-determinism, hallucination, evaluation frameworks)

Benefits
• Equity
• Benefits

Company Overview
• Finite State is a cybersecurity company that specializes in providing software risk management solutions. It was founded in 2017, and is headquartered in Columbus, Ohio, USA, with a workforce of 51-200 employees. Its website is https://www.finitestate.io.

Company H1B Sponsorship
• Finite State has a track record of offering H1B sponsorships, with 2 in 2020. Please note that this does not guarantee sponsorship for this specific role.

Apply tot his job

Apply To this Job