Remote QA Engineer (AI/ML Focus)

bout Special Projects Engineering LLC Special Projects Engineering is a small, elite team based in Seattle tackling complex, high-impact problems using advanced AI and automation. We work across domains like autonomous systems, predictive infrastructure, synthetic biology, and next-gen defense tech. When something hasn’t been done before, we don’t shy away — we build it. What You’ll Do As a QA Engineer focused on ML/AI systems, your mission is to ensure the reliability, accuracy, and stability of intelligent systems that operate in messy, real-world environments. You’ll design robust testing frameworks and evaluation pipelines to validate everything from perception models to full-stack ML deployments. Responsibilities: • Develop and maintain automated test suites for machine learning pipelines and AI-enabled systems • Create testing strategies for models handling visual, audio, sensor, and textual data • Validate data inputs, model outputs, performance benchmarks, and edge-case behavior • Build tools for continuous integration and regression testing across ML components • Work with ML engineers to define evaluation metrics and acceptable thresholds • Help ensure models are safe, stable, and robust before deployment • Identify gaps in test coverage and build test plans that scale with the codebase What We’re Looking For • 3+ years in software QA, test automation, or related role • Hands-on experience testing ML models or AI systems in production environments • Strong Python skills; bonus if you’ve worked with PyTorch, TensorFlow, or JAX • Familiarity with ML lifecycle and model validation techniques • Experience with CI/CD pipelines, test frameworks, and debugging tools • Detail-oriented mindset with strong instincts for edge cases and failure modes • Bonus: background in data validation, simulation environments, or robotics Why Join Us • Remote first company • Competitive salary and equity • Flexible hours and remote-friendly culture • Full health, dental, and vision insurance • High-end GPU hardware and compute resources • Work on real-world AI systems with a high-caliber team • Fast-moving environment where your work directly impacts production If you care about building AI that actually works, works well, and works safely — we’d love to talk. Apply tot his job