[Remote] Software Engineer, Infrastructure (ML and Real-Time Speech)

Note: The job is a remote job and is open to candidates in USA. Otter.ai is a leading tool for meeting transcription and collaboration, aiming to make conversations more valuable. They are seeking an experienced Software Engineer to build infrastructure for advanced speech recognition and real-time speaker identification systems, working closely with machine learning researchers and product managers. Responsibilities • Design, build, and operate backend services that power real-time, multi-language, ASR and speaker identification features • Architect scalable, fault-tolerant infrastructure across databases, queues, and pub/sub systems to support low-latency ML workflows • Partner with ML teams to productionize models (training pipelines, model deployment, versioning, and monitoring) for real-time and batch inference • Improve system observability, reliability, and performance for large-scale speech data ingestion and streaming • Contribute to the evolution of our platform architecture, including microservices, orchestration (Kubernetes), and API integrations • Collaborate with cross-functional teams to streamline developer experience, CI/CD pipelines, and automated testing for ML-backed services Skills • 2+ years of experience designing and building scalable backend systems and distributed infrastructure • Fluent in Python (bonus for C++) and familiar with building high-performance services • Understands data structures, algorithms, distributed systems, and operating systems at a deep level • Has worked with databases (SQL & NoSQL), queuing systems, and pub/sub solutions, and knows what's happening 'under the hood' • Has experience with ML infrastructure / MLOps (e.g., model deployment, feature stores, pipelines) or is eager to learn quickly • Enjoys collaborating with ML engineers and product teams to translate research into production-ready systems • Thrives in a fast-paced environment where innovation and reliability go hand in hand • Experience with real-time streaming frameworks (Kafka, Pulsar, Flink) • Hands-on experience with container orchestration (Kubernetes, ECS) • Familiarity with SDK integrations or developer platform design • Experience building or optimizing speech/voice AI pipelines Company Overview • Otter.ai improves business team productivity by providing an app to capture, share, and recall all meeting notes. It was founded in 2016, and is headquartered in Mountain View, California, USA, with a workforce of 51-200 employees. Its website is Company H1B Sponsorship • Otter.ai has a track record of offering H1B sponsorships, with 30 in 2025, 17 in 2024, 19 in 2023, 8 in 2022, 4 in 2021. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job