[Remote] Senior Software Engineer, Backend (AI Agent Runtime)
Note: The job is a remote job and is open to candidates in USA. Cresta is on a mission to turn every customer conversation into a competitive advantage by unlocking the true potential of the contact center. The Senior Software Engineer will build real-time AI agent infrastructure, solve distributed systems problems, and enhance developer experience while ensuring high production quality.
Responsibilities
• Build real-time AI agent infrastructure: Design and operate the stateful, low-latency runtime that powers voice and chat AI agents — from LLM streaming and conversation state management to graceful recovery and multi-channel support
• Solve distributed systems problems: Own session management across scaled-out workers — including affinity, checkpointing, crash recovery, and consistency under concurrent access
• Build a function execution platform: Own a serverless-style runtime where customers deploy custom logic — build orchestration, container lifecycle, autoscaling, and versioned rollouts
• Own developer experience and test infrastructure: Build CLI tools, local development environments, and test execution frameworks that let engineers iterate quickly and ship with confidence
• Raise the bar on production quality: Drive observability, incident response, and engineering best practices across the team
Skills
• 5+ years of software engineering experience, with meaningful time spent on infrastructure, platform, or systems work
• Strong Python and Go — both are core to this role, not one primary and one secondary
• Deep understanding of distributed systems: consistency, fault tolerance, state management, concurrency
• Experience with Kubernetes and cloud-native infrastructure
• Experience building developer-facing tooling — CLIs, SDKs, local dev environments, or internal platforms
• Strong communicator who can drive technical decisions, write clear design docs, and mentor others
• High bar for code quality — thorough testing, thoughtful code review, and sustainable engineering practices
• Comfort operating what you build — on-call, incident response, and production ownership
• AI-native workflow — you actively use LLMs and AI-assisted tools in your daily development, and can leverage them to move faster and tackle problems that would otherwise be impractical
• Experience with real-time voice or streaming media systems
• Hands-on with LLM integration — streaming inference, prompt orchestration, retrieval-augmented generation
• Experience building serverless or function-as-a-service platforms
• Workflow engines (Temporal, Argo, Airflow) for durable, long-running processes
• Experience in conversational AI or speech domains
• Infrastructure-as-code and GitOps workflows
Benefits
• We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
• Paid parental leave to support you and your family
• Monthly Health & Wellness allowance
• Work from home office stipend to help you succeed in a remote environment
• Lunch reimbursement for in-office employees
• PTO: 3 weeks in Canada
Company Overview
• Cresta uses artificial intelligence to assist sales and service agents in the quality of customer service. It was founded in 2017, and is headquartered in Palo Alto, California, USA, with a workforce of 201-500 employees. Its website is https://www.cresta.com.
Company H1B Sponsorship
• Cresta has a track record of offering H1B sponsorships, with 9 in 2025, 6 in 2024, 2 in 2023, 10 in 2022, 4 in 2021, 3 in 2020. Please note that this does not guarantee sponsorship for this specific role.
Apply tot his job
Apply To this Job
Responsibilities
• Build real-time AI agent infrastructure: Design and operate the stateful, low-latency runtime that powers voice and chat AI agents — from LLM streaming and conversation state management to graceful recovery and multi-channel support
• Solve distributed systems problems: Own session management across scaled-out workers — including affinity, checkpointing, crash recovery, and consistency under concurrent access
• Build a function execution platform: Own a serverless-style runtime where customers deploy custom logic — build orchestration, container lifecycle, autoscaling, and versioned rollouts
• Own developer experience and test infrastructure: Build CLI tools, local development environments, and test execution frameworks that let engineers iterate quickly and ship with confidence
• Raise the bar on production quality: Drive observability, incident response, and engineering best practices across the team
Skills
• 5+ years of software engineering experience, with meaningful time spent on infrastructure, platform, or systems work
• Strong Python and Go — both are core to this role, not one primary and one secondary
• Deep understanding of distributed systems: consistency, fault tolerance, state management, concurrency
• Experience with Kubernetes and cloud-native infrastructure
• Experience building developer-facing tooling — CLIs, SDKs, local dev environments, or internal platforms
• Strong communicator who can drive technical decisions, write clear design docs, and mentor others
• High bar for code quality — thorough testing, thoughtful code review, and sustainable engineering practices
• Comfort operating what you build — on-call, incident response, and production ownership
• AI-native workflow — you actively use LLMs and AI-assisted tools in your daily development, and can leverage them to move faster and tackle problems that would otherwise be impractical
• Experience with real-time voice or streaming media systems
• Hands-on with LLM integration — streaming inference, prompt orchestration, retrieval-augmented generation
• Experience building serverless or function-as-a-service platforms
• Workflow engines (Temporal, Argo, Airflow) for durable, long-running processes
• Experience in conversational AI or speech domains
• Infrastructure-as-code and GitOps workflows
Benefits
• We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
• Paid parental leave to support you and your family
• Monthly Health & Wellness allowance
• Work from home office stipend to help you succeed in a remote environment
• Lunch reimbursement for in-office employees
• PTO: 3 weeks in Canada
Company Overview
• Cresta uses artificial intelligence to assist sales and service agents in the quality of customer service. It was founded in 2017, and is headquartered in Palo Alto, California, USA, with a workforce of 201-500 employees. Its website is https://www.cresta.com.
Company H1B Sponsorship
• Cresta has a track record of offering H1B sponsorships, with 9 in 2025, 6 in 2024, 2 in 2023, 10 in 2022, 4 in 2021, 3 in 2020. Please note that this does not guarantee sponsorship for this specific role.
Apply tot his job
Apply To this Job