Senior Software Engineer, AI - UpDoc

About UpDocAt UpDoc, we are building the world's first clinically validated, physician-supervised conversational agent that manages chronic diseases; the first step towards a true "AI doctor". With partners including Stanford, Mayo Clinic, Eli Lilly, UCSF Health, and Microsoft, UpDoc is working to build a future where all patients can access high-quality, high-touch care. Learn more about us here.We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.Who You AreYou’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.What You'll DoLead the development of our patient-facing conversational agentImplement a scalable, low-latency system for voice/multimodal conversationsImplement rigorous prompt engineering processes and develop useful metrics for system evaluationIdentify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentationWork with other backend engineers to deploy AI models and chat/voice APIsHelp identify, evaluate, and implement emerging LLM technologies, tools and frameworksCollaborate with clinical experts to validate performance and medical accuracyWork on developing backend services using FastAPI and PydanticWhat You’ll Need5+ years of professional software development experience, including 2+ years of experience with backend web developmentExperienced and comfortable working with type-hinted, modern Python2+ years of experience building end-to-end LLM applications, personally or professionallyExperience integrating/optimizing LLMs in production environmentsKnowledge of evaluation frameworksKnowledge and experience with MLOps/LLMOps best practicesExperience building AI infrastructure from 0 -> 1Experience with cloud platforms (especially Azure) and containerization technologiesHighly DesiredProfessional experience building end-to-end LLM-powered applicationsExperience with model fine-tuning/alignmentExperience in an early stage startup environmentExperience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2Why You Should Join UsJoin a small, high-impact team building the future of healthcareWork with cutting-edge LLM tools that support world-class medical institutionsShape core technical architecture in an emerging fieldCompetitive compensation and equity in an early-stage startupInterview ProcessApplication formConversation with our CTOTechnical interviews: Coding interview focused on a real-world application relevant to the role (e.g., LLMs, backend engineering) Architecture/whiteboarding interview focused on discussing general application-design relevant to the roleConversation with our CEO

Apply Now