LLMOps Engineer (Large Language models operations Engineer
LLMOps Engineer (Large Language models operations Engineer) Remote Long term Key note from Manager- Candidate should be able to support for LLM models- including incidents management, ongoing model management and maintenance, and user support Candidate should be able to support Gen AI solutions -monitoring and maintenance, including performance monitoring, user interaction monitoring and efficacy monitoring Terrafoam for deployment is must to have Core Skills needed - • Strong experience in developing, deploying, and managing large language models, specifically on Microsoft Azure. • Proven expertise in Azure cloud platforms and services, including Azure Machine Learning, Azure Kubernetes Service, and Azure DevOps. • Strong knowledge of LLMOPS guardrails implementation practices. • Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders. Experience with Python/ Job Duties: • Ops support for LLM models including incidents management, ongoing model management and maintenance, and user support • GenAI solutions monitoring and maintenance, including performance monitoring, user interaction monitoring and efficacy monitoring • Guardrails review and monitoring including bais audits, and other identified guardrail checks based on implemented GenAI solutions • Code management support including proactive code optimization beyond breakfixes LLMs provide context and memory capabilities, while generative AI enables the production of engaging responses Apply tot his job