[Remote] AI/ML QA Engineer (RAG & Evaluation focus)
Note: The job is a remote job and is open to candidates in USA. Activesoft, Inc. is a company seeking an AI/ML QA Engineer focused on RAG and evaluation. The role involves ensuring quality assurance in AI/ML systems, utilizing evaluation tools, and collaborating with cross-functional teams. Skills • 3-5 years of professional experience in software QA, AI/ML evaluation, or intelligent system testing. • Proficiency in Python and scripting for automation and data analysis. • Hands-on experience with AI evaluation tools (e.g., Ragas, LangChain evaluation tools, Weights & Biases, PromptLayer, etc.). • Solid understanding of retrieval-augmented generation (RAG) systems, vector databases, and embedding evaluation. • Experience with modern MLOps tools, CI/CD systems, and version control (GitHub, Jenkins, etc.). • Strong analytical and problem-solving skills, with a data-driven approach to quality assurance. • Excellent communication skills and ability to collaborate cross-functionally with AI engineers, data scientists, and product managers. • Experience in user feedback loop integration and reinforcement learning from human feedback (RLHF). • Familiarity with retrieval pipelines, document ranking, and semantic search systems. • Exposure to real estate or SaaS platforms is a plus. Company Overview • Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want. It was founded in undefined, and is headquartered in , with a workforce of 0-1 employees. Its website is Apply tot his job