Data Scientist (AI Agent Security and Observability)
About the Role As a Data Scientist, you will join the AI Models team at Weni by VTEX , a business unit of VTEX. You will be responsible for researching, developing, and improving machine learning models that power our conversational agents and multi-agent systems. You are driven by curiosity and impact, transforming complex data into tangible improvements in user experience and product performance. What you will do Develop guardrail pipelines for generative models. Develop tests related to the safety and ethics of generative models. Research, design, and implement machine learning models to improve the performance of conversational agents and multi-agent systems. Analyze large datasets to extract insights that guide model improvements and product decisions. Work closely with engineers and product managers to bring AI models from prototype to production. Continuously evaluate model performance and iterate based on real-world usage and feedback. Perform exploratory data analysis (EDA) to uncover hidden structures, anomalies, and relationships in data, informing hypothesis generation and experimental design for conversational AI systems. Who you are Familiarity with guardrail concepts in generative models Familiarity with safety/ethics concepts in generative models Strong foundation in Statistics Proficiency in Python Experience using Git for code version control Hands-on practice with scikit-learn, pandas, and other data-related frameworks Knowledge of Deep Learning Experience with cloud services (AWS) for storage, pipelines, and deployment Monitoring of performance, data drift, and data quality in production Critical thinking, curiosity, and proactive problem-solving Clear communication (oral, written, and visual) and collaborative work style Familiarity with GenAI/LLMs (prompt engineering, fine-tuning, hallucination evaluation) Bachelor’s degree in Computer Science, Engineering, Statistics, Mathematics, or related fields About VTEX VTEX (NYSE: VTEX) is the composable and complete commerce platform that delivers more efficiency and less maintenance to organizations seeking to make smarter IT investments and modernize their tech stack. Through our pragmatic composability approach, we empower brands, distributors, and retailers with unparalleled flexibility and comprehensive solutions, enabling them to invest solely in what provides a clear business advantage and boosts profitability. VTEX is trusted by 2,400 global B2C and B2B customers, including Carrefour, Colgate, Motorola, Sony, Stanley Black & Decker, and Whirlpool, having 3,400 active online stores across 43 countries (as of FY ended on December 31, 2024). Founded in the year 2000, VTEX has a history of being unstoppable. Completely against the odds, VTEX is leading a high-tech industry and positioned above market giants. We are building an extraordinary future with more than 1,300 employees scattered across 25 locations in 16 countries in Latin America, North America, Europe, and Asia. For more information, visit www.vtex.com. At VTEX, you will work in a challenge-driven environment and collaborate with amazing peers. If you are powerful individually, join us, and we will be unstoppable together. About Weni by VTEX Weni by VTEX is a business unit of VTEX dedicated to enterprise customer experience solutions powered by artificial intelligence, designed for brands and retailers. With the Weni Platform, we redefine sales and post-sales journeys through hyperautomation and the smart integration of data into conversational channels, delivering faster, more personalized, and more efficient experiences for consumers. Benefits Health, dental, and life insurance with national coverage provided by VTEX; Language development incentive program (English, Spanish, Portuguese); Flexible meal allowance; Extended parental leaves; Flexible work schedule and remote-first culture; Financial assistance to build your work-from-home setup; Wellness program;