Research Scientist (L6) - LLM-Driven Product Understanding

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. The Member Capabilities and Research team is looking for an experienced Research Scientist to research, develop, and iterate on LLM-as-a-Judge prototypes and offline LLM evaluation systems to improve Netflix's understanding of our members. The team aims to develop and improve decision-making capabilities across the company by undertaking intersectional research, building scalable data products, and providing frameworks and guidance that improve how we think about and interact with our members. This individual will both lead independent research and partner with a variety of technical and non-technical teams to understand member behavior, inspire innovation, and help shape the direction of future product innovation. Responsibilities • Research, develop, and iterate on LLM-as-a-Judge prototypes and offline LLM evaluation systems to improve Netflix's understanding of our members. • Drive your own roadmap, determining what areas are best served by rapid iteration and which ones deserve deeper development. • Create insights and help shape the direction of future member-facing investments by influencing the broader Product team. • Collaborate with Data Scientists, ML Scientists, and Engineers on a variety of projects to ensure we maximize our ability to understand our members. • Stay up to date with research in areas related to LLM advancement, identifying when and where to implement new best practices and methodologies. About You • You have a strong foundation in deep learning and LLMs, with proven hands-on industry experience in improving large generative models and model evaluation. • You have substantial relevant industry experience building scalable ML models, particularly in natural language processing and machine learning, and translating this into business impact. • You hold an advanced degree (PhD) in Computer Science, Electrical Engineering, or a related technical field with a focus on machine learning, artificial intelligence, or computer vision, or equivalent industry experience. • You are flexible with your approach, able to pivot between research goals and implementing end-to-end solutions with ease. • You excel at solving complex problems with innovative solutions, developing novel algorithms, and adapting existing methods from the literature to new challenges. • You are an excellent communicator, capable of explaining complex technical details to both technical and non-technical audiences. • You thrive in fast-paced, dynamic environments with ambiguity, contributing positively to team collaboration and company culture. Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $400,000 - $960,000. Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more detail about our Benefits here. Netflix has a unique culture and environment. Learn more here. Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner. We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service. Job is open for no less than 7 days and will be removed when the position is filled. Apply Job! Apply tot his job