Intern: Reinforcement/Imitation Learning

Your New Role and TeamSanctuary, a world leader in building AI-based control systems for humanoid robots, is looking to hire a skilled and motivated intern to join our Machine Learning Research team. Reporting to the AI Team Lead, you will have the opportunity to tackle a variety of challenges related to the perception, planning, and motion systems for humanoid general-purpose robots.The best candidates for this role have excellent software development and machine learning skills as well as hands-on experience with robotics. In this role you’ll be a valued contributor and you’ll gain a comprehensive understanding of the design, architecture, and implementation of the simulation platform and machine learning systems that power our general-purpose robots. Our Success Criteria Design, implement, and improve state-of-the-art Reinforcement Learning (RL) and Imitation Learning (IL) algorithms and test them in real-world settingsKeep up to date with state-of-the-art RL/IL methodologies and roboticsIdentify, communicate, and drive promising research directions to the teamFind ways of improving existing implementations of RL/IL pipelines with regards to standard metrics such as sample efficiency, speed, computational resource usage, and scalabilityDesign RL/IL training and data-collection pipelines to facilitate fast deployment on physical robotsWork with a multidisciplinary team to develop novel algorithms and investigate sources of errors with existing implementationsYour ExperienceDesired Qualifications Pursuing MS or Ph.D. in Machine Learning, Computer Science, Applied Math, or related fieldExperience implementing a variety of RL and IL methods with a focus in a specialization such as computer vision or roboticsHands-on experience integrating ML models onto a robotics platformExperience implementing and deploying (dexterous) robotic manipulation tasks in simulation and on physical robotsExperience taking ML R&D and trained models into productionExperience with computer vision systemsExperience in simulation-to-reality transfer learningSkillsDevelopment with Python 3.6 or laterWorking knowledge of PyTorch and/or JAXFamiliarity with ROS2Extensive knowledge of RL/IL principles and useExperience with Atlassian tools; Jira, Confluence, or equivalent e.g. GitLabTraitsAbove all else, a consistently positive attitude and a willingness to do whatever it takes to create robust solutions to complex problemsOptimistic listening and conflict resolution capabilitiesDemonstrated ability to influence others without authorityEager to take on new challenges with tenacity and positivityPatience, persistence, and attention to detail when resolving performance issuesObsession with bringing human-like intelligence to machines Additional Information Working at Sanctuary AISanctuary AI is an equal opportunity employer; employment with Sanctuary AI is governed based on skills, competence, and qualifications and will not be influenced in any way by race, color, religion, gender, national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability, or any other legally protected status. In 2023, Sanctuary AI moved into a state-of-the-art office facility and has been recognized by LinkedIn as a Top Startup company.Compensation and BenefitsSanctuary offers a market-leading compensation package that includes competitive salaries, equity stakes, and a full suite of benefits for permanent employees, encompassing health coverage, paid time off, cutting-edge work facilities, and worksite flexibility by role. Our commitment to fairness ensures that our total compensation consistently surpasses market standards.About Sanctuary AIFounded in 2018, Sanctuary builds humanoid robots and a novel control system for them that integrates symbolic logic and reasoning with data-driven robot foundation models. We use our robots to collect vision, audio, touch, and proprioception data from the perspective of the robot while they perform real-world work tasks. We use that data to train multimodal robot foundation models. Because our systems are vertically integrated, we can design, deploy, and refine at scale. Our mission is to create the world's first human-like intelligence in general-purpose robots.Recruiting and Employment Agency Notice:Recruitment and hiring is conducted internally by Sanctuary AI. We are not seeking or soliciting any new agency partnerships or agreements at this time.Any employment agency or professional recruiter (“Agency”) that provides an unsolicited resume(s) or otherwise presents a prospective job candidate through the Sanctuary AI career site or directly to any Sanctuary AI employee, irrevocably grants to Sanctuary AI the unrestricted right to engage, hire, or contract with that candidate at Sanctuary AI's sole discretion without any compensation to the Agency. We appreciate your interest in working together, and should the need arise our Talent Acquisition team will contact any external firms directly.

Apply Now