[Remote] Staff Machine Learning Scientist, Oncology Foundation Model

Note: The job is a remote job and is open to candidates in USA. Tempus AI is a company focused on precision medicine and advancing the healthcare industry through AI technology. They are seeking a Staff Machine Learning Scientist to contribute to the design and architecture of large multimodal models (LMMs) and build infrastructure for training at scale. Responsibilities • Design and definition of the architecture of the LMMs, considering different fusion strategies and modality-specific processing. • Implement, refine, benchmark and optimize model architectures using deep learning frameworks such as PyTorch or TensorFlow. • Develop and manage the end-to-end training pipelines, including data loading, preprocessing, and model training. Architect and deploy distributed training workflows, optimizing for performance across cloud GPU fleets. • Implement distributed training strategies to handle large-scale datasets and models. • Design and implement methods to fuse knowledge with the multimodal representations within the LMM. • Experiment with different approaches to enhance the model's understanding and reasoning abilities through knowledge integration. • Monitor and debug training processes, identifying and resolving performance bottlenecks. • Collaborate with the knowledge integration engineer to ensure the architecture can accommodate knowledge injection mechanisms. Skills • Deep understanding of deep learning principles and architectures (especially transformers). • Extensive experience with multimodal machine learning concepts and techniques (for example, different fusion methods for text and images). • Solid understanding of optimization techniques for large-scale models. • Strong proficiency in Python and deep learning frameworks (PyTorch/TensorFlow) and model management libraries like HF Transformers. • Experience with training large multimodal models with distributed training frameworks (for example, Horovod, MosaicML) and GPU fleet management. • Strong understanding of knowledge representation concepts (for example, knowledge graphs, ontologies). • Experience with distributed training frameworks and cloud computing platforms (for example, GCP, Azure). Benefits • Incentive compensation • Restricted stock units • Medical and other benefits depending on the position Company Overview • Tempus is making precision medicine a reality by applying AI in healthcare, deriving insights from our expansive library of clinical data and molecular data. It was founded in 2015, and is headquartered in Chicago, Illinois, USA, with a workforce of 1001-5000 employees. Its website is Company H1B Sponsorship • Tempus AI has a track record of offering H1B sponsorships, with 3 in 2021. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job