AI Auditing Engineer (Temporary) - Penn Center for Media, Technology, and Democracy - Penn Engineering
The University of Pennsylvania is a world-renowned leader in education, research, and innovation. They are seeking a part-time AI Auditing Engineer to develop and productionize auditing and monitoring of large language models, creating tools for longitudinal monitoring of LLMs. Responsibilities Develop and deploy an interoperable set of tools that is generally useful for longitudinal monitoring of LLMs Design and manage appropriate databases for LLM monitoring Advance research methods for LLM monitoring of political topics Skills Bachelor's degree in a relevant field of study Required proficiency in developing efficient and scalable data pipelines in Python Required proficiency in designing and managing NoSQL databases Required proficiency in working with cloud computing platforms Preferred understanding or prior experience working with LLM APIs Preferred understanding or experience with natural language processing methods for LLM evaluation Preferred understanding or experience with cloud cost engineering and other aspects of DevOps, especially cost efficient use of LLMs Preferred experience with data visualization in interactive dashboards Interest in the political outputs and impacts of large language models (LLMs) is a bonus Benefits Health and Life: Penn offers comprehensive medical, prescription, behavioral health, dental, vision, and life insurance benefits to protect you and your family’s health and welfare. Retirement: Penn offers generous retirement plans to help you save for your future. Penn’s Basic, Matching, and Supplemental retirement plans allow you to save for retirement on a pre-tax or Roth basis. Choose from a wide variety of investment options through TIAA and Vanguard. Company Overview The University of Pennsylvania is an American private Ivy League Research University that excels in producing future leaders. It was founded in 1740, and is headquartered in Philadelphia, Pennsylvania, USA, with a workforce of 10001+ employees. Its website is Company H1B Sponsorship University of Pennsylvania has a track record of offering H1B sponsorships, with 7 in 2025, 3 in 2024, 2 in 2023, 3 in 2022, 5 in 2021, 6 in 2020. Please note that this does not guarantee sponsorship for this specific role.