[Remote] Senior AI Infrastructure Engineer - DGX Cloud
Note: The job is a remote job and is open to candidates in USA. NVIDIA is looking for an outstanding, passionate, and talented Senior AI Infrastructure Engineer to join their DGX Cloud group. This role involves designing, building, and maintaining large scale production systems for AI training and inferencing, ensuring maximum reliability and uptime of GPU cloud services.
Responsibilities
• Design, build, deploy, and run internal tooling for large scale AI training and Inferencing platform built on top of cloud infrastructure
• Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters
• Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement
• Support services before they go live through activities such as system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews
• Maintain services once they are live by measuring and monitoring availability, latency and overall system health
• Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity
• Practice sustainable incident response and blameless postmortems
• Be part of an on call rotation to support production systems
Skills
• BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience
• 6+ years of experience
• A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others
• Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud systems in production
• Experience in one or more of the following: Python, Go, C/C++, Java
• In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
• Experience with Public Cloud and Infrastructure as a code (IAAC) and Terraform
• Distributed system experience
• Interest in crafting, analyzing and fixing large-scale distributed systems
• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive
• Ability to debug and optimize code and automate routine tasks
• Experience in using or running large private and public cloud systems based on Kubernetes or Slurm
Benefits
• Equity
• Benefits
Company Overview
• NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI. It was founded in 1993, and is headquartered in Santa Clara, California, USA, with a workforce of 10001+ employees. Its website is https://www.nvidia.com.
Company H1B Sponsorship
• NVIDIA has a track record of offering H1B sponsorships, with 1877 in 2025, 1355 in 2024, 976 in 2023, 835 in 2022, 601 in 2021, 529 in 2020. Please note that this does not guarantee sponsorship for this specific role.
Apply Now
Apply Now
Responsibilities
• Design, build, deploy, and run internal tooling for large scale AI training and Inferencing platform built on top of cloud infrastructure
• Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters
• Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement
• Support services before they go live through activities such as system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews
• Maintain services once they are live by measuring and monitoring availability, latency and overall system health
• Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity
• Practice sustainable incident response and blameless postmortems
• Be part of an on call rotation to support production systems
Skills
• BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience
• 6+ years of experience
• A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others
• Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud systems in production
• Experience in one or more of the following: Python, Go, C/C++, Java
• In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
• Experience with Public Cloud and Infrastructure as a code (IAAC) and Terraform
• Distributed system experience
• Interest in crafting, analyzing and fixing large-scale distributed systems
• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive
• Ability to debug and optimize code and automate routine tasks
• Experience in using or running large private and public cloud systems based on Kubernetes or Slurm
Benefits
• Equity
• Benefits
Company Overview
• NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI. It was founded in 1993, and is headquartered in Santa Clara, California, USA, with a workforce of 10001+ employees. Its website is https://www.nvidia.com.
Company H1B Sponsorship
• NVIDIA has a track record of offering H1B sponsorships, with 1877 in 2025, 1355 in 2024, 976 in 2023, 835 in 2022, 601 in 2021, 529 in 2020. Please note that this does not guarantee sponsorship for this specific role.
Apply Now
Apply Now