Overview NVIDIA has been redefining computer graphics, PC gaming, and accelerated computing for more than 25 years. Today, we lead in artificial intelligence, driving advances in natural language processing, computer vision, autonomous systems, and scientific research. We are looking for a forward-thinking HPC and AI Inference Software Architect to help shape the future of scalable AI infrastructure—focusing on distributed training, real-time inference, and communication optimization across large-scale systems. Join our world-class team of researchers and engineers building next-generation software and hardware systems that power the most demanding AI workloads on the planet.
What You Will Be Doing
Design and prototype scalable software systems that optimize distributed AI training and inference—focusing on throughput, latency, and memory efficiency.
Develop and evaluate enhancements to communication libraries such as NCCL, UCX, and UCC, tailored to the unique demands of deep learning workloads.
Collaborate with AI framework teams (e.g., TensorFlow, PyTorch, JAX) to improve integration, performance, and reliability of communication backends.
Co-design hardware features (e.g., in GPUs, DPUs, or interconnects) that accelerate data movement and enable new capabilities for inference and model serving.
Contribute to the evolution of runtime systems, communication libraries, and AI-specific protocol layers.
What We Need To See
Ph.D. or equivalent industry experience in computer science, computer engineering, or a closely related field.
2+ years of experience in systems programming, parallel or distributed computing, or high-performance data movement.
Strong programming background in C++, Python, and ideally CUDA or other GPU programming models.
Practical experience with AI frameworks (e.g., PyTorch, TensorFlow) and familiarity with how they use communication libraries under the hood.
Experience in designing or optimizing software for high-throughput, low-latency systems.
Strong collaboration skills in a multi-national, interdisciplinary environment.
Ways To Stand Out From The Crowd
Expertise with NCCL, Gloo, UCX, or similar libraries used in distributed AI workloads.
Background in networking and communication protocols, RDMA, collective communications, or accelerator-aware networking.
Deep understanding of large model training, inference serving at scale, and associated communication bottlenecks.
Knowledge of quantization, tensor/activation fusion, or memory optimization for inference.
Familiarity with infrastructure for deployment of LLMs or transformer-based models, including sharding, pipelining, or hybrid parallelism.
At NVIDIA, you’ll work alongside some of the brightest minds in the industry, pushing the boundaries of what’s possible in AI and high-performance computing. If you're passionate about distributed systems, AI inference, and solving problems at scale, we want to hear from you.
NVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High-Performance Computing, and Visualization. Our teams are composed of driven, innovative professionals dedicated to pushing the boundaries of technology. We offer highly competitive salaries, an extensive benefits package, and a work environment that promotes diversity, inclusion, and flexibility. As an equal opportunity employer, we are committed to fostering a supportive and empowering workplace for all.
JR1997486
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing
Referrals increase your chances of interviewing at NVIDIA by 2x
Get notified about new Software Architect jobs in Switzerland .
Other similar roles
AI Solutions Architect (Remote – Switzerland based)
Principal Solutions Architect - Healthcare & Life Science - Europe
Senior R&D Engineer - System Architecture (Italy based)
Software & Systems Architect – Industrial Automation
Software Engineer Java (80%-100%) - Bern
Software Engineer Java (80%-100%) - St Gallen
Senior Software Architect - Deep Learning and HPC Communications
Distinguished Software Architect - Deep Learning and HPC Communications
Senior Software Engineer, AI Model serving - Geneva, Switzerland
.NET Software Engineer (80%-100%) - Basel
.NET Software Engineer (80%-100%) - Bern
WPF Software Engineer (80%-100%) - Frauenfeld
Software Engineer, iOS Core Product - Europe
Senior Software Engineer, AI Model serving (Europe)
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr