Platform Engineer - AI Infrastructure

Overview

AI Infrastructure About Sarvam Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures.

What you'll do

• This role builds the platform that sits on top of that fleet
• the scheduling, scaling, multi-tenancy, serving, and self-service layers that let our ML teams use thousands of GPUs without a human in the loop for every job.
• This is the build side of infrastructure, not the operate side.
• Our SREs keep the fleet reliable and carry the pager; you build the systems that make the fleet usable
• and that make it break less in the first place.
• The work is heavy software engineering: you will design and ship control-plane services, scheduler integrations, autoscaling controllers, the inference-serving platform, RBAC and quota systems, observability and cost tooling, and the CLI and APIs ML engineers touch every day.
• You will treat the platform as a product and its internal users as customers.
• You should be a strong systems engineer who is fluent in Kubernetes at the controller and internals level, comfortable in Go or Python, and literate in the GPU-specific constraints

Requirements

• Practical experience with Node, Python, Go, Kubernetes.
• Experience level: 5+ yrs.
• Strong written and verbal communication in English.
• Comfortable working on-site in Bengaluru.

Skills