Product Manager On-Device & Edge AI
Sarvam AI
Software Engineering, Product, Data Science
Bengaluru, Karnataka, India
Location
Bengaluru
Employment Type
Full time
Location Type
On-site
Department
Product
About Sarvam
Sarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.
About the Role
Sarvam is our on-device AI product line — purpose-built for enterprise deployments where data sovereignty, low latency, and offline reliability are non-negotiable. We're looking for a Product Manager who understands enterprise AI deeply: the IT admin personas, the procurement cycles, the compliance requirements, and the day-to-day friction that determines whether an AI tool gets embedded into workflows or quietly abandoned.
You'll own the product roadmap for drive B2B GTM alignment, and run iterative experiments to build stickiness in enterprise workflows. You'll work closely with engineering, sales, and customer success to define what enterprise-grade AI looks like when it runs on-device, at the edge, and inside a customer's own security perimeter.
You will co-own as a Full Stack product builder the most ambitious on-device AI problem in India building sovereign models that run at the silicon level across devices. You will be embedded with silicon partners like Qualcomm, Intel, HP, Apple, NVIDIA etc turning research breakthroughs into production-grade optimisations that serve 1.5b indians at min latency. You will architect the Product motion from tuning to agentic orchestration and client deployment, this is not a feature team, it is a platform-defining role. If you want to build the infrastructure layer that makes AI truly accessible across every laptop, phone, glasses and car in India, please apply!
What You'll Do
• Own the product roadmap for Sarvam, from on-device inference to enterprise deployment and fleet management
• Define and prioritise features for IT admin personas — MDM integration, device provisioning, policy enforcement, and enterprise authentication (including Microsoft ecosystem)
• Drive B2B GTM alignment by working with sales and customer success to translate customer pain points into product requirements
• Run iterative experiments in enterprise deployments to identify and improve workflow stickiness and adoption
• Design and ship features for multi-tenant SaaS architecture, including tenant isolation, access controls, and admin tooling
• Define requirements for HITL (human-in-the-loop) and agentic workflows, ensuring enterprise-grade reliability and auditability
• Work across security and compliance requirements — data residency, enterprise auth (SSO, SAML, SCIM), and regulatory standards relevant to enterprise AI
• Collaborate with engineering on API design and integration patterns for enterprise tooling and partner ecosystems
• Define and track product metrics that measure enterprise engagement, retention, and workflow depth
What We're Looking For
• 4–8 years of product management experience, with significant time in enterprise SaaS or B2B AI products
• Demonstrable experience with on-device or edge AI products, or IT fleet management and enterprise device management
• Strong understanding of enterprise authentication and identity — Microsoft ecosystem (Entra ID, Intune, Azure AD), SSO, SAML, or SCIM
• Experience running structured product experiments and using data to drive roadmap decisions in enterprise contexts
• Ability to work directly with IT admin and enterprise buyer personas — understanding their workflows, constraints, and decision criteria
• Comfort with technical depth: APIs, security and compliance requirements, and multi-tenant SaaS architecture
• Background in Computer Science or Electrical Engineering preferred
Bonus Points
• Experience with HITL workflows or agentic AI product design
• Prior exposure to data residency, sovereign cloud, or on-premise enterprise AI deployments
• Familiarity with MDM/UEM platforms (Jamf, Intune, or equivalent)
• Experience working on AI products in regulated industries (BFSI, healthcare, or government)
• Background that combines technical depth with business or GTM exposure
Why Sarvam?
Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.
• Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
• High ownership and high impact, from day one
• Everything we do is AI-first, from the way we build and ship to the way we think about problems
• You can work on problems that could change how an entire country learns, works, and communicates
If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.