Applied AI Engineer, Sarvam Agents
Sarvam AI
Software Engineering, Data Science
Bengaluru, Karnataka, India
Location
Bengaluru
Employment Type
Full time
Location Type
On-site
Department
Engineering
About Sarvam
Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.
About the Role
Sarvam Agents bring AI into the way teams actually work. They plug into the tools and workflows of an organization (email, docs, calendars, internal systems, the long tail of SaaS), take multi-step action on a user's behalf, run on a schedule when no one is watching, and get better as the team uses them. Shared across the org, scoped by the right permissions, observable by admins. This is what agents look like when they have to actually work.
We're hiring an Applied AI Engineer to build these agents and own them in production. You'll design the flows, wire up the tools, ship the harness, and be on the hook when something breaks.
What You’ll Do
Build agents end-to-end: flow design, prompting, tool definitions, memory, evaluation, deployment
Own agent reliability in production: debugging real failures, designing guardrails, running incident response when things break
The agent runtime: state management, retries, scheduled triggers, long-running execution that keeps moving when no one is watching
Connector and integration framework: OAuth, third-party SaaS APIs, the plumbing that lets agents reach into real workplaces
MCP server infrastructure at scale: the tool layer agents reach for
Memory and context engineering: knowing when to use working memory vs. long-term memory vs. retrieval, and building the systems that make it work (Honcho and friends)
Multi-tenancy and sharing: agents that live inside organizations, with the right permissions, audit trails, and admin surfaces
Evals: the test infrastructure that tells us whether a change made the agent better or worse, before it touches a user
Tool design discipline: schemas, error messages, idempotency, retry semantics. Tools your agents actually use well.
Streaming, cost, and latency engineering for live agent traffic
Observability and integration testing for agent runs
Prompt iteration workflows: versioning, A/B testing, safe rollback
What We’re Looking For
3 to 5 years of total experience, with 2+ years of strong backend development experience in Python
LLM API fluency: prompt design, structured outputs, function calling, working with major model APIs at production quality
Agentic framework experience: LangGraph, ADK, or equivalent
Production experience running MCP servers at scale
Shipped AI features to real users in production, not just notebooks or prototypes
RAG patterns: chunking, embeddings, hybrid search, reranking, vector databases
Building and running evals for AI systems
Cost and latency optimization for LLM workloads
Observability fluency: Signoz, Datadog, or any equivalent stack
Experience integrating with third-party SaaS APIs and OAuth flows
PostgreSQL or MySQl, Redis
Bonus Points
Open-source contributions in the agent / LLM / harness ecosystem
Familiarity with eval frameworks (LangSmith, Braintrust, and similar)
Experience with human-in-the-loop / approval flow design for AI systems
Time at an early- or growth-stage startup: comfort with ambiguity, speed, and ownership
Why Sarvam?
Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.
Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
High ownership and high impact, from day one
Everything we do is AI-first, from the way we build and ship to the way we think about problems
You can work on problems that could change how an entire country learns, works, and communicates
If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.