Staff Data Engineer
Sarvam AI
Sarvam AI
Sarvam is pioneering Sovereign AI for India, developing a comprehensive AI platform that spans research, models, infrastructure, and applications. Our singular mission is to make AI impactful and accessible for India. We collaborate with leading enterprises and public institutions, supported by esteemed investors like Lightspeed, Peak XV, and Khosla Ventures. We are proud partners with prominent Indian brands such as Tata Capital, SBI Life, CRED, IDFC, and LIC.
This Staff Engineer role involves architecting and constructing Sarvam's Data & Analytics Platform from its inception. It's a position demanding significant ownership and impact, where you will lead the technical vision for a critical system used by all Sarvam products and customers.
The platform's core functions include ingesting events through a robust API with schema evolution, replicating product databases via CDC for analytics, and exposing data via a tenant-aware query API and a no-code dashboarding layer. You'll be responsible for the architecture, hands-on development of core systems, setting engineering standards, and shaping the future team dedicated to this platform. All data interactions will be managed through APIs you design, ensuring data integrity and security.
We are seeking an experienced engineer with 5+ years in backend or data-platform engineering, including substantial experience in designing and operating production analytics systems. A proven history of building foundational platforms from scratch that are depended upon by other engineering teams is essential.
Key technical requirements include deep expertise in ClickHouse at scale (sharding, replication, operational knowledge), proficiency in Golang for high-throughput services (concurrency, performance, API design), and extensive experience with Kafka as a streaming backbone (partitioning, consumer groups, exactly-once processing). Experience with Debezium-based CDC pipelines is also crucial. Strong systems thinking, focusing on throughput, latency, cost, and failure modes, is fundamental.
Valuable additions include experience with Spark and Airflow for batch processing, building multi-tenant SaaS platforms with robust security, and integrating with or building BI/dashboarding tools. Familiarity with billing or metering data feeds where accuracy is paramount is also a plus. This role is based on-site in Bengaluru.
Sarvam AI
AI / Machine Learning