Iceberg, Doris, Trino
Infosys
Infosys
Lead a pivotal role in shaping our data platform's future, focusing on scalable analytics storage and querying. You will architect and evolve a modern lakehouse ecosystem leveraging Iceberg, Doris, and Trino to deliver rapid, reliable insights across various business needs. Collaborate with data engineering, analytics, and infrastructure teams to drive technical direction, implement best practices, and guide engineers in building robust production solutions. This opportunity is perfect for those passionate about tackling complex performance and reliability issues, constructing scalable architectures, and transforming data into a valuable business asset. If you thrive on modern table formats, distributed query engines, and collaborative engineering, seize this chance to lead and make a significant impact.
Key responsibilities include:
- Architecting and implementing lakehouse solutions with Iceberg for robust table management, governance, and scalable storage. - Designing and optimizing distributed query workloads using Trino, including intricate catalog configuration, connector strategies, and query performance tuning. - Building and operating high-performance analytics serving layers with Doris, emphasizing efficient ingestion patterns, schema design, and workload isolation. - Driving end-to-end data pipeline execution via Spark for batch processing, data transformations, and quality enforcement. - Establishing comprehensive standards for data modeling, partitioning, compaction, file sizing, and lifecycle management to enhance cost-efficiency and performance. - Owning production readiness, encompassing monitoring, alerting, incident response, root-cause analysis, and continuous stack performance improvements. - Collaborating with stakeholders to translate analytical requirements into scalable technical designs, delivery plans, and measurable outcomes. - Mentoring engineers, conducting design and code reviews, and promoting best practices for reliability, maintainability, and secure data access.
Minimum qualifications:
- Educational background in Computer Science, Engineering, or a related discipline, holding a B.Tech, M.Tech, MCA, or MSc. - 8 to 12 years of experience in data engineering, data platform, or analytics infrastructure roles, with demonstrated leadership or ownership experience. - Profound hands-on expertise with Iceberg, Doris, and Trino in production settings, including performance tuning and operational support. - Strong experience utilizing Spark for scalable data processing and developing data pipelines. - Solid understanding of distributed systems, data storage formats, query optimization techniques, and effective production troubleshooting practices.
Infosys
IT Consulting