Join Iris Software, recognized as one of India's Top 25 Best Workplaces in the IT industry. We are a rapidly growing IT services company committed to empowering our clients and fostering the professional growth of our associates.

Our vision is to be the most trusted technology partner for our enterprise clients, offering transformative solutions across financial services, healthcare, transportation & logistics, and professional services. We specialize in complex, mission-critical applications utilizing cutting-edge technologies like Data & Analytics, Cloud, DevOps, and more.

As a Senior Big Data Engineer, you will be instrumental in designing and implementing scalable Big Data solutions.

Key responsibilities include: - Architecting robust data processing pipelines using Apache Spark, Hadoop, and Azure Databricks. - Defining transformation strategies and engineering standards. - Developing and optimizing SQL and Hive-based data processing solutions. - Designing and implementing data Lakehouse solutions with Apache Hudi or Iceberg. - Establishing frameworks for data ingestion, transformation, validation, and reconciliation. - Driving performance tuning initiatives across various Big Data components. - Mentoring team members on best practices and collaborating with stakeholders for seamless end-to-end data platform delivery.

We are seeking experienced engineers with 6-7 years of hands-on experience in Big Data technologies.

Mandatory skills include proficiency in: - Data Ingestion Tools (Sqoop) - Hadoop Ecosystem Fundamentals (HDFS, YARN, HBase, Impala) - Azure Databricks - Hive - Scala - Apache Hudi

Experience with PySpark is an added advantage. A strong understanding of distributed data processing and a commitment to engineering excellence, quality, and continuous improvement are essential. Successful candidates will demonstrate strong analytical thinking, adaptability, and effective communication skills.