Join a dynamic team at Iris Software, recognized as one of India's Top 25 Best Workplaces in the IT industry. We are a rapidly growing IT services company committed to being a trusted technology partner and a platform for professionals to realize their full potential. With a global presence, we empower enterprise clients across various sectors through cutting-edge technology solutions, including advanced application engineering, data analytics, cloud, and DevOps.

Design and implement scalable data engineering solutions using PySpark and distributed processing frameworks. Develop robust data ingestion, transformation, and processing architectures. Optimize Snowflake or Delta Lake on Databricks for enterprise-scale data platforms. Lead the creation of high-performance batch and streaming data pipelines using Apache Kafka or Amazon Kinesis. Architect workflow orchestration using Apache Airflow or Databricks Workflows. Ensure data quality, governance, and adherence to Lakehouse architecture principles. Drive the development of business-focused data products, enhancing data discoverability and usability. Promote AI-assisted engineering to boost development productivity and quality. Review pipeline designs for scalability and performance, and troubleshoot complex data processing issues.

We are seeking a Senior Engineer with mandatory skills in PySpark, Apache Kafka, Databricks Workflows, and Delta Lake on Databricks. Proficiency in Snowflake, Amazon Kinesis, and Apache Airflow is also required. Candidates should demonstrate strong ownership, effective collaboration with stakeholders, and a commitment to quality-focused engineering. Excellent analytical thinking is essential for evaluating complex data engineering challenges. Mentorship of team members on best practices is a key aspect of this role.