Join Iris Software, a rapidly growing IT services company and one of India's Top 25 Best Workplaces in the IT industry. We are seeking a Senior Data Engineer to contribute to our mission of being a trusted technology partner. With a strong presence in India, the U.S.A., and Canada, we empower enterprise clients across financial services, healthcare, transportation & logistics, and professional services with cutting-edge solutions in Data & Analytics, Cloud, DevOps, and more. This is an opportunity to own and shape your career in an award-winning, growth-oriented culture.

Design and implement scalable data engineering solutions leveraging PySpark and modern distributed data processing frameworks. Architect high-performance batch and streaming data pipelines, and design event-driven architectures using Apache Kafka or Amazon Kinesis. Optimize Snowflake or Delta Lake on Databricks solutions for enterprise-scale data platforms. Define data streaming standards, establish monitoring and operational controls, and drive data quality, validation, and governance practices. Architect workflow orchestration solutions using Apache Airflow or Databricks Workflows, promoting responsible AI-assisted engineering and adhering to Lakehouse architecture principles.

We are looking for a Senior Data Engineer with 5-8 years of experience, proficient in Python, PySpark, Databricks Workflows, Delta Lake on Databricks, and Apache Kafka. Experience with AWS CloudShell and Azure Databricks is beneficial. Key responsibilities include designing scalable data solutions, defining data ingestion and transformation architectures, and optimizing data platforms. The role also involves leading implementation of data pipelines, designing event-driven architectures, and establishing monitoring and governance practices. Troubleshooting complex data issues, mentoring team members, and collaborating with stakeholders are integral parts of this position.