Advance your career at Iris Software, recognized as one of India's Top 25 Best Workplaces in the IT industry. Join an award-winning culture that values your ambition and talent. As a fast-growing IT services company, Iris empowers you to shape your success.

Our vision is to be the most trusted technology partner for our clients and the preferred employer for top industry professionals. With a global team across India, the U.S.A., and Canada, we drive technology-enabled transformations in financial services, healthcare, transportation, and professional services. We specialize in complex, mission-critical applications utilizing cutting-edge technologies in application engineering, data & analytics, cloud, DevOps, and automation.

As a Senior Data Engineer, you will architect and implement scalable data engineering solutions. Responsibilities include designing data ingestion, transformation, and processing frameworks, optimizing solutions on Databricks or Snowflake, and leading the development of high-performance batch and streaming data pipelines.

You will also design and optimize event-driven architectures using Apache Kafka or Amazon Kinesis, establish standards for data streaming, and architect workflow orchestration using Apache Airflow or Databricks Workflows. Ensuring reliable pipeline execution through robust monitoring and scheduling is key. You will drive data quality, governance, and promote the adoption of AI-assisted engineering for enhanced productivity and quality.

This role requires expertise in PySpark, Apache Kafka, Databricks Workflows, and Delta Lake on Databricks. Experience with Snowflake, Amazon Kinesis, and Apache Airflow is also essential.

Key requirements involve designing scalable data processing solutions, defining ingestion and transformation architectures, and optimizing enterprise-scale data platforms. You will lead the implementation of data pipelines, architect event-driven systems, and establish standards for data streaming. Strong skills in troubleshooting complex data issues and mentoring team members on best practices are expected.