Join Iris Software, recognized as one of India's Top 25 Best Workplaces in the IT industry. We are a rapidly growing IT services company committed to helping our clients thrive through technology-enabled transformation. Our vision is to be the most trusted technology partner and the preferred employer for top industry professionals.

We specialize in complex, mission-critical applications utilizing the latest technologies across Data & Analytics, Cloud, DevOps, and more. At Iris, your role is a launchpad for growth, driven by our "Build Your Future. Own Your Journey." employee value proposition, fostering a culture where your potential is valued, your voice matters, and your work creates real impact.

As a Senior ETL Data Engineer, you will architect and implement scalable data engineering solutions using PySpark and modern distributed data processing frameworks. You will define data ingestion, transformation, and processing architectures aligned with business objectives.

Key responsibilities include designing and optimizing Snowflake or Delta Lake on Databricks solutions, leading the implementation of high-performance batch and streaming data pipelines, and defining data streaming standards. You will architect workflow orchestration using Apache Airflow or Databricks Workflows and establish monitoring and operational controls for reliable pipeline execution.

You will drive data quality, validation, and governance practices, design solutions following Lakehouse architecture principles, and promote the responsible use of AI-assisted engineering capabilities. Reviewing data pipeline designs, troubleshooting complex issues, and collaborating with stakeholders are also crucial aspects of this role.

We are seeking individuals with strong proficiency in PySpark, Databricks Workflows, Delta Lake on Databricks, and Amazon Kinesis. Essential competencies include Big Data (PySpark, Apache Spark), Data Science and Machine Learning (Python), Database Programming (SQL), and Cloud technologies (AWS services like SNS, SQS, Kinesis, CloudWatch, S3, IAM, Secrets Manager, KMS, API Gateway, Glue, EMR, Redshift, DynamoDB, Aurora, RDS, EC2).

Experience with ETL/Data Integration, API middleware (SOAP, REST), and Unix/Linux Shell scripting is required. Behavioral competencies such as strong ownership, effective collaboration, quality-focused engineering, analytical thinking, adaptability, and clear communication are essential for success in this role. A strong attention to detail and a commitment to continuous improvement are also valued.