Join Iris Software, recognized as one of India's Top 25 Best Workplaces in IT. We are a rapidly expanding IT services company committed to empowering our clients through technology-driven transformations.

Our vision is to be the most trusted technology partner and a preferred destination for top industry professionals. With a global team across India, the U.S.A., and Canada, we specialize in complex, mission-critical applications leveraging cutting-edge technologies in areas like Data & Analytics, Cloud, DevOps, and AI.

At Iris, we believe in fostering a culture where your career growth is paramount. We offer a launchpad for your ambitions, encouraging ownership of your professional journey. Expect cutting-edge projects, personalized development plans, continuous learning, and mentorship to help you excel both personally and professionally.

As a Senior Data Engineer, you will be instrumental in designing and implementing scalable data engineering solutions.

Key responsibilities include: - Developing scalable data processing solutions using PySpark and distributed frameworks. - Architecting robust data ingestion, transformation, and processing pipelines. - Designing and optimizing Snowflake or Delta Lake on Databricks for enterprise-scale platforms. - Leading the implementation of high-performance batch and streaming data pipelines. - Crafting event-driven architectures with Apache Kafka or Amazon Kinesis. - Establishing standards and frameworks for data streaming and scalable processing. - Architecting workflow orchestration using Apache Airflow or Databricks Workflows. - Implementing comprehensive monitoring, scheduling, and operational controls for reliable pipeline execution. - Driving data quality, validation, reconciliation, and governance initiatives. - Designing solutions adhering to Lakehouse architecture, data observability, and platform engineering principles. - Developing business-focused data products to enhance data quality, usability, and consumption. - Promoting the responsible use of AI-assisted engineering tools to boost productivity and quality. - Reviewing pipeline designs to ensure adherence to engineering, scalability, and performance standards. - Troubleshooting complex data processing and streaming issues through root cause analysis. - Mentoring team members on data engineering best practices. - Collaborating with stakeholders for end-to-end data platform delivery.

We are seeking a Senior Data Engineer with strong ownership and a passion for data engineering excellence.

Essential competencies include: - Demonstrating strong ownership in driving data engineering initiatives. - Collaborating effectively with diverse teams and business stakeholders for seamless delivery. - Promoting quality through proactive validation, optimization, and continuous improvement. - Applying strong analytical thinking to solve complex data engineering challenges. - Adapting to evolving technologies, data ecosystems, and business needs. - Communicating clearly on delivery status, risks, and opportunities. - Maintaining a high level of attention to detail in all aspects of data architecture and implementation.

Mandatory Skills: - Databricks Workflows - PySpark - Apache Kafka - Snowflake