Lead Data Engineer (Noida, UP, India)
Iris Software
Iris Software
Join Iris Software, recognized as one of India's Top 25 Best Workplaces in the IT industry. We are a rapidly growing IT services company dedicated to helping clients thrive through technology-enabled transformation. Our vision is to be the most trusted technology partner and the preferred destination for top industry professionals.
With a global presence spanning India, the U.S.A., and Canada, we engage in complex, mission-critical projects utilizing cutting-edge technologies. These include Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. At Iris, we believe in empowering our associates, offering them ownership of their careers and opportunities to shape their success. We foster a culture that values potential, amplifies voices, and drives real impact, providing continuous learning, mentorship, and exciting projects for personal and professional growth.
Develop scalable data engineering solutions leveraging PySpark and contemporary distributed data processing frameworks. Establish robust data ingestion, transformation, and processing architectures tailored to meet both business and analytical objectives.
Demonstrate strong ownership and drive for data engineering excellence. Foster effective collaboration with diverse teams and business stakeholders to ensure seamless project delivery.
Proficiency in Python, Apache Spark, Data Quality & Validation, PySpark, and SQL. Experience with streaming technologies like Amazon Kinesis and Apache Kafka. Familiarity with Databricks Workflows and Delta Lake on Databricks.
Additional skills include cloud platforms such as AWS S3, Amazon Aurora, DynamoDB, AWS Glue, and AWS Redshift. Knowledge of Data Governance Frameworks and GitHub is also beneficial.
Iris Software
IT Consulting