ETL Data - Senior Engineer

Iris Software

Fresher Noida Full Time Work from office
Iris Software logo
Posted : 6 days ago
Actively hiring

Job description

Join Iris Software, recognized as one of India's Top 25 Best Workplaces in the IT industry. We are a rapidly growing IT services company committed to being a trusted technology partner and a platform for top talent to realize their full potential.

Our vision extends to transforming enterprises across financial services, healthcare, transportation & logistics, and professional services. We specialize in complex, mission-critical applications utilizing cutting-edge technologies in Application & Product Engineering, Data & Analytics, Cloud, DevOps, and more.

Responsibilities

Design and implement scalable data engineering solutions using PySpark and distributed frameworks. Define data ingestion, transformation, and processing architectures. Optimize Snowflake or Delta Lake on Databricks for enterprise data platforms. Lead the development of high-performance batch and streaming data pipelines.

Architect workflow orchestration using Apache Airflow or Databricks Workflows. Establish monitoring and operational controls for reliable pipeline execution. Drive data quality, validation, and governance practices. Design solutions based on Lakehouse architecture principles, data observability, and platform engineering standards.

Promote the responsible use of AI-assisted engineering to enhance productivity and quality. Review data pipeline designs for adherence to standards. Troubleshoot complex data processing and streaming issues. Collaborate with cross-functional teams for end-to-end data platform delivery.

Qualifications

Possess strong ownership and drive for data engineering excellence. Collaborate effectively with diverse teams and stakeholders. Champion quality-focused engineering through proactive validation and optimization. Apply analytical thinking to complex data challenges.

Demonstrate adaptability to evolving technologies and business needs. Communicate delivery status, risks, and dependencies clearly. Maintain meticulous attention to detail in architecture, design, and implementation. Foster continuous improvement in data engineering practices.

Balance scalability, performance, reliability, and business priorities. Promote innovation by adopting modern data engineering and platform engineering principles. Experience with PySpark, Databricks Workflows, Delta Lake on Databricks, and Amazon Kinesis is mandatory. Proficiency in Big Data, Apache Spark, Python, SQL, and various AWS services is required.

Essential Skills

PySparkDatabricks WorkflowsDelta Lake on DatabricksAmazon KinesisApache SparkPythonSQLAWS SNSAWS SQSAWS KinesisDatabricksAmazon CloudWatchAWS S3AWS IAMAmazon API GatewayAWS GlueAWS RedshiftDynamo DBAmazon RDSAmazon EC2ETL & Data IntegrationAPI (SOAPREST)Shell ScriptingData Quality & Validation

Highlights

  • Actively hiring

More Details

RoleETL Data - Senior Engineer
IndustryData Analytics, Cloud Computing
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Iris Software logo

Iris Software

Data Analytics

ETL Data - Senior Engineer at Iris Software | SkillMX | SkillMX