Big Data Lead

Hexaware

5–9 yrs India Full Time Remote
Hexaware logo
Posted : today
Actively hiring

Job description

Seeking a skilled Senior Data Engineer to spearhead the migration of an Oracle data warehouse to Databricks within the Allianz Data Platform (ADP).

This role is crucial for modernizing our data infrastructure, with a preference for candidates experienced in contemporary data engineering methodologies and AI-ready platforms.

Responsibilities

Key duties include analyzing the existing Oracle data warehouse and designing the future state in Databricks.

Responsibilities involve building and optimizing ETL/ELT pipelines using Spark SQL and PySpark for data migration, translating Oracle SQL/PL-SQL to Databricks, and ensuring the quality, performance, and reliability of the new data warehouse.

Collaboration with Enterprise Architects, the ADP team, and stakeholders is essential, alongside documenting migration processes and data models for ongoing support.

Qualifications

Candidates must possess 5-9 years of IT experience, with a strong foundation in Databricks, SQL, and data warehousing.

Proficiency in Spark SQL and PySpark for ETL/ELT pipeline development is required.

A degree in Engineering or a postgraduate degree in any discipline is necessary, coupled with a positive, solution-oriented attitude and experience in ITIL processes or application support/deployment activities.

Essential Skills

DatabricksSQLdata warehousingSpark SQLPySpark

Good to Have

modern data engineeringAI-enabling data platformsITIL

Highlights

  • Actively hiring

More Details

RoleBig Data Lead
Employment TypeFull Time, Remote

About the Company

Hexaware Technologies logo

Hexaware Technologies

IT Consulting

Big Data Lead at Hexaware | SkillMX | SkillMX