Big Data Lead
Hexaware
Hexaware
Seeking a skilled Senior Data Engineer to spearhead the migration of an Oracle data warehouse to Databricks within the Allianz Data Platform (ADP).
This role is crucial for modernizing our data infrastructure, with a preference for candidates experienced in contemporary data engineering methodologies and AI-ready platforms.
Key duties include analyzing the existing Oracle data warehouse and designing the future state in Databricks.
Responsibilities involve building and optimizing ETL/ELT pipelines using Spark SQL and PySpark for data migration, translating Oracle SQL/PL-SQL to Databricks, and ensuring the quality, performance, and reliability of the new data warehouse.
Collaboration with Enterprise Architects, the ADP team, and stakeholders is essential, alongside documenting migration processes and data models for ongoing support.
Candidates must possess 5-9 years of IT experience, with a strong foundation in Databricks, SQL, and data warehousing.
Proficiency in Spark SQL and PySpark for ETL/ELT pipeline development is required.
A degree in Engineering or a postgraduate degree in any discipline is necessary, coupled with a positive, solution-oriented attitude and experience in ITIL processes or application support/deployment activities.
Hexaware Technologies
IT Consulting