Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. We foster a collaborative environment where curiosity drives innovation and personal career development is a priority.
This role focuses on Data Engineering within Data Platforms on Azure. You'll be instrumental in designing, developing, and maintaining robust data engineering solutions leveraging the Azure Cloud ecosystem.
As a Data Engineer, you will be responsible for designing, building, and operating batch and real-time data pipelines. This includes developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
You will implement and maintain key Azure Data Platform components, utilizing open-source technologies like Apache Airflow and dbt, along with Spark/Python or Spark/Scala. Ensuring seamless operation of data processing solutions is also a critical aspect of this role.
We are seeking individuals with proven experience in data engineering on the Azure Cloud. This includes designing and building data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks.
Proficiency in Azure Data Platform components (ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions, Azure Purview, Cosmos DB) is essential. Familiarity with open-source technologies like Apache Airflow and dbt, alongside Spark/Python or Spark/Scala, is also required.
IBM
Data Analytics