Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting to shape hybrid cloud and AI journeys for leading companies worldwide. We foster a culture of curiosity, innovation, and collaboration, empowering you to drive meaningful change and accelerate client impact. Your career development is a priority, and we value your unique contributions.
This role focuses on Data Engineering within Data Platforms on Azure, offering a dynamic opportunity to advise on, develop, and maintain cutting-edge data solutions in the Azure Cloud ecosystem. You will be instrumental in designing, building, and operating robust data pipelines.
Design, build, and maintain batch and real-time data pipelines utilizing Azure services like Synapse Analytics, Data Factory, and Databricks. Develop and manage the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
Implement and sustain key Azure Data Platform components including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. Leverage open-source technologies such as Apache Airflow, dbt, Spark, Python, or Scala to enhance data engineering solutions.
Ensure the seamless operation and maintenance of data engineering solutions for efficient batch and real-time data processing.
A strong understanding of Azure services is essential, including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for pipeline development. Proven experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions (Python), Azure Purview, and Cosmos DB is required.
Proficiency in open-source technologies such as Apache Airflow, dbt, Spark, Python, or Scala is necessary for supporting advanced data engineering solutions. Experience in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is critical. You will also be responsible for the ongoing operation and maintenance of these data engineering solutions.
IBM
Information Technology & Services