Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. As part of our collaborative team, you'll leverage IBM technology, Red Hat, and strategic partnerships to drive impactful change.
Curiosity is key at IBM Consulting. We encourage challenging the status quo, exploring novel ideas, and crafting innovative solutions. Our supportive culture fosters long-term career growth while valuing your unique contributions.
As an Azure Data Engineer, you will design, develop, and maintain robust data engineering solutions within the Azure cloud ecosystem. This involves building and operating both batch and real-time data pipelines using a variety of Azure services.
Key responsibilities include designing and implementing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. You will also implement and maintain core Azure Data Platform components such as ADLS2, Blob Storage, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.
A strong understanding of open-source technologies like Apache Airflow and dbt, along with proficiency in Spark/Python or Spark/Scala, is essential. You will ensure the seamless operation and maintenance of data engineering solutions for efficient data processing.
We are looking for expertise in the Azure toolset, including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hubs. Experience with Azure Data Platform components and developing data pipelines on Azure is crucial for this role.
IBM
Information Technology & Services