Data Engineer-Data Platforms-Azure
IBM
IBM
Embark on a journey with IBM Consulting, where innovation meets client success. You'll collaborate globally to guide leading organizations through their hybrid cloud and AI transformations. Leveraging robust IBM technology and Red Hat, you'll drive impactful change and accelerate client outcomes. Curiosity is key; we foster an environment where challenging the status quo and creating groundbreaking solutions is the norm. Our growth-oriented and empathetic culture prioritizes your career development while celebrating your unique contributions.
As a specialized Data Engineer for Data Platforms on Azure, you will architect, develop, and manage robust data engineering solutions within the Azure Cloud ecosystem. This involves designing, building, and maintaining both batch and real-time data pipelines using a suite of Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. You will also develop and manage the data layer using Azure Synapse Analytics, SQL DW, and Cosmos DB, while implementing and overseeing Azure Data Platform components such as ADLS2, Blob Storage, and Azure Purview.
We are seeking individuals proficient in developing and maintaining data engineering solutions on the Azure Cloud. Key responsibilities include designing, building, and operating batch and real-time data pipelines with Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. Expertise in developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is essential. Furthermore, a strong understanding of Azure Data Platform components, including ADLS2, Blob Storage, SQL DW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB, is required. Proficiency in open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is also highly valued for supporting data engineering initiatives.
IBM
Information Technology & Services