Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI for leading global companies. In our FutureNow Centers, you'll leverage deep technical and industry expertise to drive innovation for clients worldwide. This role focuses on delivering cutting-edge data engineering solutions within the Azure Cloud ecosystem, fostering a culture of curiosity and continuous growth.
As a Data Engineer, you will architect, develop, and maintain robust data engineering solutions on Azure. Your core responsibilities include designing and building sophisticated batch and real-time data pipelines utilizing services like Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks. You will also develop and manage the data layer on platforms such as Azure Synapse Analytics and Cosmos DB, and implement various Azure Data Platform components. Leveraging open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, will be crucial for supporting these data engineering initiatives and ensuring seamless data processing operations.
This position requires a Bachelor's Degree and 5-10 years of experience in data engineering on Azure. You should possess strong proficiency with Azure services including Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hubs for pipeline development. Expertise in Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions with Python, Azure Purview, and Cosmos DB is essential. Familiarity with open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala) is also necessary. A Master's Degree is preferred.
IBM
IT Consulting