Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI for leading global companies. We foster a collaborative environment where curiosity drives innovation and leads to impactful solutions. Your career development is our priority, and we value your unique contributions.
As a Data Engineer focused on Azure Data Platforms, you'll be instrumental in designing, developing, and maintaining robust data engineering solutions within the Azure Cloud ecosystem. This role involves building and managing both batch and real-time data pipelines, leveraging a variety of cutting-edge Azure services.
Key responsibilities include designing and constructing data pipelines using Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. You will also develop and maintain the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB. Implementation and upkeep of Azure Data Platform components such as ADLS2, Blob Storage, and Azure Purview are crucial.
Additionally, you will apply expertise in open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala. Ensuring the smooth operation and maintenance of data engineering solutions for seamless data processing is paramount.
We are seeking individuals with proven experience in data engineering on the Azure Cloud, including proficiency with Azure services for designing and operating batch and real-time data pipelines. Familiarity with Azure Data Platform components is essential.
Experience with open-source technologies such as Apache Airflow and dbt, along with Spark/Python or Spark/Scala, is highly desirable. A strong understanding of designing, building, and operating data layers in Azure Synapse Analytics, SQL DW, and Cosmos DB will be key to success in this role.
IBM
Information Technology & Services