Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies. As a Data Engineer focused on Azure Data Platforms, you will be instrumental in developing and maintaining cutting-edge data engineering solutions.
This role offers a dynamic environment where curiosity and innovation are celebrated. You'll collaborate globally, leveraging robust IBM technology and Red Hat expertise to drive significant client impact and accelerate business transformation.
Your career development is a priority, with a culture that fosters growth, empathy, and recognizes your unique contributions. We empower you to challenge the status quo and create innovative solutions.
Design, construct, and manage robust batch and real-time data pipelines utilizing key Azure services. Develop and maintain the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB.
Implement and oversee essential Azure Data Platform components, including ADLS2, Blob Storage, and Azure Purview. Leverage open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance data engineering capabilities.
Ensure the smooth and continuous operation of data engineering solutions for efficient batch and real-time data processing. Maintain seamless batch and real-time data processing.
Demonstrate proficiency with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for building comprehensive data pipelines.
Possess practical experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.
Exhibit familiarity with open-source technologies including Apache Airflow and dbt, as well as Spark with Python or Scala for data engineering tasks. Expertise in data pipeline development on the Azure Cloud ecosystem is essential.
IBM
Information Technology & Services