Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and become a key player in shaping hybrid cloud and AI journeys for leading global companies. Embrace a culture of curiosity and innovation, where your contributions drive meaningful change. This role focuses on building and maintaining advanced data engineering solutions within the Azure cloud ecosystem, leveraging cutting-edge technologies to accelerate client impact.
As a Data Engineer, you will be instrumental in designing, developing, and optimizing robust data platforms. You will work collaboratively to create scalable and efficient data pipelines, ensuring seamless data processing for critical business operations. Your expertise will be vital in transforming how businesses leverage their data.
Design, build, and operate robust batch and real-time data pipelines utilizing key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.
Develop and maintain the data layer on platforms such as Azure Synapse Analytics, SQL DW, and Cosmos DB.
Implement and manage core Azure Data Platform components including ADLS2, Blob Storage, and Azure Functions with Python.
Apply proficiency in open-source technologies such as Apache Airflow and dbt to enhance data engineering solutions.
Proven experience in designing, building, and operating batch and real-time data pipelines within the Azure Cloud ecosystem.
Demonstrated expertise in Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub.
Hands-on experience with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.
Proficiency with open-source technologies like Apache Airflow and dbt, along with Spark using Python or Scala.
IBM
Information Technology & Services