Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and be part of a global team focused on building lasting client relationships. You will collaborate with leading companies to shape their hybrid cloud and AI strategies. Leveraging robust IBM technology, Red Hat, and support from our strategic partners, you'll drive significant change and accelerate client success.
At IBM Consulting, curiosity is key. We encourage challenging the status quo, exploring novel ideas, and developing innovative solutions that deliver tangible results. Our supportive culture fosters long-term career growth, valuing your unique contributions and experiences.
As a Data Engineer specializing in Azure Data Platforms, you will design, develop, and maintain robust data engineering solutions within the Azure Cloud ecosystem.
Key responsibilities include: - Architecting and building batch and real-time data pipelines using Azure services like Synapse Analytics, Data Factory, Databricks, and Event Hub. - Developing and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and managing Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Utilizing open-source technologies such as Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance data engineering solutions.
We are seeking Data Engineers with expertise in Azure Data Platforms to design, build, and operate efficient data pipelines.
Essential qualifications include: - Proven experience in designing, building, and operating batch and real-time data pipelines on the Azure Cloud. - Hands-on experience with Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Proficiency in working with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Familiarity with open-source technologies like Apache Airflow and dbt, coupled with Spark using Python or Scala.
IBM
Information Technology & Services