Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting to collaborate with leading global companies and guide them on their hybrid cloud and AI journeys. Leveraging IBM technology, Red Hat, and strategic partner support, you'll drive significant change and client impact. Our culture thrives on curiosity, encouraging innovation and the creation of impactful solutions.
At IBM Consulting, we foster a growth-oriented and empathetic environment that prioritizes your long-term career development and values your unique contributions. As a Data Engineer focused on Azure Data Platforms, you will be instrumental in advising on, developing, and maintaining robust data engineering solutions within the Azure cloud ecosystem.
Your role involves designing, building, and operating efficient batch and real-time data pipelines utilizing various Azure services. Key responsibilities include:
- Architecting and constructing data pipelines using Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing and managing the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining essential Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Applying expertise in open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala) to enhance data engineering solutions. - Ensuring the reliable operation and maintenance of data engineering solutions for seamless data processing.
We are seeking a Data Engineer with significant experience in data engineering on the Azure Cloud. This includes a proven track record in:
- Designing, building, and operating batch and real-time data pipelines leveraging Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining Azure Data Platform components including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Utilizing open-source technologies such as Apache Airflow and dbt, along with proficiency in Spark with Python or Scala.
IBM
Information Technology & Services