Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI. Collaborate with leading companies worldwide, leveraging robust IBM technology and Red Hat. Our culture fosters curiosity, innovation, and continuous career growth, valuing your unique contributions.
This role focuses on developing and maintaining data engineering solutions within the Azure Cloud ecosystem. You will be instrumental in designing, building, and operating both batch and real-time data pipelines, contributing to seamless data processing and analytics.
Design, build, and operate robust batch and real-time data pipelines utilizing core Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. Develop and maintain the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. Implement and manage essential Azure Data Platform components, including ADLS2, Blob Storage, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. Ensure the seamless operation and maintenance of data engineering solutions.
Demonstrate proficiency in Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for data pipeline development. Possess hands-on experience with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. Familiarity with open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is essential for supporting data engineering solutions. Proven ability in designing, building, and operating data layers on Azure Synapse Analytics, SQL DW, and Cosmos DB is required.
IBM
Information Technology & Services