Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and build lasting client relationships globally. You'll collaborate with leading companies to guide their hybrid cloud and AI strategies. Leveraging IBM's technology and Red Hat, you'll drive significant change and accelerate client success.
Curiosity is key at IBM Consulting. We encourage challenging the status quo, exploring new ideas, and developing innovative solutions that deliver tangible results. Our supportive culture fosters your career growth while valuing your unique talents.
As a Data Engineer focused on Azure Data Platforms, you will design, develop, and maintain robust data engineering solutions within the Azure Cloud ecosystem. This includes building and managing both batch and real-time data pipelines using a variety of Azure services.
Key responsibilities involve: - Architecting and constructing data pipelines using Azure services like Synapse Analytics, Data Factory, Databricks, and Event Hub. - Developing and maintaining the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and managing Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Applying open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala for data engineering tasks. - Ensuring the smooth operation and maintenance of data engineering solutions for efficient data processing.
We are seeking candidates with proven experience in data engineering on the Azure Cloud. A strong understanding of Azure services and open-source technologies is essential.
Ideal candidates will possess: - Expertise in Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for pipeline development. - Experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Proficiency with open-source tools such as Apache Airflow, dbt, and frameworks like Spark with Python or Scala. - Demonstrated experience in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - A solid background in developing and maintaining data engineering solutions within the Azure ecosystem.
IBM
IT Services and IT Consulting