Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting as a Data Engineer focused on Data Platforms within the Azure ecosystem. This role involves shaping hybrid cloud and AI journeys for leading companies through collaboration and innovative solutions. We foster a culture of curiosity, continuous growth, and empathy, valuing your unique contributions and supporting your long-term career development.
As part of our team, you'll leverage robust IBM technology and strategic partnerships to drive meaningful change and accelerate client impact. If you're passionate about data and cloud technologies, this is an opportunity to contribute to cutting-edge projects and make a tangible difference.
Your core responsibilities will revolve around designing, developing, and maintaining sophisticated data engineering solutions on Azure. This includes building and operating robust batch and real-time data pipelines using key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks. You will also develop and manage the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB, ensuring efficient data storage and retrieval.
Further, you will implement and maintain various Azure Data Platform components, including ADLS2, Blob Storage, and Azure Functions. Leveraging open-source technologies such as Apache Airflow and dbt, along with Spark in Python or Scala, will be crucial for supporting these solutions. Maintaining seamless operations for batch and real-time data processing is also a key aspect of this role.
We are seeking individuals with demonstrated expertise in data engineering on the Azure Cloud platform. Proficiency in designing, building, and operating batch and real-time data pipelines is essential, utilizing Azure services like Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.
Experience with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB is required. A strong understanding of open-source technologies like Apache Airflow and dbt, coupled with Spark/Python or Spark/Scala, is also necessary. Experience developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is a significant advantage.
IBM
IT Services and IT Consulting