Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting to shape hybrid cloud and AI journeys for leading companies. Collaborate globally, leveraging IBM technology and Red Hat to drive meaningful client impact. Our culture encourages curiosity, innovation, and continuous growth, fostering your long-term career development. We value your unique skills and experiences as you contribute to creating real results.
As a Data Engineer on the Data Platforms team, you will design, build, and maintain robust data engineering solutions within the Azure Cloud ecosystem. This includes developing and operating batch and real-time data pipelines using key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. You will also be responsible for constructing and managing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
We are seeking expertise in implementing and maintaining Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure Functions with Python, Azure Purview, and Cosmos DB. A strong command of open-source technologies including Apache Airflow and dbt, alongside proficiency in Spark/Python or Spark/Scala, is essential for supporting our data engineering initiatives. Ensuring the seamless operation of data engineering solutions for both batch and real-time processing is a key aspect of this role.
IBM
Software