Data Engineer-Data Platforms-Azure
IBM
IBM
Join IBM Consulting and contribute to transformative client journeys in hybrid cloud and AI. We foster a culture of curiosity and innovation, empowering you to challenge norms and deliver impactful solutions. Your career development is our priority, with a focus on your long-term growth and the value of your unique skills.
As a Data Engineer specializing in Azure Data Platforms, you will architect, build, and maintain robust data engineering solutions. This includes designing and operating batch and real-time data pipelines using key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. You will also develop and manage the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB, ensuring the seamless flow of data.
Your role involves implementing and maintaining critical Azure Data Platform components such as ADLS2, Blob Storage, and Azure Functions. You will leverage open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance our data engineering capabilities. Ensuring the continuous operation and maintenance of these solutions is paramount to our success.
We are seeking individuals with demonstrated experience in data engineering on the Azure Cloud ecosystem. Essential skills include proficiency in designing, building, and operating batch and real-time data pipelines using Azure services. You should possess hands-on experience with Azure Data Platform components, including ADLS2, Blob Storage, Synapse Analytics (Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.
Familiarity with open-source technologies such as Apache Airflow and dbt, along with Spark using Python or Scala, is highly valued. A solid understanding of developing and maintaining the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is crucial for this role. This position is based in Bangalore, India, with a hybrid work arrangement.
IBM
Information Technology & Services