Data Engineer-Data Platforms-Azure

IBM

5–10 yrs Pune Full Time Work from office
IBM logo
Posted : yesterday
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading global companies. In our FutureNow Centers, you'll leverage deep technical and industry expertise to drive innovation for clients worldwide. This role focuses on delivering cutting-edge data engineering solutions within the Azure Cloud ecosystem, fostering a culture of curiosity and continuous growth.

Responsibilities

As a Data Engineer, you will architect, develop, and maintain robust data engineering solutions on Azure. Your core responsibilities include designing and building sophisticated batch and real-time data pipelines utilizing services like Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks. You will also develop and manage the data layer on platforms such as Azure Synapse Analytics and Cosmos DB, and implement various Azure Data Platform components. Leveraging open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, will be crucial for supporting these data engineering initiatives and ensuring seamless data processing operations.

Qualifications

This position requires a Bachelor's Degree and 5-10 years of experience in data engineering on Azure. You should possess strong proficiency with Azure services including Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hubs for pipeline development. Expertise in Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions with Python, Azure Purview, and Cosmos DB is essential. Familiarity with open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala) is also necessary. A Master's Degree is preferred.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DataBricksEvent HubADLS2Blob StorageSQLDWSynapse Analytics with Spark and SQLAzure functions with PythonAzure PurviewCosmos DBApache AirflowdbtSpark/PythonSpark/Scala

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
Employment TypeFull Time, Work from office

About the Company

IBM logo

IBM

IT Consulting

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX