Data Engineer-Data Platforms-Azure

IBM

5–10 yrs Bengaluru Full Time Work from office
IBM logo
Posted : yesterday
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. You will leverage IBM's robust technology, strategic partnerships, and Red Hat's capabilities to drive meaningful change and accelerate client impact. This role is within one of our IBM Consulting FutureNow Centers, delivering deep technical expertise to diverse public and private sector clients globally, fostering innovation and adoption of new technologies.

Responsibilities

As a Data Engineer focused on Azure Data Platforms, you will architect, develop, and maintain data engineering solutions within the Azure cloud environment. Key responsibilities include designing and building robust batch and real-time data pipelines using services like Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks. You will also develop and manage the data layer utilizing Azure Synapse Analytics, SQL DW, and Cosmos DB, alongside implementing and maintaining core Azure Data Platform components. Proficiency in open-source technologies such as Apache Airflow, dbt, Spark, and Python/Scala is essential for supporting these solutions and ensuring seamless data processing operations.

Qualifications

A Bachelor's Degree is required, with a Master's Degree preferred. Essential technical expertise includes strong proficiency with Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks for designing and operating data pipelines. You should have practical experience with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure functions (Python), Azure Purview, and Cosmos DB. Familiarity with open-source technologies like Apache Airflow, dbt, and Spark (Python/Scala) for data engineering solutions is also crucial. Prior experience in designing, building, and maintaining data pipelines on the Azure cloud ecosystem, and experience designing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB are required. The role requires 5-10 years of relevant experience.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DataBricksEvent HubADLS2Blob StorageSQLDWSparkSQLAzure functions with PythonAzure PurviewCosmos DBApache AirflowdbtPythonScala

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
Employment TypeFull Time, Work from office

About the Company

IBM logo

IBM

IT Consulting

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX