Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. We foster a collaborative environment where curiosity drives innovation and personal career development is a priority.

This role focuses on Data Engineering within Data Platforms on Azure. You'll be instrumental in designing, developing, and maintaining robust data engineering solutions leveraging the Azure Cloud ecosystem.

Responsibilities

As a Data Engineer, you will be responsible for designing, building, and operating batch and real-time data pipelines. This includes developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

You will implement and maintain key Azure Data Platform components, utilizing open-source technologies like Apache Airflow and dbt, along with Spark/Python or Spark/Scala. Ensuring seamless operation of data processing solutions is also a critical aspect of this role.

Qualifications

We are seeking individuals with proven experience in data engineering on the Azure Cloud. This includes designing and building data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks.

Proficiency in Azure Data Platform components (ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions, Azure Purview, Cosmos DB) is essential. Familiarity with open-source technologies like Apache Airflow and dbt, alongside Spark/Python or Spark/Scala, is also required.

Essential Skills

PythonStructured Query LanguageScala Programming LanguageSparkStorageAzure Data EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksOpen SourceAzure Cosmos DBAzure Synapse AnalyticsReal-time DataAzure Functions

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryData Analytics
DepartmentDesign, Delivery, Pipelines
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX