Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting to shape hybrid cloud and AI journeys for leading companies worldwide. We foster a culture of curiosity, innovation, and collaboration, empowering you to drive meaningful change and accelerate client impact. Your career development is a priority, and we value your unique contributions.

This role focuses on Data Engineering within Data Platforms on Azure, offering a dynamic opportunity to advise on, develop, and maintain cutting-edge data solutions in the Azure Cloud ecosystem. You will be instrumental in designing, building, and operating robust data pipelines.

Responsibilities

Design, build, and maintain batch and real-time data pipelines utilizing Azure services like Synapse Analytics, Data Factory, and Databricks. Develop and manage the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Implement and sustain key Azure Data Platform components including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. Leverage open-source technologies such as Apache Airflow, dbt, Spark, Python, or Scala to enhance data engineering solutions.

Ensure the seamless operation and maintenance of data engineering solutions for efficient batch and real-time data processing.

Qualifications

A strong understanding of Azure services is essential, including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for pipeline development. Proven experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions (Python), Azure Purview, and Cosmos DB is required.

Proficiency in open-source technologies such as Apache Airflow, dbt, Spark, Python, or Scala is necessary for supporting advanced data engineering solutions. Experience in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is critical. You will also be responsible for the ongoing operation and maintenance of these data engineering solutions.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksEvent HubAzure Cosmos DBADLS2Blob StorageSQL DWAzure FunctionsAzure PurviewApache AirflowdbtSparkPythonScalaSQL

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX