Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting to shape hybrid cloud and AI journeys for leading companies worldwide. Collaborate closely with clients and leverage robust IBM technology, Red Hat, and strategic partnerships. Curiosity and innovation drive our success, fostering an environment where new ideas deliver real results. We focus on your long-term career growth and value your unique contributions.

As an Azure Data Platform Engineer, you will design, develop, and maintain sophisticated data engineering solutions within the Azure Cloud ecosystem. This role is central to building and operating efficient batch and real-time data pipelines.

Responsibilities

Your core responsibilities will include designing and constructing robust batch and real-time data pipelines using key Azure services like Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.

You will also develop and manage the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. Implementing and maintaining various Azure Data Platform components, such as ADLS2, Blob Storage, and Azure Purview, is crucial.

Proficiency in open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, will be utilized to support data engineering solutions. Ensuring the seamless operation and maintenance of these data engineering solutions for continuous processing is also a key aspect of this role.

Qualifications

We seek individuals with demonstrated experience in data engineering on Azure, including expertise with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.

Proficiency in designing, building, and operating batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub is essential.

Experience with open-source technologies including Apache Airflow and dbt, coupled with Spark using Python or Scala, is required. A solid understanding of developing and maintaining data engineering solutions within the Azure Cloud ecosystem, including the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB, is also necessary.

Essential Skills

PythonSQLScalaSparkAzureData EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksOpen SourceAzure Cosmos DBAzure Synapse AnalyticsReal-time DataAzure FunctionsADLS2Blob StorageSQLDWAzure Purviewdbt

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryTechnology
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Technology

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX