Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Embark on a career with IBM Consulting, where you'll build lasting client relationships and collaborate globally. You'll assist leading companies in their hybrid cloud and AI transformations, leveraging IBM's technology, Red Hat, and strategic partner support. Curiosity drives success here; we encourage challenging the status quo and developing innovative solutions. Our growth and empathy-focused culture supports your long-term career development while celebrating your unique contributions.

Responsibilities

As a Data Engineer focused on Azure Data Platforms, you will design, develop, and maintain robust data engineering solutions within the Azure Cloud ecosystem. This includes creating and managing batch and real-time data pipelines using key Azure services. You will also develop and operate the data layer using Azure Synapse Analytics, SQL DW, and Cosmos DB, applying your expertise in Azure Data Platform components. Implementation of open-source technologies like Apache Airflow, dbt, and Spark (Python/Scala) is also a key part of this role.

Qualifications

This role demands proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for data pipeline development. A strong understanding of Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, and Synapse Analytics with Spark/SQL, is essential. Experience with Azure Functions (Python), Azure Purview, and Cosmos DB is required. Familiarity with operating Azure services like Event Hub, Streaming Analytics, and Managed Streaming for Apache Kafka is also crucial. Proficiency in open-source technologies like Apache Airflow and dbt, alongside Spark/Python or Spark/Scala, is expected to support data engineering solutions.

Essential Skills

AzureData EngineeringData PipelinesApache KafkaSparkPythonSQLScalaApache AirflowAzure Data FactoryAzure DatabricksAzure Synapse AnalyticsAzure Cosmos DBAzure FunctionsStreaming AnalyticsAzure Purview

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryData Analytics
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX