Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Embark on a career in IBM Consulting, where you'll cultivate enduring client relationships and collaborate globally. You will assist leading organizations across diverse industries in navigating their hybrid cloud and AI strategies. Leveraging the strength of our strategic partners, robust IBM technology, and Red Hat, you'll be equipped to drive significant transformations and accelerate client success. At IBM Consulting, curiosity is the engine of achievement. We foster an environment that encourages challenging the status quo, exploring novel concepts, and developing innovative solutions that deliver tangible outcomes. Our culture emphasizes growth and empathy, focusing on your long-term professional development while honoring your unique talents and backgrounds.

Responsibilities

As a Data Engineer focused on Data Platforms within Azure, your role involves advising on, developing, and maintaining data engineering solutions on the Azure Cloud. You will be responsible for designing, building, and operating both batch and real-time data pipelines, utilizing various Azure services.

Key responsibilities include: - Designing and constructing robust data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing and maintaining the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and managing Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (with Python), Azure Purview, and Cosmos DB. - Applying proficiency in open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, to support data engineering initiatives.

Qualifications

The ideal candidate will possess experience in data engineering on Azure, specifically working with components like ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions, Azure Purview, and Cosmos DB. Proficiency in open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala), and a strong understanding of Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub are essential for designing, building, and operating batch and real-time data pipelines. Experience in developing and maintaining data engineering solutions within the Azure Cloud ecosystem, along with expertise in designing and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB, will be crucial for success in this role.

Essential Skills

PythonStructured Query LanguageScalaSparkStorageAzure Data EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksOpen SourceAzure Cosmos DBAzure Synapse AnalyticsReal-time DataAzure Functions

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryData Analytics
DepartmentData Engineering, Data & Analytics
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX