Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and be part of a dynamic team shaping the future of hybrid cloud and AI. We partner with leading companies, leveraging robust IBM technology and Red Hat to drive significant client impact. At IBM Consulting, curiosity is key; we encourage challenging the status quo and creating innovative, results-driven solutions.

Our growth and empathy-focused culture supports your long-term career development, valuing your unique contributions. This role focuses on advising on, developing, and maintaining cutting-edge data engineering solutions within the Azure Cloud ecosystem.

Responsibilities

As a Data Engineer specializing in Data Platforms on Azure, your core responsibilities will involve designing, building, and operating robust batch and real-time data pipelines. You will develop and manage the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Key tasks include implementing and maintaining critical Azure Data Platform components like ADLS2, Blob Storage, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. You'll utilize open-source technologies such as Apache Airflow and dbt, alongside Spark/Python or Spark/Scala, to support these solutions and ensure seamless data processing operations.

Qualifications

We are seeking a Data Engineer with expertise in Azure services, including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub, for designing and operating data pipelines.

Demonstrated experience with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB is essential. Proficiency in open-source technologies like Apache Airflow and dbt, combined with Spark/Python or Spark/Scala, is required to support data engineering solutions.

Essential Skills

Azure CloudAzure Data FactoryAzure Synapse AnalyticsDatabricksPythonSparkSQLApache AirflowAzure Cosmos DBAzure FunctionsScalaData EngineeringData PipelinesStorageReal-time DataOpen Source

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX