Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies. As a Data Engineer focused on Azure Data Platforms, you will be instrumental in developing and maintaining cutting-edge data engineering solutions.

This role offers a dynamic environment where curiosity and innovation are celebrated. You'll collaborate globally, leveraging robust IBM technology and Red Hat expertise to drive significant client impact and accelerate business transformation.

Your career development is a priority, with a culture that fosters growth, empathy, and recognizes your unique contributions. We empower you to challenge the status quo and create innovative solutions.

Responsibilities

Design, construct, and manage robust batch and real-time data pipelines utilizing key Azure services. Develop and maintain the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB.

Implement and oversee essential Azure Data Platform components, including ADLS2, Blob Storage, and Azure Purview. Leverage open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance data engineering capabilities.

Ensure the smooth and continuous operation of data engineering solutions for efficient batch and real-time data processing. Maintain seamless batch and real-time data processing.

Qualifications

Demonstrate proficiency with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for building comprehensive data pipelines.

Possess practical experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.

Exhibit familiarity with open-source technologies including Apache Airflow and dbt, as well as Spark with Python or Scala for data engineering tasks. Expertise in data pipeline development on the Azure Cloud ecosystem is essential.

Essential Skills

Azure CloudAzure Data FactoryAzure Synapse AnalyticsAzure DatabricksAzure Cosmos DBAzure FunctionsPythonScalaSparkSQLData EngineeringData PipelinesApache AirflowdbtADLS2Blob StorageSQLDWAzure Purview

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services, Software Development
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX