Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and embark on a career focused on building lasting client relationships and global collaboration. You'll partner with leading companies to guide their hybrid cloud and AI strategies. Leverage IBM's robust technology, Red Hat, and strategic partner support to drive significant client impact and innovation.

At IBM Consulting, we foster a culture of curiosity and encourage challenging the status quo. Explore new ideas and craft groundbreaking solutions that deliver tangible results. Your long-term career development is prioritized within our growth-oriented and empathetic environment, where your unique talents are valued.

Responsibilities

As a Data Engineer specializing in Azure Data Platforms, you will be instrumental in advising on, developing, and maintaining sophisticated data engineering solutions within the Azure cloud ecosystem.

Key responsibilities include: - Designing, building, and operating robust batch and real-time data pipelines utilizing core Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing and managing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining critical Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Ensuring the seamless operation and maintenance of data engineering solutions for efficient batch and real-time data processing.

Qualifications

We are seeking a Data Engineer with expertise in Azure Data Platforms. Your background should include:

- Proven experience in data engineering on the Azure Cloud, including designing, building, and operating batch and real-time data pipelines. - Proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Experience developing and managing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Familiarity with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure Functions with Python, Azure Purview, and Cosmos DB. - Exposure to open-source technologies like Apache Airflow and dbt, along with proficiency in Spark/Python or Spark/Scala for data engineering solutions.

Essential Skills

PythonSQLScalaSparkAzure Data FactoryAzure DatabricksAzure Synapse AnalyticsAzure Cosmos DBAzure FunctionsApache AirflowdbtAzure CloudData PipelinesData EngineeringStorage

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryTechnology
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Technology

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX