Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Embark on a journey with IBM Consulting, where innovation meets client success. You'll collaborate globally to guide leading organizations through their hybrid cloud and AI transformations. Leveraging robust IBM technology and Red Hat, you'll drive impactful change and accelerate client outcomes. Curiosity is key; we foster an environment where challenging the status quo and creating groundbreaking solutions is the norm. Our growth-oriented and empathetic culture prioritizes your career development while celebrating your unique contributions.

Responsibilities

As a specialized Data Engineer for Data Platforms on Azure, you will architect, develop, and manage robust data engineering solutions within the Azure Cloud ecosystem. This involves designing, building, and maintaining both batch and real-time data pipelines using a suite of Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. You will also develop and manage the data layer using Azure Synapse Analytics, SQL DW, and Cosmos DB, while implementing and overseeing Azure Data Platform components such as ADLS2, Blob Storage, and Azure Purview.

Qualifications

We are seeking individuals proficient in developing and maintaining data engineering solutions on the Azure Cloud. Key responsibilities include designing, building, and operating batch and real-time data pipelines with Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. Expertise in developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is essential. Furthermore, a strong understanding of Azure Data Platform components, including ADLS2, Blob Storage, SQL DW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB, is required. Proficiency in open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is also highly valued for supporting data engineering initiatives.

Essential Skills

PythonScalaSQLSparkAzure Data FactoryAzure Synapse AnalyticsAzure DatabricksAzure Cosmos DBAzure FunctionsAzure CloudData PipelinesData EngineeringApache AirflowdbtADLS2Blob StorageSQL DWAzure PurviewEvent Hub

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services, Data Analytics, Cloud Computing
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX