Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Advance your career in IBM Consulting, collaborating globally with leading companies to shape their hybrid cloud and AI strategies. Leverage IBM technology, Red Hat, and our strategic partners to drive significant client impact. At IBM Consulting, we foster a culture of curiosity, innovation, and continuous growth, encouraging you to challenge the status quo and develop cutting-edge solutions.

As a Data Engineer focused on Azure Data Platforms, you will be instrumental in advising on, developing, and maintaining robust data engineering solutions within the Azure Cloud ecosystem. Your expertise will be crucial in designing, building, and operating both batch and real-time data pipelines, utilizing a comprehensive suite of Azure services.

Responsibilities

Key responsibilities include designing and building scalable data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. You will also develop and maintain the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Implementing and managing Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (with Python), Azure Purview, and Cosmos DB, is a core part of this role. Ensuring seamless batch and real-time data processing through diligent operation and maintenance of data engineering solutions is essential.

Qualifications

Candidates should possess proficiency in designing, building, and operating data pipelines utilizing Azure services like Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. Experience in developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is required.

Demonstrated experience with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB is crucial. Familiarity with open-source technologies like Apache Airflow and dbt, alongside Spark/Python or Spark/Scala, to support data engineering solutions, is highly valued.

Essential Skills

Azure CloudAzure Data FactoryAzure DataBricksAzure Synapse AnalyticsPythonSparkSQLData EngineeringData PipelinesApache AirflowdbtScalaAzure Cosmos DBAzure FunctionsAzure PurviewADLS2Blob StorageSQLDWEvent Hub

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services, Cloud Computing
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX