Data Engineer-Data Platforms-Azure

IBM

5–10 yrs Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : yesterday
Actively hiring

Job description

Join IBM Consulting and be at the forefront of shaping hybrid cloud and AI journeys for leading global companies. Our FutureNow Centers offer deep technical and industry expertise, driving innovation and adoption of new technologies for public and private sector clients. We foster a culture of curiosity, encouraging bold ideas and innovative solutions that deliver tangible results.

Your career development is a priority, with a focus on growth, empathy, and valuing your unique contributions. Embrace challenges, explore new avenues, and contribute to a world where technology creates positive impact.

Responsibilities

As a Data Engineer focused on Azure Data Platforms, you will be instrumental in advising on, developing, and maintaining robust data engineering solutions within the Azure cloud ecosystem. Your role involves designing, building, and operating both batch and real-time data pipelines, leveraging a suite of Azure services.

Key responsibilities include: - Crafting and implementing batch and real-time data pipelines using Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. - Developing and managing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining critical Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (with Python), Azure Purview, and Cosmos DB. - Applying proficiency in open-source technologies like Apache Airflow, dbt, Spark (Python/Scala) to enhance data engineering solutions. - Ensuring the operational excellence and seamless functioning of data engineering solutions for efficient data processing.

Qualifications

We seek individuals with a Bachelor's Degree and 5-10 years of experience, possessing a strong command of Azure services including Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub for designing and operating data pipelines. Experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions, Azure Purview, and Cosmos DB is essential.

Proficiency in open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala) is required to support advanced data engineering solutions. You should have a proven track record in data pipeline development and experience in designing and building the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

A Master's Degree is preferred. We value candidates who are growth-minded, curious, and ready to contribute to a collaborative environment focused on delivering exceptional outcomes and driving technological progress.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DataBricksEvent HubADLS2Blob StorageSQL DWCosmos DBApache AirflowdbtSparkPythonScala

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services, Management Consulting
DepartmentData Engineering, Cloud Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX