Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Embark on a career in IBM Consulting, where you'll build lasting client relationships and collaborate globally to guide leading companies through their hybrid cloud and AI transformations. Leveraging IBM technology, Red Hat, and strategic partnerships, you'll drive significant change and accelerate client success.

At IBM Consulting, curiosity is key. We encourage challenging the status quo, exploring novel ideas, and crafting innovative solutions that deliver tangible results. Our supportive and growth-oriented culture prioritizes your long-term career development while celebrating your unique talents and experiences.

Responsibilities

As a Data Engineer focused on Azure Data Platforms, your role involves advising on, developing, and maintaining robust data engineering solutions within the Azure Cloud ecosystem.

You will be responsible for:

- Designing and constructing batch and real-time data pipelines utilizing Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. - Developing and managing the data layer using Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and overseeing Azure Data Platform components, including ADLS2, Blob Storage, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Applying open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala in data engineering solutions. - Ensuring the efficient operation and maintenance of data engineering solutions for seamless data processing.

Qualifications

To excel in this role, you'll need expertise in the Azure Cloud ecosystem for data engineering.

Key qualifications include:

- Proven experience in designing, building, and operating batch and real-time data pipelines on Azure using services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. - Hands-on experience with Azure Data Platform components such as ADLS2, Blob Storage, SQL DW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Familiarity with open-source technologies like Apache Airflow and dbt, along with proficiency in Spark/Python or Spark/Scala. - Experience in developing and maintaining data engineering solutions, including the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Essential Skills

PythonScalaSQLApache AirflowdbtSpark

Good to Have

Azure Data FactoryAzure DatabricksAzure Synapse AnalyticsAzure Cosmos DBAzure FunctionsAzure PurviewADLS2Blob StorageSQL DWEvent Hub

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services, Software Development, Cloud Computing
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX