Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and be part of a global team focused on building lasting client relationships. You will collaborate with leading companies to shape their hybrid cloud and AI strategies. Leveraging robust IBM technology, Red Hat, and support from our strategic partners, you'll drive significant change and accelerate client success.

At IBM Consulting, curiosity is key. We encourage challenging the status quo, exploring novel ideas, and developing innovative solutions that deliver tangible results. Our supportive culture fosters long-term career growth, valuing your unique contributions and experiences.

Responsibilities

As a Data Engineer specializing in Azure Data Platforms, you will design, develop, and maintain robust data engineering solutions within the Azure Cloud ecosystem.

Key responsibilities include: - Architecting and building batch and real-time data pipelines using Azure services like Synapse Analytics, Data Factory, Databricks, and Event Hub. - Developing and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and managing Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Utilizing open-source technologies such as Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance data engineering solutions.

Qualifications

We are seeking Data Engineers with expertise in Azure Data Platforms to design, build, and operate efficient data pipelines.

Essential qualifications include: - Proven experience in designing, building, and operating batch and real-time data pipelines on the Azure Cloud. - Hands-on experience with Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Proficiency in working with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Familiarity with open-source technologies like Apache Airflow and dbt, coupled with Spark using Python or Scala.

Essential Skills

PythonScala Programming LanguageSparkAzure Data EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksOpen SourceAzure Cosmos DBAzure Synapse AnalyticsAzure Functions

Good to Have

Structured Query LanguageStorageReal-time Data

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX