Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and embark on a career focused on building lasting client relationships and fostering global collaboration. You'll engage with industry leaders, guiding them through their hybrid cloud and AI transformations. Leveraging IBM technology, Red Hat, and strong partnerships, you'll drive significant impact and deliver tangible results.

At IBM Consulting, curiosity is key to success. We encourage challenging the status quo, exploring novel ideas, and crafting innovative solutions. Our supportive and growth-oriented culture prioritizes your career development while celebrating your unique contributions.

Responsibilities

As a Data Engineer specializing in Azure Data Platforms, your role involves advising on, developing, and maintaining robust data engineering solutions within the Azure Cloud ecosystem.

You will be responsible for designing, building, and operating both batch and real-time data pipelines, utilizing a range of Azure services. This includes:

- Developing and implementing the data layer using Azure Synapse Analytics, SQL DW, and Cosmos DB. - Maintaining key Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (with Python), Azure Purview, and Cosmos DB. - Employing open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance data engineering solutions. - Ensuring the smooth operation and maintenance of data engineering solutions for efficient data processing.

Qualifications

This role requires hands-on experience with Azure services, including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub, for designing and operating data pipelines.

Demonstrated experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB is essential.

Proficiency in open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala) is necessary to support data engineering initiatives.

We are looking for individuals experienced in developing and maintaining data engineering solutions within the Azure Cloud environment, encompassing the design, build, and operation of batch and real-time data pipelines. Prior experience in designing and building the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is also a key requirement.

Essential Skills

PythonStructured Query LanguageScala Programming LanguageSparkStorageAzure Data EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksOpen SourceAzure Cosmos DBAzure Synapse AnalyticsReal-time DataAzure Functions

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryData Analytics
DepartmentDesign, Delivery, Pipelines
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX