Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and collaborate with leading companies worldwide to shape their hybrid cloud and AI futures. Harness robust IBM technology, Red Hat, and strategic partner support to drive impactful change. At IBM, curiosity is key to success, empowering you to challenge norms, explore new ideas, and create innovative solutions.

Our growth-focused and empathetic culture prioritizes your long-term career development while valuing your unique contributions. As a Data Engineer specializing in Azure Data Platforms, you will advise on, develop, and maintain cutting-edge data engineering solutions within the Azure Cloud ecosystem.

Responsibilities

Design, build, and operate robust batch and real-time data pipelines utilizing Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.

Develop and manage the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB, ensuring efficient data management.

Implement and maintain essential Azure Data Platform components, including ADLS2, Blob Storage, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.

Apply proficiency in open-source technologies such as Apache Airflow and dbt, alongside Spark/Python or Spark/Scala, to enhance data engineering solutions.

Ensure the seamless operation and maintenance of data engineering solutions for reliable batch and real-time data processing.

Qualifications

Demonstrate proficiency in Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for designing and operating data pipelines.

Possess practical experience with Azure Data Platform components such as ADLS2, Blob Storage, SQL DW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.

Showcase exposure to open-source technologies like Apache Airflow and dbt, in conjunction with Spark/Python or Spark/Scala, for data engineering support.

Exhibit experience in developing and maintaining data engineering solutions on Azure Cloud, encompassing the design, build, and operation of batch and real-time pipelines.

Have prior experience in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksEvent HubADLS2Blob StorageSQL DWSynapse AnalyticsCosmos DBApache AirflowdbtSparkPythonScalaAzure FunctionsAzure PurviewStructured Query Language

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX