Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and build lasting client relationships globally. You'll collaborate with leading companies to guide their hybrid cloud and AI strategies. Leveraging IBM's technology and Red Hat, you'll drive significant change and accelerate client success.

Curiosity is key at IBM Consulting. We encourage challenging the status quo, exploring new ideas, and developing innovative solutions that deliver tangible results. Our supportive culture fosters your career growth while valuing your unique talents.

Responsibilities

As a Data Engineer focused on Azure Data Platforms, you will design, develop, and maintain robust data engineering solutions within the Azure Cloud ecosystem. This includes building and managing both batch and real-time data pipelines using a variety of Azure services.

Key responsibilities involve: - Architecting and constructing data pipelines using Azure services like Synapse Analytics, Data Factory, Databricks, and Event Hub. - Developing and maintaining the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and managing Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Applying open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala for data engineering tasks. - Ensuring the smooth operation and maintenance of data engineering solutions for efficient data processing.

Qualifications

We are seeking candidates with proven experience in data engineering on the Azure Cloud. A strong understanding of Azure services and open-source technologies is essential.

Ideal candidates will possess: - Expertise in Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for pipeline development. - Experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark & SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Proficiency with open-source tools such as Apache Airflow, dbt, and frameworks like Spark with Python or Scala. - Demonstrated experience in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - A solid background in developing and maintaining data engineering solutions within the Azure ecosystem.

Essential Skills

PythonScalaSparkSQLAzure Data FactoryAzure DatabricksAzure Synapse AnalyticsApache AirflowAzure Cosmos DBAzure FunctionsAzure Cloud

Good to Have

dbtAzure PurviewBlob StorageADLS2

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryIT Services and IT Consulting
DepartmentEngineering, Information Technology
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

IT Services and IT Consulting

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX