Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI. Collaborate with leading companies worldwide, leveraging robust IBM technology and Red Hat. Our culture fosters curiosity, innovation, and continuous career growth, valuing your unique contributions.

This role focuses on developing and maintaining data engineering solutions within the Azure Cloud ecosystem. You will be instrumental in designing, building, and operating both batch and real-time data pipelines, contributing to seamless data processing and analytics.

Responsibilities

Design, build, and operate robust batch and real-time data pipelines utilizing core Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. Develop and maintain the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. Implement and manage essential Azure Data Platform components, including ADLS2, Blob Storage, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. Ensure the seamless operation and maintenance of data engineering solutions.

Qualifications

Demonstrate proficiency in Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for data pipeline development. Possess hands-on experience with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. Familiarity with open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is essential for supporting data engineering solutions. Proven ability in designing, building, and operating data layers on Azure Synapse Analytics, SQL DW, and Cosmos DB is required.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksEvent HubAzure Data Lake Storage Gen2Blob StorageSQL Data WarehouseAzure FunctionsAzure PurviewCosmos DBApache AirflowdbtSparkPythonScalaData PipelinesData EngineeringAzure Cloud

Good to Have

Structured Query LanguageProgramming Language

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX