Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting to collaborate with leading global companies and guide them on their hybrid cloud and AI journeys. Leveraging IBM technology, Red Hat, and strategic partner support, you'll drive significant change and client impact. Our culture thrives on curiosity, encouraging innovation and the creation of impactful solutions.

At IBM Consulting, we foster a growth-oriented and empathetic environment that prioritizes your long-term career development and values your unique contributions. As a Data Engineer focused on Azure Data Platforms, you will be instrumental in advising on, developing, and maintaining robust data engineering solutions within the Azure cloud ecosystem.

Responsibilities

Your role involves designing, building, and operating efficient batch and real-time data pipelines utilizing various Azure services. Key responsibilities include:

- Architecting and constructing data pipelines using Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing and managing the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining essential Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Applying expertise in open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala) to enhance data engineering solutions. - Ensuring the reliable operation and maintenance of data engineering solutions for seamless data processing.

Qualifications

We are seeking a Data Engineer with significant experience in data engineering on the Azure Cloud. This includes a proven track record in:

- Designing, building, and operating batch and real-time data pipelines leveraging Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining Azure Data Platform components including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Utilizing open-source technologies such as Apache Airflow and dbt, along with proficiency in Spark with Python or Scala.

Essential Skills

PythonScalaSparkAzure Data FactoryAzure Synapse AnalyticsAzure Cosmos DBApache AirflowdbtAzure Data EngineeringData PipelinesAzure Cloud

Good to Have

Structured Query LanguageDatabricksOpen SourceAzure FunctionsReal-time DataStorageSQL DWADLS2Blob StorageAzure Purview

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentEngineering, Technology
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX