Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and contribute to transformative client journeys in hybrid cloud and AI. Leverage robust IBM technology and Red Hat alongside strategic partners to drive innovation and accelerate impact. Cultivate your career in a supportive environment that champions curiosity, challenges norms, and fosters empathy for long-term professional growth.

Responsibilities

As a Data Engineer on our Data Platforms team, you will architect, develop, and manage sophisticated data engineering solutions within the Azure Cloud ecosystem. Your role involves designing, building, and maintaining robust batch and real-time data pipelines utilizing key Azure services.

Key responsibilities include: - Crafting and deploying data pipelines using Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing and optimizing the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining essential Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Applying expertise in open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala to enhance data engineering solutions. - Ensuring the efficient operation and upkeep of data engineering solutions for seamless batch and real-time data processing.

Qualifications

We are seeking skilled Data Engineers with a strong foundation in Azure Data Platforms. Ideal candidates will possess practical experience in designing, building, and operating batch and real-time data pipelines on Azure.

Required expertise includes: - Proficiency with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Hands-on experience with Azure Data Platform components including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Familiarity with open-source technologies like Apache Airflow and dbt, or Spark/Python/Scala for data engineering. - Demonstrated experience in developing and maintaining data engineering solutions within the Azure Cloud ecosystem. - Proven ability in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksEvent HubAzure SQL DWCosmos DBADLS2Blob StorageAzure FunctionsAzure PurviewApache AirflowdbtSparkPythonScalaData PipelinesData EngineeringAzure CloudStructured Query LanguageProgramming Language

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services, Data Analytics, Cloud Computing
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX