Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting as a Data Engineer focused on Data Platforms within the Azure ecosystem. This role involves shaping hybrid cloud and AI journeys for leading companies through collaboration and innovative solutions. We foster a culture of curiosity, continuous growth, and empathy, valuing your unique contributions and supporting your long-term career development.

As part of our team, you'll leverage robust IBM technology and strategic partnerships to drive meaningful change and accelerate client impact. If you're passionate about data and cloud technologies, this is an opportunity to contribute to cutting-edge projects and make a tangible difference.

Responsibilities

Your core responsibilities will revolve around designing, developing, and maintaining sophisticated data engineering solutions on Azure. This includes building and operating robust batch and real-time data pipelines using key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure DataBricks. You will also develop and manage the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB, ensuring efficient data storage and retrieval.

Further, you will implement and maintain various Azure Data Platform components, including ADLS2, Blob Storage, and Azure Functions. Leveraging open-source technologies such as Apache Airflow and dbt, along with Spark in Python or Scala, will be crucial for supporting these solutions. Maintaining seamless operations for batch and real-time data processing is also a key aspect of this role.

Qualifications

We are seeking individuals with demonstrated expertise in data engineering on the Azure Cloud platform. Proficiency in designing, building, and operating batch and real-time data pipelines is essential, utilizing Azure services like Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.

Experience with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB is required. A strong understanding of open-source technologies like Apache Airflow and dbt, coupled with Spark/Python or Spark/Scala, is also necessary. Experience developing the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is a significant advantage.

Essential Skills

PythonSQLScalaSparkStorageAzure Data EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksOpen SourceAzure Cosmos DBAzure Synapse AnalyticsReal-time DataAzure FunctionsAzure Purview

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryIT Services and IT Consulting
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

IT Services and IT Consulting

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX