Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and collaborate with leading companies worldwide to shape their hybrid cloud and AI strategies. Leverage robust IBM technology and Red Hat to drive significant change and accelerate client impact. We foster a culture of curiosity, innovation, and continuous growth, valuing your unique contributions.

As an IBM Consulting Data Engineer, you will focus on building and maintaining advanced data engineering solutions within the Azure Cloud ecosystem. This role involves designing, developing, and operating sophisticated batch and real-time data pipelines that are crucial for our clients' data initiatives.

Responsibilities

Key responsibilities include designing and constructing robust batch and real-time data pipelines utilizing a range of Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. You will develop and manage the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB, ensuring efficient data storage and retrieval.

Implement and maintain essential Azure Data Platform components, including ADLS2, Blob Storage, and Synapse Analytics (with Spark and SQL). You will also work with Azure Functions using Python, Azure Purview for data governance, and Cosmos DB. Applying proficiency in open-source technologies such as Apache Airflow, dbt, Spark (Python/Scala), will be integral to supporting these data engineering solutions.

Qualifications

We are seeking candidates with proven exposure to the Azure toolset, specifically Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub, for designing, building, and operating data pipelines. Experience in data engineering on the Azure Data Platform, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB is essential.

A strong understanding of open-source technologies like Apache Airflow, dbt, and Spark (Python/Scala) for data engineering solutions is required. Candidates should possess experience in developing and maintaining data engineering solutions on Azure Cloud, encompassing the design, build, and operation of both batch and real-time data pipelines. Prior experience in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is also a key requirement.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksEvent HubADLS2Blob StorageSQLDWSynapse AnalyticsSparkSQLAzure FunctionsPythonAzure PurviewCosmos DBApache AirflowdbtScalaAzure CloudData PlatformAnalytics

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryData Analytics
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX