Data Engineer-Data Platforms-Azure

IBM

Fresher Pune Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and build long-term client relationships while collaborating globally. You'll partner with leading companies across industries, guiding their hybrid cloud and AI transformations. Leveraging IBM technology, Red Hat, and strategic partnerships, you'll drive significant change and client impact.

At IBM Consulting, curiosity is key to success. We encourage challenging the status quo, exploring novel ideas, and developing innovative solutions that yield tangible results. Our supportive culture fosters career growth and empathy, valuing your unique skills and experiences.

Responsibilities

As a Data Engineer focused on Data Platforms within Azure, you will develop, maintain, and advise on data engineering solutions across the Azure Cloud ecosystem. This involves designing, building, and operating robust batch and real-time data pipelines utilizing various Azure services.

Key responsibilities include: - Designing and constructing data pipelines using Azure services like Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. - Developing and managing the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining core Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.

Qualifications

Essential skills include proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub for designing, building, and operating data pipelines. Experience with Azure Data Platform components including ADLS2, Blob Storage, SQLDW, Synapse Analytics, Azure Functions, Azure Purview, and Cosmos DB is also vital.

Furthermore, you should have exposure to open-source technologies like Apache Airflow, dbt, Spark (Python/Scala), and Python programming. Demonstrable experience in developing and maintaining data engineering solutions within the Azure Cloud ecosystem, including designing, building, and operating batch and real-time data pipelines, is required. Familiarity with designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is also necessary.

Essential Skills

Azure CloudAzure Data FactoryAzure DatabricksAzure Synapse AnalyticsAzure FunctionsAzure Cosmos DBData PipelinesApache AirflowdbtSparkPythonScalaSQLData EngineeringADLS2Blob StorageSQLDWAzure PurviewReal-time Data

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryData Analytics
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX