Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Advance your career in IBM Consulting, where we foster enduring client relationships and global collaboration. You'll partner with industry leaders to guide their hybrid cloud and AI transformations. Supported by our strategic alliances, robust IBM technology, and Red Hat, you'll be equipped to drive significant change and accelerate client impact.

At IBM Consulting, curiosity is key to success. We encourage challenging the status quo, exploring novel ideas, and crafting innovative solutions that yield tangible results. Our growth-oriented, empathetic culture prioritizes your long-term career development while celebrating your unique skills and experiences.

Responsibilities

As a Data Engineer focused on Azure Data Platforms, you will be instrumental in advising on, developing, and maintaining data engineering solutions within the Azure Cloud ecosystem.

Key responsibilities include:

- Designing and building robust batch and real-time data pipelines using core Azure services like Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. - Developing and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Implementing and maintaining critical Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (with Python), Azure Purview, and Cosmos DB. - Leveraging open-source technologies such as Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance data engineering solutions. - Ensuring the seamless operation and maintenance of data engineering solutions for efficient batch and real-time data processing.

Qualifications

We are seeking individuals with proven experience in developing and maintaining data engineering solutions within the Azure Cloud. A strong understanding of Azure services is essential.

Essential qualifications include:

- Proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub for designing, building, and operating batch and real-time data pipelines. - Hands-on experience with Azure Data Platform components like ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB. - Familiarity with open-source technologies including Apache Airflow, dbt, and Spark (Python/Scala). - Expertise in designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. - Demonstrated ability to ensure seamless batch and real-time data processing through effective operation and maintenance of data engineering solutions.

Essential Skills

PythonSparkAzureData EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksOpen SourceAzure Cosmos DBAzure Synapse AnalyticsReal-time DataAzure Functions

Good to Have

Structured Query LanguageScala Programming LanguageStorage

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryIT Services and IT Consulting
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

IT Services and IT Consulting

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX