Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading global companies. We foster a collaborative environment where curiosity drives innovation and leads to impactful solutions. Your career development is our priority, and we value your unique contributions.

As a Data Engineer focused on Azure Data Platforms, you'll be instrumental in designing, developing, and maintaining robust data engineering solutions within the Azure Cloud ecosystem. This role involves building and managing both batch and real-time data pipelines, leveraging a variety of cutting-edge Azure services.

Responsibilities

Key responsibilities include designing and constructing data pipelines using Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. You will also develop and maintain the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB. Implementation and upkeep of Azure Data Platform components such as ADLS2, Blob Storage, and Azure Purview are crucial.

Additionally, you will apply expertise in open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala. Ensuring the smooth operation and maintenance of data engineering solutions for seamless data processing is paramount.

Qualifications

We are seeking individuals with proven experience in data engineering on the Azure Cloud, including proficiency with Azure services for designing and operating batch and real-time data pipelines. Familiarity with Azure Data Platform components is essential.

Experience with open-source technologies such as Apache Airflow and dbt, along with Spark/Python or Spark/Scala, is highly desirable. A strong understanding of designing, building, and operating data layers in Azure Synapse Analytics, SQL DW, and Cosmos DB will be key to success in this role.

Essential Skills

PythonScalaSparkSQLAzure Data FactoryAzure DatabricksAzure Synapse AnalyticsAzure Cosmos DBAzure FunctionsApache Airflowdbt

Good to Have

StorageAnalytics

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Science
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX