Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and contribute to transformative client journeys in hybrid cloud and AI. We foster a culture of curiosity and innovation, empowering you to challenge norms and deliver impactful solutions. Your career development is our priority, with a focus on your long-term growth and the value of your unique skills.

Responsibilities

As a Data Engineer specializing in Azure Data Platforms, you will architect, build, and maintain robust data engineering solutions. This includes designing and operating batch and real-time data pipelines using key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. You will also develop and manage the data layer within Azure Synapse Analytics, SQL DW, and Cosmos DB, ensuring the seamless flow of data.

Your role involves implementing and maintaining critical Azure Data Platform components such as ADLS2, Blob Storage, and Azure Functions. You will leverage open-source technologies like Apache Airflow and dbt, alongside Spark with Python or Scala, to enhance our data engineering capabilities. Ensuring the continuous operation and maintenance of these solutions is paramount to our success.

Qualifications

We are seeking individuals with demonstrated experience in data engineering on the Azure Cloud ecosystem. Essential skills include proficiency in designing, building, and operating batch and real-time data pipelines using Azure services. You should possess hands-on experience with Azure Data Platform components, including ADLS2, Blob Storage, Synapse Analytics (Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.

Familiarity with open-source technologies such as Apache Airflow and dbt, along with Spark using Python or Scala, is highly valued. A solid understanding of developing and maintaining the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is crucial for this role. This position is based in Bangalore, India, with a hybrid work arrangement.

Essential Skills

PythonSparkScalaAzure Data EngineeringData PipelinesApache AirflowAzure CloudAzure Data FactoryData PlatformDatabricksAzure Cosmos DBAzure Synapse AnalyticsReal-time DataAzure Functions

Good to Have

Structured Query LanguageSQL DWBlob StorageAzure Purviewdbt

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Science
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX