Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies globally. As a Data Engineer, you will focus on developing and maintaining robust data engineering solutions within the Azure Cloud ecosystem. This role is ideal for a curious and innovative individual eager to drive meaningful change and accelerate client impact.

Our collaborative environment fosters continuous learning and career development, valuing your unique contributions. You'll leverage cutting-edge IBM technology and strategic partnerships to deliver real results. Embrace a culture of growth and empathy as you explore new ideas and challenge the status quo.

Responsibilities

Design, build, and operate sophisticated batch and real-time data pipelines utilizing key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Develop and manage the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. Implement and maintain essential Azure Data Platform components, including ADLS2, Blob Storage, Synapse Analytics with Spark and SQL, and Azure Functions with Python.

Apply proficiency in open-source technologies such as Apache Airflow and dbt, along with Spark/Python or Spark/Scala, to support advanced data engineering solutions. Ensure the seamless operation and maintenance of data engineering solutions for efficient data processing.

Qualifications

Proven experience in designing, building, and operating data engineering solutions within the Azure Cloud ecosystem, specifically focusing on batch and real-time data pipelines. Demonstrated expertise in Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub. Experience with Azure Data Platform components like ADLS2, Blob Storage, SQL DW, Synapse Analytics (Spark/SQL), Azure Functions (Python), Azure Purview, and Cosmos DB is essential.

Familiarity with open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is required. Experience in developing and maintaining the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB is also a key requirement for this role.

Essential Skills

Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksEvent HubADLS2Blob StorageSQL DWCosmos DBSparkPythonScalaApache AirflowdbtAzure FunctionsAzure PurviewData PipelinesData PlatformReal-time DataStructured Query Language

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryData Analytics, Information Technology & Services, Software Development
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX