Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and become a key player in shaping hybrid cloud and AI journeys for leading global companies. Embrace a culture of curiosity and innovation, where your contributions drive meaningful change. This role focuses on building and maintaining advanced data engineering solutions within the Azure cloud ecosystem, leveraging cutting-edge technologies to accelerate client impact.

As a Data Engineer, you will be instrumental in designing, developing, and optimizing robust data platforms. You will work collaboratively to create scalable and efficient data pipelines, ensuring seamless data processing for critical business operations. Your expertise will be vital in transforming how businesses leverage their data.

Responsibilities

Design, build, and operate robust batch and real-time data pipelines utilizing key Azure services like Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.

Develop and maintain the data layer on platforms such as Azure Synapse Analytics, SQL DW, and Cosmos DB.

Implement and manage core Azure Data Platform components including ADLS2, Blob Storage, and Azure Functions with Python.

Apply proficiency in open-source technologies such as Apache Airflow and dbt to enhance data engineering solutions.

Qualifications

Proven experience in designing, building, and operating batch and real-time data pipelines within the Azure Cloud ecosystem.

Demonstrated expertise in Azure services including Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and Event Hub.

Hands-on experience with Azure Data Platform components such as ADLS2, Blob Storage, SQLDW, Synapse Analytics (Spark and SQL), Azure Functions (Python), Azure Purview, and Cosmos DB.

Proficiency with open-source technologies like Apache Airflow and dbt, along with Spark using Python or Scala.

Essential Skills

Azure CloudAzure Data FactoryAzure Data PlatformAzure Cosmos DBAzure Synapse AnalyticsPythonSparkScalaApache AirflowdbtData EngineeringData PipelinesSQLStructured Query LanguageAzure FunctionsAzure PurviewADLS2Blob StorageSQLDW

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services
DepartmentData Science
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX