Data Engineer-Data Platforms-Azure

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and become a key player in shaping hybrid cloud and AI journeys for leading companies worldwide. You'll collaborate closely with clients, leveraging robust IBM technology and Red Hat to drive meaningful change. As a Data Engineer specializing in Data Platforms on Azure, you will architect, develop, and maintain cutting-edge data engineering solutions within the Azure Cloud ecosystem.

Our culture fosters curiosity and innovation, encouraging you to challenge the status quo and create solutions that deliver tangible results. We are committed to your long-term career development, valuing your unique skills and experiences in a supportive and empathetic environment.

Responsibilities

Your primary role will involve designing, building, and operating robust batch and real-time data pipelines using a variety of Azure services. This includes developing the data layer on platforms like Azure Synapse Analytics, SQL DW, and Cosmos DB. You will also be responsible for implementing and maintaining critical Azure Data Platform components, ensuring seamless data processing and operational efficiency. Leveraging open-source technologies like Apache Airflow and dbt alongside Spark/Python or Spark/Scala will be integral to your success.

Qualifications

We are looking for individuals with demonstrated experience in data engineering on the Azure Cloud. Proficiency with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub is essential for building and operating data pipelines. Experience with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics (with Spark and SQL), Azure Functions (with Python), Azure Purview, and Cosmos DB is required. A strong understanding of open-source technologies like Apache Airflow and dbt, coupled with Spark/Python or Spark/Scala, will be key to developing innovative data solutions.

Essential Skills

Azure CloudAzure Data FactoryAzure DataBricksAzure Synapse AnalyticsPythonSparkSQLData PipelinesApache AirflowdbtScala

Good to Have

Azure Cosmos DBAzure FunctionsAzure PurviewADLS2Blob StorageSQL DW

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Azure
IndustryInformation Technology & Services, Software Development
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Azure at IBM | SkillMX | SkillMX