Data Engineer-Data Platforms-Google

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting to shape hybrid cloud and AI journeys for leading companies globally. Collaborate closely with clients and leverage IBM technology, Red Hat, and strategic partner support to drive impactful change.

Embrace a culture of curiosity and innovation where challenging the norm and exploring new ideas are encouraged. We focus on your long-term career development, valuing your unique skills and fostering growth and empathy.

Responsibilities

As a Data Engineer focused on Google's data platforms, you will design, build, and maintain robust data engineering solutions. This involves creating batch and real-time data pipelines, managing data migration, and optimizing data layers within the Google Cloud ecosystem.

Key responsibilities include designing and developing data pipelines using services like DataProc, DataFlow, Pub/Sub, BigQuery, and BigTable. You will also build and maintain data engineering solutions with Google Cloud Storage, BigTable, and DataFlow, leveraging Spark/Hadoop or Apache Beam/Python. Ensuring efficient data pipeline operations through scheduling with Google Cloud Scheduler and Cloud Composer (Airflow) is crucial. You'll also implement data migration solutions and optimize data layers using services like BigQuery, BigTable, and Cloud Spanner.

Qualifications

This role requires extensive experience with Google's data platform ecosystem, including designing, building, and maintaining data engineering solutions. Proficiency in developing and managing batch and real-time data pipelines for Data Warehouses and Datelakes using Google services and open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is essential.

You should possess strong experience with Google Cloud Storage, BigTable, BigQuery DataProc with Spark/Hadoop, and Google DataFlow with Apache Beam or Python. Familiarity with scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow) is required. Experience in data layer design using BigQuery, BigTable, and Cloud Spanner for efficient storage and retrieval, along with implementing data migration solutions, is also expected.

Essential Skills

Google CloudData EngineeringData PipelinesBigQueryDataFlowPub/SubBigTableCloud StorageSparkPythonApache AirflowHadoopScaladbtApache Beam

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

IT Consulting

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX