Data Engineer-Data Platforms-Google

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Shape your career in IBM Consulting by fostering long-term client relationships and collaborating globally. You will empower leading companies across diverse industries to advance their hybrid cloud and AI strategies. Leverage robust IBM technology, Red Hat, and strategic partner support to drive significant change and accelerate client impact.

At IBM Consulting, curiosity is key to success. We encourage challenging the status quo, exploring novel ideas, and developing innovative solutions that deliver tangible results. Our growth-focused and empathetic culture prioritizes your long-term career development while celebrating your unique contributions.

Responsibilities

As a Data Engineer focused on Google's data platforms, you will architect, construct, and maintain sophisticated data engineering solutions within Google's Cloud ecosystem. This involves leveraging various Google services for both batch and real-time data pipelines, facilitating data migration, and designing robust data layers.

Key responsibilities include designing and developing data pipelines for Data Warehouses and Datalakes using services like DataProc, DataFlow, PubSub, BigQuery, and BigTable. You will also build and manage data engineering solutions using Google Cloud Storage, BigTable, BigQuery DataProc with Spark/Hadoop, and Google DataFlow with Apache Beam or Python. Furthermore, you'll schedule and manage data platforms via Google Cloud Scheduler and Cloud Composer (Airflow), implement data migration solutions, and optimize data layers using services such as BigQuery, BigTable, and Cloud Spanner.

Qualifications

This role demands extensive experience in designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, encompassing services like Google DataProc, DataFlow, PubSub, BigQuery, BigTable, Cloud Spanner, CloudSQL, and AlloyDB. Proven expertise in developing and managing batch and real-time data pipelines for Data Warehouses and Datalakes using Google services and open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is essential.

Proficiency with Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, and Google DataFlow with Apache Beam or Python is required. Familiarity with scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow) for efficient operations is expected. Experience in data layer design with services like BigQuery, BigTable, and Cloud Spanner, along with implementing data migration solutions, is crucial. Familiarity with open-source technologies is a plus.

Essential Skills

PythonScalaSparkHadoopGoogle CloudBigQueryDataFlowPubSubBigTableData StorageData EngineeringData PipelinesApache AirflowData PlatformOpen SourceApache BeamData MigrationCloud ComposerdbtCloud SpannerCloudSQLAlloyDB

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
IndustryInformation Technology & Services, Data Analytics
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX