Data Engineer-Data Platforms-Google

IBM

17–20 yrs Bengaluru Full Time Work from office
IBM logo
Posted : yesterday
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. Within our IBM Consulting FutureNow Centers, you'll leverage deep technical and industry expertise to drive innovation for public and private sector clients. This role focuses on designing, building, and maintaining robust data engineering solutions on Google's Cloud Platform, playing a key part in accelerating client impact through cutting-edge technology.

Responsibilities

As a Data Engineer specializing in Google's data platforms, your core function will be to architect and implement advanced data engineering solutions. This includes developing batch and real-time data pipelines for data warehouses and data lakes using services like Dataproc, Dataflow, Pub/Sub, BigQuery, and Bigtable. You will also be responsible for managing data platforms through scheduling tools, implementing efficient data migration strategies, and optimizing data layers for enhanced storage and retrieval.

Qualifications

A strong foundation in Google's Cloud ecosystem is essential, with proven experience in designing and building data engineering solutions. Expertise in developing and managing both batch and real-time data pipelines for data warehouses and data lakes is required. Proficiency with Google Cloud services such as BigQuery, Pub/Sub, Dataproc, Dataflow, and Bigtable, along with familiarity with open-source technologies like Apache Airflow, Spark, and Python, will be critical for success in this role.

Essential Skills

Google Cloud PlatformData PipelinesData WarehousingData LakeBatch ProcessingReal-time ProcessingData MigrationData Layer DesignBigQueryPub/SubBigtableDataprocDataflowCloud StorageCloud SchedulerCloud ComposerApache AirflowApache BeamPythonSparkHadoopCloud SpannerCloud SQLAlloyDBdbt

Good to Have

Scala

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
IndustryManagement Consulting
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

IBM logo

IBM

Management Consulting

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX