Data Engineer-Data Platforms-Google

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and build lasting client relationships while collaborating globally. You'll empower leading companies across various industries to advance their hybrid cloud and AI strategies. Leveraging robust IBM technology, Red Hat, and support from strategic partners, you'll possess the tools to drive significant transformations and accelerate client success.

At IBM Consulting, curiosity is key to achievement. We encourage challenging the status quo, exploring novel concepts, and developing innovative solutions that deliver tangible outcomes. Our growth-oriented and empathetic culture prioritizes your long-term career advancement while celebrating your unique talents and experiences.

Responsibilities

As a Data Engineer specializing in Google's data platforms, your role involves designing, building, and maintaining robust data engineering solutions within the Google Cloud ecosystem.

Key responsibilities include: - Developing batch and real-time data pipelines for Data Warehouses and Data Lakes using Google services like DataProc, DataFlow, Pub/Sub, BigQuery, and BigTable. - Constructing and managing data engineering solutions with Google Cloud Storage, BigTable, BigQuery DataProc (Spark/Hadoop), and Google DataFlow (Apache Beam/Python). - Scheduling and overseeing data platform operations via Google Cloud Scheduler and Cloud Composer (Airflow) for efficient pipeline execution. - Implementing comprehensive data migration solutions using Google services for seamless system data transfers.

Qualifications

This position requires expertise in Google's data platform services, including batch and real-time data pipelines, data migration, and data layer design.

Essential qualifications include: - Experience in designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, utilizing services like DataProc, DataFlow, Pub/Sub, BigQuery, BigTable, Cloud Spanner, CloudSQL, and AlloyDB. - Proven ability to develop and manage batch and real-time data pipelines for Data Warehouses and Data Lakes using Google services and open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala. - Proficiency with Google Cloud Storage, BigTable, BigQuery DataProc (Spark/Hadoop), and Google DataFlow (Apache Beam/Python). - Understanding of data platform management, including scheduling and operations using Google Cloud Scheduler and Cloud Composer (Airflow). - Experience in designing and optimizing the data layer with Google services like BigQuery, BigTable, and Cloud Spanner for efficient data storage and retrieval.

Essential Skills

PythonScalaSparkHadoopGoogle Cloud PlatformBigQueryDataFlowPub/SubBigTableCloud SpannerCloud SQLAlloyDBData PipelineData WarehouseData LakeData MigrationApache AirflowdbtApache BeamCloud SchedulerCloud ComposerCloud Storage

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
IndustryTechnology
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Technology

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX