Data Engineer-Data Platforms-Google

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting to build lasting client relationships and drive transformation in hybrid cloud and AI. You'll collaborate with leading companies, leveraging IBM technology, Red Hat, and robust tools to create innovative solutions. Curiosity and a drive for results are key. We foster a culture of growth, empathy, and career development, valuing your unique contributions.

Responsibilities

As a Data Engineer on Google's data platforms, you will architect, develop, and maintain robust data solutions within the Google Cloud ecosystem. This involves creating efficient batch and real-time data pipelines, facilitating data migration, and designing optimized data layers. You will utilize services like DataProc, DataFlow, PubSub, BigQuery, and BigTable for these tasks.

Qualifications

This role requires hands-on experience with Google Cloud services such as Google Cloud Storage, BigTable, BigQuery, DataProc (with Spark/Hadoop), and DataFlow (with Apache Beam/Python). Proficiency in developing and managing data pipelines for data warehouses and data lakes using open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala is essential. Experience with data migration solutions and optimizing data layers using BigQuery, BigTable, and Cloud Spanner is also crucial. Familiarity with Cloud Scheduler and Cloud Composer (Airflow) for platform management is expected.

Essential Skills

Google CloudData EngineeringData PipelinesBigQueryDataFlowPubSubBigTableSparkPythonHadoopApache BeamCloud SchedulerCloud ComposerAirflowData MigrationCloud SpannerCloudSQLAlloyDBdbtScalaData StorageProgramming LanguageSchedulingManagement

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
IndustryData Analytics
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX