Data Engineer-Data Platforms-Google

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and build impactful, long-term client relationships across the globe. You will collaborate with leading companies, guiding them through their hybrid cloud and AI transformations. Leveraging IBM's technology, Red Hat, and strategic partnerships, you will drive significant change and accelerate client success.

At IBM Consulting, curiosity is key to success. We encourage challenging the status quo, exploring new ideas, and innovating to deliver tangible results. Our culture fosters growth, empathy, and your long-term career development, valuing your unique contributions.

Responsibilities

As a Data Engineer specializing in Google's data platforms, you will be responsible for designing, building, and maintaining robust data engineering solutions within the Google Cloud ecosystem. This includes developing batch and real-time data pipelines, migrating data, and architecting data layers using a variety of Google services.

Key duties involve architecting and developing data pipelines using services like DataProc, DataFlow, PubSub, BigQuery, and Big Table. You will also develop data engineering solutions leveraging Google Cloud Storage, BigTable, and DataFlow with Apache Beam or Python. Efficiently managing data platforms through Google Cloud Scheduler and Cloud Composer (Airflow) is crucial, as is implementing effective data migration strategies and optimizing data layers with services such as BigQuery, Big Table, and Cloud Spanner.

Qualifications

We are seeking individuals with proven expertise in designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem. Essential skills include a deep understanding of Google services for batch and real-time data pipelines, data migration, and data layer design.

Candidates should have experience developing and managing data pipelines for Data Warehouses and Datalakes using services like DataProc, DataFlow, PubSub, BigQuery, and Big Table. Proficiency with Google Cloud Storage, BigTable, and DataFlow with Apache Beam or Python is required. Experience in scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow) is also necessary. Familiarity with open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala is highly valued, as is experience with data migration solutions using Google services.

Essential Skills

Google Cloud PlatformBigQueryDataflowPub/SubBigtableDataProcCloud ComposerApache AirflowSparkPythonScalaHadoopdbtApache BeamCloud StorageCloud SpannerCloud SQLAlloyDB

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
IndustryTechnology
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Technology

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX