Data Engineer-Data Platforms-Google

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. As a Data Engineer specializing in Google's data platforms, you will design, build, and maintain robust data engineering solutions within the Google Cloud ecosystem. This role is ideal for individuals driven by curiosity and a passion for creating innovative solutions that deliver tangible client impact.

Our culture fosters growth and empathy, prioritizing your long-term career development while valuing your unique contributions. You'll collaborate closely with clients and leverage IBM's technology and Red Hat's capabilities to drive meaningful change and accelerate client success.

Responsibilities

Design and develop sophisticated batch and real-time data pipelines for data warehouses and data lakes utilizing Google Cloud services such as DataProc, DataFlow, Pub/Sub, BigQuery, and BigTable.

Implement and maintain data engineering solutions using Google Cloud Storage, BigTable, BigQuery, DataProc with Spark/Hadoop, and DataFlow with Apache Beam or Python.

Manage and schedule data platform operations efficiently using Google Cloud Scheduler and Cloud Composer (Airflow).

Develop and execute seamless data migration strategies between various systems.

Optimize data layer design using services like BigQuery, BigTable, and Cloud Spanner for enhanced data storage and retrieval.

Qualifications

Demonstrated experience in designing, building, and maintaining data engineering solutions within the Google Cloud ecosystem, including services like DataProc, DataFlow, Pub/Sub, BigQuery, BigTable, Cloud Spanner, Cloud SQL, and AlloyDB.

Proven ability in developing and managing batch and real-time data pipelines for data warehouses and data lakes, leveraging Google services and open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala.

Proficiency in working with Google Cloud Storage, BigTable, BigQuery, DataProc with Spark/Hadoop, and Google DataFlow with Apache Beam or Python.

Familiarity with scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow).

Experience in data layer design with Google services like BigQuery, BigTable, and Cloud Spanner.

Exposure to implementing data migration solutions using Google services.

Essential Skills

Google Cloud PlatformData EngineeringData PipelinesBigQueryDataFlowPub/SubBigTableCloud ComposerApache AirflowSparkPythonHadoopScalaData MigrationData WarehousingData Lakes

Good to Have

dbtCloud SpannerCloud SQLAlloyDBApache Beam

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
IndustryInformation Technology & Services, Management Consulting
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX