Data Engineer-Data Platforms-Google

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Advance your career in data platforms with a role focused on Google Cloud. This position involves shaping hybrid cloud and AI journeys for leading companies, driving innovation, and delivering impactful solutions.

Join a collaborative environment that fosters continuous learning and celebrates unique contributions. Your role as a Data Engineer will be central to designing, building, and maintaining robust data engineering solutions within Google's dynamic cloud ecosystem.

Responsibilities

Key responsibilities include architecting and developing both batch and real-time data pipelines utilizing Google services like DataProc, DataFlow, PubSub, BigQuery, and Big Table. You will also be responsible for creating and managing data engineering solutions, ensuring efficient data platform operations through scheduling tools, and implementing effective data migration strategies.

Further duties involve optimizing the data layer for efficient storage and retrieval, leveraging Google Cloud Storage, BigTable, BigQuery DataProc with Spark/Hadoop, and Google DataFlow with Apache Beam or Python. Experience with Apache Airflow, dbt, Spark/Python, or Spark/Scala is essential for managing data pipelines.

Qualifications

A strong foundation in Google's data platform ecosystem is required, with demonstrated experience in designing, building, and maintaining data engineering solutions. Proficiency with Google Cloud Storage, BigTable, BigQuery DataProc (Spark/Hadoop), and Google DataFlow (Apache Beam/Python) is crucial.

Candidates should possess experience in developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google services and open-source technologies. Familiarity with Cloud Composer (Airflow) for platform management and experience in data migration solutions are also key requirements. Knowledge of data layer design using BigQuery, Big Table, and Cloud Spanner is expected.

Essential Skills

Google CloudData PipelinesBigQueryDataFlowPubSubBigTableCloud ComposerApache AirflowSparkPythonHadoopData MigrationData StorageData EngineeringScheduling

Good to Have

ScaladbtApache BeamCloud SpannerCloudSQLAlloyDB

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-Google
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

IT Consulting

Data Engineer-Data Platforms-Google at IBM | SkillMX | SkillMX