Data Engineer-Data Platforms-Google
IBM
IBM
Join IBM Consulting to build lasting client relationships and drive transformation in hybrid cloud and AI. You'll collaborate with leading companies, leveraging IBM technology, Red Hat, and robust tools to create innovative solutions. Curiosity and a drive for results are key. We foster a culture of growth, empathy, and career development, valuing your unique contributions.
As a Data Engineer on Google's data platforms, you will architect, develop, and maintain robust data solutions within the Google Cloud ecosystem. This involves creating efficient batch and real-time data pipelines, facilitating data migration, and designing optimized data layers. You will utilize services like DataProc, DataFlow, PubSub, BigQuery, and BigTable for these tasks.
This role requires hands-on experience with Google Cloud services such as Google Cloud Storage, BigTable, BigQuery, DataProc (with Spark/Hadoop), and DataFlow (with Apache Beam/Python). Proficiency in developing and managing data pipelines for data warehouses and data lakes using open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala is essential. Experience with data migration solutions and optimizing data layers using BigQuery, BigTable, and Cloud Spanner is also crucial. Familiarity with Cloud Scheduler and Cloud Composer (Airflow) for platform management is expected.
IBM
Data Analytics