Data Engineer-Data Platforms-Google
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. Within our IBM Consulting FutureNow Centers, you'll leverage deep technical and industry expertise to drive innovation for public and private sector clients. This role focuses on designing, building, and maintaining robust data engineering solutions on Google's Cloud Platform, playing a key part in accelerating client impact through cutting-edge technology.
As a Data Engineer specializing in Google's data platforms, your core function will be to architect and implement advanced data engineering solutions. This includes developing batch and real-time data pipelines for data warehouses and data lakes using services like Dataproc, Dataflow, Pub/Sub, BigQuery, and Bigtable. You will also be responsible for managing data platforms through scheduling tools, implementing efficient data migration strategies, and optimizing data layers for enhanced storage and retrieval.
A strong foundation in Google's Cloud ecosystem is essential, with proven experience in designing and building data engineering solutions. Expertise in developing and managing both batch and real-time data pipelines for data warehouses and data lakes is required. Proficiency with Google Cloud services such as BigQuery, Pub/Sub, Dataproc, Dataflow, and Bigtable, along with familiarity with open-source technologies like Apache Airflow, Spark, and Python, will be critical for success in this role.
IBM
Management Consulting