Data Engineer-Data Platforms-Google
IBM
IBM
Join IBM Consulting and shape the future of hybrid cloud and AI for leading companies worldwide. As a Data Engineer specializing in Google's data platforms, you will design, build, and maintain robust data engineering solutions within the Google Cloud ecosystem. This role is ideal for individuals driven by curiosity and a passion for creating innovative solutions that deliver tangible client impact.
Our culture fosters growth and empathy, prioritizing your long-term career development while valuing your unique contributions. You'll collaborate closely with clients and leverage IBM's technology and Red Hat's capabilities to drive meaningful change and accelerate client success.
Design and develop sophisticated batch and real-time data pipelines for data warehouses and data lakes utilizing Google Cloud services such as DataProc, DataFlow, Pub/Sub, BigQuery, and BigTable.
Implement and maintain data engineering solutions using Google Cloud Storage, BigTable, BigQuery, DataProc with Spark/Hadoop, and DataFlow with Apache Beam or Python.
Manage and schedule data platform operations efficiently using Google Cloud Scheduler and Cloud Composer (Airflow).
Develop and execute seamless data migration strategies between various systems.
Optimize data layer design using services like BigQuery, BigTable, and Cloud Spanner for enhanced data storage and retrieval.
Demonstrated experience in designing, building, and maintaining data engineering solutions within the Google Cloud ecosystem, including services like DataProc, DataFlow, Pub/Sub, BigQuery, BigTable, Cloud Spanner, Cloud SQL, and AlloyDB.
Proven ability in developing and managing batch and real-time data pipelines for data warehouses and data lakes, leveraging Google services and open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala.
Proficiency in working with Google Cloud Storage, BigTable, BigQuery, DataProc with Spark/Hadoop, and Google DataFlow with Apache Beam or Python.
Familiarity with scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow).
Experience in data layer design with Google services like BigQuery, BigTable, and Cloud Spanner.
Exposure to implementing data migration solutions using Google services.
IBM
Information Technology & Services