Data Engineer-Data Platforms-Google
IBM
IBM
Join a dynamic team focused on building robust data engineering solutions within Google's powerful cloud ecosystem. This role is central to shaping hybrid cloud and AI journeys for leading companies, driving innovation and delivering significant client impact.
We foster a culture of curiosity and continuous growth, encouraging exploration of new ideas to create groundbreaking solutions. Your unique skills and experiences are valued, supporting your long-term career development.
Design and implement sophisticated batch and real-time data pipelines for data warehouses and data lakes. Utilize Google Cloud services like DataProc, DataFlow, PubSub, BigQuery, and BigTable to build and maintain scalable data engineering solutions.
Manage data platform operations through Google Cloud Scheduler and Cloud Composer (Airflow), ensuring seamless execution. Develop and execute data migration strategies and optimize data layers using services such as BigQuery and Cloud Spanner.
Demonstrate expertise in designing, building, and maintaining data engineering solutions on Google Cloud, leveraging services like DataProc, DataFlow, PubSub, BigQuery, and BigTable. Experience in developing and managing batch/real-time data pipelines using technologies such as Apache Airflow, dbt, Spark, and Python is essential.
Proficiency in Google Cloud Storage, BigTable, and DataFlow is required. Familiarity with data platform management and data layer design principles is expected. Experience with data migration solutions and open-source technologies is a plus.
IBM
IT Consulting