GCP Data Engineer
Infosys
Infosys
Join Infosys Limited as a Consultant in our Data & Analytics Unit, contributing to cutting-edge digital services. This role focuses on cloud-native data platforms and modern analytics ecosystems for global clients. You'll engage in large-scale enterprise data modernization programs, leveraging AI-driven solutions. Infosys offers continuous learning, certifications, and career growth within our data and analytics practice.
This position requires a strong foundation in GCP Data Engineering with expertise in scalable cloud data platforms. You will work with a variety of GCP services and big data technologies to build robust data solutions. A practical understanding of data modeling and modern data architectures is essential.
Design, develop, and optimize scalable GCP Data Engineering solutions and cloud-native data platforms. Build batch and real-time pipelines using BigQuery, Cloud Storage, Dataflow, Pub/Sub, Dataproc, Python, PySpark, and Databricks.
Implement high-throughput streaming solutions and handle high-volume TB/PB-scale data with a focus on performance and reliability. Develop complex SQL transformations, data models, and analytics-ready BigQuery datasets. Orchestrate pipelines using Cloud Composer/Airflow and implement CI/CD and IaC practices.
Ensure data quality, governance, security, monitoring, and production support. Collaborate with stakeholders and cross-functional teams in an Agile environment. Troubleshoot and optimize end-to-end data pipelines.
Possess strong hands-on GCP Data Engineering experience, including Google Cloud Storage, BigQuery, Dataflow, Dataproc, Pub/Sub, and Databricks. Expertise in batch and real-time streaming using Pub/Sub, Dataflow, and Spark Structured Streaming.
Demonstrate hands-on coding proficiency in Python, PySpark, and SQL, with experience in debugging and performance optimization. Experience building high-volume, low-latency ingestion and transformation pipelines with robust error handling.
Familiarity with Data Lake, Lakehouse architectures, and modern cloud data-platform designs. Practical data-modeling experience for analytics and reporting. Experience implementing CI/CD and Terraform for Infrastructure as Code is required.
Infosys
Information Technology & Services