GCP Data Lead (IN)
HCLTech
HCLTech
Seeking a seasoned Senior Data Engineer with profound expertise in Google Cloud Platform (GCP) to architect, construct, and refine robust data ecosystems. This pivotal role is instrumental in fostering data-driven decision-making through the development of high-performance data pipelines, ensuring data integrity, and supporting enterprise-wide analytics. Collaboration with diverse teams, including data scientists, analysts, and business units, is essential to translate business needs into sophisticated data solutions.
Your contributions will drive the design and implementation of scalable data architectures, optimize data storage and query performance, and uphold stringent data quality, governance, and security standards. You will also provide technical leadership and mentorship, driving best practices and continuous improvement within the data engineering domain.
Design, build, and maintain scalable, high-performance data pipelines on GCP. Develop and manage modern data architectures for both batch and real-time processing. Implement reusable frameworks for standardized data ingestion and transformation. Leverage GCP services including Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Optimize data integration workflows for efficiency and scalability. Enhance data storage and query performance. Ensure cost optimization, performance tuning, and scalable data design. Implement robust data quality checks, validation, and monitoring. Uphold data governance, security, and compliance standards. Partner with stakeholders to understand requirements and deliver actionable insights. Translate business problems into technical data solutions. Monitor, troubleshoot, and ensure high availability of data pipelines. Implement logging, alerting, and observability frameworks. Provide technical leadership and mentorship. Drive best practices in coding, architecture, and deployment. Stay updated with GCP innovations and data engineering best practices. Proactively recommend system improvements.
Possess strong hands-on experience with GCP data services such as Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Demonstrate expertise in ETL/ELT processes, data warehousing, and data modeling. Proficient in programming languages like Python and SQL. Exhibit strong analytical and problem-solving skills with meticulous attention to detail and a commitment to data accuracy. Ability to work autonomously and collaboratively within cross-functional teams is key, complemented by excellent communication and stakeholder management abilities. Candidates with GCP Professional Data Engineer or Cloud Architect certifications are highly encouraged. Prior experience with Big Data technologies (Hadoop, Spark) and exposure to Machine Learning/AI workflows or DevOps practices are considered advantageous.
HCLTech
IT Consulting