GCP Python Developer
Persistent
Persistent
Join a leading AI-led digital engineering partner in Hyderabad as a skilled Data Engineer. This role focuses on building and optimizing data ingestion pipelines and feature stores, ensuring data quality, and supporting both real-time and batch processing needs. You'll integrate diverse data sources and play a key part in advancing our clients' data strategies.
Our company thrives on innovation and client success, working with industry leaders across finance and healthcare. We offer a dynamic environment with opportunities for growth, continuous learning, and exposure to cutting-edge technologies. We are committed to a values-driven, people-centric, and inclusive work environment, offering competitive benefits and flexible work arrangements.
Design and implement robust data ingestion pipelines for seamless data flow. Develop and maintain production feature pipelines and feature stores for efficient data access. Integrate fraud data sources and external feeds to enrich data capabilities. Implement comprehensive data quality and validation controls to ensure data integrity. Support real-time and batch processing requirements to meet dynamic business needs. Optimize pipeline performance and reliability for enhanced operational efficiency. Enable data access and governance controls to maintain compliance and security standards. Support feature engineering workloads to drive data-driven decision-making processes. Maintain essential metadata and lineage information for superior data management. Deliver thorough operational support documentation for team and stakeholder assistance.
Proficiency in Python for data engineering tasks is mandatory. Demonstrated experience with ETL processes and data pipeline development. Strong knowledge of GCP Data Services and Big Data Processing frameworks is essential. Expertise in data quality management and validation techniques is required. Familiarity with Integration & APIs and data modeling concepts is expected. Experience with Dataiku or similar data science platforms is preferred. An understanding of Agentic AI principles is a plus. Basic SQL knowledge for data manipulation and querying is beneficial.
Persistent Systems
IT