Seeking an accomplished Staff Engineer specializing in Data Engineering with a strong background in finance. This role demands extensive PySpark expertise for advanced big data processing and analytics, along with a deep understanding of Python for data manipulation and machine learning applications. We are looking for individuals adept at optimizing data pipelines and ensuring data integrity within complex systems.

Key responsibilities include designing and implementing robust data warehousing solutions and ETL processes, integrating diverse data sources, and developing scalable data models. You will be crucial in optimizing database architectures for peak performance and ensuring the highest standards of data quality. Collaboration on cloud-based data solutions using AWS or Google Cloud services will be a significant part of this role.

Candidates must possess 5-10 years of relevant experience, with a proven track record in PySpark and Python programming. A solid grasp of data warehousing principles, ETL methodologies, and cloud platform utilization (AWS/GCP) is essential. Experience in data modeling, ensuring data integrity, and optimizing database performance is expected. A Master of Technology (M.Tech) in Data Science and a Bachelor of Technology (B.Tech) in Computer Science and Engineering are required.