Big Data Lead
Hexaware
Hexaware
Lead the development and design of a highly scalable and extensible Big Data platform. This role is crucial for enabling the collection, storage, modeling, and analysis of massive datasets from diverse sources.
You will leverage your expertise in Snowflake, Spark, and Python to create robust data solutions. A strong understanding of ETL and data warehousing concepts is essential for success in this position.
Develop and architect advanced Big Data applications utilizing Snowflake, SnowSQL, and Snowpipe for efficient ETL and data storage. Design and implement scalable Big Data solutions using Spark and Python, focusing on data processing and analysis. Manage and optimize data pipelines with Airflow and Kubernetes. Ensure high-quality code through adherence to SQL programming best practices and data warehousing principles.
Requires a Bachelor's degree in Computer Science or equivalent training. A minimum of 6 years of relevant experience is essential, with a proven track record in developing applications using Snowflake, SnowSQL, and Snowpipe. Proficiency in Spark/Python for Big Data application development and core Python for data processing is mandatory. Experience with Airflow, Kubernetes, SQL programming, and ETL Data Warehousing concepts is highly valued. Familiarity with CI/CD processes, Git, and Jenkins is also expected.
Hexaware Technologies
IT Consulting