Big Data Lead

Hexaware

6+ yrs India Full Time Hybrid (office + remote)
Hexaware logo
Posted : today
Actively hiring

Job description

Lead the development and design of a highly scalable and extensible Big Data platform. This role is crucial for enabling the collection, storage, modeling, and analysis of massive datasets from diverse sources.

You will leverage your expertise in Snowflake, Spark, and Python to create robust data solutions. A strong understanding of ETL and data warehousing concepts is essential for success in this position.

Responsibilities

Develop and architect advanced Big Data applications utilizing Snowflake, SnowSQL, and Snowpipe for efficient ETL and data storage. Design and implement scalable Big Data solutions using Spark and Python, focusing on data processing and analysis. Manage and optimize data pipelines with Airflow and Kubernetes. Ensure high-quality code through adherence to SQL programming best practices and data warehousing principles.

Qualifications

Requires a Bachelor's degree in Computer Science or equivalent training. A minimum of 6 years of relevant experience is essential, with a proven track record in developing applications using Snowflake, SnowSQL, and Snowpipe. Proficiency in Spark/Python for Big Data application development and core Python for data processing is mandatory. Experience with Airflow, Kubernetes, SQL programming, and ETL Data Warehousing concepts is highly valued. Familiarity with CI/CD processes, Git, and Jenkins is also expected.

Essential Skills

SnowflakeSnowSQLSnowpipeETLSparkPythonAirflowKubernetesSQLData WarehousingCI/CDGitJenkins

Highlights

  • Actively hiring

More Details

RoleBig Data Lead
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Hexaware Technologies logo

Hexaware Technologies

IT Consulting

Big Data Lead at Hexaware | SkillMX | SkillMX