Snowflake Data Engineer

Persistent

5–10 yrs Pune Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join our dynamic team as a Snowflake Data Engineer, where you will be instrumental in crafting and enhancing cutting-edge cloud-based data platforms.

This role is pivotal for powering healthcare analytics, reporting, and AI-driven initiatives. You will engage with extensive healthcare datasets, leveraging Snowflake, Azure, Databricks, PySpark, and contemporary data engineering methodologies to build robust, scalable, and secure data solutions.

Embrace the opportunity to contribute to advanced analytics, real-time data processing, automation, and next-generation AI/GenAI projects.

Responsibilities

Design, develop, and maintain scalable data solutions using Snowflake, Azure Databricks, PySpark, Python, and SQL. Build and optimize enterprise-grade ETL/ELT pipelines for diverse healthcare data. Develop data ingestion frameworks utilizing Azure Data Services, Snowflake, Kafka, and Airflow.

Implement scalable data models and datasets for reporting and analytics. Enable real-time and event-driven data processing through Kafka and streaming technologies. Develop and maintain cloud-native data platforms on Azure, Databricks, and Snowflake.

Support AI/ML and Generative AI use cases, including LLM applications and RAG architectures. Implement CI/CD pipelines and DevOps best practices with GitHub Actions and Terraform. Collaborate with stakeholders to define requirements and data solutions. Ensure data quality, lineage, governance, and traceability.

Troubleshoot, optimize performance, and provide production support. Develop dashboards and reports for actionable business insights. Maintain platform security, compliance, and operational excellence. Conduct code and design reviews, and mentor junior engineers. Drive innovation through automation and AI-assisted engineering.

Qualifications

A minimum of 5 to 10 years of hands-on experience in Data Engineering and Data Warehouse development is essential.

Demonstrate strong expertise in Snowflake, Azure Databricks, Spark (PySpark), Python, SQL, and modern cloud data platforms. Experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure Functions, Key Vault, and Azure DevOps is required.

Possess a solid understanding of ETL/ELT frameworks, data integration patterns, and large-scale data processing architectures. Proficiency in designing and implementing data solutions with Snowflake, Databricks, Kafka, and Spark is crucial. Advanced SQL skills, including query optimization and performance tuning, are necessary.

Hands-on experience with Kafka, event-driven architectures, and streaming data processing is expected. A strong grasp of data modeling, dimensional modeling, and data warehousing concepts is vital. Experience building production-grade data platforms in cloud environments is beneficial.

Familiarity with Docker, Kubernetes, Infrastructure as Code, and automation frameworks is a plus. Experience with GitHub, GitHub Actions, CI/CD pipelines, Terraform, and DevOps methodologies is important. Practical experience supporting AI/ML initiatives and exposure to Generative AI technologies like LLMs and RAG are highly desirable.

Experience with healthcare datasets (claims, pharmacy, provider, member, eligibility) and a strong understanding of data governance, privacy, and security best practices are required. Familiarity with Agile methodologies, Scrum, Rally, and ServiceNow is also noted.

Excellent problem-solving, stakeholder management, analytical thinking, and communication skills are fundamental for this role.

Essential Skills

SnowflakeAzure DatabricksPySparkPythonSQLAzure Data ServicesKafkaAirflowAzure Data FactoryAzure Data Lake StorageAzure FunctionsKey VaultAzure DevOpsDockerKubernetesTerraformGitHub ActionsGenerative AILLMRAG

Good to Have

DatabricksSpark

Highlights

  • Actively hiring

More Details

RoleSnowflake Data Engineer
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Snowflake Data Engineer at Persistent | SkillMX | SkillMX