Sr. Developer
Cognizant
Cognizant
We are seeking a highly skilled Senior Developer with 8 to 12 years of experience to join our dynamic technology and engineering team. This role focuses on developing and optimizing robust data solutions, leveraging expertise in Delta Sharing, Databricks Unity Catalog Administration, and related technologies. The position operates within a hybrid work model during day shifts, contributing to our mission of enhancing data management processes and ensuring efficient data flow for risk management strategies.
- Architect and refine data solutions using Delta Sharing and Databricks Unity Catalog Administration to boost data accessibility and security. - Implement and oversee Databricks CLI and Delta Live Pipelines for streamlined data processing. - Employ Structured Streaming for real-time data analysis, enhancing decision-making. - Apply risk management principles to safeguard data integrity and ensure compliance. - Integrate Apache Airflow for orchestrating complex data workflows. - Utilize Amazon S3 and Amazon Redshift for scalable data storage and retrieval. - Develop Python scripts for automating data processing tasks. - Employ Databricks SQL and Databricks Delta Lake for advanced data querying and storage. - Design and deploy Databricks Workflows to automate and manage data pipelines. - Build PySpark applications for processing large datasets. - Collaborate with cross-functional teams to meet data requirements. - Monitor and troubleshoot data workflows to ensure smooth operations. - Stay abreast of emerging industry trends and technologies.
Candidates should possess substantial experience in Delta Sharing and Databricks Unity Catalog Administration. Proficiency in Databricks CLI and Delta Live Pipelines is essential for workflow optimization. A solid understanding of Structured Streaming and risk management is important for data integrity. Experience with Apache Airflow, Amazon S3, and Amazon Redshift is valuable for data orchestration and storage. Fluency in Python and PySpark is required for scripting and data processing tasks.
Cognizant
IT Consulting