Join Deloitte's Technology & Transformation practice, a global network dedicated to unlocking the full potential of vast data resources. We provide strategic guidance and implementation services to help companies manage data from diverse sources, transforming it into accurate, actionable insights. Our expertise spans business intelligence, data management, performance management, and cutting-edge analytics, including big data, cloud, cognitive, and machine learning technologies.

This role focuses on managing client relationships and ensuring the successful delivery of programs. As the primary liaison between our organization and clients, you will align goals, timelines, budgets, and expected outcomes to drive client satisfaction and business growth.

Key responsibilities include migrating SAS frameworks to Databricks/PySpark, designing and developing PySpark pipelines from SAS macros, and implementing validation frameworks between SAS and Spark outputs. You will manage the DevOps lifecycle using Git/Bitbucket, conduct code reviews, and oversee production deployments. Building and maintaining scalable data pipelines on AWS, optimizing data lakes with S3, Glue Catalog, and Lake Formation, and working with Redshift/Snowflake for data warehousing solutions are also core functions. Implementing data quality checks, monitoring, logging, and CI/CD deployments are essential, along with collaborating with analytics and business teams to deliver high-quality datasets.

We seek candidates with 3+ years of hands-on experience in migrating SAS frameworks to Databricks/PySpark. Proficiency in Python (PySpark), SQL, and data transformation logic is crucial. Experience with Redshift, Athena, and Glue Data Catalog, along with knowledge of Spark (EMR/Glue) and distributed data processing, is required. Familiarity with Terraform/CloudFormation for Infrastructure as Code is a plus. A strong understanding of data modeling, data lake principles, and best practices is expected. You should be adept at designing, developing, and deploying solutions using various tools and design principles. Understanding existing processes, facilitating changing requirements through structured change control, and maintaining proper documentation are also key aspects of this role. Collaboration with process owners and business stakeholders to understand and automate processes is integral.