Join our dynamic team as a Senior Associate specializing in Google Cloud Platform (GCP) Data Engineering. This role is integral to our Engineering as a Service initiative, focusing on Big Data solutions within the GCP ecosystem. You'll leverage your expertise in data ingestion, data lakes, and data mesh principles, while navigating the trade-offs of various GCP services like Data Proc, Cloud Composer, Google Cloud Storage, and BigQuery.

This is an experienced-level position where you will contribute significantly to our data platform's architecture and development. We're looking for individuals passionate about Big Data technologies and eager to drive innovation in cloud-based data solutions.

As a Senior Associate, you will provide essential thought leadership and engineering expertise to guide our engineering teams. Your role involves collaborating closely with business stakeholders, product teams, and cross-functional technology groups to ensure the continuous delivery of high-quality data solutions.

Key responsibilities include analyzing and elaborating user stories, designing and developing robust software applications, and building automation tools for testing. You will own the technical aspects of software development for assigned applications, from architecture and design to implementation. This includes hands-on coding, creating API specifications, conducting proof-of-concepts, performing code reviews, and actively participating in ongoing sprints.

You'll also drive consistent development practices, cultivate a deep understanding of system interdependencies, and contribute to technical blueprints and feature planning. Identifying opportunities for new technology adoption and predicting future challenges will be crucial. Effective communication with internal and external business partners regarding solution design is paramount.

We are seeking candidates with a Bachelor’s Degree in Computer Science, Computer Science Engineering, or a related field, with an advanced degree being a strong preference. A minimum of 4 years of commercial software development experience is required.

Essential technical proficiencies include deep expertise in developing and hosting solutions on Google Cloud Platform, specifically Google Cloud Storage and BigQuery. Hands-on experience with Big Data platforms such as Scala, Spark, and Hive SQL, along with experience in Big Data Lake environments, is critical. You must be proficient in ETL processes and tools, data modeling within Big Data platforms, and secure file transfer operations for data management.

Experience with Agile development, Continuous Integration, and Continuous Delivery pipelines, including tools like Maven, Git, and Jenkins, is expected. Strong skills in architecture design and modeling for complex systems are necessary. A good understanding of web technologies (HTTP, Apache) and Unix/Linux environments, as well as data structures, algorithms, and design patterns, is also vital. Excellent leadership, communication, and documentation abilities are essential for collaborating effectively across teams and influencing stakeholders at all levels.