Join our team as a Custom Software Engineer, focusing on designing, building, and configuring applications to meet dynamic business process and application requirements. This role requires a strong background in Google Cloud Platform Architecture and a passion for creating robust data solutions.

We are looking for individuals who can translate business needs into technical specifications and deliver high-quality software that drives efficiency and innovation. If you thrive in a collaborative environment and are eager to work with cutting-edge cloud technologies, this is the opportunity for you.

Key responsibilities include developing scalable batch and streaming data pipelines using Python and GCP services. You will build and maintain data transformation workflows in Dataform, integrate with BigQuery, and develop real-time data processing solutions with Pub/Sub and serverless compute. Managing large-scale data storage in GCS, BigQuery, and Cloud Spanner is also crucial.

Additionally, you will write clean, well-tested Python code, develop reusable modules, and ensure code quality through unit testing with pytest. You will also provision and manage GCP infrastructure using Terraform, maintain CI/CD pipelines in GitLab, and manage containerized workloads on Cloud Run. A solid understanding of monitoring, alerting, and observability for data pipelines and GCP resources is expected.

To excel in this role, you should possess at least 2-5 years of experience in data engineering, with a minimum of 2 years focused on GCP. Strong Python programming skills, including clean code, OOP, packaging, and performance optimization, are essential.

Hands-on experience with BigQuery for query optimization and data modeling is required. Familiarity with Pub/Sub for event-driven architectures, Cloud Run/Functions for serverless workloads, and unit testing with pytest is necessary. Proficiency in Terraform for GCP resource provisioning and GitLab CI/CD for pipeline management is also key.

A solid understanding of GCS for data lake patterns and experience with Dataform for SQL-based transformations are highly beneficial. While not mandatory, experience with Cloud Spanner, data mesh architectures, or GCP certifications would be advantageous. A full-time education spanning 15 years is a prerequisite.