Join our team as a Custom Software Engineer and play a key role in developing bespoke software solutions. You will be instrumental in designing, coding, and enhancing system components, leveraging modern frameworks and agile methodologies to deliver scalable, high-performance applications tailored to specific business requirements. This role emphasizes innovation and precision in software development.

Design and implement robust data pipelines, both batch and streaming, using Python and GCP services. Construct and maintain data transformation workflows within Dataform, integrating with BigQuery. Develop event-driven solutions with Pub/Sub and Cloud Functions. Manage large-scale structured and unstructured data across GCS, BigQuery, and Cloud Spanner. Write clean, well-tested Python code using GCP libraries and develop reusable modules. Provision and manage GCP infrastructure with Terraform, adhering to IaC principles, and maintain CI/CD pipelines in GitLab for automated deployments. Ensure code quality through unit testing with pytest and code reviews. Monitor and manage data pipelines and GCP resources, and handle containerized workloads on Cloud Run.

A minimum of 3 years of experience is required, with at least 2 years focused on GCP Architecture. Proficiency in Python programming, including OOP, packaging, and performance optimization, is essential. You should have hands-on experience with BigQuery for query optimization and data modeling, and with Pub/Sub for event-driven architectures. Experience with Cloud Run/Cloud Functions for serverless computing and unit testing with pytest is also crucial. Solid experience in provisioning GCP resources using Terraform and familiarity with GitLab CI/CD for pipeline management are necessary. A strong understanding of GCS for data lake patterns is expected. Experience with Dataform for BigQuery transformations is desirable, as is familiarity with Cloud Spanner, data mesh/lakehouse patterns, Apache Beam/Dataflow, and orchestration tools like Airflow/Cloud Composer. A GCP Professional Data Engineer or Cloud Architect certification is a plus.