Join our dynamic team as a Senior Staff Engineer specializing in Data Engineering. This role is pivotal in shaping our data infrastructure, ensuring efficiency and scalability.

We are seeking a seasoned professional to design, build, and maintain robust data pipelines and ETL processes. Your expertise will drive the integration of diverse data sources and guarantee the highest standards of data quality and reliability.

This is an excellent opportunity to contribute to cutting-edge data solutions and collaborate with cross-functional teams to meet evolving data needs.

Design and implement scalable data pipelines utilizing PySpark to process extensive datasets from various origins. Integrate data from multiple sources and formats, prioritizing data quality and dependability. Optimize data processing jobs for enhanced performance and cost-effectiveness. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver effective data solutions. Develop and maintain ETL processes for extracting, transforming, and loading data into data warehouses and data lakes. Implement data validation and monitoring to ensure data accuracy and consistency. Create comprehensive documentation for data engineering processes, workflows, and best practices. Proactively identify, troubleshoot, and resolve data-related issues.

A minimum of 3 years of hands-on experience in data engineering or a closely related domain is required. Possess a Bachelor's degree in Computer Science, Information Technology, Engineering, or a relevant field. Demonstrate proficiency in PySpark and Python programming languages. Exhibit strong knowledge of big data technologies such as Hadoop, Hive, and Spark. Experience with cloud platforms like AWS, Azure, or GCP and their associated data services is essential. Familiarity with data warehousing solutions including Amazon Redshift, Google BigQuery, or Snowflake. Knowledge of both relational and NoSQL databases (e.g., MySQL, MongoDB, Cassandra). Proven experience with ETL/ELT processes and data pipeline orchestration tools like Apache Airflow or Apache NiFi. Possess strong analytical and problem-solving capabilities. Excellent verbal and written communication skills, with the ability to articulate complex technical concepts clearly.