Join our team as a Staff Data Engineer and play a pivotal role in architecting and implementing robust data solutions. This position focuses on building and maintaining scalable data pipelines, ensuring data integrity, and optimizing performance. You will collaborate with cross-functional teams to deliver high-quality data products and drive data-informed decision-making.

This role requires a seasoned professional with a strong background in data engineering principles and a passion for leveraging cutting-edge technologies. If you are adept at handling large datasets and thrive in a dynamic environment, this is an excellent opportunity to make a significant impact.

Design, develop, and maintain scalable data pipelines using PySpark to process extensive data volumes from diverse sources. Integrate data from multiple origins and formats, prioritizing data quality and reliability. Optimize data processing jobs for peak performance and cost-efficiency. Collaborate closely with data scientists, analysts, and other stakeholders to fulfill data requirements. Develop and maintain ETL/ELT processes for efficient data warehousing and data lake management. Implement comprehensive data validation and monitoring systems to ensure accuracy. Document data engineering workflows and best practices for knowledge sharing. Proactively identify, troubleshoot, and resolve data-related issues.

Possess 3+ years of dedicated experience in data engineering or a related analytical field. Hold a Bachelor’s degree in Computer Science, Information Technology, Engineering, or a similar discipline. Demonstrate proficiency in PySpark and Python for data manipulation and analysis. Exhibit strong knowledge of big data technologies including Hadoop, Hive, and Spark. Have hands-on experience with major cloud platforms like AWS, Azure, or GCP, utilizing their data services. Familiarity with data warehousing solutions such as Amazon Redshift, Google BigQuery, or Snowflake is essential. Understand relational and NoSQL databases like MySQL, MongoDB, and Cassandra. Showcase experience with ETL/ELT processes and data pipeline orchestration tools (e.g., Apache Airflow). Possess excellent analytical and problem-solving capabilities. Communicate technical concepts clearly and effectively, both verbally and in writing.