Senior Data Engineer
Persistent
Persistent
Join Persistent as a Senior Data Engineer and be at the forefront of designing and building robust, scalable, and high-performance data solutions. This role is pivotal in shaping modern data architectures, developing efficient data pipelines, and optimizing data platforms to empower data-driven decisions across the organization. You will leverage deep expertise in SQL, cloud data platforms, and data integration to drive innovation and deliver exceptional value to our clients.
Design and optimize complex SQL queries, stored procedures, and database objects. Perform query tuning and execution plan analysis to enhance database performance. Build and maintain scalable data pipelines for ingestion, transformation, and analytics. Develop and implement modern data architectures across ingestion, storage, processing, and compute layers. Work with cloud data warehouses like Snowflake, BigQuery, Redshift, and Azure SQL, leveraging AWS, Azure, and GCP services. Integrate data from diverse sources and develop ETL/ELT workflows using tools like Airflow, ADF, or AWS Glue. Automate data processes for improved reliability and efficiency, while ensuring data quality, governance, and security.
Collaborate with cross-functional teams to translate business requirements into data engineering solutions. Monitor, troubleshoot, and optimize data pipelines and platform health. Participate in architecture reviews and contribute to data platform modernization. Mentor junior data engineers and champion engineering best practices. Create comprehensive technical documentation and architecture diagrams.
You bring 6+ years of experience in Data Engineering or Data Warehousing. Advanced SQL proficiency, including complex queries, stored procedures, CTEs, window functions, and optimization, is essential. Strong experience in database performance tuning, execution plan analysis, and indexing strategies is required. Hands-on experience with relational databases and cloud data warehouses such as Snowflake, BigQuery, Amazon Redshift, and Azure SQL is expected.
Expertise in designing and implementing scalable data architectures and modern data platforms is crucial. Solid knowledge of AWS, Azure, and GCP cloud services for data engineering workloads is necessary. Experience building and managing ETL/ELT pipelines and enterprise data integration solutions is a must. Proficiency with workflow orchestration tools like Apache Airflow, Azure Data Factory (ADF), AWS Glue, or Databricks is required. Experience integrating structured, semi-structured, and unstructured data sources is important. A strong understanding of data modeling, data warehousing concepts, and analytics platforms is needed. Proficiency in Python or SQL is essential.
Familiarity with data governance, security, compliance, and data quality best practices is valuable. Experience working with large-scale data processing and analytics environments is a plus. Strong analytical, troubleshooting, and problem-solving skills are required. Excellent communication and stakeholder management skills are vital. Experience mentoring junior engineers and promoting technical best practices is expected. The ability to collaborate effectively in Agile environments is key.
Persistent Systems
Information Technology & Services