Senior Staff Engineer - Data Engineering
Altimetrik
Altimetrik
This senior staff engineer role focuses on managing and evolving a complex, high-volume transactional SQL Server data estate. The primary mission involves stabilizing, governing, and optimizing four production SQL Server environments that are crucial for CDC-based ingestion into Redshift. This includes addressing historical data accumulation and ensuring robust data management practices.
The data environment comprises four production SQL Server instances, utilizing SQL Server CDC for ingestion into Redshift via DBT, with EC2 compute. DynamoDB is used for specific workloads, and CyberArk manages privileged access. The role requires a strong understanding of this intricate data pipeline and its components.
- Oversee performance, availability, security, and compliance for all four production SQL Server environments. - Develop and implement essential data retention and deletion policies, a key area for improvement. - Lead SQL Server CDC configuration to ensure reliable ingestion into Redshift. - Manage data volume growth through effective archiving, partitioning, and capacity planning. - Ensure robust database security, including privileged access management via CyberArk. - Collaborate with the Data Platform team on broader platform consolidation efforts. - Establish and enforce DBA standards, along with backup and recovery procedures. - Mentor and manage individual contributor DBAs within the team. - Guarantee PCI DSS compliance across all SQL Server environments, with a focus on PAN, PII, and CVV controls.
- Minimum of 12 years of experience in SQL Server DBA roles, with proven multi-environment production experience. - Demonstrated success in managing large-scale SQL Server estates with significant data volume challenges. - Deep expertise in designing and implementing data retention, archiving, and deletion policies. - Strong experience with SQL Server CDC for downstream ingestion pipelines. - Proficiency with AWS services, including EC2, DynamoDB, and RDS. - Familiarity with CyberArk or similar Privileged Access Management (PAM) solutions. - Experience with PCI DSS database compliance and handling sensitive data like PAN and PII. - Ability to manage legacy SQL Server environments and address inherited technical debt. - Excellent people management and mentoring capabilities.
Altimetrik
IT Consulting