Senior Engineer - Data Engineering
Altimetrik
Altimetrik
Join Altimetrik, a leader in digital business services, as an L4 Databricks Platform Administrator on AWS. You will ensure the stability, performance, security, and scalability of our Databricks environments, playing a crucial role in supporting data science and engineering teams.
This role involves expert-level administration, troubleshooting, and optimization of the Databricks platform, leveraging your deep expertise to drive tangible business outcomes through innovative digital strategies.
Administer and maintain Databricks workspaces on AWS, managing users, clusters, and resources. Monitor platform performance and implement optimizations. Troubleshoot Databricks clusters, jobs, and notebooks. Ensure seamless integration with AWS services like S3, IAM, and EC2. Implement and enforce security policies, manage access control, and ensure compliance.
Develop automation scripts for platform tasks, optimize cluster configurations for cost and performance, and implement infrastructure-as-code and CI/CD pipelines. Collaborate with data engineers, data scientists, and AWS/Databricks support teams to align the platform with business needs and resolve complex technical issues.
A Bachelor's degree in Computer Science, Information Technology, or a related field is required. Candidates should possess a minimum of 10 years of experience in data platform administration, with extensive experience managing Databricks environments on AWS.
Proven experience with cluster management, performance tuning, and security best practices is essential. Familiarity with infrastructure-as-code tools (Terraform, CloudFormation) and CI/CD pipelines is also necessary. Proficiency in scripting languages like Python and Bash, along with a strong understanding of AWS services and data warehousing concepts, is expected.
Altimetrik
IT Consulting