Project Lead – Data Engineering & AI
Persistent
Persistent
Join our dynamic team as a Project Lead, specializing in Data Engineering, AWS, and AI Solutions. This role is pivotal in shaping and delivering advanced, cloud-native data platforms and innovative AI-powered applications. You will guide the design, development, and implementation of scalable, secure, and high-performance enterprise solutions, leveraging cutting-edge cloud technologies and artificial intelligence.
We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner committed to helping clients anticipate future needs. Our expertise and proven solutions empower clients with a competitive edge, enabling them to see beyond the present and rise above challenges. We collaborate with leading global organizations across various industries, including finance and healthcare, driving transformation with a disruptor's mindset and a focus on client success.
Drive the end-to-end lifecycle of cloud-native data platforms and AI solutions, from conceptualization to deployment. Collaborate closely with cross-functional teams to translate innovative concepts into robust, scalable products and impactful business solutions.
Take an active role in architecture discussions, influencing technical design and implementation strategies. Utilize a comprehensive suite of AWS services, including Lambda, S3, IAM, KMS, API Gateway, EC2, ECS, and EKS, to construct resilient and scalable applications. Manage cloud infrastructure efficiently using Terraform and Infrastructure as Code (IaC) principles. Develop and maintain robust CI/CD pipelines using tools like Jenkins, GitHub Actions, or GitLab CI.
Build and support advanced AI systems incorporating RAG, AI Gateways, MCP, Guardrails, and Vector Databases. Contribute to the advancement of Generative AI platforms by leveraging services such as AWS Bedrock, Azure AI, and Vertex AI. Implement sophisticated data engineering pipelines that fuel analytics, machine learning, and AI workloads. Champion automation across development, deployment, monitoring, and operational processes to enhance efficiency and reliability.
Ensure the scalability, performance, reliability, and security of solutions across all cloud environments. Mentor junior engineers, fostering a culture of engineering excellence through code reviews, best practices, and knowledge sharing.
We are seeking candidates with 8–12 years of progressive experience in Software Engineering and Data Engineering. A minimum of 1 year of hands-on experience in delivering AI or Generative AI projects is essential.
Possess strong proficiency in Python for backend development, automation, data engineering, and AI applications. Demonstrate deep expertise in AWS services such as Lambda, S3, IAM, KMS, API Gateway, EC2, ECS/EKS, and containerized deployments. Showcase experience in designing and maintaining modern data architectures and pipelines. Strong practical experience with Terraform or other IaC tools is required.
Implement and manage CI/CD pipelines effectively using Jenkins, GitHub Actions, GitLab CI, or similar platforms. Exhibit expertise in designing cloud-native applications and distributed systems. A solid understanding of REST APIs, Microservices Architecture, and Event-Driven Systems is crucial. Experience with AI technologies like Retrieval-Augmented Generation (RAG), Vector Databases, AI Gateways, MCP, and AI Guardrails is a key requirement.
Build and deploy Generative AI solutions using AWS Bedrock, Azure AI, Vertex AI, or comparable platforms. Familiarity with Prompt Engineering methodologies and AI-assisted development practices is advantageous. Knowledge of Docker, Kubernetes, and container orchestration is expected. Experience developing secure, highly available, and scalable enterprise cloud solutions is necessary.
A strong grasp of software engineering principles, testing frameworks, deployment automation, and DevOps practices is vital. Proven ability to influence architecture decisions and participate in technical design reviews. Excellent analytical, troubleshooting, and problem-solving capabilities are essential. Experience working within Agile delivery environments and using Jira is preferred. Strong leadership skills, including mentoring engineers and driving technical excellence, are highly valued. A passion for innovation, AI technologies, and continuous learning is a must.
Persistent Systems
IT Consulting