AWS Lead Data Engineer
Infosys
Infosys
An experienced AWS Lead Data Engineer is sought to spearhead the design and implementation of expansive cloud-based data platforms. This role demands profound expertise in AWS data services, data lake architectures, robust ETL frameworks, and enterprise-grade data governance solutions. The position offers a dynamic environment to influence and build sophisticated data solutions.
Key responsibilities include developing and maintaining scalable data pipelines leveraging AWS Glue, Lambda, and Step Functions. You will build and optimize data ingestion frameworks on Amazon S3-based data lakes, and design/implement complex ETL/ELT workflows for diverse data types. Additionally, you'll develop reusable components, automation frameworks, and implement data governance using Lake Formation and IAM. Deployment and management of containerized workloads on ECS, alongside performance optimization and troubleshooting, are crucial. Collaboration with cross-functional teams and mentoring junior engineers are integral to the role.
Candidates should possess significant IT experience with a strong Data Engineering background, including hands-on expertise with AWS Glue, Lambda, Step Functions, S3, and Lake Formation. Proficiency in Python and SQL is essential, as is experience building enterprise-scale Data Lake solutions. A solid understanding of IAM roles, policies, and AWS security best practices is required, along with experience in container technologies and ECS. Strong knowledge of ETL, Data Warehousing, and Data Modeling concepts, and experience in Agile environments are expected. An MBA, MCA, ME, MSc, MTech, Bachelor of Engineering, BCA, BSc, or BTech is required.
Infosys
IT Consulting