Aws Developer
Infosys
Infosys
Join our dynamic Data & Analytics team as an AWS Glue Developer / Data Engineer. This role focuses on designing, developing, and refining scalable ETL/ELT data pipelines within the AWS ecosystem. If you possess strong expertise in AWS Glue, Python, PySpark, SQL, data lake technologies, and core AWS data services, we encourage you to apply.
Key responsibilities include developing and maintaining robust ETL/ELT pipelines using AWS Glue, leveraging PySpark and SQL for efficient data processing. You will build data ingestion and transformation workflows for diverse data types, manage AWS Glue components like the Data Catalog, Jobs, and Triggers, and integrate with essential AWS services such as S3, Redshift, and IAM. The role demands optimizing Glue/Spark jobs for performance and cost, implementing advanced features like incremental loads and error handling, and troubleshooting pipeline issues. You'll also implement security controls, support cloud migrations, and contribute to CI/CD practices. Collaboration with cross-functional teams to translate requirements into data solutions and preparing comprehensive technical documentation are also vital aspects of this position.
We are seeking candidates with a minimum of 2 years of dedicated Data Engineering or ETL development experience. Proven, hands-on expertise in building production-ready AWS Glue, Python, and PySpark solutions is essential. You should be adept at handling large datasets and performing complex transformations within AWS environments. A Bachelor of Engineering or Bachelor of Technology degree is required. Experience with Amazon Dynamo DB and other AWS database technologies is a significant advantage. An AWS Certified Data Engineer – Associate or similar relevant AWS certification is preferred.
Infosys
IT Consulting