Aws Developer
Infosys
Infosys
Join our Data & Analytics Unit as a Senior Consultant, focusing on designing, developing, and optimizing scalable ETL/ELT data pipelines within the AWS ecosystem. This role offers a fantastic opportunity to leverage your expertise in AWS Glue, Python, PySpark, and SQL to build robust data solutions.
You will be instrumental in transforming data and architecting cloud-based data platforms, contributing directly to innovative projects for our clients.
Key responsibilities include designing and maintaining ETL/ELT pipelines using AWS Glue with PySpark and SQL for large-scale data processing. You will build ingestion and transformation pipelines, manage AWS Glue components, and work with core AWS services like S3 and Redshift.
Focus will be on implementing data quality checks, optimizing job performance for cost and scalability, and ensuring reliability through incremental loads and error handling. You'll also troubleshoot pipeline issues, implement security controls, and assist in migrating legacy workloads to AWS.
We are seeking a seasoned professional with 7-9 years of data engineering and ETL development experience, particularly in building production-grade AWS Glue, Python, and PySpark solutions.
Essential skills include a strong command of SQL, Amazon S3, data lake concepts, and ETL/ELT design. Experience with high-volume datasets, complex transformations, and performance optimization is crucial. A Bachelor of Engineering or Bachelor of Technology degree is required, and relevant AWS certifications are a plus.
Infosys
Information Technology & Services