AWS Data Engineer
Infosys
Infosys
Join our Data & Analytics Unit as a Lead Consultant specializing in AWS Data Engineering. This role is pivotal in designing, building, and maintaining large-scale cloud data platforms. You will leverage cutting-edge AWS services to drive data innovation and deliver robust analytical solutions.
We are seeking a seasoned professional with a strong understanding of modern data architectures, including Data Lakes and Lakehouses. Your expertise will ensure data quality, governance, security, and efficient production support. This is an exciting opportunity to shape the future of data at Infosys Limited.
Design and implement scalable AWS data engineering solutions, focusing on large-scale cloud data platforms. Develop and optimize real-time and streaming data processing pipelines using services like Kinesis and Kafka. Code proficiently in Python, PySpark, and SQL, with a keen eye for performance tuning and optimization. Build high-volume, low-latency data ingestion and transformation systems, managing petabyte-scale datasets. Implement robust CI/CD pipelines for seamless deployment and integration. Troubleshoot production issues, identify performance bottlenecks, and drive cost optimization initiatives. Collaborate effectively with architects, stakeholders, and cross-functional teams in an Agile environment.
Extensive hands-on experience in AWS Data Engineering across S3, Glue, Lambda, Redshift, Lake Formation, CloudWatch, and IAM. Proven expertise in real-time data processing with Kinesis, Kafka, or equivalent technologies. Strong coding skills in Python, PySpark, and SQL, coupled with advanced optimization techniques. Experience with Databricks, Delta Lake, Structured Streaming, and Spark performance tuning is essential. Proficiency in managing large datasets (TB/PB-scale), including partitioning, file optimization, schema evolution, and data lifecycle management. Solid understanding of Data Lake, Lakehouse, and Modern Data Platform architectures. Practical experience in data modeling for analytical, operational, and reporting needs. Experience implementing CI/CD pipelines using AWS services or Jenkins/GitHub Actions. Excellent troubleshooting, client communication, stakeholder management, and problem-solving capabilities. A Bachelor of Engineering or Bachelor of Technology degree is required.
Infosys
IT Consulting