AWS Data Engineer

Infosys

9–11 yrs Bengaluru Full Time Work from office
Infosys logo
Posted : today
Actively hiring

Job description

Join our Data & Analytics Unit as a Lead Consultant specializing in AWS Data Engineering. This role is pivotal in designing, building, and maintaining large-scale cloud data platforms. You will leverage cutting-edge AWS services to drive data innovation and deliver robust analytical solutions.

We are seeking a seasoned professional with a strong understanding of modern data architectures, including Data Lakes and Lakehouses. Your expertise will ensure data quality, governance, security, and efficient production support. This is an exciting opportunity to shape the future of data at Infosys Limited.

Responsibilities

Design and implement scalable AWS data engineering solutions, focusing on large-scale cloud data platforms. Develop and optimize real-time and streaming data processing pipelines using services like Kinesis and Kafka. Code proficiently in Python, PySpark, and SQL, with a keen eye for performance tuning and optimization. Build high-volume, low-latency data ingestion and transformation systems, managing petabyte-scale datasets. Implement robust CI/CD pipelines for seamless deployment and integration. Troubleshoot production issues, identify performance bottlenecks, and drive cost optimization initiatives. Collaborate effectively with architects, stakeholders, and cross-functional teams in an Agile environment.

Qualifications

Extensive hands-on experience in AWS Data Engineering across S3, Glue, Lambda, Redshift, Lake Formation, CloudWatch, and IAM. Proven expertise in real-time data processing with Kinesis, Kafka, or equivalent technologies. Strong coding skills in Python, PySpark, and SQL, coupled with advanced optimization techniques. Experience with Databricks, Delta Lake, Structured Streaming, and Spark performance tuning is essential. Proficiency in managing large datasets (TB/PB-scale), including partitioning, file optimization, schema evolution, and data lifecycle management. Solid understanding of Data Lake, Lakehouse, and Modern Data Platform architectures. Practical experience in data modeling for analytical, operational, and reporting needs. Experience implementing CI/CD pipelines using AWS services or Jenkins/GitHub Actions. Excellent troubleshooting, client communication, stakeholder management, and problem-solving capabilities. A Bachelor of Engineering or Bachelor of Technology degree is required.

Essential Skills

AWS S3AWS GlueAWS LambdaAWS RedshiftAWS Lake FormationAWS CloudWatchAWS IAMAmazon Kinesis Data StreamsKinesis FirehoseKinesis AnalyticsAmazon KafkaPythonPySparkSQLDatabricksDelta LakeStructured StreamingSpark Performance TuningCI/CDAWS CodePipelineCodeBuildCodeDeployGitHub ActionsJenkinsData ModelingData GovernanceData SecurityCloud MonitoringProduction Support

Highlights

  • Actively hiring

More Details

RoleAWS Data Engineer
DepartmentData Engineering, Consulting
Employment TypeFull Time, Work from office

About the Company

Infosys logo

Infosys

IT Consulting

AWS Data Engineer at Infosys | SkillMX | SkillMX