AWS Data Engineer

Infosys

7–9 yrs Bengaluru Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Join Infosys Limited as a Senior Consultant in our Data & Analytics Unit, focusing on building cutting-edge AWS Data Engineering solutions. This role is ideal for experienced professionals seeking to leverage their expertise in large-scale cloud data platforms and contribute to innovative data solutions.

We are looking for individuals passionate about designing, developing, and optimizing robust data pipelines and modern data architectures within the AWS ecosystem. If you thrive in a collaborative environment and are adept at problem-solving, this is an excellent opportunity to advance your career.

Responsibilities

Key responsibilities include designing and developing scalable AWS data engineering solutions and cloud-native data platforms. You will build batch and real-time data pipelines using AWS Glue, PySpark, Databricks, S3, Kinesis, Redshift, and Kafka/MSK. Optimizing Databricks, Delta Lake, and Spark workloads for large-scale data processing with PySpark and Databricks transformations is crucial.

Implement streaming solutions using Amazon Kinesis for near real-time data ingestion. You'll also handle high-volume data pipelines, focusing on performance, scalability, and cost optimization, alongside developing complex SQL transformations and data models. Adhering to CI/CD, Infrastructure as Code, and DevOps best practices is essential.

Qualifications

A strong foundation in AWS Data Engineering with expertise across S3, Glue, Lambda, Redshift, Lake Formation, CloudWatch, and IAM is required. Proficiency in real-time and streaming data processing using Kinesis or Kafka is key. Candidates must possess hands-on coding skills in Python, PySpark, and SQL, with strong optimization capabilities.

Experience with Databricks, Delta Lake, Structured Streaming, and Spark performance tuning is essential. You should be comfortable handling TB/PB-scale datasets, understanding partitioning, file optimization, schema evolution, and data lifecycle management. A solid grasp of Data Lake, Lakehouse, and Modern Data Platform architectures is necessary. Practical data modeling experience for analytical, operational, and reporting workloads is expected.

Essential Skills

AWS S3AWS GlueAWS LambdaAWS RedshiftAWS Lake FormationAWS CloudWatchAWS IAMAmazon Kinesis Data StreamsKinesis FirehoseKinesis AnalyticsAmazon KafkaPythonPySparkSQLDatabricksDelta LakeStructured StreamingSpark Performance TuningAWS CodePipelineCodeBuildCodeDeployGitHub ActionsJenkinsTerraformCloudFormation

Good to Have

AWS Core servicesAWS - Database TechnologiesAWS Data Analytics

Highlights

  • Actively hiring

More Details

RoleAWS Data Engineer
DepartmentData & Analytics
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

IT Consulting

AWS Data Engineer at Infosys | SkillMX | SkillMX