AWS Data Engineer

Infosys

5–8 yrs Bengaluru Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Join our team as an AWS Data Engineer and play a pivotal role in architecting and implementing robust cloud-based data solutions. This position requires a seasoned professional with extensive experience in designing, building, and managing scalable data pipelines within the AWS ecosystem. You will leverage cutting-edge AWS data services, PySpark, SQL, and modern data warehousing techniques to drive innovation and deliver high-impact results.

As a key member of our delivery team, your responsibilities will span client engagement, quality assurance, and ensuring client satisfaction through expert technical guidance. You'll translate client needs into effective technical designs, validate architectural integrity, and uphold exceptional service standards. This role offers the opportunity to contribute significantly to our clients' digital transformation journeys.

Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines on AWS, building and optimizing data ingestion, transformation, and processing frameworks.

Develop data solutions using key AWS services such as Glue, EMR, Redshift, S3, Athena, and Lambda. Create and optimize PySpark/Spark jobs for efficient large-scale data processing.

Design and implement comprehensive data models, data warehouses, and data lakes, working with diverse structured and unstructured data sources. Ensure adherence to data quality, governance, security, and compliance standards.

Implement workflow orchestration using Airflow or AWS Step Functions, and monitor/troubleshoot data pipelines for performance bottlenecks. Collaborate closely with Data Scientists, Analysts, and Business teams to deliver tailored data solutions.

Optimize cloud infrastructure costs, enhance system performance, and participate in code reviews, upholding DevOps best practices.

Qualifications

We are looking for a skilled AWS Data Engineer with 5-8 years of professional experience.

Essential technical skills include strong AWS expertise with Glue, EMR, Redshift, Athena, S3, Lambda, and IAM. Proficiency in PySpark, Apache Spark, advanced SQL, and ETL/ELT development is crucial.

Demonstrated experience in Data Warehousing and Data Modeling is required. Familiarity with Airflow or AWS Step Functions, robust Python programming skills, and experience with Git and CI/CD processes are necessary.

Knowledge of Databricks, Snowflake, Kafka/Kinesis, Terraform, Docker, Kubernetes, and Jenkins are considered beneficial additions.

Essential Skills

AWS GlueAWS EMRAWS RedshiftAWS AthenaAWS S3AWS LambdaAWS IAMPySparkApache SparkSQLETL DevelopmentData WarehousingData ModelingPythonGitCI/CDDevOps

Good to Have

DatabricksSnowflakeKafkaKinesisTerraformDockerKubernetesJenkinsDelta LakeAirflowAWS Step Functions

Highlights

  • Actively hiring

More Details

RoleAWS Data Engineer
DepartmentData Engineering, Data & Analytics
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

IT Consulting

AWS Data Engineer at Infosys | SkillMX | SkillMX