AWS Data Engineer
Infosys
Infosys
Join our team as an AWS Data Engineer and play a pivotal role in architecting and implementing robust cloud-based data solutions. This position requires a seasoned professional with extensive experience in designing, building, and managing scalable data pipelines within the AWS ecosystem. You will leverage cutting-edge AWS data services, PySpark, SQL, and modern data warehousing techniques to drive innovation and deliver high-impact results.
As a key member of our delivery team, your responsibilities will span client engagement, quality assurance, and ensuring client satisfaction through expert technical guidance. You'll translate client needs into effective technical designs, validate architectural integrity, and uphold exceptional service standards. This role offers the opportunity to contribute significantly to our clients' digital transformation journeys.
Design, develop, and maintain scalable ETL/ELT pipelines on AWS, building and optimizing data ingestion, transformation, and processing frameworks.
Develop data solutions using key AWS services such as Glue, EMR, Redshift, S3, Athena, and Lambda. Create and optimize PySpark/Spark jobs for efficient large-scale data processing.
Design and implement comprehensive data models, data warehouses, and data lakes, working with diverse structured and unstructured data sources. Ensure adherence to data quality, governance, security, and compliance standards.
Implement workflow orchestration using Airflow or AWS Step Functions, and monitor/troubleshoot data pipelines for performance bottlenecks. Collaborate closely with Data Scientists, Analysts, and Business teams to deliver tailored data solutions.
Optimize cloud infrastructure costs, enhance system performance, and participate in code reviews, upholding DevOps best practices.
We are looking for a skilled AWS Data Engineer with 5-8 years of professional experience.
Essential technical skills include strong AWS expertise with Glue, EMR, Redshift, Athena, S3, Lambda, and IAM. Proficiency in PySpark, Apache Spark, advanced SQL, and ETL/ELT development is crucial.
Demonstrated experience in Data Warehousing and Data Modeling is required. Familiarity with Airflow or AWS Step Functions, robust Python programming skills, and experience with Git and CI/CD processes are necessary.
Knowledge of Databricks, Snowflake, Kafka/Kinesis, Terraform, Docker, Kubernetes, and Jenkins are considered beneficial additions.
Infosys
IT Consulting