Data Engineer-Data Platforms-AWS
IBM
IBM
Join IBM Consulting and help shape the future of hybrid cloud and AI for leading companies worldwide. This role focuses on data engineering within the AWS Cloud ecosystem, driving innovation and client impact. We foster a culture of curiosity, encouraging new ideas and rewarding unique skills. Your career development and growth are paramount here.
As a Data Engineer for Data Platforms on AWS, you will design, develop, and maintain robust data engineering solutions. This includes building and operating batch and real-time data pipelines using services like AWS EMR, Glue, and Kinesis. You'll create data layers on RedShift, Aurora, and DynamoDB, manage data services, and leverage open-source technologies such as Apache Airflow and dbt, alongside Spark/Python or Spark/Scala.
Experience is needed in designing and building data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka. You should have experience with AWS RedShift, Aurora, and DynamoDB for data layer creation and data migration using AWS DMS. Proficiency with AWS Glue Databrew, Lambda functions (Python), and RedShift Spectrum is also essential for data preparation, transformation, and analytics tasks.
IBM
Data Analytics