Data Engineer-Data Platforms-AWS
IBM
IBM
Join IBM Consulting and be at the forefront of shaping hybrid cloud and AI journeys for leading companies globally. We foster long-term client relationships through close collaboration, leveraging robust IBM technology, Red Hat, and strategic partnerships. At IBM Consulting, curiosity drives innovation, encouraging you to challenge the status quo and deliver impactful solutions. Our growth-oriented and empathetic culture prioritizes your career development while valuing your unique contributions.
As a Data Engineer on our Data Platforms team, you will design, develop, and maintain robust data engineering solutions within the AWS Cloud ecosystem. This includes building and operating batch and real-time data pipelines using AWS services like EMR, Glue, Glue Catalog, and Kinesis. You will also create and manage data layers on RedShift, Aurora, and DynamoDB, and utilize tools such as AWS DMS for data migration. Efficient scheduling and management of data services on the AWS Platform are key responsibilities, alongside developing pipelines for Data Warehouse and Datalake environments.
We seek engineers experienced in designing, building, and operating batch and real-time data pipelines using AWS services. Proficiency with data layer creation on AWS RedShift, Aurora, and DynamoDB, and data migration using AWS DMS is essential. Experience managing data services on the AWS platform is required. Familiarity with open-source technologies like Apache Airflow, dbt, Spark (Python/Scala), AWS Kinesis, and Managed Streaming for Apache Kafka is also important. Exposure to AWS Glue Databrew, Lambda functions with Python, and RedShift Spectrum for data analytics and warehousing tasks is highly valued.
IBM
Information Technology & Services