Data Engineer-Data Platforms-AWS

IBM

Fresher Pune, Chennai, Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and be at the forefront of shaping hybrid cloud and AI journeys for leading companies globally. We foster long-term client relationships through close collaboration, leveraging robust IBM technology, Red Hat, and strategic partnerships. At IBM Consulting, curiosity drives innovation, encouraging you to challenge the status quo and deliver impactful solutions. Our growth-oriented and empathetic culture prioritizes your career development while valuing your unique contributions.

Responsibilities

As a Data Engineer on our Data Platforms team, you will design, develop, and maintain robust data engineering solutions within the AWS Cloud ecosystem. This includes building and operating batch and real-time data pipelines using AWS services like EMR, Glue, Glue Catalog, and Kinesis. You will also create and manage data layers on RedShift, Aurora, and DynamoDB, and utilize tools such as AWS DMS for data migration. Efficient scheduling and management of data services on the AWS Platform are key responsibilities, alongside developing pipelines for Data Warehouse and Datalake environments.

Qualifications

We seek engineers experienced in designing, building, and operating batch and real-time data pipelines using AWS services. Proficiency with data layer creation on AWS RedShift, Aurora, and DynamoDB, and data migration using AWS DMS is essential. Experience managing data services on the AWS platform is required. Familiarity with open-source technologies like Apache Airflow, dbt, Spark (Python/Scala), AWS Kinesis, and Managed Streaming for Apache Kafka is also important. Exposure to AWS Glue Databrew, Lambda functions with Python, and RedShift Spectrum for data analytics and warehousing tasks is highly valued.

Essential Skills

AWSData EngineeringData PipelinesPythonSparkAmazon RedshiftApache AirflowAWS KinesisAWS GlueAWS Elastic MapReduceAmazon DynamoDBData WarehousingData ProcessingData PreparationData TransformationScala

Good to Have

Apache KafkaAWS LambdaRedshift SpectrumAWS Glue Databrew

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-AWS
IndustryInformation Technology & Services
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Information Technology & Services

Data Engineer-Data Platforms-AWS at IBM | SkillMX | SkillMX