Data Engineer-Data Platforms-AWS

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and build lasting client relationships while shaping hybrid cloud and AI journeys. As a Data Engineer specializing in AWS Data Platforms, you'll leverage IBM's technology and strategic partnerships to drive impactful change. We foster a culture of curiosity, innovation, and growth, valuing your unique contributions to career development.

Responsibilities

Your role involves designing, developing, and maintaining data engineering solutions on AWS. Key responsibilities include building batch and real-time data pipelines using services like EMR, Glue, Kinesis, and MSK. You will create data layers on Redshift, Aurora, and DynamoDB, manage data services, and utilize open-source technologies such as Apache Airflow, dbt, and Spark (Python/Scala).

Qualifications

We are seeking professionals experienced with AWS services for data pipeline development, data layer creation on Redshift, Aurora, and DynamoDB, and data migration using DMS. Proficiency with AWS Databrew, Lambda functions (Python), and Redshift Spectrum is essential. Familiarity with Apache Kafka, Apache Airflow, dbt, Spark (Python/Scala), and other open-source technologies on the AWS platform is required to support comprehensive data engineering solutions.

Essential Skills

AWS EMRAWS GlueGlue CatalogKinesisAWS RedshiftAuroraDynamoDBAWS DMSApache KafkaApache AirflowdbtSparkPythonScalaAWS DatabrewLambda FunctionsRedshift Spectrum

Good to Have

Data ProcessingData QualityData WarehousingDesignDeliveryPipelinesProgramming LanguageSchedulingData PreparationData EngineeringData PipelinesAWS LambdaAmazon RedshiftApache AirflowOpen SourceData AnalyticsAmazon DynamoDBData TransformationReal-time DataDealership Management SystemsAmazon Web ServicesGlueAWS KinesisAWS Elastic MapReduceService Management

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-AWS
IndustryTechnology
DepartmentEngineering, Information Technology
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Technology

Data Engineer-Data Platforms-AWS at IBM | SkillMX | SkillMX