Data Engineer-Data Platforms-AWS

IBM

Fresher Bengaluru Full Time Hybrid (office + remote)
IBM logo
Posted : today
Actively hiring

Job description

Join IBM Consulting and help shape the future of hybrid cloud and AI for leading companies worldwide. This role focuses on data engineering within the AWS Cloud ecosystem, driving innovation and client impact. We foster a culture of curiosity, encouraging new ideas and rewarding unique skills. Your career development and growth are paramount here.

Responsibilities

As a Data Engineer for Data Platforms on AWS, you will design, develop, and maintain robust data engineering solutions. This includes building and operating batch and real-time data pipelines using services like AWS EMR, Glue, and Kinesis. You'll create data layers on RedShift, Aurora, and DynamoDB, manage data services, and leverage open-source technologies such as Apache Airflow and dbt, alongside Spark/Python or Spark/Scala.

Qualifications

Experience is needed in designing and building data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka. You should have experience with AWS RedShift, Aurora, and DynamoDB for data layer creation and data migration using AWS DMS. Proficiency with AWS Glue Databrew, Lambda functions (Python), and RedShift Spectrum is also essential for data preparation, transformation, and analytics tasks.

Essential Skills

AWSAmazon RedshiftApache KafkaData WarehousingData EngineeringData PipelinesPythonScalaSparkApache AirflowAWS GlueAWS KinesisAWS Elastic MapReduceAmazon DynamoDB

Good to Have

Data ProcessingData QualityDesignDeliveryPipelinesProgramming LanguageSchedulingData PreparationOpen SourceData AnalyticsData TransformationReal-time DataDealership Management SystemsAWS LambdaService Management

Highlights

  • Actively hiring

More Details

RoleData Engineer-Data Platforms-AWS
IndustryData Analytics
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

IBM logo

IBM

Data Analytics

Data Engineer-Data Platforms-AWS at IBM | SkillMX | SkillMX