Programming language knowledge - Java
NTT DATA
NTT DATA
Join our team as a Migration Platform Engineer, focusing on the OBSv2 to AWS S3 migration. This role is crucial for designing, building, and maintaining a secure and scalable platform to facilitate the seamless transfer of object data. You will be instrumental in ensuring reliable execution, robust automation, effective governance, comprehensive monitoring, and essential production support for large-scale enterprise data migrations.
Take ownership of the complete migration lifecycle, from OBSv2 source buckets to AWS S3 destinations. Develop and manage AWS-based orchestration using services like Step Functions, Lambda, and Fargate. Support diverse migration strategies, including manifest-based and dynamic approaches, with detailed attention to batching, sharding, and retry mechanisms. Implement stringent governance for bandwidth, queue management, prioritization, and job tracking. Build advanced observability through CloudWatch dashboards, logs, and alerts for proactive monitoring. Ensure secure multi-account deployments and implement necessary IAM controls and privacy safeguards.
Key technical skills include strong proficiency in AWS Serverless (Lambda, Step Functions, SQS, SNS), Compute and Containers (ECS Fargate, AWS Batch), and Storage (Amazon S3). Expertise in object storage migration, particularly from S3-compatible platforms like OBSv2 to AWS S3, is essential. Hands-on experience with rclone for high-volume transfers and robust Python development skills for AWS services are required. A deep understanding of DynamoDB for state management, networking concepts in AWS, and IAM/security best practices is also critical. Familiarity with CI/CD pipelines and observability tools like CloudWatch is expected.
NTT DATA
Information Technology & Services