AWS Systems Integration Specialist Advisor
NTT DATA
NTT DATA
Join NTT DATA as an AWS Systems Integration Specialist Advisor and contribute to innovative technology solutions. This role focuses on designing, developing, and optimizing robust data pipelines within the AWS ecosystem.
We are seeking individuals passionate about growing with a forward-thinking and inclusive organization. If you are eager to make a significant impact through responsible innovation and AI/digital infrastructure leadership, we encourage you to apply.
Key responsibilities include architecting and maintaining Directed Acyclic Graphs (DAGs) using Apache Airflow for efficient batch scheduling and dependency management. You will also develop and manage event-streaming pipelines with Kafka for real-time data ingestion and pub/sub messaging.
This role involves building and deploying scalable cloud infrastructure on AWS, including services like Amazon MSK, MWAA, S3, RDS, EC2, and IAM. A critical aspect is continuously monitoring, troubleshooting, and optimizing data pipelines to ensure low latency, high fault tolerance, and cost-effectiveness.
The ideal candidate possesses strong proficiency in Python, with Java or Scala being beneficial. Extensive experience with Apache Airflow, including custom operators and DAG design, is mandatory.
You will need proven hands-on experience with Apache Kafka, covering topics, partitions, consumer groups, and Kafka Connect. A strong command of the AWS ecosystem, particularly Amazon MSK, S3, EMR, CloudWatch, and AWS Glue, is essential.
Familiarity with Big Data tools such as Spark and Hadoop, alongside data warehouses like Redshift, Snowflake, or BigQuery, is also required for this position.
NTT DATA
IT Consulting