Senior Team Lead | Hadoop | Ahmedabad | Engineering | Data Modernization & Migration (Ahmedabad, IN)
Deloitte
Deloitte
Join our dynamic Engineering team as a Senior Team Lead, focusing on Data Modernization & Migration. You will play a crucial role in managing and optimizing critical data platforms, ensuring their performance and stability. This position offers an exciting opportunity to leverage your expertise in Hadoop and cloud technologies within a leading organization.
This role involves working with cutting-edge technologies to drive innovation and support mission-critical solutions. You will be instrumental in enhancing financial performance, accelerating new digital businesses, and fueling overall company growth. Become part of a team dedicated to building and implementing advanced technology products and platforms.
Your primary responsibilities will include the administration and support of Cloudera CDP/CDH clusters in production environments. You will manage essential Hadoop ecosystem components like HDFS, YARN, Hive, Impala, Spark, and Kafka. Monitoring cluster health, troubleshooting issues, and optimizing platform performance are key aspects of this role.
Key duties involve handling cluster upgrades, patching, capacity planning, and routine maintenance. You will also manage security using tools such as Kerberos, LDAP/AD, Ranger, and TLS/SSL. Automating operational tasks through Shell or Python scripting, and supporting incident management and Root Cause Analysis (RCA) to ensure platform availability and stability are also critical.
We are seeking a seasoned professional with 5–8 years of hands-on experience in Cloudera/Hadoop administration. A strong command of Cloudera Manager, CDP, and CDH is essential, along with solid knowledge of HDFS, YARN, Hive, Impala, Spark, and Kafka. Proficiency in Linux administration (RHEL/CentOS) and experience with Hadoop security tools like Kerberos, Ranger, and LDAP/AD integration are required.
Candidates must possess scripting experience in Shell and/or Python, coupled with excellent troubleshooting, performance tuning, and production support skills. A Bachelor's or Master's degree in a relevant field is necessary. Experience with Cloudera Data Engineering (CDE) or Cloudera Data Warehouse (CDW), and exposure to AWS/Azure, Kubernetes, Ansible, Grafana, or Prometheus are considered advantageous. A Cloudera certification is a plus.
Deloitte
IT Consulting