Join our dynamic team as a Senior Data Engineer, specializing in the automotive domain. This role requires a seasoned professional with 6 to 10 years of experience in building and optimizing complex data systems.

We are seeking an individual with advanced expertise in Hadoop and Apache Spark, coupled with strong Python skills for developing robust data pipelines. A solid understanding of data warehousing principles and experience with cloud services, particularly Google Cloud Platform (GCP), are essential. Proficiency in Terraform for infrastructure as code and relational databases (RDBMS) is also crucial.

Your responsibilities will include orchestrating data workflows using Apache Airflow and optimizing data processing for enhanced efficiency. This is an excellent opportunity for a skilled engineer to contribute to cutting-edge data solutions.

Design and implement scalable and reliable data pipelines using technologies like Hadoop and Apache Spark. Develop and maintain Python scripts for data processing and automation. Ensure data integrity and optimize data workflows for performance. Manage infrastructure as code using Terraform and leverage GCP services for data storage and processing. Orchestrate complex data workflows using Apache Airflow for efficient job scheduling and monitoring. Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.

Minimum of 6 to 10 years of professional experience in data engineering, preferably within the automotive sector. Demonstrated expertise in Hadoop and Apache Spark for large-scale data processing. Proficiency in Python scripting and building data pipelines. Solid understanding of data warehousing concepts and best practices. Experience with cloud platforms, specifically Google Cloud Platform (GCP). Familiarity with infrastructure as code tools like Terraform. Strong knowledge of relational databases (RDBMS). Experience with workflow orchestration tools such as Apache Airflow. Bachelor of Engineering (B.E.) in Computer Science or Information Technology is required. Master of Technology (M.Tech) in Data Science or Big Data is also a requirement. Excellent problem-solving and analytical skills.