Data Architect (IN)
HCLTech
HCLTech
Join our innovative team as a Data Architect specializing in Data Engineering. This role is pivotal in shaping the future of our automotive and connected-vehicle data platforms. We are seeking a seasoned professional with a deep understanding of data engineering principles and a proven track record in designing robust, scalable data architectures.
As a Technical Architect, you will be instrumental in defining and maintaining the end-to-end data engineering architecture. Your expertise will drive the design of efficient data pipelines and the implementation of advanced data architecture patterns like data lakes and lakehouses. This is an opportunity to work with cutting-edge technologies and contribute to significant advancements in vehicle data utilization.
Key responsibilities include defining and maintaining the comprehensive data engineering architecture for automotive and connected-vehicle data platforms.
You will design scalable and efficient data pipelines for ingestion, transformation, processing, storage, and consumption. This involves establishing appropriate data architecture patterns, including data lake/lakehouse configurations and layered processing approaches.
The role requires working with diverse vehicle data, such as telemetry, logged parameters, DTCs, and status information, while understanding the intricate relationships between vehicle signals, ECUs, configurations, and software versions.
You will architect robust data ingestion and transformation pipelines using technologies like Python, SQL, and PySpark, alongside optimizing ETL/ELT workflows and defining strategies for data storage, partitioning, schema management, incremental processing, and data lifecycle.
We are looking for individuals with significant experience in data engineering, solution architecture, or technical leadership roles, possessing a minimum of 10 years of overall experience and at least 8 years of hands-on data engineering expertise.
Essential skills include strong proficiency in Python, SQL, PySpark, and distributed data processing, complemented by a deep understanding of data modelling, ETL/ELT processes, data integration, performance optimization, and data quality engineering.
Ideal candidates will have at least 3 years of experience, with 5 years being preferred, in the automotive domain, focusing on commercial vehicles, trucks, connected vehicles, or vehicle telemetry data. A demonstrated ability to translate business requirements into scalable and maintainable data engineering architectures is crucial.
Familiarity with Databricks, Delta Lake, and Azure data services is considered a strong advantage for this role.
HCLTech
Automotive