Data Architect (IN)

HCLTech

10+ yrs India Full Time Remote
HCLTech logo
Posted : today
Actively hiring

Job description

Join our innovative team as a Data Architect specializing in Data Engineering. This role is pivotal in shaping the future of our automotive and connected-vehicle data platforms. We are seeking a seasoned professional with a deep understanding of data engineering principles and a proven track record in designing robust, scalable data architectures.

As a Technical Architect, you will be instrumental in defining and maintaining the end-to-end data engineering architecture. Your expertise will drive the design of efficient data pipelines and the implementation of advanced data architecture patterns like data lakes and lakehouses. This is an opportunity to work with cutting-edge technologies and contribute to significant advancements in vehicle data utilization.

Responsibilities

Key responsibilities include defining and maintaining the comprehensive data engineering architecture for automotive and connected-vehicle data platforms.

You will design scalable and efficient data pipelines for ingestion, transformation, processing, storage, and consumption. This involves establishing appropriate data architecture patterns, including data lake/lakehouse configurations and layered processing approaches.

The role requires working with diverse vehicle data, such as telemetry, logged parameters, DTCs, and status information, while understanding the intricate relationships between vehicle signals, ECUs, configurations, and software versions.

You will architect robust data ingestion and transformation pipelines using technologies like Python, SQL, and PySpark, alongside optimizing ETL/ELT workflows and defining strategies for data storage, partitioning, schema management, incremental processing, and data lifecycle.

Qualifications

We are looking for individuals with significant experience in data engineering, solution architecture, or technical leadership roles, possessing a minimum of 10 years of overall experience and at least 8 years of hands-on data engineering expertise.

Essential skills include strong proficiency in Python, SQL, PySpark, and distributed data processing, complemented by a deep understanding of data modelling, ETL/ELT processes, data integration, performance optimization, and data quality engineering.

Ideal candidates will have at least 3 years of experience, with 5 years being preferred, in the automotive domain, focusing on commercial vehicles, trucks, connected vehicles, or vehicle telemetry data. A demonstrated ability to translate business requirements into scalable and maintainable data engineering architectures is crucial.

Familiarity with Databricks, Delta Lake, and Azure data services is considered a strong advantage for this role.

Essential Skills

Data EngineeringSolution ArchitecturePythonSQLPySparkData ModellingETL/ELTData IntegrationPerformance OptimizationData Quality Engineering

Good to Have

DatabricksDelta LakeAzure Data ServicesTime-Series Data

Highlights

  • Actively hiring

More Details

RoleData Architect (IN)
IndustryAutomotive
DepartmentData Engineering
Employment TypeFull Time, Remote

About the Company

HCLTech logo

HCLTech

Automotive

Data Architect (IN) at HCLTech | SkillMX | SkillMX