Technical Architect (DPO) (IN)

HCLTech

7–10 yrs India Full Time Remote
HCLTech logo
Posted : today
Actively hiring

Job description

We are seeking a highly skilled Technical Architect with a focus on Data Engineering and Data Governance to join our team. This role is crucial for designing and implementing robust data solutions, ensuring data quality, and driving our AI data engineering initiatives.

This position offers the opportunity to work with cutting-edge technologies in a dynamic environment. If you have a passion for data and a proven track record in architecting complex data systems, we encourage you to apply.

Join us to shape the future of our data landscape and contribute to impactful projects.

Responsibilities

Architect and design scalable data pipelines using Databricks, Delta Lake, and PySpark. Implement and manage streaming data ingestion and workflow orchestration. Develop and optimize complex SQL queries and data models. Leverage AWS services for data storage, processing, and analysis. Implement data quality frameworks and AI data engineering pipelines, including vector search and embedding. Manage CI/CD processes for data solutions using Git and Azure DevOps. Ensure strong data governance, metadata management, and data lineage practices. Collaborate with cross-functional teams to deliver data-driven solutions.

Qualifications

A Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field is required. We are looking for 7-10 years of progressive experience in data engineering and data governance. Expert proficiency in Databricks, advanced SQL, and Python is essential. Demonstrated experience with AWS cloud platforms and data governance tools is expected. Strong understanding of data warehousing, data modeling, and data architecture principles. Familiarity with data quality management, metadata, and lineage is necessary. Excellent analytical, problem-solving, and communication skills are key. Ability to manage multiple projects in a fast-paced environment is important.

Essential Skills

DatabricksDelta LakeDLT / LakeflowStreaming PipelinesWorkflow OrchestrationPySparkStructured StreamingWindow FunctionsPartitioningBroadcast joinsAdaptive Query ExecutionPerformance TuningSQLAdvanced JoinsCTEsMERGESubqueriesRecursive CTEsQuery OptimizationExecution PlansAWSS3GlueIAMLambdaCloudWatchKinesisData QualityDQXGreat ExpectationsDelta ExpectationsReconciliation FrameworksAI Data EngineeringChunking methodsDocument ingestionEmbedding pipelinesVector Search implementationMetadata enrichmentCICDGitAzure DevOps / GitHub ActionsTerraformDatabricks Asset BundlesPythonETL toolsCloud data platformsData governance toolsData modelingData warehousingData lineageAnalytical skillsProblem-solving skillsDecision-making skillsCommunication skillsInterpersonal skills

Highlights

  • Actively hiring

More Details

RoleTechnical Architect (DPO) (IN)
DepartmentData Engineering
Employment TypeFull Time, Remote

About the Company

HCLTech logo

HCLTech

IT Consulting