Technical Architect (IN)

HCLTech

8+ yrs Noida, Bengaluru, Hyderabad, Chennai, Pune Full Time Remote
HCLTech logo
Posted : today
Actively hiring

Job description

Join our team as an AWS AI Data Architect and lead the design and implementation of cutting-edge AI-driven data platforms. This role requires extensive experience in AWS Cloud, Artificial Intelligence/Machine Learning, Databricks, Python, and PySpark. You will be instrumental in building scalable data lakehouse solutions and advanced analytics architectures.

We are looking for a seasoned professional with hands-on experience in cloud-native data engineering, generative AI solutions, MLOps, and large-scale data modernization initiatives. If you are passionate about shaping the future of data and AI on the cloud, this is the opportunity for you.

Responsibilities

Key responsibilities include architecting and designing enterprise-scale data solutions on AWS, encompassing Data Lakes, Lakehouses, Warehouses, and AI/ML platforms. You will define robust governance, security, and metadata management frameworks, and design efficient batch, streaming, and real-time data processing solutions.

Develop and deploy AI/ML solutions leveraging AWS AI services, including Generative AI applications with AWS Bedrock, Foundation Models, and LLMs. Implement Retrieval-Augmented Generation (RAG) architectures, Vector Databases, and prompt engineering. Collaborate closely with Data Scientists and ML Engineers to operationalize AI models.

Design and implement Databricks Lakehouse architectures, build scalable ETL/ELT pipelines using PySpark, and optimize Delta Lake performance. Implement Unity Catalog, Data Lineage, and Data Governance solutions, developing reusable frameworks for data ingestion, transformation, and orchestration.

Architect solutions using a wide array of AWS services such as S3, Glue, Lambda, EMR, Redshift, Step Functions, Athena, Kinesis, SageMaker, Bedrock, IAM, and CloudWatch. Implement CI/CD pipelines for data and AI workloads, build MLOps frameworks, and automate infrastructure using Terraform or CloudFormation. Continuously monitor and optimize cloud costs, performance, and security.

Qualifications

The ideal candidate possesses 8+ years of experience and expertise in AWS Cloud, AI/ML, Databricks, Python, and PySpark. A strong understanding of data architecture principles, including Data Lakes, Lakehouses, and Warehouses, is essential.

Hands-on experience with cloud-native data engineering, generative AI technologies (AWS Bedrock, LLMs), MLOps, and enterprise data modernization is required. Proficiency in designing and implementing ETL/ELT pipelines, optimizing data processing, and working with tools like Delta Lake and Unity Catalog is crucial.

Familiarity with AWS services like S3, Glue, Lambda, EMR, Redshift, SageMaker, and Bedrock is necessary. Experience with infrastructure automation tools such as Terraform or CloudFormation, and CI/CD practices for data and AI workloads, will be highly valued.

Essential Skills

AWSAIMachine LearningDatabricksPythonPySparkData LakeLakehouseData WarehouseGenerative AIMLOpsData EngineeringETLELTDelta LakeUnity CatalogTerraformCloudFormationCI/CDAmazon S3AWS GlueAWS LambdaAmazon EMRAmazon RedshiftAWS Step FunctionsAmazon AthenaAmazon KinesisAmazon SageMakerAWS BedrockIAMCloudWatch

Highlights

  • Actively hiring

More Details

RoleTechnical Architect (IN)
DepartmentData Architect
Employment TypeFull Time, Remote

About the Company

HCLTech logo

HCLTech

IT Consulting