Technical Architect (IN)
HCLTech
HCLTech
We are seeking an experienced AWS AI Data Architect with extensive expertise in AWS Cloud, Artificial Intelligence/Machine Learning, Databricks, Python, and PySpark. This role involves designing, architecting, and implementing cutting-edge AI-driven data platforms, modern data lakehouse solutions, and advanced analytics frameworks.
The ideal candidate will bring hands-on experience in cloud-native data engineering, generative AI solutions, MLOps, and large-scale enterprise data modernization initiatives. This position is crucial for driving innovation and building scalable data solutions.
Key responsibilities include architecting and designing enterprise-scale data solutions on AWS, including Data Lakes, Lakehouses, Data Warehouses, and AI/ML platforms. You will define robust data governance, security, metadata management, and compliance frameworks, alongside designing batch, streaming, and real-time data processing systems.
This role also involves building and deploying AI/ML solutions using AWS AI services and developing Generative AI applications with AWS Bedrock, Foundation Models, and LLMs. Designing Retrieval-Augmented Generation (RAG) architectures, implementing Vector Databases, Embedding Models, and Prompt Engineering frameworks are also key functions. Collaboration with Data Scientists and ML Engineers to operationalize AI models is expected.
Essential skills encompass a deep understanding of AWS, including Data Lake Architecture, AWS Glue, Lambda, EMR, Redshift, Step Functions, Athena, Kinesis, SageMaker, Bedrock, and IAM. Expertise in AI, Machine Learning, Databricks, Python, and PySpark is mandatory. Experience with designing Databricks Lakehouse architecture, developing scalable ETL/ELT pipelines using PySpark, and optimizing Delta Lake performance is crucial.
Furthermore, proficiency in MLOps and DevOps practices, including CI/CD pipelines for Data and AI workloads, is required. The ability to automate infrastructure using Terraform or CloudFormation and monitor/optimize cloud costs, performance, and security is also vital. Experience in training and developing teams, ensuring knowledge up-gradation with new technologies, and gathering client specifications to deliver solutions based on domain or technology understanding are also part of the role.
HCLTech
IT Consulting