Technical Specialist (IN)

HCLTech

Fresher India Full Time Work from office
HCLTech logo
Posted : today
Actively hiring

Job description

Join our team as a Technical Specialist and drive innovation in data engineering. This role focuses on designing and developing robust batch and real-time data pipelines crucial for advanced analytics, AI, and machine learning applications.

You will be instrumental in building and optimizing data infrastructure, ensuring efficiency and scalability. The position requires a proactive approach to data management, quality assurance, and operational excellence.

If you have a passion for data and a knack for solving complex technical challenges, we encourage you to apply and contribute to cutting-edge projects.

Responsibilities

Key responsibilities include architecting and implementing batch and real-time data pipelines for AI and machine learning initiatives. You'll develop sophisticated Kafka workflows, manage and optimize BigQuery datasets for peak performance and cost-effectiveness, and integrate diverse data sources.

This role involves preparing high-quality, reusable datasets and feature pipelines for model training and deployment. You will establish comprehensive data quality checks, implement schema validation, and manage data lineage and metadata.

Furthermore, you'll build reliable orchestration, CI/CD pipelines, and automated testing. Troubleshooting pipeline issues, collaborating with data scientists to operationalize ML workflows, and documenting all technical aspects are also core duties.

Qualifications

We are seeking candidates proficient in Python programming and advanced SQL. Proven hands-on experience with Apache Kafka in production environments is essential, alongside strong expertise in Google BigQuery, including data modeling and performance tuning.

Practical knowledge of ETL/ELT patterns, data warehousing concepts, and distributed processing is required. Experience building data pipelines for AI/ML workloads and understanding machine learning lifecycle concepts are critical.

Familiarity with Google Cloud data services, cloud-native security, workflow orchestration, version control, automated testing, and CI/CD is expected. A solid grasp of data governance, privacy, and access management is also necessary. Strong diagnostic and performance-tuning skills are vital for success in this role.

Essential Skills

PythonSQLApache KafkaGoogle BigQueryETLELTData ModelingData LakesData WarehousesAIMachine LearningGoogle Cloud PlatformCI/CDAutomated TestingWorkflow OrchestrationVersion Control

Highlights

  • Actively hiring

More Details

RoleTechnical Specialist (IN)
Employment TypeFull Time, Work from office

About the Company

HCLTech logo

HCLTech

IT Consulting