Senior Analyst(Development) (IN)
HCLTech
HCLTech
Join our team as a Senior Analyst specializing in development. We are seeking a seasoned Data Engineer to architect, build, and manage robust data platforms, efficient data pipelines, and advanced cloud-based analytics solutions. The ideal candidate will possess deep expertise in data integration, ETL/ELT processes, big data technologies, cloud environments, and data governance principles.
Key duties include designing and developing scalable ETL/ELT pipelines, constructing and maintaining data lakes, data warehouses, and Lakehouse architectures. You will develop both batch and real-time data processing solutions, implement comprehensive data quality checks, monitoring, and governance frameworks. Responsibilities also cover optimizing database performance, enhancing large-scale data processing workloads, and automating data workflows.
Further responsibilities involve collaborating closely with analytics, AI/ML, and business teams to foster data-driven decision-making. You will implement CI/CD practices for data engineering solutions and ensure adherence to all security, privacy, and governance standards.
Essential technical skills include proficiency in Python, SQL, and PySpark. Experience with Azure Data Factory, AWS Glue, or Informatica is required, alongside expertise in Databricks and Apache Spark. Familiarity with Apache Kafka, Data Warehousing Concepts, ETL/ELT Development, and Data Modeling is crucial. Experience with major cloud platforms like Azure, AWS, or GCP, along with Git and CI/CD practices, is also necessary.
Candidates should hold a Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline. Relevant cloud certifications are considered a significant advantage. This role is based in India and requires a strong understanding of on-site collaboration.
HCLTech
IT Consulting