Development Lead - Advanced RPA (IN)
HCLTech
HCLTech
Join our innovative team as an Advanced RPA Development Lead, a pivotal role focused on designing, constructing, and enhancing robust data solutions across AWS and Microsoft Azure cloud platforms. This position demands deep, practical expertise in Databricks, data lake and lakehouse architectures, efficient ETL/ELT pipelines, and data warehousing principles. You will be instrumental in delivering business-ready reporting solutions powered by Power BI, ensuring scalability and performance.
This is an exciting opportunity to leverage cutting-edge technologies and contribute to data-driven decision-making within a dynamic environment. Your work will directly impact how we understand and utilize our data.
Key responsibilities include the end-to-end development, testing, and maintenance of scalable batch and streaming data pipelines on AWS and Azure. You will construct and fine-tune Databricks lakehouse environments utilizing PySpark, Delta Lake, and medallion architecture. Integrating diverse data sources, both structured and unstructured, will be a core function, always prioritizing reliability, scalability, and cost-effectiveness. Furthermore, you will develop sophisticated data models and semantic layers to empower Power BI dashboards and self-service analytics. Implementing comprehensive data quality, security, governance standards, metadata management, and lineage tracking throughout the data lifecycle is essential. Proactive monitoring, performance optimization of pipelines and queries, and supporting production data operations are also critical aspects of this role. Close collaboration with architects, analysts, BI developers, and business stakeholders will be vital to translate reporting requirements into dependable, high-quality data products.
We are seeking candidates with 6–10+ years of dedicated data engineering experience, including extensive hands-on delivery within AWS and Azure cloud environments. Proven, strong experience with Databricks and Power BI in large-scale enterprise analytics settings is a must. Familiarity with tools such as Snowflake, Fivetran, HVR, Tableau, Atlan, or similar data integration and governance platforms is advantageous. A solid understanding of cloud security best practices, cost optimization strategies, deployment automation, and production support methodologies is expected. Excellent stakeholder communication, adept problem-solving abilities, meticulous documentation skills, and a talent for cross-functional collaboration are paramount for success in this role.
HCLTech
IT Consulting