Subject Matter Expert (Tools&Automation) (IN)
HCLTech
HCLTech
Seeking a skilled Microsoft Fabric Developer with robust data engineering fundamentals, complemented by applied Machine Learning (ML) and Deep Learning (DL) expertise. This role focuses on constructing and deploying data pipelines within Microsoft Fabric, integrating predictive analytics and AI-driven functionalities.
This is a remote position for professionals aiming to advance AI capabilities in data platforms.
Design, build, and maintain comprehensive data pipelines on Microsoft Fabric, including Data Factory pipelines, Dataflows Gen2, Lakehouse, and OneLake. Develop and deploy ML and DL models for predictive use cases, such as time-series forecasting, clustering, classification, anomaly detection, and sequence models (LSTM/transformers). Construct and operationalize real-time analytics using KQL, Eventstreams, and Eventhouse for streaming data and automated alerting. Implement semantic models, Direct Lake datasets, and Power BI reporting layers to visualize ML/DL outcomes and platform KPIs. Integrate AI capabilities within Fabric and complementary Azure ML/Databricks workloads for data enrichment, feature engineering, and anomaly monitoring. Apply Microsoft Purview governance, RBAC/Entra ID security, workspace design, and data classification to ensure enterprise security and compliance. Establish CI/CD, Git integration, and deployment pipelines for Fabric artifacts like notebooks, pipelines, and semantic models. Collaborate with cross-functional teams to define data contracts, SOPs, and onboarding workflows for new use cases.
Possess 4–7 years of data engineering/AI-ML experience, with a minimum of 2 years hands-on with Microsoft Fabric components (OneLake, Lakehouse, Data Factory/Dataflows Gen2, Synapse Data Warehouse, Real-Time Intelligence/KQL). Demonstrate strong programming proficiency in Python and PySpark, along with solid working knowledge of SQL/T-SQL and DAX. Showcase hands-on Machine Learning expertise, including supervised and unsupervised techniques (classification, clustering, regression, anomaly detection) utilizing scikit-learn or similar tools. Exhibit Deep Learning expertise, with experience in TensorFlow or PyTorch, covering sequence/time-series models (LSTM/GRU) and/or transformer-based architectures. Have experience building ML pipelines for both batch and real-time/streaming scenarios, encompassing feature engineering and retraining workflows. Familiarity with Fabric's Data Science workload and/or Azure Databricks for model development and MLOps is essential. Experience with Fabric governance and security features, including Microsoft Purview, Entra ID, RBAC, and row/object-level security, is required. Possess working knowledge of API development (FastAPI or similar) and OAuth2/Entra ID-based authentication. Have experience with Power BI, specifically Direct Lake, semantic models, and DAX. Exhibit a strong understanding of CI/CD practices (Azure DevOps/Git) and deployment pipelines for Fabric items. Demonstrate strong analytical, problem-solving, and communication skills.
HCLTech
IT Consulting