Seeking a talented Consultant to join our team in Kolkata, specializing in Microsoft Azure Data Modernization & Migration. This role is crucial for driving innovation in data solutions, focusing on building robust and scalable data platforms.

Ideal candidates will possess a strong technical background in data engineering and a passion for leveraging Azure services to solve complex data challenges. You will be instrumental in transforming data landscapes and enabling advanced analytics for our clients.

Design and implement advanced batch and incremental data pipelines using Azure Data Factory or Fabric Data Factory. Develop sophisticated Lakehouse and Warehouse solutions leveraging OneLake, Delta tables, SQL, and Spark. Craft reusable Python/PySpark notebooks for data transformation and quality assurance. Implement robust pipeline patterns including full-load, incremental-load, CDC, and parameter-driven approaches.

Construct curated data layers to empower reporting and analytics. Integrate comprehensive logging, exception handling, alerting, and retry mechanisms. Optimize SQL queries, Spark jobs, pipelines, data models, and storage for maximum efficiency. Provide essential support for deployments across all environments and conduct root-cause analysis for production incidents. Collaborate effectively with cross-functional teams.

A strong command of SQL, including advanced techniques like joins, window functions, CTEs, stored procedures, and performance tuning, is essential. Proven hands-on experience with Python and/or PySpark is required. Demonstrated experience with Azure Data Factory or Fabric Data Factory, alongside building Lakehouse, data warehouse, or enterprise data-platform solutions, is expected.

Familiarity with Delta Lake, Parquet, partitioning, and medallion architecture is necessary. A solid understanding of data modeling principles, including star and snowflake schemas, is crucial. Proficiency in using Git and CI/CD tools like Azure DevOps is mandatory. Basic working knowledge of Power BI semantic models and reporting needs, along with an understanding of cloud security concepts, is required.