Consultant | Microsoft Azure | Kolkata | Engineering | Data Modernization & Migration
Deloitte
Deloitte
Join our team as a Consultant specializing in Microsoft Azure, focusing on Data Modernization and Migration initiatives. This role is based in Kolkata and offers an exciting opportunity to work with cutting-edge data technologies.
You will play a key part in designing and implementing robust data solutions that drive business value and enable advanced analytics. Your expertise will be crucial in transforming data landscapes for our clients.
Key responsibilities include architecting and developing scalable data pipelines using Azure Data Factory or Fabric Data Factory. You will build advanced Lakehouse and Warehouse solutions leveraging OneLake, Delta tables, SQL, and Spark. Developing reusable Python/PySpark notebooks for data transformation and quality processing is essential. The role involves implementing various pipeline patterns, creating curated data layers, and ensuring robust logging and exception handling. Optimization of SQL queries, Spark jobs, and data models will be a critical aspect, alongside supporting deployments and troubleshooting production incidents.
Collaboration is key; you'll work closely with business analysts, architects, and other engineering teams. Peer reviews and mentoring junior engineers are also part of this dynamic role.
Mandatory technical skills encompass strong SQL proficiency, including advanced concepts and performance tuning, alongside hands-on experience with Python/PySpark. You must have practical experience with Azure Data Factory or Fabric Data Factory and building Lakehouse, data warehouse, or enterprise data-platform solutions. Familiarity with Delta Lake, Parquet, partitioning, and medallion architecture is required. A solid understanding of data modeling principles and experience with Git and CI/CD tools like Azure DevOps are essential. Working knowledge of Power BI semantic models and cloud security best practices is also necessary.
Deloitte
Engineering