Join Microsoft's Azure Data engineering team as a Software Engineer II, contributing to the cutting-edge transformation of data analytics. This role is pivotal in building the data platform for the AI era, empowering data-first applications and fostering a data-driven culture. You'll work with an impressive portfolio of products including Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, and Power BI, shaping the future of big data analytics.

The big data analytics team within Azure Data focuses on providing tools for data engineers and scientists to derive insights from all types of data. You will be instrumental in developing the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric. This position offers hands-on experience with large-scale distributed systems, cloud platform engineering, and the maintenance of Azure HDInsight.

Embrace a culture that values diverse perspectives and actively seeks them out to drive innovation and better serve customers.

As a Software Engineer II, you will design, develop, and deploy high-quality code for Fabric Materialized Lake View services and HDInsight components using languages such as C#, Java, Scala, or Python. You'll own features throughout their entire lifecycle, from initial requirements and design to implementation, deployment, and ongoing production support.

Key responsibilities include designing and optimizing data refresh, scheduling, and query features with minimal oversight, and evaluating design options to contribute to the architecture of Fabric data engineering components. You will also be responsible for reviewing teammates' code, providing constructive feedback to enhance team-wide code quality, and debugging complex distributed system issues on Azure, Linux, and Windows platforms.

This role involves participating in live site operations, including on-call rotations, to diagnose and resolve issues across Fabric and HDInsight workloads. You'll also integrate logging and instrumentation for system monitoring, collaborate with product managers and partners globally to define requirements, and champion customer security and privacy needs.

We are seeking candidates with a Bachelor's Degree in Computer Science or a related technical field, coupled with at least 4 years of technical engineering experience. Proficiency in coding with languages such as Apache Spark, Kafka, Spark SQL, PySpark, C, C++, C#, Java, JavaScript, or Python is essential.

Alternatively, candidates with equivalent experience will be considered. A Master's degree plus 4 years of technical engineering experience, or a Bachelor's degree plus 4 years of technical engineering experience, is also a strong qualification. Experience with the Azure stack (Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, Power BI) and big data technologies like Spark, Kafka, Hadoop, or HBase is highly preferred.

Familiarity with container-based architectures (Docker, Kubernetes) and the ability to debug complex distributed systems on Linux and/or Windows platforms are valuable. Meeting specific Microsoft, customer, and government security screening requirements, including the Microsoft Cloud Background Check, is mandatory for this role.