Staff Data Engineer - P4 Lead Senior| Fullstack Java | Bengaluru | Engineering as a Service/ Operate
Deloitte
Deloitte
Join our dynamic team as a Lead Data Engineer, focusing on optimizing workflows and data streams within the music supply chain. This role offers a unique opportunity to architect and deliver resilient, scalable systems, blending technical leadership with strategic insight.
You'll be instrumental in transforming business needs into innovative solutions, driving data-informed decision-making. If you are a proactive engineer eager to shape development direction and collaborate with top talent in an agile, innovative environment, this position is for you.
Our focus areas include music repertoire, planning, distribution, and sales, with an emphasis on robust data integrations between various systems.
Lead the architectural design and implementation of large-scale projects, ensuring technical excellence and adherence to organizational standards. Mentor senior engineers, facilitate cross-functional collaboration with Product Management, QA, and Design teams, and mediate stakeholder disagreements to drive alignment.
Own and spearhead development projects, setting architectural direction to ensure scalability and maintainability. Your decisions will significantly impact project and team outcomes, with a scope encompassing strategic planning and large-scale solutions.
Broadly influence product and project success, driving innovation and technical strategy with a material impact on business objectives and OKRs.
A minimum of 7 years in software engineering, with a proven track record in designing and delivering production-grade applications. Expertise in Python, large-scale data processing with Apache Spark, and advanced SQL for data modeling and performance tuning is essential.
Proficiency with data platform technologies like Databricks and Snowflake, and orchestration tools such as Apache Airflow is required. A deep understanding of data integration, ETL/ELT pipeline design, containerization (Docker, Kubernetes), and DevOps practices (CI/CD) is crucial.
Strong knowledge of AWS cloud environments, data lakehouse and microservices architectures, and API integration (RESTful, GraphQL) is necessary. Experience with Linux environments, shell scripting, and modern programming paradigms (object-oriented, functional) is expected. Familiarity with data governance, security, and observability best practices, along with excellent communication and problem-solving skills within Agile frameworks, is key.
Deloitte
Technology