Staff Data Engineer - P4 Lead Senior| Fullstack Java | Bengaluru | Engineering as a Service/ Operate

Deloitte

7+ yrs Bengaluru Full Time Work from office
Deloitte logo
Posted : today
Actively hiring

Job description

Join our dynamic team as a Lead Data Engineer, focusing on optimizing workflows and data streams within the music supply chain. This role offers a unique opportunity to architect and deliver resilient, scalable systems, blending technical leadership with strategic insight.

You'll be instrumental in transforming business needs into innovative solutions, driving data-informed decision-making. If you are a proactive engineer eager to shape development direction and collaborate with top talent in an agile, innovative environment, this position is for you.

Our focus areas include music repertoire, planning, distribution, and sales, with an emphasis on robust data integrations between various systems.

Responsibilities

Lead the architectural design and implementation of large-scale projects, ensuring technical excellence and adherence to organizational standards. Mentor senior engineers, facilitate cross-functional collaboration with Product Management, QA, and Design teams, and mediate stakeholder disagreements to drive alignment.

Own and spearhead development projects, setting architectural direction to ensure scalability and maintainability. Your decisions will significantly impact project and team outcomes, with a scope encompassing strategic planning and large-scale solutions.

Broadly influence product and project success, driving innovation and technical strategy with a material impact on business objectives and OKRs.

Qualifications

A minimum of 7 years in software engineering, with a proven track record in designing and delivering production-grade applications. Expertise in Python, large-scale data processing with Apache Spark, and advanced SQL for data modeling and performance tuning is essential.

Proficiency with data platform technologies like Databricks and Snowflake, and orchestration tools such as Apache Airflow is required. A deep understanding of data integration, ETL/ELT pipeline design, containerization (Docker, Kubernetes), and DevOps practices (CI/CD) is crucial.

Strong knowledge of AWS cloud environments, data lakehouse and microservices architectures, and API integration (RESTful, GraphQL) is necessary. Experience with Linux environments, shell scripting, and modern programming paradigms (object-oriented, functional) is expected. Familiarity with data governance, security, and observability best practices, along with excellent communication and problem-solving skills within Agile frameworks, is key.

Essential Skills

PythonApache SparkSQLDatabricksSnowflakeApache AirflowETLELTCI/CDDockerKubernetesAWSData LakehouseMicroservicesAPI IntegrationKafkaLinuxShell ScriptingObject-Oriented ProgrammingFunctional ProgrammingData GovernanceAgile Methodologies

Good to Have

GraphQLKinesisPub/SubGitLabPostgreSQLServerless Computing

Highlights

  • Actively hiring

More Details

RoleStaff Data Engineer - P4 Lead Senior| Fullstack Java | Bengaluru | Engineering as a Service/ Operate
IndustryTechnology, Music, Entertainment
DepartmentData Engineering, Software Development
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

Technology

Staff Data Engineer - P4 Lead Senior| Fullstack Java | Bengaluru | Engineering as a Service/ Operate at Deloitte | SkillMX | SkillMX