Lead Associate | Data Engineering | Hyderabad | Engineering as a Service/ Operate (Hyderabad, IN)
Deloitte
Deloitte
Join our dynamic team as a Data Engineer and play a crucial role in building and maintaining our advanced data platforms. This position offers the opportunity to work independently on complex data challenges, collaborating closely with stakeholders to deliver impactful data solutions.
You will be instrumental in shaping the future of our data infrastructure, enabling analytics, reporting, and AI/ML initiatives. This role also involves mentoring team members and driving continuous improvement in our data engineering practices.
Design, develop, and maintain robust, scalable data pipelines for ingestion, transformation, and integration.
Construct and optimize ETL/ELT workflows to process diverse datasets from various sources.
Translate business and customer requirements into effective technical data solutions.
Address and resolve complex engineering problems and non-standard data challenges.
Develop and manage data models, ensuring data quality and implementing validation processes.
Collaborate with cross-functional teams, including data analysts, scientists, product managers, and business users, to deliver reliable data assets.
Monitor and enhance pipeline performance, reliability, scalability, and cost-effectiveness.
Support cloud-based data platforms and data warehouse/lakehouse environments.
Implement comprehensive data governance, security, lineage, and compliance standards.
Create detailed technical documentation and operational procedures.
Participate in code reviews, championing engineering best practices for development, testing, and deployment.
Troubleshoot production issues, conduct root-cause analysis, and implement lasting solutions.
Contribute to automation, CI/CD processes, and ongoing enhancements within the data ecosystem.
Hold a Bachelor's degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related field.
Possess 3+ years of experience in data engineering, software engineering, or big data development.
Demonstrate experience in developing ETL/ELT pipelines and managing large-scale datasets.
Showcase experience with data warehouses, data lakes, and modern data architectures.
Exhibit strong proficiency in SQL and Python for data processing and engineering tasks.
Possess knowledge of cloud data platforms such as Azure, AWS, or Google Cloud.
Understand core principles of data modeling, data quality, and data governance.
Display proven analytical and problem-solving abilities.
Exhibit excellent communication and stakeholder collaboration skills.
Demonstrate the ability to work independently, manage multiple priorities, and require minimal supervision.
Deloitte
IT Consulting