Data Engineer
Accenture
Accenture
Join our team as a Data Engineer and play a crucial role in designing, developing, and maintaining robust data solutions. You will be instrumental in generating, collecting, and processing data, building efficient data pipelines, and ensuring high data quality through effective ETL processes. This role offers an exciting opportunity to work with large-scale data and cutting-edge technologies.
As a Data Engineer, you will be expected to lead and collaborate with teams to drive performance and make key decisions. Your responsibilities will include designing and developing highly scalable data pipelines and ETL/ELT processes, building data services/APIs, and ensuring data integrity and consistency. You will optimize data workflows for performance and cost, manage high-volume datasets, and mentor junior team members. Continuous improvement of data engineering processes will be a key focus.
We are seeking a candidate with a strong foundation in Python programming and extensive experience in building scalable data pipelines and distributed data processing systems. A solid understanding of SQL and NoSQL databases, along with advanced query optimization, is essential. Proficiency in ETL/ELT frameworks, multi-cloud platforms (AWS, Azure, or Google Cloud), and workflow orchestration tools like Apache Airflow is required. Familiarity with CI/CD tools and containerization (Docker) is also beneficial. The ideal candidate will possess a minimum of 5 years of experience in Python and have completed 15 years of full-time education.
Accenture
IT Consulting