Data Engineer
Accenture
Accenture
Join our dynamic team as a Data Engineer, playing a crucial role in developing and maintaining the robust data infrastructure essential for processing and analysis within our ecosystem. You will collaborate closely with data scientists, analysts, and other stakeholders, ensuring data is readily available, accurate, and usable for critical business intelligence and analytics initiatives.
This position involves creating and managing sophisticated data pipelines, guaranteeing data integrity, and implementing efficient ETL processes for seamless data migration and deployment across various systems. Your expertise will be vital in supporting our data-driven objectives.
Key responsibilities include integrating diverse database systems into our environment by building and maintaining scalable ETL pipelines capable of handling large data volumes, while upholding strict data governance and security policies.
You'll collaborate within cross-functional teams, delivering solutions to data scientists, analysts, and business partners, and effectively communicating technical concepts to non-technical audiences.
Further duties involve optimizing data architectures and transformation technologies to meet analytical needs, managing database performance, scalability, and availability, and integrating data from various sources like APIs and cloud platforms.
Additionally, you will identify and resolve bottlenecks in data processing, implement monitoring and logging solutions for proactive data reliability, and contribute to the development and optimization of data pipelines.
A strong foundation in Data Engineering is essential, complemented by expertise in AWS Services, Python, SQL, and experience with data warehousing and modeling. Proficiency in database management systems such as SQL (mandatory), NoSQL, PostgreSQL, and MongoDB is required.
Candidates should possess hands-on experience with Kafka, big data technologies including Hadoop and PySpark, and data warehousing solutions like Snowflake, Redshift, or BigQuery. Familiarity with DevOps tools such as GitLab, Docker, and Kubernetes is also expected.
We are seeking individuals with excellent analytical and problem-solving skills, who can work both independently and collaboratively within a team. The ability to coach junior team members is a valuable asset. An educational background reflecting 15 years of full-time study is required.
Accenture
IT Consulting