Senior Data Engineer (Noida, UP, India)
Iris Software
Iris Software
Join Iris Software, a rapidly expanding IT services company and one of India's Top 25 Best Workplaces in the IT industry. We are dedicated to being our clients' most trusted technology partner and a preferred destination for top industry professionals. With a global presence and a focus on cutting-edge technologies like Data & Analytics, Cloud, and DevOps, we offer exciting opportunities for career growth and success.
Our Employee Value Proposition, "Build Your Future. Own Your Journey.", underscores our commitment to empowering individuals. At Iris, your potential is valued, your voice is heard, and your work makes a tangible impact. We provide extensive opportunities for continuous learning, mentorship, and personalized career development to help you excel both professionally and personally.
Develop and maintain SSIS jobs and AWS-based ETL pipelines. Analyze existing SSIS workflows and refactor them for cloud execution on AWS, leveraging services like Lambda, Glue, and EMR. Write Python and advanced SQL code for data manipulation and processing. Implement and automate data pipelines, ensuring robust data flow and reliability. Monitor and troubleshoot data migration processes, addressing issues promptly. Collaborate with stakeholders to gather data requirements and design effective solutions.
Document migration procedures, best practices, and technical specifications. Understand C# scripting for integration purposes. Work with cloud services such as Dynamo DB, Redshift, and RDS. Gain awareness of reporting tools like Power BI.
Possess a Bachelor's degree in Computer Science, Information Technology, or a related field. Bring at least 5 years of experience in data migration or similar roles. Demonstrate strong proficiency in SSIS and proven experience building ETL pipelines on AWS. Expertise in Python and advanced SQL is essential, along with a good understanding of the Spark ecosystem and PySpark programming. Familiarity with data modeling and schema design principles is required.
Ability to analyze and resolve complex data-related issues. Strong analytical and problem-solving skills. Excellent communication and collaboration capabilities. Capacity to work effectively both independently and as part of a team. Familiarity with Agile project management methodologies is preferred.
Iris Software
IT Consulting