Senior Data Engineer (Noida, UP, India)

Iris Software

5+ yrs Noida Full Time Work from office
Iris Software logo
Posted : today
Actively hiring

Job description

Join Iris Software, a rapidly expanding IT services company and one of India's Top 25 Best Workplaces in the IT industry. We are dedicated to being our clients' most trusted technology partner and a preferred destination for top industry professionals. With a global presence and a focus on cutting-edge technologies like Data & Analytics, Cloud, and DevOps, we offer exciting opportunities for career growth and success.

Our Employee Value Proposition, "Build Your Future. Own Your Journey.", underscores our commitment to empowering individuals. At Iris, your potential is valued, your voice is heard, and your work makes a tangible impact. We provide extensive opportunities for continuous learning, mentorship, and personalized career development to help you excel both professionally and personally.

Responsibilities

Develop and maintain SSIS jobs and AWS-based ETL pipelines. Analyze existing SSIS workflows and refactor them for cloud execution on AWS, leveraging services like Lambda, Glue, and EMR. Write Python and advanced SQL code for data manipulation and processing. Implement and automate data pipelines, ensuring robust data flow and reliability. Monitor and troubleshoot data migration processes, addressing issues promptly. Collaborate with stakeholders to gather data requirements and design effective solutions.

Document migration procedures, best practices, and technical specifications. Understand C# scripting for integration purposes. Work with cloud services such as Dynamo DB, Redshift, and RDS. Gain awareness of reporting tools like Power BI.

Qualifications

Possess a Bachelor's degree in Computer Science, Information Technology, or a related field. Bring at least 5 years of experience in data migration or similar roles. Demonstrate strong proficiency in SSIS and proven experience building ETL pipelines on AWS. Expertise in Python and advanced SQL is essential, along with a good understanding of the Spark ecosystem and PySpark programming. Familiarity with data modeling and schema design principles is required.

Ability to analyze and resolve complex data-related issues. Strong analytical and problem-solving skills. Excellent communication and collaboration capabilities. Capacity to work effectively both independently and as part of a team. Familiarity with Agile project management methodologies is preferred.

Essential Skills

PythonAdvanced SQLSparkPySparkAWSSSISC# scriptingData pipeline automationETLLambdaGlueEMRDynamo DBS3RedshiftEC2RDSStep FunctionsCloud WatchSystems ManagerEvent BridgeDMS

Good to Have

KafkaKinesisAIPower BIPostgre SQLDBT

Highlights

  • Actively hiring

More Details

RoleSenior Data Engineer (Noida, UP, India)
Employment TypeFull Time, Work from office

About the Company

Iris Software logo

Iris Software

IT Consulting

Senior Data Engineer (Noida, UP, India) at Iris Software | SkillMX | SkillMX