Developer
Persistent
Persistent
Join Persistent as an Abinitio-Python Developer, contributing to a leading Digital Engineering and Enterprise Modernization partner. This role is key to designing, developing, and optimizing data processing applications using Python, PySpark, Advanced SQL, and Big Data technologies. You will be instrumental in data engineering, ETL development, and leveraging cloud platforms for large-scale data solutions. Collaborate with stakeholders and cross-functional teams to deliver high-performance, scalable data initiatives. This is a full-time opportunity based in Bangalore, requiring 5-8 years of experience.
Develop and optimize complex Ab Initio ETL workflows and data integration solutions, utilizing expertise in GDE, Co>Operating System, EME, Conduct>IT, and Express>IT. Design and implement robust data warehousing concepts and ETL patterns, ensuring performance tuning. Leverage Ab Initio components like Reformat, Rollup, and Join for data manipulation. Manage metadata, analyze dependencies, and perform code migration using EME. Provide strong troubleshooting and production support. Scripting with Unix/Linux and scheduling with Autosys are essential. Develop scalable data processing solutions and automation frameworks using Python, including Pandas, NumPy, and PySpark. Build applications using REST APIs, Flask/FastAPI, and microservices architecture, focusing on data ingestion, transformation, and orchestration. Gain experience with cloud platforms (AWS, Azure, GCP) and DevOps practices (CI/CD, Git, Docker). Optimize and debug Python applications for performance.
A Bachelor's or Master's degree in a relevant field such as Computer Science or Engineering is required. We seek candidates with 5-8 years of software development and data engineering experience. Strong proficiency in Python and PySpark is crucial, alongside extensive experience with Advanced SQL and database performance tuning. Hands-on Ab Initio ETL development and data integration expertise is essential. Solid knowledge of Teradata databases, large-scale data warehousing, and Big Data technologies including Apache Spark and Hadoop ecosystem is expected. Familiarity with cloud platforms (AWS, Azure, GCP) and NoSQL databases like MongoDB is beneficial. Working knowledge of Autosys job scheduling and production support activities is important. Understanding of Data Lake, Data Warehouse, and modern data architecture concepts, coupled with Agile/Scrum methodologies, is valued. Excellent analytical, problem-solving, and communication skills are necessary for effective collaboration.
Persistent Systems
IT Consulting