Databricks Data Engineer
Infosys
Infosys
Join our Data & Analytics practice to modernize data landscapes using cloud-native architectures, advanced analytics, and AI. As a Databricks Data Engineer, you will drive enterprise-scale data modernization, focusing on Lakehouse implementations, cloud migrations, real-time analytics, and building AI-ready data ecosystems. This role offers a significant opportunity to contribute to cutting-edge data solutions within a leading organization.
Infosys Limited is seeking a Senior Systems Engineer specializing in Data and Analytics. This position is integral to our mission of empowering organizations with intelligent data platforms.
Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark. Build and optimize ETL/ELT workflows for large datasets, and develop data ingestion frameworks from diverse sources. Implement and manage Lakehouse architecture with Databricks and Delta Lake, optimizing Spark jobs for performance and cost. Collaborate with analytics, BI, and business teams to deliver data assets, while implementing data quality, monitoring, and governance controls. Troubleshoot production issues, participate in architecture and code reviews, and create technical documentation.
We are looking for candidates with 2-3 years of experience in Data Engineering and Big Data technologies, possessing strong hands-on Databricks expertise. Proficiency in PySpark or Spark SQL, along with robust SQL skills and experience in query optimization, is essential. Familiarity with designing and developing ETL/ELT pipelines, Delta Lake, DataFrames, Spark architecture, and data warehousing concepts is required. Experience with cloud platforms like Azure, AWS, or GCP, along with Git and DevOps practices, is expected. Strong analytical and problem-solving skills are key.
Infosys
IT Consulting