Databricks Data Engineer

Infosys

2–3 yrs Bengaluru Full Time Work from office
Infosys logo
Posted : today
Actively hiring

Job description

Join our Data & Analytics practice to modernize data landscapes using cloud-native architectures, advanced analytics, and AI. As a Databricks Data Engineer, you will drive enterprise-scale data modernization, focusing on Lakehouse implementations, cloud migrations, real-time analytics, and building AI-ready data ecosystems. This role offers a significant opportunity to contribute to cutting-edge data solutions within a leading organization.

Infosys Limited is seeking a Senior Systems Engineer specializing in Data and Analytics. This position is integral to our mission of empowering organizations with intelligent data platforms.

Responsibilities

Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark. Build and optimize ETL/ELT workflows for large datasets, and develop data ingestion frameworks from diverse sources. Implement and manage Lakehouse architecture with Databricks and Delta Lake, optimizing Spark jobs for performance and cost. Collaborate with analytics, BI, and business teams to deliver data assets, while implementing data quality, monitoring, and governance controls. Troubleshoot production issues, participate in architecture and code reviews, and create technical documentation.

Qualifications

We are looking for candidates with 2-3 years of experience in Data Engineering and Big Data technologies, possessing strong hands-on Databricks expertise. Proficiency in PySpark or Spark SQL, along with robust SQL skills and experience in query optimization, is essential. Familiarity with designing and developing ETL/ELT pipelines, Delta Lake, DataFrames, Spark architecture, and data warehousing concepts is required. Experience with cloud platforms like Azure, AWS, or GCP, along with Git and DevOps practices, is expected. Strong analytical and problem-solving skills are key.

Essential Skills

DatabricksApache SparkPySparkSpark SQLSQLETLELTDelta LakeDataFramesSpark ArchitectureData WarehousingDimensional ModelingData Lake ArchitectureAzureAWSGCPGitDevOps

Highlights

  • Actively hiring

More Details

RoleDatabricks Data Engineer
DepartmentData Engineering, Data & Analytics
Employment TypeFull Time, Work from office

About the Company

Infosys logo

Infosys

IT Consulting

Databricks Data Engineer at Infosys | SkillMX | SkillMX