Databricks Architect

Infosys

11–20 yrs Bengaluru Full Time Hybrid (office + remote)
Infosys logo
Posted : today
Actively hiring

Job description

Join our dynamic Data & Analytics Unit as a Senior Technology Architect, focusing on designing and delivering scalable cloud-based data platforms and advanced analytics solutions. This role requires a strategic thinker with deep expertise in data architecture, cloud-native technologies, and modern data engineering practices. You will be instrumental in building high-performance, secure, and cost-effective data ecosystems leveraging Databricks, Snowflake, and PySpark, collaborating closely with stakeholders and engineering teams to drive innovation and modernization.

Responsibilities

Define and champion enterprise-scale data architecture and modernization strategies. Design comprehensive cloud data platforms using Databricks, Snowflake, and cutting-edge data engineering frameworks. Architect robust batch and real-time data processing pipelines for massive datasets. Lead the implementation of data lakes, lakehouses, and data warehouses. Provide expert architectural guidance on optimizing performance, scalability, governance, security, and reliability.

Collaborate with business stakeholders to translate analytical and reporting needs into technical solutions. Conduct thorough reviews of technical designs and architecture assessments, establishing best practices. Mentor data engineers and technical leads, fostering technical growth across project teams. Lead technology evaluations and proof-of-concept initiatives. Drive cloud migration and modernization efforts from legacy data platforms, ensuring adherence to enterprise security, compliance, and data governance standards. Partner with DevOps and platform teams to implement CI/CD and infrastructure automation for data solutions.

Qualifications

Possess 11-20 years of experience in Data Engineering, Analytics, or Data Platform Architecture. Demonstrate strong expertise in the Databricks Lakehouse Platform and extensive hands-on experience with Snowflake Data Cloud. Exhibit expert-level proficiency in PySpark and distributed data processing. Have significant experience designing enterprise-scale data lakes, data warehouses, and lakehouse architectures. Gain practical experience with major cloud platforms like Azure (ADF, ADLS Gen2, Synapse, Azure Databricks), AWS (S3, Glue, EMR, Redshift), and GCP (BigQuery, DataProc, Cloud Storage).

Showcase strong SQL and data modeling skills, including Dimensional Modeling, Data Vault, and Star Schema. Build ETL/ELT frameworks and reusable data engineering accelerators. Understand Data Governance, Metadata Management, Data Lineage, and Data Quality frameworks. Utilize orchestration tools such as Airflow, Azure Data Factory, or similar. Excel in performance tuning and cost optimization within Databricks and Snowflake environments. Implement CI/CD pipelines using tools like Azure DevOps, GitHub Actions, or Jenkins.

Essential Skills

DatabricksSnowflakePySparkData ArchitectureCloud Data PlatformsData EngineeringETLELTSQLData ModelingAzure DatabricksAzure Data FactoryADLS Gen2SynapseAWS GlueAWS EMRAWS RedshiftGCP BigQueryGCP DataProcCloud StorageAirflowCI/CDAzure DevOpsGitHub ActionsJenkins

Good to Have

Data GovernanceMetadata ManagementData LineageData Quality

Highlights

  • Actively hiring

More Details

RoleDatabricks Architect
IndustryInformation Technology & Services, Data Analytics, Cloud Computing
DepartmentCloud Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Infosys logo

Infosys

Information Technology & Services

Databricks Architect at Infosys | SkillMX | SkillMX