Azure Databricks Architect

Birlasoft

15 yrs Mumbai, Pune, Noida, Bengaluru, Chennai, Hyderabad Full Time Hybrid (office + remote)
Birlasoft logo
Posted : 6 days ago
Actively hiring

Job description

Seeking a seasoned Azure Databricks Sr. Architect with over 15 years of extensive industry experience, including a minimum of 3 years in a dedicated architect role. This position requires a deep understanding of designing and implementing robust analytics solutions within the Azure ecosystem.

The ideal candidate will possess a proven track record in architecting data ingestion and integration frameworks for diverse data sets and implementing real-time and batch processing solutions. A strong grasp of Azure cloud services, database design, and data pipeline development is essential for success in this role.

Responsibilities

As an Azure Databricks Architect, you will be instrumental in developing and maintaining scalable architecture, optimizing database design, and building efficient data pipelines. You will lead the integration of new data sources to accommodate growing data volumes and complexity.

Key responsibilities include designing and developing data lakes and data warehouses using Azure Cloud Services. You will also assist in architecting end-to-end data and analytics solutions, conducting Proofs of Concept (POCs) within Azure, and driving the design and sizing of Azure environments. Client-facing skills are crucial for facilitating requirements sessions and leading teams, alongside providing technical guidance and mentoring.

Qualifications

This role mandates 12-15 years of industry experience, with at least 3 years in an architect capacity and 3-4 years focused on Azure analytics solutions. Expertise in architecting data ingestion/integration frameworks, handling structured, semi-structured, and unstructured data, and designing reporting schemas is necessary.

Demonstrated experience with ETL development on-premises and in the cloud, specifically using SSIS, Data Factory, and Azure Analysis Services, is required. Proficiency in Azure services such as Azure Synapse, Data Factory, Azure Data Lake Storage, Databricks, Python, and SSIS for design, development, and deployment is also a must. A thorough understanding of operational dependencies across applications, networks, systems, security, and policy is expected.

Essential Skills

Azure DatabricksPythonPySparkData FactoryData LakeAzure SynapseAzure Data Lake StorageDatabricks

Highlights

  • Actively hiring

More Details

RoleAzure Databricks Architect
DepartmentCloud Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Birlasoft logo

Birlasoft

IT Consulting