Azure Databricks Sr.Architect

Birlasoft

15+ yrs Mumbai, Pune, Noida, Bengaluru, Chennai, Hyderabad Full Time Hybrid (office + remote)
Birlasoft logo
Posted : 1 week ago
Actively hiring

Job description

Seeking a seasoned Azure Databricks Senior Architect with extensive experience in designing and implementing robust data solutions on the Azure cloud platform. This role requires a deep understanding of data architecture, pipeline development, and cloud services to support growing data volumes and complexities.

Ideal candidates will possess a strong client-facing aptitude and the ability to lead technical teams. You will be instrumental in driving architectural decisions, conducting Proofs of Concept (POCs), and ensuring efficient resource utilization and system integration.

This position offers an opportunity to shape the future of our data and analytics landscape, providing technical guidance and mentorship to foster best practices in design and development.

Responsibilities

Architect, develop, and maintain scalable data pipelines, database designs, and data architectures. Integrate new data sources to accommodate increasing data volume and complexity.

Design and implement Data Lakes and Data Warehouses using Azure Cloud Services. Assist in developing end-to-end data and analytics solution architectures and conduct POCs within Azure.

Drive the design, sizing, and setup of Azure environments and related services for various use cases. Review solution requirements and support architectural design to ensure optimal technology selection and resource utilization.

Engage with clients, facilitate requirements sessions, and lead technical teams effectively. Present solutions to both technical and business stakeholders. Provide technical guidance, mentorship, and code reviews, promoting design-level best practices.

Qualifications

A minimum of 15 years of industry experience is required, including at least 3 years in an architect role and 3-4 years specifically designing and building analytics solutions in Azure.

Demonstrated experience in architecting data ingestion and integration frameworks for batch and real-time processing of structured, semi-structured, and unstructured data. Hands-on experience with designing reporting schemas, data marts, and developing reporting solutions.

Proficiency in developing batch processing, streaming, and integration solutions, capable of handling diverse data types. Experience with ETL development, both on-premises and in the cloud, using tools like SSIS, Data Factory, and Azure Analysis Services.

Experience with Azure services such as Azure Synapse, Data Factory, Azure Data Lake Storage, Databricks, Python, and SSIS for design, development, and deployment. Familiarity with transactional, temporal, time series, structured, and unstructured data is essential.

A comprehensive understanding of operational dependencies, including applications, networks, systems, security, and policy, across on-premise and cloud environments (VMs, Networking, VPN, Active Directory, Storage, Windows/Linux) is crucial.

Essential Skills

Azure DatabricksPythonPysparkData FactoryData LakeAzure SynapseAzure Data Lake StorageDatabricks

Highlights

  • Actively hiring

More Details

RoleAzure Databricks Sr.Architect
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Birlasoft logo

Birlasoft

IT Consulting