Azure Databricks

Birlasoft

6–10 yrs Noida, Mumbai, Pune, Bengaluru, Hyderabad, Chennai Full Time Work from office
Birlasoft logo
Posted : today
Actively hiring

Job description

Seeking an experienced Data Engineer with a strong background in Azure Databricks, PySpark, and data modeling to join our dynamic team. This role involves designing, developing, and deploying robust data solutions on Azure services.

You will be instrumental in building and maintaining scalable data pipelines, integrating new data sources, and creating efficient data warehouse solutions.

If you possess a deep understanding of modern data warehousing concepts and are adept at handling both structured and unstructured data, we encourage you to apply.

Responsibilities

Design, develop, and deploy solutions utilizing Azure Services, including Databricks, PySpark, SQL, and Data Factory.

Develop and maintain scalable data pipelines, while also building new data source integrations to accommodate growing data volumes and complexities.

Create detailed technical specifications and application interface designs.

Develop modern data warehouse solutions using the Azure Stack, specifically Azure Data Lake and Azure Databricks, leveraging PySpark for advanced processing.

Implement batch processing and integration solutions, effectively processing both structured and non-structured data.

Collaborate closely with BI, analytics, and business teams to ensure data solutions align with strategic objectives.

Qualifications

A minimum of 6 to 10 years of relevant experience in data engineering.

Proven expertise in designing, developing, and deploying solutions using Azure Services such as Databricks, PySpark, SQL, and Data Factory.

Demonstrated ability to develop and maintain scalable data pipelines and integrate diverse data sources.

Experience in creating technical specification designs and application interface designs.

Proficiency in developing modern data warehouse solutions with Azure Stack (Azure Data Lake, Azure Databricks) and PySpark.

Skilled in developing batch processing and integration solutions, handling structured and non-structured data.

In-depth knowledge of Databricks, PySpark, and SQL is essential.

Strong collaboration and communication skills to engage effectively with BI, analytics, and business teams.

Essential Skills

Azure DatabricksPySparkData ModellingSQLAzure Data FactoryAzure Data Lake

Highlights

  • Actively hiring

More Details

RoleAzure Databricks
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Birlasoft logo

Birlasoft

IT Consulting

Azure Databricks at Birlasoft | SkillMX | SkillMX