Databricks - Technical Specialist-Data Engg

Birlasoft

Fresher Pune Full Time Work from office
Birlasoft logo
Posted : 1 week ago
Actively hiring

Job description

Join our team as a Technical Specialist in Data Engineering. This role focuses on designing, developing, and deploying robust data solutions leveraging Azure services.

You will be instrumental in building and maintaining scalable data pipelines, ensuring seamless integration of new data sources. This position requires a deep understanding of data processing across various formats and a commitment to collaborative problem-solving.

Responsibilities

Design, develop, and deploy solutions using Azure services like Data Factory, Azure Data Lake Storage, Databricks, PySpark, and SQL.

Create and maintain scalable data pipelines, integrating new data sources to manage increasing data volumes and complexity.

Develop batch processing, streaming, and integration solutions for structured and non-structured data.

Collaborate effectively with BI, analytics, and business teams to align technical solutions with business objectives.

Qualifications

Proficiency in Azure Data Factory, Azure Databricks, PySpark, and ADLS is essential.

Experience with SQL and configuring/administering Azure SQL DB is required.

Familiarity with XML, CSV, Excel, ORC, and Parquet file formats is necessary.

Demonstrated skills in designing technical specifications and application interfaces are expected. Knowledge of operational dependencies across applications, networks, systems, and security is also important.

Essential Skills

Azure Data FactoryAzure DatabricksPySparkADLSSQLData PipelinesETLXMLCSVExcelORCParquet

Good to Have

SSISInformatica

Highlights

  • Actively hiring

More Details

RoleDatabricks - Technical Specialist-Data Engg
DepartmentData Engineering, Software Development
Employment TypeFull Time, Work from office

About the Company

Birlasoft logo

Birlasoft

IT Consulting

Databricks - Technical Specialist-Data Engg at Birlasoft | SkillMX | SkillMX