Databricks - Technical Specialist-Data Engg
Birlasoft
Birlasoft
Join our team as a Technical Specialist in Data Engineering. This role focuses on designing, developing, and deploying robust data solutions leveraging Azure services.
You will be instrumental in building and maintaining scalable data pipelines, ensuring seamless integration of new data sources. This position requires a deep understanding of data processing across various formats and a commitment to collaborative problem-solving.
Design, develop, and deploy solutions using Azure services like Data Factory, Azure Data Lake Storage, Databricks, PySpark, and SQL.
Create and maintain scalable data pipelines, integrating new data sources to manage increasing data volumes and complexity.
Develop batch processing, streaming, and integration solutions for structured and non-structured data.
Collaborate effectively with BI, analytics, and business teams to align technical solutions with business objectives.
Proficiency in Azure Data Factory, Azure Databricks, PySpark, and ADLS is essential.
Experience with SQL and configuring/administering Azure SQL DB is required.
Familiarity with XML, CSV, Excel, ORC, and Parquet file formats is necessary.
Demonstrated skills in designing technical specifications and application interfaces are expected. Knowledge of operational dependencies across applications, networks, systems, and security is also important.
Birlasoft
IT Consulting