Administrator (Support & Operations) (IN)

HCLTech

5–8 yrs India Full Time Hybrid (office + remote)
HCLTech logo
Posted : today
Actively hiring

Job description

Advance your career as a Data Engineer by leveraging software engineering principles to build and manage fully automated data transformation pipelines. This role focuses on integrating diverse storage and computation technologies to handle varied data types and volumes, supporting robust data architecture.

Develop resilient, modular, flexible, scalable, reusable, and cost-effective data pipelines. The expectation for this position is 5-8 years of relevant professional experience. This role is designed to support global operations and business requirements, with standard work hours aligning to business needs.

Responsibilities

Design, build, and maintain sophisticated data pipelines and ETL processes, primarily utilizing Microsoft Azure services like Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric.

Effectively use Azure data storage solutions, including Azure Data Lake Storage Gen 2 and Azure Blob Storage, for organizing and managing pipeline outputs.

Proficiently query modern RDBMS using SQL DML (e.g., SQL Server, PostgreSQL) for efficient data retrieval.

Collaborate with data architects and stakeholders to translate data requirements into high-quality solutions.

Continuously optimize data pipelines within the Azure environment for enhanced performance, scalability, and reliability.

Implement data validation techniques to ensure superior data quality and integrity.

Proactively monitor and resolve data pipeline issues to guarantee timely operations.

Stay informed about industry advancements and emerging technologies to maintain cutting-edge data solutions.

Manage the CI/CD process for deploying and maintaining data solutions, ensuring smooth integration and updates.

Qualifications

A Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience, is required.

Possess 3-5 years of demonstrated experience as a Data Engineer or in a similar role focused on data and ETL processes.

Exhibit strong expertise in Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage, and Azure Data Lake Gen 2.

Demonstrate proficiency in using SQL DML for efficient querying of modern RDBMS like SQL Server and PostgreSQL.

Show a deep understanding of Software Engineering principles and their application to Data Engineering, such as CI/CD, version control, and testing methodologies.

Strong knowledge of pyspark is essential.

Possess excellent problem-solving abilities and meticulous attention to detail.

Display outstanding communication and collaboration skills.

Essential Skills

Microsoft AzureAzure Data FactoryAzure SynapseAzure DatabricksAzure Blob StorageAzure Data Lake Gen 2SQLRDBMSSQL ServerPostgreSQLSoftware EngineeringCI/CDVersion ControlTestingpysparkProblem-SolvingAttention to DetailCommunicationCollaboration

Good to Have

PowerAppsPower AutomatePower BIREST APIOAuthC#JavaJavaScriptPythonAPI EndpointsAzure SubscriptionsResource GroupsGit WorkflowsAzure DevOpsAnsible

Highlights

  • Actively hiring

More Details

RoleAdministrator (Support & Operations) (IN)
DepartmentData Engineering, Business Analysis
Employment TypeFull Time, Hybrid (office + remote)

About the Company

HCLTech logo

HCLTech

IT Consulting

Administrator (Support & Operations) (IN) at HCLTech | SkillMX | SkillMX