Engineer - Data Engineering

Altimetrik

3+ yrs Chennai Full Time Work from office
Altimetrik logo
Posted : 1 week ago
Actively hiring

Job description

Join our dynamic team as a Data Engineering expert and play a pivotal role in shaping our data infrastructure. This position is ideal for an experienced professional passionate about building robust and scalable data solutions.

We are seeking an individual who can transform raw data into actionable insights, contributing to key business decisions. You will be instrumental in managing and optimizing our data pipelines, ensuring efficiency and reliability.

This role offers a fantastic opportunity to work with cutting-edge technologies and collaborate with a talented group of professionals. If you are driven by innovation and possess a strong technical background, we encourage you to apply.

Responsibilities

Develop and maintain sophisticated data pipelines using PySpark, processing extensive datasets from diverse sources.

Integrate data from various formats and origins, upholding the highest standards of data quality and dependability.

Enhance and optimize data processing jobs for superior performance and cost-effectiveness.

Collaborate effectively with data scientists, analysts, and stakeholders to grasp data needs and deliver exceptional data solutions.

Construct and manage ETL processes for extracting, transforming, and loading data into data warehouses and lakes.

Implement data validation and monitoring systems to guarantee data accuracy and consistency.

Create comprehensive documentation for data engineering processes, workflows, and best practices.

Swiftly identify, diagnose, and resolve data-related challenges.

Qualifications

A minimum of 3 years of dedicated experience in data engineering or a closely related domain is essential.

Possession of a Bachelor’s degree in Computer Science, Information Technology, Engineering, or an equivalent field is required.

Proficiency in PySpark and Python is a must.

Solid understanding of big data technologies including Hadoop, Hive, and Spark.

Demonstrated experience with cloud platforms such as AWS, Azure, and GCP, along with their data services.

Familiarity with data warehousing solutions like Amazon Redshift, Google BigQuery, and Snowflake.

Knowledge of both relational and NoSQL databases, including MySQL, MongoDB, and Cassandra.

Experience with ETL/ELT processes and data pipeline orchestration tools such as Apache Airflow and Apache NiFi.

Exceptional analytical and problem-solving capabilities.

Excellent verbal and written communication skills, with the ability to articulate complex technical concepts to diverse audiences.

Essential Skills

PySparkPythonHadoopHiveSparkAWSAzureGCPAmazon RedshiftGoogle BigQuerySnowflakeMySQLMongoDBCassandraETLELTApache AirflowApache NiFiSQL

Highlights

  • Actively hiring

More Details

RoleEngineer - Data Engineering
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Altimetrik logo

Altimetrik

IT Consulting