Engineer - Data Engineering

Altimetrik

3–30 yrs Chennai Full Time Work from office
Altimetrik logo
Posted : today
Actively hiring

Job description

Join our team as a Data Engineering specialist and play a crucial role in building and maintaining robust data infrastructure. This position offers an exciting opportunity to work with cutting-edge big data technologies and cloud platforms, driving data-driven decision-making across the organization.

We are seeking a proactive individual with a passion for data, strong analytical abilities, and a knack for solving complex challenges. If you thrive in a collaborative environment and are eager to contribute to impactful data solutions, this role is for you.

Responsibilities

As a Data Engineer, you will be instrumental in designing, developing, and maintaining scalable data pipelines using PySpark to process vast datasets. You will integrate data from diverse sources, ensuring exceptional quality and reliability. Responsibilities include optimizing data processing jobs for peak performance and cost-efficiency, collaborating closely with data scientists and analysts to understand data needs, and developing efficient ETL processes.

Key duties also involve implementing rigorous data validation and monitoring to uphold data accuracy, meticulously documenting workflows and best practices, and swiftly troubleshooting and resolving any data-related issues. Your contributions will be vital in shaping our data landscape.

Qualifications

To excel in this role, a Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field is required, complemented by over 3 years of dedicated experience in data engineering.

Essential technical expertise includes strong proficiency in PySpark and Python, a solid understanding of big data technologies like Hadoop, Hive, and Spark, and hands-on experience with major cloud platforms (AWS, Azure, GCP) and their associated data services. Familiarity with data warehousing solutions such as Amazon Redshift, Google BigQuery, or Snowflake, alongside knowledge of both relational and NoSQL databases (MySQL, MongoDB, Cassandra), is crucial. Experience with ETL/ELT processes and orchestration tools like Apache Airflow is also highly valued. Excellent analytical, problem-solving, and communication skills are paramount.

Essential Skills

PySparkPythonData EngineeringSQLHadoopHiveSparkAWSAzureGCPAmazon RedshiftGoogle BigQuerySnowflakeMySQLMongoDBCassandraETLELTApache AirflowApache NiFi

Highlights

  • Actively hiring

More Details

RoleEngineer - Data Engineering
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Altimetrik logo

Altimetrik

IT Consulting

Engineer - Data Engineering at Altimetrik | SkillMX | SkillMX