Join our team as a Software Team Lead, driving innovation in data engineering. This role focuses on building robust and scalable data solutions using cutting-edge technologies.

You will be instrumental in designing and implementing advanced data pipelines, ensuring efficient data processing and integration across various cloud platforms.

Lead the design and development of scalable batch and near-real-time ETL/ELT pipelines. Implement structured streaming solutions with Kafka and Spark.

Develop dimensional data models, including Fact/Dimension and SCD Type 2. Orchestrate data workflows using Databricks or Airflow. Integrate CI/CD pipelines for automated deployments.

Proficiency in core technologies like Apache Spark (Core, Structured Streaming), PySpark, Databricks, and Advanced SQL is essential.

Experience with DevOps tools such as Jenkins and Git is required. Strong skills in Python and Cloud platforms like AWS are necessary. Familiarity with Databricks Runtime and cluster management is expected.