Job Description :

·      Create data processing pipeline from various sources (Relational DB, API, Unstructured Data) and put them into DWH

·      Communicate with various functions about their data need and ensure our data warehouse is ready to support them

·      Extend and manage current data platform (Apache Airflow, Alibaba Maxcompute, Hive, Spark)

·      Champion data quality dimensions and enforce them to various data stakeholders (BI, analysts, scientists)

·      Monitor the capacity and performance of our data platform and tune the performance when an anomaly is detected

·      Constantly update domain knowledge and skills

What requirements are we looking for?

·      Skilled in at least one scripting language (Python, Java, Scala).

·      Have good knowledge of SQL Language.

·      Have excellent communication skills.

·      Have huge curiosity and critical thinking about the data domain

·      Know what data quality dimensions are and demonstrate their practice.

·      Have knowledge in Data Modelling best practices.

·      Have knowledge in Cloud Technologies, especially in Data Processing Service.

·      Have a basic knowledge of Unix systems operation.