Big Data Engineer – Job Description (JD)

Responsibilities

1. Responsible for the construction and research of data warehouses for massive logistics data, building PB-level data warehouses, and overseeing data warehouse design, modeling, ETL, report development, etc.;

2. Familiar with Hadoop, Hive, Spark, Flink, YARN;

3. Experience participating in at least 2 large-scale data warehouse/big data/data governance projects;

4. Proficient in commonly used big data systems, components, or computing frameworks such as HBase, Starrocks, Doris, ES, Kafka, MongoDB;

5. Experience in processing and optimizing large-scale data (TB level, PB level).

Job Requirements

1. Bachelor's degree or above in a related field, preferably in Computer Science;

2. Familiarity with the Hadoop ecosystem, including HDFS, Hive, etc.; understanding of Spark, Flink, and other computational frameworks; experience in big data development or internships;

3. Independent programming skills, with proficiency in at least one programming language such as Java, Scala, or Python; familiarity with the basic Spring Boot development framework;

4. Strong data analysis skills, data sensitivity, and curiosity, with a focus on discovering and transforming data value;

5. Quick learning ability, strong communication and coordination skills, team spirit, and a strong sense of responsibility and proactive attitude towards learning.