A newer version of the Streamlit SDK is available:
1.40.1
The baseline_example folder provides a simple baseline implementation along with the evaluation logic for reference.
Methodology: The approach involves using chatglm3_6B to perform pointwise (5-level) evaluation on question-answer pairs.
baseline3.py stores the model's evaluation results in output/baseline1_chatglm3_6B.txt.
eval.py calculates the evaluation metrics based on the model's evaluation results and the human annotation results.
The human annotation results are temporarily hidden due to testing requirements.