cmmlu-main.zip cmmlu_v1_0_1.zip cmmlu-main.zip (0.01M) 下载 File Name Size Update Time cmmlu-main/.gitattributes 2307 2023-07-13 18:19:29 cmmlu-main/README.md 4867 2023-07-13 18:19:29 cmmlu-main/cmmlu.py 4930 2023-07-13 18:19:29 cmmlu-main/cmmlu_v1_0_1.zip 132 20...
设置了环境变量后 export HF_ENDPOINT=https://hf-mirror.com datasets.load_dataset 仍然卡住了ctrl-c掉,继续查看日志 发现程序跳转到了这个文件下 /root/.cache/huggingface/modules/datasets_modules/datasets…
Harness评测适配gsm8k、ceval、mmlu、cmmlu、race、lambada数据集 本地验证,以llama3.1-8b为例进行验证 评测结果如下: gsm8k: npu: gpu: mmlu: npu: gpu: cmmlu: npu: gpu: ceval: npu: gpu: race: npu: gpu: lambada: npu: gpu: check list ...