Skywork/eval/文件夹下的evaluate_ceval.py, evaluate_cmmlu.py和evaluate_mmlu.py文件中,获取选项ABCD的概率的关键代码如下: softval = torch.nn.functional.softmax( torch.tensor( [ logits[tokenizer("A")["input_ids"][-1]], logits[tokenizer("B")["input_ids"][-1]], logits[tokenizer("C")[...