AutoTinyBERT BBPE BinaryBERT CAME CeMAT DynaBERT HyperText JABER-PyTorch NEZHA-Gen-TensorFlow NEZHA-PyTorch NEZHA-TensorFlow Noah_WuKong Noah_Wukong-MindSpore PMLM PanGu-Bot PanGu-α TernaryBERT-MindSpore TernaryBERT TinyBERT-MindSpore TinyBERT
This repository provides the latest pretrained language models and its related optimization techniques developed by Huawei Noah's Ark Lab. Directory structure PanGu-α is a Large-scale autoregressive pretrained Chinese language model with up to 200B parameter. The models are developed under the MindSpor...
(raw_dataset_dir, task_name): # https://www.alue.org/tasks bench_dict = defaultdict(list) if task_name == "MQ2Q": df_train = pd.read_csv(os.path.join(raw_dataset_dir, "q2q_similarity_workshop_v2.1.tsv"), sep="\t") df_test = pd.read_csv(os.path.join(raw_dataset_dir, ...