4. 下载 数据集: CNSD:https://github.com/pluto-junzeng/CNSD 预训练模型: BERT BERT-wwm BERT-wwm-ext RoBERTa-wwm-ext 无监督:batch_size=64,lr=1e-5,droupout_rate=0.3,pooling=cls, 抽样10000样本 模型STS-B devSTS-B test BERT0.73080.6725 ...
下载 Google官方的两个BERT模型: BERT:chinese_L-12_H-768_A-12.zip RoBERTa:chinese_roberta_wwm_ext_L-12_H-768_A-12.zip NEZHA:NEZHA-base-WWM WoBERT:chinese_wobert_plus_L-12_H-768_A-12.zip RoFormer:chinese_roformer_L-12_H-768_A-12.zip SimBERT: chinese_simbert_L-12_H-768_A-12.zi...
4. 下载 数据集: CNSD:https://github.com/pluto-junzeng/CNSD 预训练模型: BERT BERT-wwm BERT-wwm-ext RoBERTa-wwm-ext 5. 测评 测评指标为spearman相关系数 无监督:batch_size=64,lr=1e-5,droupout_rate=0.3,pooling=cls, 抽样10000样本 模型STS-B devSTS-B test ...
RoBERTa:chinese_roberta_wwm_ext_L-12_H-768_A-12.zip NEZHA:NEZHA-base-WWM WoBERT:chinese_wobert_plus_L-12_H-768_A-12.zip RoFormer:chinese_roformer_L-12_H-768_A-12.zip SimBERT:chinese_simbert_L-12_H-768_A-12.zip SimBERT-small:chinese_simbert_L-6_H-384_A-12.zip ...
下载 Google官方的两个BERT模型: BERT:chinese_L-12_H-768_A-12.zip RoBERTa:chinese_roberta_wwm_ext_L-12_H-768_A-12.zip NEZHA:NEZHA-base-WWM WoBERT:chinese_wobert_plus_L-12_H-768_A-12.zip RoFormer:chinese_roformer_L-12_H-768_A-12.zip ...
4. 下载 数据集: CNSD:https://github.com/pluto-junzeng/CNSD 预训练模型: BERT BERT-wwm BERT-wwm-ext RoBERTa-wwm-ext 无监督:batch_size=64,lr=1e-5,droupout_rate=0.3,pooling=cls, 抽样10000样本 模型STS-B devSTS-B test BERT0.73080.6725 ...