高性能小模型排行榜*记最佳得分(模型名称需带有nlpcc标识,模型参数低于1/9的bert-base参数量)

排行模型研究机构测评时间Score认证CLUEWSC
2020
CSLCLUENERCMRC2018
1nlpcc-tiny-NEZHA-8LHuawei Cloud & Noah's Ark lab20-08-2578.897待认证80.34582.93378.05874.250
2nlpcc-tiny-NEZHA-6LHuawei Cloud & Noah's Ark lab20-09-0877.587待认证80.69081.20076.45972.000
3nlpcc-tiny-bert-6LXiaomi AI Lab20-06-2876.860待认证80.69078.56779.08269.100
4nlpcc-bert-base-testmi-ailab-nlp-app20-03-3176.047待认证74.82881.26777.44170.650
5nlpcc-bert-tinyTencentPretrain & TI-ONE20-05-2073.507待认证73.44874.16775.61370.800
6nlpcc-tiny-bertXiaomi AI Lab20-05-2773.114待认证67.93178.56776.85869.100
7nlpcc-tiny-NEZHA-4LHuawei Cloud & Noah's Ark lab20-05-0972.514待认证66.20779.76775.58368.500
8nlpcc-xiaomi-tiny-6Lmi-ailab-nlp-app20-05-0372.045待认证67.93179.03375.16666.050
9nlpcc-bert-smallTencent TEG20-05-0169.704待认证63.44876.76774.85163.750
10nlpcc-RoBERTa-tiny-clueNUDT20-06-2969.298待认证64.82878.70067.41466.250
11nlpcc-tiny-bert-6Lmi-ailab-nlp-app20-04-2568.577待认证62.41476.73373.26261.900
12nlpcc-BERT-4THuawei-ICS-NLP20-05-2067.885待认证63.79375.50072.99659.250
13nlpcc-roberta_tinymi-ailab-nlp-app20-04-0767.421待认证62.41472.73372.28762.250
14nlpcc-tinymi-ailab-nlp-app20-04-0267.237待认证62.75972.43371.50762.250
15nlpcc-roberta-tiny-clue-baseline1test-baseline120-03-3166.580待认证60.69072.03371.74561.850
16nlpcc-RoBERTa-tiny-cluedlnu-5.2020-05-2063.423待认证62.41466.00066.42958.850
17nlpcc-RoBERTa-tiny-cluedlnu-5.1920-05-1963.337待认证62.06966.00066.42958.850
18nlpcc-RoBERTa-tiny-cluedlnu-xiaomi20-05-1562.043待认证62.41466.00060.90858.850
19nlpcc-RoBERTa-tiny-clue民大F420-05-1962.043待认证62.41466.00060.90858.850
20nlpcc-roberta-tiny-clue中国平安财产险科技中心20-05-1161.191待认证60.69068.56760.80554.700

ALBERT(Ensemble)

GitHub/模型网址:

提交日期:9月17日

分数:9月17日

更多详情:

型号说明

阿尔伯特模型集合

参数说明

单任务微调。我们从MNLI为RTE、STS和MRPC优化的模型开始

总参数:-1

共享参数:-1

诊断信息

诊断主混淆矩阵

C N E
C 182 36 40
N 81 189 116
E 17 69 374

C = 对立

N = 不包含

E = 包含

类别相关马修分数