ZeroCLUE零样本学习榜 Github地址 | 提交样例 | 测评方案 | 测评规则
模型描述需包含关键词"ZeroCLUE.M"; 提交需实名，即：队伍名称、模型名称、Url/Github、模型描述，需有真实有效。无意义的提交将被移除；有问题发邮件：CLUEbenchmark@163.com
2021-06-18: 零样本学习榜(ZeroCLUE)启用。

排行	模型	研究机构	测评时间	Score	EPRSTMT	CSLDCP	TNEWSF	IFLYTEKF	OCNLIF	BUSTM	CHIDF	CSLF	CLUEWSCF
1	Human	CLUE	21-06-18	83.934	90.0	68.0	71	66.0	90.3	88	87.1	84	98.0
2	CPM-Bee	OpenBMB&面壁智能	23-05-26	78.184	85.52	58.99	78.2	58.81	77.73	83.85	89.65	83.6	87.24
3	Ctyun_Big_Model	天翼云AI	23-02-24	76.217	87.25	48.02	77.13	59.62	75.5	90.05	84.6	82.9	81.72
4	PaddleNLP-UTC	飞桨PaddleNLP	23-01-11	70.547	85.92	58.92	68.27	40.15	74.79	76.7	82.75	70.6	74.48
5	二郎神-UnifiedMC	IDEA研究院	22-08-30	70.295	88.71	50.18	71.67	40.58	75.5	80.15	84.85	60.6	81.72
6	GPT-MoE	阿里云机器学习平台PAI	22-08-22	69.545	84.2	60.29	57.73	51.31	71.41	63.9	88.2	69.4	67.59
7	Randeng-T5-784M-MultiTask	IDEA研究院	22-12-01	69.176	85.13	52.32	69.93	42.08	74.28	81.65	75.1	58.3	84.48
8	Mengzi-T5-MT	澜舟科技	22-08-22	68.926	86.99	55.19	74.73	22.42	74.69	77.6	85.1	84.17	65.17
9	asdf	11	23-04-28	67.705	82.87	35.91	59.6	52.23	70.33	74.4	81.2	70.5	74.14
10	CPM-Bee	Modelbest	23-04-28	67.698	82.87	35.91	0	52.23	70.33	74.4	81.2	70.5	74.14
11	assistant	zz	23-05-15	65.940	87.12	60.02	69.6	45	76.78	67.45	49.65	60.4	81.03
12	XXXX-Test	XXXX-Test	22-11-14	63.805	88.71	37.81	71.27	26.35	72.66	75.05	72.9	71.03	65.86
13	二郎神-MRC	IDEA研究院	22-01-24	63.515	86.19	48.65	69.47	36.08	45.59	74.05	84.65	53.53	79.31
14	abtest03	abtest03	22-12-24	61.536	87.52	56.75	66.4	39.58	67.18	23.3	73.4	68.97	75.52
15	bumble-75	lpnhtu	23-05-08	61.514	88.31	0	0	0	73.07	77.25	84.8	80.4	88.28
16	4731	4731	23-05-14	61.236	87.12	60.02	69.6	45	53.6	53	49.65	60.4	81.03
17	XXXXRoberta	XXXXRoberta	22-11-15	60.360	86.45	36.31	0	25.19	66.71	73.15	76.4	66.6	52.07
18	bumble-20	plnuht	23-05-08	60.141	88.45	0	0	0	73.64	73.7	81.1	78.03	86.21
19	t5_wu	t5_wu	22-11-11	59.960	77.03	38.58	69.93	42.08	71.21	73.7	64.45	52.9	59.66
20	UniCU	UniCU	22-11-08	59.251	87.52	37.81	71.4	26.12	72.66	74.45	56.6	55.33	63.45

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

	C	E	N
C	0.0	0.0	0.0
E	0.0	0.0	0.0
N	0.0	0.0	0.0

ALBERT(Ensemble)

GitHub/模型网址：

提交日期：9月17日

分数：9月17日

更多详情：

型号说明

阿尔伯特模型集合

参数说明

单任务微调。我们从MNLI为RTE、STS和MRPC优化的模型开始

总参数:-1

共享参数:-1

诊断信息

诊断主混淆矩阵

	C	N	E
C	182	36	40
N	81	189	116
E	17	69	374

C = 对立

N = 不包含

E = 包含