Punctuation restoration from read text
Restore punctuation marks from the output of an ASR system. [ver. 3.0.4]
poleval-2021 asr
Git repo URL: https://github.com/poleval/2021-punctuation-restoration / Branch: main
Run git clone --single-branch https://github.com/poleval/2021-punctuation-restoration -b main to get the challenge data
Browse at https://github.com/poleval/2021-punctuation-restoration/tree/main
Leaderboard
| # |
submitter |
when |
ver. |
description |
test-A Weighted-F1 |
test-B Weighted-F1 |
test-C Weighted-F1 |
test-D Weighted-F1 |
× |
|
|---|
| 1 |
eNeLPol UJ AGH |
2021-09-06 17:54
|
3.0.2 poleval-2021 |
S1
|
N/A
|
N/A
|
N/A
|
81.29
|
9 |
|
| 2 |
CLARIN |
2021-09-06 06:33
|
3.0.2 poleval-2021 |
HLV
|
N/A
|
N/A
|
N/A
|
81.25
|
20 |
|
| 3 |
Samurai Labs, Wrocław University of Science and Technology |
2021-09-06 12:04
|
3.0.2 poleval-2021 |
qjjdptpc-v4b
|
N/A
|
N/A
|
N/A
|
81.23
|
21 |
|
| 4 |
AGH eNeLPol |
2021-09-06 00:55
|
3.0.2 poleval-2021 |
at least I've tried 🤷♂️
test |
N/A
|
N/A
|
N/A
|
80.34
|
3 |
|
| 5 |
Samsung & UAM |
2021-09-06 17:07
|
3.0.2 poleval-2021 |
Herbert tagger. Spaces after all punctuation marks.
additional-data |
78.55
|
82.32
|
73.84
|
78.37
|
4 |
|
| 6 |
None |
2021-09-06 15:20
|
3.0.2 poleval-2021 |
v2
|
77.42
|
80.90
|
72.29
|
76.65
|
9 |
|
| 7 |
Pinczewski |
2023-09-22 00:16
|
3.0.4 after-poleval-2021 |
HerBERT
after-poleval-2021 |
51.94
|
N/A
|
N/A
|
52.74
|
4 |
|
| 8 |
Test Team |
2021-10-09 12:14
|
3.0.3 after-poleval-2021 |
simple, hand-crafted solution
baseline rule-based |
14.75
|
9.90
|
9.67
|
9.45
|
1 |
|
| # |
tags |
test-A Excl-F1 |
test-A Colon-F1 |
test-A QMark-F1 |
test-A Fullstop-F1 |
test-A Ellipsis-F1 |
test-A Comma-F1 |
test-A Hyphens-F1 |
test-A Weighted-F1 |
test-B Excl-F1 |
test-B Colon-F1 |
test-B QMark-F1 |
test-B Fullstop-F1 |
test-B Ellipsis-F1 |
test-B Comma-F1 |
test-B Hyphens-F1 |
test-B Weighted-F1 |
test-C Excl-F1 |
test-C Colon-F1 |
test-C QMark-F1 |
test-C Fullstop-F1 |
test-C Ellipsis-F1 |
test-C Comma-F1 |
test-C Hyphens-F1 |
test-C Weighted-F1 |
test-D Excl-F1 |
test-D Colon-F1 |
test-D QMark-F1 |
test-D Fullstop-F1 |
test-D Ellipsis-F1 |
test-D Comma-F1 |
test-D Hyphens-F1 |
test-D Weighted-F1 |
|
|---|
| 1 |
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
36.36
|
82.98
|
80.61
|
88.68
|
0.00
|
76.08
|
66.91
|
81.29
|
|
| 2 |
test |
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
20.00
|
81.03
|
79.03
|
87.42
|
0.00
|
75.97
|
65.46
|
80.34
|
|
| 3 |
language-model |
22.22
|
64.91
|
83.51
|
87.64
|
100.00
|
78.11
|
66.92
|
80.18
|
40.00
|
85.36
|
80.95
|
89.80
|
100.00
|
76.05
|
71.86
|
82.89
|
76.71
|
87.80
|
90.85
|
89.94
|
100.00
|
84.58
|
73.63
|
86.46
|
16.67
|
82.01
|
76.49
|
86.36
|
11.11
|
73.47
|
67.77
|
79.16
|
|
| 4 |
additional-data |
0.00
|
56.53
|
76.00
|
87.72
|
100.00
|
77.39
|
60.24
|
78.55
|
0.00
|
80.17
|
77.78
|
89.01
|
100.00
|
78.63
|
63.14
|
82.32
|
0.00
|
70.57
|
70.36
|
81.86
|
100.00
|
72.85
|
48.80
|
73.84
|
0.00
|
77.19
|
69.23
|
85.65
|
0.00
|
76.36
|
57.50
|
78.37
|
|
| 5 |
after-poleval-2021 |
8.00
|
55.84
|
16.13
|
39.03
|
100.00
|
70.36
|
39.55
|
51.94
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
N/A
|
18.18
|
74.00
|
30.56
|
43.05
|
0.00
|
64.93
|
51.16
|
52.74
|
|
| 6 |
baseline rule-based |
0.00
|
0.00
|
0.00
|
0.00
|
100.00
|
36.53
|
0.00
|
14.75
|
0.00
|
0.00
|
0.00
|
0.00
|
100.00
|
27.14
|
0.00
|
9.90
|
0.00
|
0.00
|
0.00
|
0.00
|
100.00
|
26.22
|
0.00
|
9.67
|
0.00
|
0.00
|
0.00
|
0.00
|
0.00
|
26.63
|
0.00
|
9.45
|
|