Evaluation of translation quality assessment metrics (blind)
The task is to investigate metrics for automatic evaluation of machine translation results or other similar data types. [ver. 2.0.4]
poleval-2021 mt quality-estimation
This is a long list of all submissions, if you want to see only the best, click leaderboard.
| # | submitter | when | ver. | description | dev-0 Pearson | test-A Pearson | test-B Pearson | |
|---|---|---|---|---|---|---|---|---|
| 25 | skok.ai | 2021-09-06 17:56 | 2.0.2 poleval-2021 | v015 | N/A | N/A | 0.4358 | |
| 10 | skok.ai | 2021-09-06 17:39 | 2.0.2 poleval-2021 | blind score v016a | N/A | N/A | 0.4765 | |
| 4 | skok.ai | 2021-09-06 17:35 | 2.0.2 poleval-2021 | blind score v016 | N/A | N/A | 0.4840 | |
| 22 | skok.ai | 2021-09-06 10:28 | 2.0.2 poleval-2021 | blind score v011 | N/A | N/A | 0.4458 | |
| 11 | Adam Mickiewicz University | 2021-09-06 07:53 | 2.0.2 poleval-2021 | C-G-01 | N/A | N/A | 0.4753 | |
| 6 | skok.ai | 2021-09-06 07:32 | 2.0.2 poleval-2021 | blind score v012 | N/A | N/A | 0.4801 | |
| 26 | Adam Mickiewicz University | 2021-09-06 07:06 | 2.0.2 poleval-2021 | TG-01 | N/A | N/A | 0.4259 | |
| 5 | skok.ai | 2021-09-06 05:08 | 2.0.2 poleval-2021 | blind score v010 | N/A | N/A | 0.4803 | |
| 16 | skok.ai | 2021-09-05 20:14 | 2.0.2 poleval-2021 | blind score v009 | N/A | N/A | 0.4655 | |
| 15 | skok.ai | 2021-09-05 16:48 | 2.0.2 poleval-2021 | blind score v008 | N/A | N/A | 0.4678 | |
| 18 | skok.ai | 2021-09-05 10:19 | 2.0.2 poleval-2021 | blind score v007a | N/A | N/A | 0.4608 | |
| 3 | eNeLPol UJ AGH | 2021-09-03 17:48 | 2.0.2 poleval-2021 | M1 | N/A | N/A | 0.5076 | |
| 2 | eNeLPol UJ AGH | 2021-09-03 17:47 | 2.0.2 poleval-2021 | A1 | N/A | N/A | 0.5136 | |
| 8 | skok.ai | 2021-09-02 07:17 | 2.0.2 poleval-2021 | blind score v007 | N/A | N/A | 0.4793 | |
| 13 | skok.ai | 2021-09-01 23:54 | 2.0.2 poleval-2021 | blind_testB_007_0corrected2 | N/A | N/A | 0.4717 | |
| 23 | skok.ai | 2021-09-01 23:18 | 2.0.2 poleval-2021 | blind_testB_007_fold0corrected | N/A | N/A | 0.4425 | |
| 21 | skok.ai | 2021-09-01 23:17 | 2.0.2 poleval-2021 | blind score v007.0corr | N/A | N/A | 0.4596 | |
| 20 | skok.ai | 2021-09-01 22:42 | 2.0.2 poleval-2021 | blind score v007.0 | N/A | N/A | 0.4596 | |
| 1 | eNeLPol UJ AGH | 2021-09-01 09:39 | 2.0.2 poleval-2021 | B1 | N/A | N/A | 0.5138 | |
| 19 | skok.ai | 2021-08-30 17:51 | 2.0.2 poleval-2021 | blind score v006 | N/A | N/A | 0.4606 | |
| 14 | skok.ai | 2021-08-29 21:04 | 2.0.2 poleval-2021 | blind score v005 (HRO) | N/A | N/A | 0.4707 | |
| 12 | skok.ai | 2021-08-29 20:54 | 2.0.2 poleval-2021 | blind score v005 (HRL) | N/A | N/A | 0.4737 | |
| 7 | Adam Mickiewicz University | 2021-08-29 11:39 | 2.0.2 poleval-2021 | C-01 | N/A | N/A | 0.4793 | |
| 28 | Adam Mickiewicz University | 2021-08-29 11:31 | 2.0.2 poleval-2021 | H-01-R | N/A | N/A | 0.4088 | |
| 17 | skok.ai | 2021-08-28 21:59 | 2.0.2 poleval-2021 | blind score v005 (KM) | N/A | N/A | 0.4629 | |
| 24 | skok.ai | 2021-08-28 09:56 | 2.0.2 poleval-2021 | blind score v005 (AL) | N/A | N/A | 0.4392 | |
| 9 | skok.ai | 2021-08-28 09:53 | 2.0.2 poleval-2021 | blind score v005 (HL) | N/A | N/A | 0.4785 | |
| 32 | eNeLPol UJ AGH | 2021-08-26 14:47 | 2.0.2 poleval-2021 | LM 1 | 0.4492 | 0.4651 | 0.3031 | |
| 27 | Adam Mickiewicz University | 2021-08-26 07:46 | 2.0.2 poleval-2021 | T-02 | N/A | N/A | 0.4171 | |
| 30 | Adam Mickiewicz University | 2021-08-26 06:56 | 2.0.2 poleval-2021 | T-01 | N/A | N/A | 0.4052 | |
| 31 | Adam Mickiewicz University | 2021-08-24 12:12 | 2.0.0 poleval-2021 | Baseline test-B v.00001b | N/A | 0.3677 | 0.3414 | |
| 29 | Adam Mickiewicz University | 2021-08-24 11:56 | 2.0.0 poleval-2021 | Baseline test-B v.00001 baseline | N/A | 0.5488 | 0.4057 | |
| 41 | Adam Mickiewicz University | 2021-08-23 12:16 | 1.0.1 poleval-2021 | Baseline v.00001a | N/A | 0.3677 | N/A | |
| 40 | Adam Mickiewicz University | 2021-08-23 12:14 | 1.0.1 poleval-2021 | Baseline v.00001 | N/A | 0.5488 | N/A | |
| 39 | skok.ai | 2021-08-20 10:55 | 1.0.1 poleval-2021 | blind score v003c | N/A | 0.4917 | N/A | |
| 38 | skok.ai | 2021-08-20 10:53 | 1.0.1 poleval-2021 | blind score v003b | N/A | 0.5162 | N/A | |
| 37 | skok.ai | 2021-08-20 10:52 | 1.0.1 poleval-2021 | blind score v003a | N/A | 0.5215 | N/A | |
| 36 | skok.ai | 2021-08-20 09:47 | 1.0.1 poleval-2021 | blind score v003 | N/A | 0.5171 | N/A | |
| 35 | skok.ai | 2021-08-20 08:56 | 1.0.1 poleval-2021 | blind score v002 | N/A | 0.5005 | N/A | |
| 34 | skok.ai | 2021-08-20 05:20 | 1.0.1 poleval-2021 | blind score v001 baseline | N/A | 0.4996 | N/A | |
| 33 | PJA | 2021-08-12 14:06 | 1.0.1 poleval-2021 | Baseline Bleu baseline | N/A | N/A | N/A |