Quiz Question Answering Challenge
The goal of the task is to develop solution capable of providing answers to general-knowledge questions typical for the popular TV quiz shows, such as Fifteen to One (PL: Jeden z dziesięciu). [ver. 2.0.7]
This is a long list of all submissions, if you want to see only the best, click leaderboard.
| # | submitter | when | ver. | description | dev-0 Acc | test-A Acc | test-B Acc | |
|---|---|---|---|---|---|---|---|---|
| 21 | Filip Graliński | 2021-10-25 11:37 | 2.0.6 after-poleval-2021 | mt5 mt5 zero-shot | 16.60 | 17.92 | 17.36 | |
| 27 | Filip Graliński | 2021-10-25 11:14 | 2.0.6 after-poleval-2021 | polish roberta | 7.20 | 6.88 | 4.96 | |
| 24 | PolEval | 2021-10-14 15:20 | 2.0.6 after-poleval-2021 | BASELINE | N/A | N/A | 9.60 | |
| 29 | Filip Graliński | 2021-10-08 07:42 | 2.0.6 after-poleval-2021 | test baseline | 5.10 | 5.72 | 4.16 | |
| 31 | BI Insight S.A | 2021-09-06 17:53 | 2.0.4 poleval-2021 | v 1.0 baseline | N/A | N/A | 0.96 | |
| 5 | AGH, eNeLPol | 2021-09-06 07:59 | 2.0.4 poleval-2021 | v 0.27c | N/A | N/A | 50.96 | |
| 7 | AGH, eNeLPol | 2021-09-06 07:49 | 2.0.4 poleval-2021 | v 0.27b | N/A | N/A | 50.12 | |
| 6 | AGH, eNeLPol | 2021-09-06 07:32 | 2.0.4 poleval-2021 | v 0.27a | N/A | N/A | 50.68 | |
| 1 | None | 2021-09-05 23:14 | 2.0.4 poleval-2021 | v2.2 | N/A | N/A | 71.68 | |
| 2 | None | 2021-09-05 23:13 | 2.0.4 poleval-2021 | v2.1 | N/A | N/A | 70.36 | |
| 11 | ML Research at Allegro.pl | 2021-09-05 21:36 | 2.0.4 poleval-2021 | v6 | N/A | N/A | 47.52 | |
| 12 | ML Research at Allegro.pl | 2021-09-05 21:32 | 2.0.4 poleval-2021 | v5 | N/A | N/A | 47.48 | |
| 10 | ML Research at Allegro.pl | 2021-09-05 21:28 | 2.0.4 poleval-2021 | v4 | N/A | N/A | 47.84 | |
| 9 | ML Research at Allegro.pl | 2021-09-04 20:00 | 2.0.4 poleval-2021 | v3 | N/A | N/A | 49.96 | |
| 8 | ML Research at Allegro.pl | 2021-09-04 19:56 | 2.0.4 poleval-2021 | v2 | N/A | N/A | 50.08 | |
| 4 | ML Research at Allegro.pl | 2021-09-04 19:49 | 2.0.4 poleval-2021 | v1 | N/A | N/A | 50.96 | |
| 3 | None | 2021-09-04 12:36 | 2.0.4 poleval-2021 | v1 | N/A | 64.88 | 69.68 | |
| 13 | AGH, eNeLPol | 2021-09-04 09:05 | 2.0.4 poleval-2021 | v 0.27 | N/A | N/A | 46.84 | |
| 17 | bards.ai / CLARIN | 2021-09-03 12:18 | 2.0.4 poleval-2021 | v0.2 | 32.80 | N/A | 36.12 | |
| 19 | AGH, eNeLPol | 2021-09-03 06:56 | 2.0.4 poleval-2021 | v. 0.18 | N/A | N/A | 24.84 | |
| 55 | bards.ai / CLARIN | 2021-09-02 15:13 | 2.0.4 poleval-2021 | v0.1 baseline | 27.80 | N/A | N/A | |
| 14 | skok.ai | 2021-08-31 22:20 | 2.0.4 poleval-2021 | Different Kind of Magic, v0.021 | 42.40 | 42.88 | 46.44 | |
| 15 | skok.ai | 2021-08-31 07:03 | 2.0.4 poleval-2021 | Different Kind of Magic, v0.020 | 43.60 | 42.64 | 45.36 | |
| 18 | AGH, eNeLPol | 2021-08-31 01:01 | 2.0.4 poleval-2021 | v 0.7 | N/A | N/A | 25.76 | |
| 25 | AGH, eNeLPol | 2021-08-30 23:11 | 2.0.4 poleval-2021 | v 0.6.1 | N/A | N/A | 6.12 | |
| 22 | AGH, eNeLPol | 2021-08-30 23:06 | 2.0.4 poleval-2021 | v 0.6 | 7.70 | N/A | 10.64 | |
| 20 | AGH, eNeLPol | 2021-08-30 22:53 | 2.0.4 poleval-2021 | v 0.5 | N/A | N/A | 18.60 | |
| 23 | AGH, eNeLPol | 2021-08-30 17:45 | 2.0.4 poleval-2021 | v 0.4 test | N/A | N/A | 9.72 | |
| 26 | AGH, eNeLPol | 2021-08-30 17:20 | 2.0.4 poleval-2021 | v 0.3 test | N/A | N/A | 5.64 | |
| 28 | AGH, eNeLPol | 2021-08-30 17:17 | 2.0.4 poleval-2021 | v 0.2 test | N/A | N/A | 4.88 | |
| 30 | AGH, eNeLPol | 2021-08-30 16:42 | 2.0.4 poleval-2021 | v 0.1 test | N/A | N/A | 3.08 | |
| 16 | skok.ai | 2021-08-25 07:45 | 2.0.4 poleval-2021 | Different Kind of Magic, v0.014fin | 36.70 | 37.12 | 38.16 | |
| 54 | skok.ai | 2021-08-18 20:23 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.016 | 37.20 | 36.44 | N/A | |
| 53 | skok.ai | 2021-08-18 16:25 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.015 | 37.30 | 36.44 | N/A | |
| 52 | skok.ai | 2021-08-18 13:35 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.014 | 36.60 | 37.08 | N/A | |
| 51 | skok.ai | 2021-08-18 08:22 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.0131 | 36.60 | 37.08 | N/A | |
| 50 | skok.ai | 2021-08-18 08:18 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.013 | 11.30 | 7.72 | N/A | |
| 49 | skok.ai | 2021-08-17 14:33 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.012 | 36.60 | 36.88 | N/A | |
| 48 | skok.ai | 2021-08-17 10:58 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.011 | 36.10 | 35.24 | N/A | |
| 47 | skok.ai | 2021-08-17 10:00 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.010 | 34.30 | 34.24 | N/A | |
| 46 | skok.ai | 2021-08-17 09:03 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.009 | 33.30 | 33.96 | N/A | |
| 45 | skok.ai | 2021-08-17 08:06 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.008 | 28.60 | 28.56 | N/A | |
| 44 | skok.ai | 2021-08-17 07:33 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.007 | N/A | 20.44 | N/A | |
| 43 | skok.ai | 2021-08-16 20:31 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.0061 (probably failed) | N/A | 4.08 | N/A | |
| 42 | skok.ai | 2021-08-16 20:09 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.006 (probably failed) | N/A | N/A | N/A | |
| 41 | aff | 2021-08-10 17:46 | 1.0.3 poleval-2021 | tak | N/A | 5.72 | N/A | |
| 40 | aff | 2021-08-10 17:30 | 1.0.3 poleval-2021 | tak | N/A | 5.72 | N/A | |
| 39 | aff | 2021-08-10 17:21 | 1.0.3 poleval-2021 | tak | N/A | 5.72 | N/A | |
| 38 | skok.ai | 2021-08-05 17:25 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.005 | 0.10 | 17.84 | N/A | |
| 37 | skok.ai | 2021-08-04 13:04 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.004 | 0.10 | 18.20 | N/A | |
| 36 | skok.ai | 2021-08-02 13:10 | 1.0.3 poleval-2021 | Different Kind of Magic, v0.01 | 0.10 | 16.64 | N/A | |
| 35 | PolEval | 2021-07-20 09:01 | 1.0.3 poleval-2021 | BASELINE baseline | N/A | 8.68 | N/A | |
| 34 | skok.ai | 2021-07-20 06:52 | 1.0.3 poleval-2021 | tak baseline, powtórka | 5.10 | 5.72 | N/A | |
| 33 | skok.ai | 2021-07-20 06:45 | 1.0.3 poleval-2021 | Zero-Shot Magic :) | 0.50 | 18.00 | N/A | |
| 32 | skok.ai | 2021-07-13 14:50 | 1.0.3 poleval-2021 | Baseline: answer all questions with 'tak' baseline | 5.10 | 5.72 | N/A |