Quiz Question Answering Challenge
The goal of the task is to develop solution capable of providing answers to general-knowledge questions typical for the popular TV quiz shows, such as Fifteen to One (PL: Jeden z dziesięciu). [ver. 2.0.7]
Git repo URL: https://github.com/poleval/2021-question-answering.git / Branch: main
Run git clone --single-branch https://github.com/poleval/2021-question-answering.git -b main to get the challenge data
Browse at https://github.com/poleval/2021-question-answering/tree/main
Leaderboard
| # | submitter | when | ver. | description | test-A Acc | test-B Acc | × | |
|---|---|---|---|---|---|---|---|---|
| 1 | None | 2021-09-05 23:14 | 2.0.4 poleval-2021 | v2.2 | N/A | 71.68 | 3 | |
| 2 | AGH, eNeLPol | 2021-09-06 07:59 | 2.0.4 poleval-2021 | v 0.27c | N/A | 50.96 | 13 | |
| 3 | ML Research at Allegro.pl | 2021-09-04 19:49 | 2.0.4 poleval-2021 | v1 | N/A | 50.96 | 6 | |
| 4 | skok.ai | 2021-08-31 22:20 | 2.0.4 poleval-2021 | Different Kind of Magic, v0.021 | 42.88 | 46.44 | 22 | |
| 5 | bards.ai / CLARIN | 2021-09-03 12:18 | 2.0.4 poleval-2021 | v0.2 | N/A | 36.12 | 2 | |
| 6 | Filip Graliński | 2021-10-25 11:37 | 2.0.6 after-poleval-2021 | mt5 mt5 zero-shot | 17.92 | 17.36 | 3 | |
| 7 | PolEval | 2021-10-14 15:20 | 2.0.6 after-poleval-2021 | BASELINE | N/A | 9.60 | 2 | |
| 8 | BI Insight S.A | 2021-09-06 17:53 | 2.0.4 poleval-2021 | v 1.0 baseline | N/A | 0.96 | 1 |