Polish Automatic Speech Recognition Challenge
Automatic speech recognition (ASR) has made significant progress over the last decade. Improvements in deep learning and increased data availability have resulted in accuracy levels for artificial speech transcription that are on par with human transcription, at least in specific domains, tasks, and speech characteristics. ASR technology has expanded to cover many new languages, use cases, user demographics, and devices. However, achieving robust speech recognition remains a challenge for many low-resource languages, specific speaker groups, application domains, and acoustic conditions. [ver. 1.0.14]
Deadline: 2024-10-28 23:59:00 UTC
This is a long list of all submissions, if you want to see only the best, click leaderboard.
| # | submitter | when | ver. | description | dev-0 CER | dev-0 WER | test-A CER | test-A WER | test-B CER | test-B WER | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 9 | Metamedia Technologies | 2024-10-01 07:13 | 1.0.14 poleval-2024 | 00 test submission asr mt5 poleval-2024 test | 0.983894441754086 | 1.0192400816958769 | 0.9397742349435587 | 1.0180248042829088 | 0.9472076982485419 | 1.0206505898204417 | |
| 4 | Samsung R&D Poland | 2024-09-04 13:37 | 1.0.14 poleval-2024 | whisper-large-v3-mix-01-50k poleval-2024 | N/A | N/A | 6.971746742936685e-2 | 0.11253396464986146 | 7.277916359665865e-2 | 0.11493936810844997 | |
| 2 | Samsung R&D Poland | 2024-09-04 13:35 | 1.0.14 poleval-2024 | whisper-large-v3-mix-00-18k-beam4 poleval-2024 | N/A | N/A | 6.850381712595428e-2 | 0.11065077614269188 | 6.906852257898428e-2 | 0.11150218604779058 | |
| 3 | Samsung R&D Poland | 2024-09-04 13:33 | 1.0.14 poleval-2024 | whisper-large-v3-baseline-13k-beam4 poleval-2024 | N/A | N/A | 7.154446788611697e-2 | 0.11517042855989884 | 7.10481229305187e-2 | 0.11227211482937828 | |
| 1 | Samsung R&D Poland | 2024-08-28 10:57 | 1.0.14 poleval-2024 | whisper-large-v3-mix-01-25k-beam4 poleval-2024 | N/A | N/A | 6.904756726189182e-2 | 0.1127222835005784 | 6.848707045779368e-2 | 0.11073225726620288 | |
| 8 | Samsung R&D Poland | 2024-08-28 08:49 | 1.0.14 poleval-2024 | conformer-baseline-500k poleval-2024 | N/A | N/A | 8.767427191856798e-2 | 0.17475989346533588 | 8.365808839847669e-2 | 0.16820194132042787 | |
| 7 | Samsung R&D Poland | 2024-08-28 08:19 | 1.0.14 poleval-2024 | conformer-mix-00-500k poleval-2024 | N/A | N/A | 7.597276899319225e-2 | 0.15253826908073498 | 7.156299656455006e-2 | 0.14328924574476862 | |
| 6 | Samsung R&D Poland | 2024-08-28 06:53 | 1.0.14 poleval-2024 | conformer-mix-01-500k poleval-2024 | N/A | N/A | 7.084411771102943e-2 | 0.1399209060826989 | 6.90463297499312e-2 | 0.13399510545274562 | |
| 5 | Samsung R&D Poland | 2024-08-27 11:57 | 1.0.14 poleval-2024 | whisper-large-v3-mix-01-25k poleval-2024 | N/A | N/A | 6.580246645061662e-2 | 0.11826423825024884 | 7.336505428365986e-2 | 0.13000797426238073 | |
| 14 | [name not given] | 2024-05-24 10:10 | 1.0.8 poleval-2024 | test test | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | |
| 13 | [name not given] | 2024-05-24 10:08 | 1.0.8 poleval-2024 | test error test | 2.4394889945308734e-5 | 3.0551935999804467e-6 | 1.218000304500076e-4 | 1.0761077183826101e-4 | 1.1096414526538185e-4 | 8.249236945582533e-5 | |
| 12 | [name not given] | 2024-05-24 09:37 | 1.0.8 poleval-2024 | test test | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | |
| 11 | UAM | 2024-03-11 08:37 | 1.0.8 poleval-2024 | Test dev-0 test | 0.1424627835192276 | 0.2116271502834456 | 0.967452774624381 | 0.9999846801991574 | 0.9671964713226366 | 0.9999719062542921 | |
| 10 | [name not given] | 2024-03-10 14:13 | 1.0.8 poleval-2024 | 1234 | N/A | N/A | N/A | N/A | N/A | N/A |