5ce92e8ddc92da02aed1730e9e0c5014ce52039c
base2.1
- challenge
- Punctuation prediction from conversational language
- submitter
- Oskar Bujacz
- submitted
- 2022-12-19 19:52:25.204889 UTC
- file basename
- out
dev-0 / c19cfb063792f8b9ab0a7ff2200e758140d94617
| Metric | Score |
|---|---|
| Weighted-F1 | 65.78 |
| Hyphens-F1 | 72.73 |
| Comma-F1 | 61.46 |
| Ellipsis-F1 | 0.00 |
| Fullstop-F1 | 84.74 |
| QMark-F1 | 74.56 |
| Colon-F1 | 100.00 |
| Excl-F1 | 33.33 |
worst items
note: the gold standard is taken from the challenge| # | input | expected output | actual output | test-B Weighted-F1 |
|---|---|---|---|---|
| 1 | audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa Wie:119580-119670 pan:119700-119760 co:119790-119880 | O O B-ELLIPSIS | O O B-QMARK | 0.00 |
| 2 | audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa @interia.pl:302610-302610 | B-FULLSTOP | O B-FULLSTOP | 0.00 |
| 3 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Tak:52320-52410 więc:52440-52560 poproszę:52770-53460 | O O B-ELLIPSIS | O O B-KOLON | 0.00 |
| 4 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Mhm:128910-128970 | B-QMARK | B-FULLSTOP | 0.00 |
| 5 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Czy:196950-196980 ma:197040-197070 pan:197130-197220 jakieś:197280-197490 | O O O B-ELLIPSIS | O O O B-QMARK | 0.00 |
| 6 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Mhm:202080-202110 | B-QMARK | B-FULLSTOP | 0.00 |
| 7 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Dziękuję:490710-490950 serdecznie:491010-491370 Do:491400-491430 usłyszenia:49146… | O B-FULLSTOP O B-FULLSTOP O B-FULLSTOP | O B-COMMA O B-COMMA O B-XCL | 0.00 |
| 8 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 No:19560-19590 | B-XCL | B-FULLSTOP | 0.00 |
| 9 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 Numer:33990-34200 klienta:34320-34710 to:34800-34890 dwa:34980-35160 dwa:35220-354… | O O O B-COMMA B-ELLIPSIS | O O O O B-FULLSTOP | 0.00 |
| 10 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 cztery:36420-36690 pięć:36780-37020 | B-COMMA B-COMMA | O B-FULLSTOP | 0.00 |
| 11 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 To:107670-107700 co:107880-107940 to:108000-108030 są:108120-108360 Z:108510-10851… | O O O B-ELLIPSIS O O O O B-ELLIPSIS | O O O B-QMARK O O O O B-QMARK | 0.00 |
| 12 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 No:144030-144060 ja:145440-145470 | O B-ELLIPSIS | O B-FULLSTOP | 0.00 |
| 13 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 O:164400-164400 Boże:164520-164820 | O B-FULLSTOP | O B-XCL | 0.00 |
| 14 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 żebyście:168270-168600 państwo:168660-168900 znowu:168960-169170 włączyli:169260-1… | O O O B-QMARK O O O O O B-COMMA O O O B-COMMA O B-ELLIPSIS | O O O B-FULLSTOP O O O O O B-QMARK O O O O O B-FULLSTOP | 0.00 |
| 15 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 W:176610-176610 ponie:177510-177510 we:177780-178050 wtorek:178200-178500 przyszły… | O B-ELLIPSIS O O B-COMMA O B-COMMA O B-COMMA O O O B-FULLSTOP | O O O O O O O O O O O O B-QMARK | 0.00 |
| 16 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 O:195900-195900 Jezu:196020-196260 | O B-FULLSTOP | O B-XCL | 0.00 |
| 17 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 I:203310-203310 po:203520-203550 prostu:203610-203790 wpłacić:203910-204270 to:204… | O O O O O B-ELLIPSIS O O O B-COMMA O B-COMMA O B-COMMA B-QMARK | O O O O O B-QMARK O O O O O O O O B-FULLSTOP | 0.00 |
| 18 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 O:216540-216540 Boże:216660-216900 Czyli:217350-217470 | O B-FULLSTOP B-ELLIPSIS | O B-XCL B-QMARK | 0.00 |
| 19 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 w:219930-219930 tej:219990-220080 ciemności:220110-220620 dopóki:220680-220950 nie… | O O B-COMMA O O B-QMARK O O B-XCL | O O O O O B-FULLSTOP O O B-FULLSTOP | 0.00 |
| 20 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Dzień:7020-7140 dobry:7200-7440 Energetyka:7800-8280 SA:8610-8610 Karolina:8760-90… | O B-FULLSTOP O B-COMMA O B-COMMA O O O B-QMARK | O B-COMMA O B-HYPHENO O O O O B-QMARK | 0.00 |
| 21 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Ta:72960-73020 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 22 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Z:114120-114120 tego:114210-114390 co:114450-114540 widzę:114630-114900 | O B-COMMA O B-COMMA | O O O B-FULLSTOP | 0.00 |
| 23 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 to:115170-115230 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 24 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Termin:122520-122820 płatności:122970-123660 minął:123810-124290 | O O B-ELLIPSIS | O O B-FULLSTOP | 0.00 |
| 25 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Wartość:155340-155640 samej:155670-155940 | O B-ELLIPSIS | O B-FULLSTOP | 0.00 |
| 26 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 faktury:156510-156810 była:156930-157110 na:157200-157230 dwieście:157500-157860 d… | O O O O O B-COMMA B-QMARK | O O O O O B-FULLSTOP B-FULLSTOP | 0.00 |
| 27 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Dwieście:159870-160170 dwadzieścia:160200-160680 osiem:160830-161040 to:161130-161… | O O O O B-COMMA O O B-FULLSTOP | O O O O O O O B-QMARK | 0.00 |
| 28 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 No:203430-203490 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 29 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 No:245340-245400 To:245910-245940 wtedy:246000-246240 | B-FULLSTOP O B-ELLIPSIS | O O B-QMARK | 0.00 |
| 30 | audio/cbiz_tc_41.wav 3896bb9d-e80e-458e-9695-4f7427c1abdf Siedem:41910-42120 siedem:42180-42510 | B-COMMA B-COMMA | O B-FULLSTOP | 0.00 |
| 31 | audio/cbiz_tc_41.wav 3896bb9d-e80e-458e-9695-4f7427c1abdf Dziękuję:294780-295110 również:295170-295410 życzę:295470-295650 miłego:295710-295… | O B-COMMA O O B-COMMA O B-FULLSTOP | O O O O B-FULLSTOP O B-XCL | 0.00 |
| 32 | audio/cbiz_tc_41.wav 1f0220c3-4246-4648-bbe4-53fcc8fe5318 I:54480-54480 już:54570-54630 sprawdzam:54750-55230 co:55800-55860 się:55890-55980… | O O B-COMMA O O O O O B-COMMA | O O O O O O O O B-FULLSTOP | 0.00 |
| 33 | audio/cbiz_tc_41.wav 1f0220c3-4246-4648-bbe4-53fcc8fe5318 z:124620-124620 umową:124770-125190 ale:125340-125460 ja:125580-125610 w:125670-12… | O B-COMMA O O O O O O O O O O | O B-FULLSTOP O O O O O O O O O B-FULLSTOP | 0.00 |
| 34 | audio/cbiz_tc_41.wav 1f0220c3-4246-4648-bbe4-53fcc8fe5318 ale:171750-171870 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 35 | audio/cbiz_tc_24.wav e2a8a04f-2a58-4361-8d2b-c92bb50a7081 Dzień:12420-12570 dob:12690-12690 | O B-ELLIPSIS | O B-FULLSTOP | 0.00 |
| 36 | audio/cbiz_tc_24.wav e2a8a04f-2a58-4361-8d2b-c92bb50a7081 No:100380-100470 niemożliwe:100560-101070 no:101160-101190 No:101490-101520 ale:10… | O B-COMMA B-FULLSTOP O O B-COMMA O O O O O O O O B-FULLSTOP | O B-FULLSTOP O O O B-FULLSTOP O O O O O O O O B-QMARK | 0.00 |
| 37 | audio/cbiz_tc_24.wav e2a8a04f-2a58-4361-8d2b-c92bb50a7081 Z:116130-116130 miesiąca:116220-116580 na:116670-116730 miesiąc:116790-117180 nie:… | O O O B-COMMA B-QMARK | O O O O B-FULLSTOP | 0.00 |
| 38 | audio/cbiz_tc_24.wav e2a8a04f-2a58-4361-8d2b-c92bb50a7081 I:148740-148740 może:148800-148950 może:149040-149160 może:149430-149550 się:14961… | O B-COMMA B-COMMA O O O O B-COMMA B-QMARK | O O O O O O O O B-FULLSTOP | 0.00 |
| 39 | audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 W:135690-135690 tym:135780-135840 momencie:135930-136290 | O O B-ELLIPSIS | O O B-FULLSTOP | 0.00 |
| 40 | audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 od:141270-141330 tej:141450-141510 decyzji:141570-141900 na:141990-142020 adres:14… | O O O O O B-ELLIPSIS | O O O O O B-FULLSTOP | 0.00 |