Compliance cases
These are the 7,246 inputs a submission must answer.
A conforming implementation returns true
for the 2,791 valid ones and false
for the 4,455 invalid ones.
You can run the suite without reading it, or open any case to see its input and where its first ill-formed byte is.
Well-formed means Table 3-7 of the Unicode Standard, as RFC 3629 restates it: no overlong forms, surrogates, code points above U+10FFFF, stray continuation bytes or sequences cut short. The compliance suite combines Markus Kuhn's UTF-8 stress test, WPT's fatal TextDecoder tests, every lead byte against the edges of its allowed ranges, errors at every offset around 16-, 32- and 64-byte blocks and at the end of every length up to 130 bytes, large inputs, and seeded random text. simdutf, Python and a Table 3-7 reference agree on every answer.
Run the full compliance suite locally. Replace your-component.wasm
with your compiled component.
Download the suite
curl -fLo validate_utf8.comply.wasm https://calculated.world/comply/validate_utf8.wasm
npx qipok your-component.wasm --suite validate_utf8.comply.wasm
All 7,246 cases · 2,791 true · 4,455 false
| Case | Name | Expected | Note | Size |
|---|---|---|---|---|
| 001850 | regression/noncharacter U+FDE9 Focused regression | true | 3 B | |
| 001851 | regression/noncharacter U+FDEA Focused regression | true | 3 B | |
| 001852 | regression/noncharacter U+FDEB Focused regression | true | 3 B | |
| 001853 | regression/noncharacter U+FDEC Focused regression | true | 3 B | |
| 001854 | regression/noncharacter U+FDED Focused regression | true | 3 B | |
| 001855 | regression/noncharacter U+FDEE Focused regression | true | 3 B | |
| 001856 | regression/noncharacter U+FDEF Focused regression | true | 3 B | |
| 001857 | regression/noncharacter U+1FFFE Focused regression | true | 4 B | |
| 001858 | regression/noncharacter U+1FFFF Focused regression | true | 4 B | |
| 001859 | regression/noncharacter U+2FFFE Focused regression | true | 4 B | |
| 001860 | regression/noncharacter U+2FFFF Focused regression | true | 4 B | |
| 001861 | regression/noncharacter U+3FFFE Focused regression | true | 4 B | |
| 001862 | regression/noncharacter U+4FFFE Focused regression | true | 4 B | |
| 001863 | regression/noncharacter U+4FFFF Focused regression | true | 4 B | |
| 001864 | regression/noncharacter U+5FFFE Focused regression | true | 4 B | |
| 001865 | regression/noncharacter U+5FFFF Focused regression | true | 4 B | |
| 001866 | regression/noncharacter U+6FFFE Focused regression | true | 4 B | |
| 001867 | regression/noncharacter U+6FFFF Focused regression | true | 4 B | |
| 001868 | regression/noncharacter U+7FFFE Focused regression | true | 4 B | |
| 001869 | regression/noncharacter U+7FFFF Focused regression | true | 4 B | |
| 001870 | regression/noncharacter U+8FFFE Focused regression | true | 4 B | |
| 001871 | regression/noncharacter U+8FFFF Focused regression | true | 4 B | |
| 001872 | regression/noncharacter U+9FFFE Focused regression | true | 4 B | |
| 001873 | regression/noncharacter U+9FFFF Focused regression | true | 4 B | |
| 001874 | regression/noncharacter U+AFFFE Focused regression | true | 4 B | |
| 001875 | regression/noncharacter U+AFFFF Focused regression | true | 4 B | |
| 001876 | regression/noncharacter U+BFFFE Focused regression | true | 4 B | |
| 001877 | regression/noncharacter U+BFFFF Focused regression | true | 4 B | |
| 001878 | regression/noncharacter U+CFFFE Focused regression | true | 4 B | |
| 001879 | regression/noncharacter U+CFFFF Focused regression | true | 4 B | |
| 001880 | regression/noncharacter U+DFFFE Focused regression | true | 4 B | |
| 001881 | regression/noncharacter U+DFFFF Focused regression | true | 4 B | |
| 001882 | regression/noncharacter U+EFFFE Focused regression | true | 4 B | |
| 001883 | regression/noncharacter U+EFFFF Focused regression | true | 4 B | |
| 001884 | regression/noncharacter U+FFFFE Focused regression | true | 4 B | |
| 001885 | regression/noncharacter U+10FFFE Focused regression | true | 4 B | |
| 001886 | regression/every noncharacter Focused regression | true | 230 B | |
| 001887 | regression/BOM then text Focused regression | true | 8 B | |
| 001888 | regression/BOM twice in text Focused regression | true | 8 B | |
| 001889 | regression/truncated BOM Focused regression | false | 2 B | |
| 001890 | regression/UTF-16LE BOM Focused regression | false | 6 B | |
| 001891 | regression/UTF-16BE BOM Focused regression | false | 6 B | |
| 001892 | regression/latin-1 text Focused regression | false | 10 B | |
| 001893 | regression/cp1252 text Focused regression | false | 19 B | |
| 001894 | regression/cp1251 text Focused regression | false | 6 B | |
| 001895 | regression/shift_jis text Focused regression | false | 10 B | |
| 001896 | regression/gb18030 text Focused regression | false | 4 B | |
| 001897 | regression/euc-kr text Focused regression | false | 10 B | |
| 001898 | regression/iso8859-7 text Focused regression | false | 4 B | |
| 001899 | regression/double-encoded UTF-8 Focused regression | true | 7 B |
Where these rules come from
Well-formed UTF-8 is defined by Table 3-7 of
the Unicode Standard, chapter 3
, which
RFC 3629
restates as ABNF. Every answer is agreed by
simdutf
9.4.0, Python’s strict codec and a direct reading of the table; the
suite’s own tests add Node.js’s buffer.isUtf8
and a fatal TextDecoder.
- UTF-8 decoder capability and stress test — Markus Kuhn’s file, the source of the 80 Kuhn cases
-
WPT textdecoder-fatal tests
— what browsers must reject when decoding with
fatal: true - Validating UTF-8 In Less Than One Instruction Per Byte — John Keiser and Daniel Lemire’s vectorised algorithm, which simdutf uses