Compliance cases
These are the 7,246 inputs a submission must answer.
A conforming implementation returns true
for the 2,791 valid ones and false
for the 4,455 invalid ones.
You can run the suite without reading it, or open any case to see its input and where its first ill-formed byte is.
Well-formed means Table 3-7 of the Unicode Standard, as RFC 3629 restates it: no overlong forms, surrogates, code points above U+10FFFF, stray continuation bytes or sequences cut short. The compliance suite combines Markus Kuhn's UTF-8 stress test, WPT's fatal TextDecoder tests, every lead byte against the edges of its allowed ranges, errors at every offset around 16-, 32- and 64-byte blocks and at the end of every length up to 130 bytes, large inputs, and seeded random text. simdutf, Python and a Table 3-7 reference agree on every answer.
Run the full compliance suite locally. Replace your-component.wasm
with your compiled component.
Download the suite
curl -fLo validate_utf8.comply.wasm https://calculated.world/comply/validate_utf8.wasm
npx qipok your-component.wasm --suite validate_utf8.comply.wasm
51 of 7,246 cases · 29 true · 22 false
| Case | Name | Expected | Note | Size |
|---|---|---|---|---|
| 001900 | regression/text English Focused regression | true | 44 B | |
| 001901 | regression/text English cut short Focused regression | true | 43 B | |
| 001902 | regression/text French Focused regression | true | 81 B | |
| 001903 | regression/text French cut short Focused regression | true | 80 B | |
| 001904 | regression/text French with a broken character Focused regression | false | 81 B | |
| 001905 | regression/text German Focused regression | true | 63 B | |
| 001906 | regression/text German cut short Focused regression | true | 62 B | |
| 001907 | regression/text German with a broken character Focused regression | false | 63 B | |
| 001908 | regression/text Polish Focused regression | true | 78 B | |
| 001909 | regression/text Polish cut short Focused regression | true | 77 B | |
| 001910 | regression/text Polish with a broken character Focused regression | false | 78 B | |
| 001911 | regression/text Greek Focused regression | true | 64 B | |
| 001912 | regression/text Greek cut short Focused regression | true | 63 B | |
| 001913 | regression/text Greek with a broken character Focused regression | false | 64 B | |
| 001914 | regression/text Russian Focused regression | true | 103 B | |
| 001915 | regression/text Russian cut short Focused regression | true | 102 B | |
| 001916 | regression/text Russian with a broken character Focused regression | false | 103 B | |
| 001917 | regression/text Hebrew Focused regression | true | 66 B | |
| 001918 | regression/text Hebrew cut short Focused regression | true | 65 B | |
| 001919 | regression/text Hebrew with a broken character Focused regression | false | 66 B | |
| 001920 | regression/text Arabic Focused regression | true | 90 B | |
| 001921 | regression/text Arabic cut short Focused regression | true | 89 B | |
| 001922 | regression/text Arabic with a broken character Focused regression | false | 90 B | |
| 001923 | regression/text Hindi Focused regression | true | 255 B | |
| 001924 | regression/text Hindi cut short Focused regression | false | 254 B | |
| 001925 | regression/text Hindi with a broken character Focused regression | false | 255 B | |
| 001926 | regression/text Thai Focused regression | true | 169 B | |
| 001927 | regression/text Thai cut short Focused regression | false | 168 B | |
| 001928 | regression/text Thai with a broken character Focused regression | false | 169 B | |
| 001929 | regression/text Chinese Focused regression | true | 60 B | |
| 001930 | regression/text Chinese cut short Focused regression | false | 59 B | |
| 001931 | regression/text Chinese with a broken character Focused regression | false | 60 B | |
| 001932 | regression/text Japanese Focused regression | true | 108 B | |
| 001933 | regression/text Japanese cut short Focused regression | false | 107 B | |
| 001934 | regression/text Japanese with a broken character Focused regression | false | 108 B | |
| 001935 | regression/text Korean Focused regression | true | 94 B | |
| 001936 | regression/text Korean cut short Focused regression | true | 93 B | |
| 001937 | regression/text Korean with a broken character Focused regression | false | 94 B | |
| 001938 | regression/text Emoji Focused regression | true | 108 B | |
| 001939 | regression/text Emoji cut short Focused regression | false | 107 B | |
| 001940 | regression/text Emoji with a broken character Focused regression | false | 108 B | |
| 001941 | regression/text Combining Focused regression | true | 49 B | |
| 001942 | regression/text Combining cut short Focused regression | false | 48 B | |
| 001943 | regression/text Combining with a broken character Focused regression | false | 49 B | |
| 001944 | regression/text Math Focused regression | true | 73 B | |
| 001945 | regression/text Math cut short Focused regression | false | 72 B | |
| 001946 | regression/text Math with a broken character Focused regression | false | 73 B | |
| 005312 | regression/256 KiB mixed text Focused regression | true | 256.0 KiB | |
| 005317 | regression/64 KiB CJK Focused regression | true | 64.0 KiB | |
| 005319 | regression/64 KiB emoji Focused regression | true | 64.0 KiB |
Where these rules come from
Well-formed UTF-8 is defined by Table 3-7 of
the Unicode Standard, chapter 3
, which
RFC 3629
restates as ABNF. Every answer is agreed by
simdutf
9.4.0, Python’s strict codec and a direct reading of the table; the
suite’s own tests add Node.js’s buffer.isUtf8
and a fatal TextDecoder.
- UTF-8 decoder capability and stress test — Markus Kuhn’s file, the source of the 80 Kuhn cases
-
WPT textdecoder-fatal tests
— what browsers must reject when decoding with
fatal: true - Validating UTF-8 In Less Than One Instruction Per Byte — John Keiser and Daniel Lemire’s vectorised algorithm, which simdutf uses