Encoding Tests
Free CSV test files in UTF-8 without BOM, UTF-8 with BOM, Shift_JIS and CP932, containing Japanese data — for testing mojibake and CSV import.
A CSV test file encoded in UTF-8 without BOM
utf8.csv / 659 B
A CSV test file encoded in UTF-8 with BOM
utf8-bom.csv / 662 B
A CSV test file encoded in Shift_JIS
sjis.csv / 514 B
A CSV test file encoded in CP932, including vendor-specific characters
cp932.csv / 518 B
Why character encoding tests matter
CSV files containing Japanese (or other non-ASCII) text often suffer mojibake due to encoding mismatches. Excel, for example, prefers UTF-8 with BOM, and tool support varies widely.
Use these test files to verify that your CSV importers and text-processing libraries handle each encoding correctly.
Key characteristics of common encodings
- UTF-8: The most common; default in most programming languages.
- UTF-8 BOM: Recommended for opening Japanese CSV in Excel. Prepends three bytes (EF BB BF).
- Shift_JIS: Widely used on Windows; some characters (like 〜, −) cause issues.
- CP932: Extended Shift_JIS that supports machine-dependent characters like 髙, 﨑.