@toon-format/cli
Command-line tool for converting between JSON and TOON formats.
TOON (Token-Oriented Object Notation) is a compact, human-readable serialization format designed for passing structured data to Large Language Models with significantly reduced token usage.
Installation
# npm
npm install -g @toon-format/cli
# pnpm
pnpm add -g @toon-format/cli
# yarn
yarn global add @toon-format/cli
Or use directly with npx:
npx @toon-format/cli [options] [input]
Usage
toon [options] [input]
Standard input: Omit the input argument or use - to read from stdin. This enables piping data directly from other commands.
Auto-detection: The CLI automatically detects the operation based on file extension (.json → encode, .toon → decode). When reading from stdin, use --encode or --decode flags to specify the operation (defaults to encode).
Basic Examples
# Encode JSON to TOON (auto-detected)
toon input.json -o output.toon
# Decode TOON to JSON (auto-detected)
toon data.toon -o output.json
# Output to stdout
toon input.json
# Pipe from stdin
cat data.json | toon
echo '{"name": "Ada"}' | toon
# Decode from stdin
cat data.toon | toon --decode
Options
| Option | Description |
|---|---|
-o, --output <file> |
Output file path (prints to stdout if omitted) |
-e, --encode |
Force encode mode (overrides auto-detection) |
-d, --decode |
Force decode mode (overrides auto-detection) |
--delimiter <char> |
Array delimiter: , (comma), \t (tab), | (pipe) |
--indent <number> |
Indentation size (default: 2) |
--stats |
Show token count estimates and savings (encode only) |
--no-strict |
Disable strict validation when decoding |
--key-folding <mode> |
Enable key folding: off, safe (default: off) |
--flatten-depth <number> |
Maximum folded segment count when key folding is enabled (default: Infinity) |
--expand-paths <mode> |
Enable path expansion: off, safe (default: off) |
Advanced Examples
Token Statistics
Show token savings when encoding:
toon data.json --stats -o output.toon
Example output:
✓ Encoded to TOON
Input: 15,145 tokens (JSON)
Output: 8,745 tokens (TOON)
Saved: 6,400 tokens (42.3% reduction)
Alternative Delimiters
Tab-separated (often more token-efficient)
toon data.json --delimiter "\t" -o output.toon
Lenient Decoding
Skip validation for faster processing:
toon data.toon --no-strict -o output.json
Stdin Workflows
# Convert API response to TOON
curl https://api.example.com/data | toon --stats
# Process large dataset
cat large-dataset.json | toon --delimiter "\t" > output.toon
# Chain with other tools
jq '.results' data.json | toon > filtered.toon
Key Folding (Since v1.5)
Collapse nested wrapper chains to reduce tokens:
Basic key folding
# Encode with key folding
toon input.json --key-folding safe -o output.toon
For data like:
{
"data": {
"metadata": {
"items": ["a", "b"]
}
}
}
Output becomes:
data.metadata.items[2]: a,b
Instead of:
data:
metadata:
items[2]: a,b
Limit folding depth
# Fold maximum 2 levels deep
toon input.json --key-folding safe --flatten-depth 2 -o output.toon
Path expansion on decode
# Reconstruct nested structure from folded keys
toon data.toon --expand-paths safe -o output.json
Round-trip workflow
# Encode with folding
toon input.json --key-folding safe -o compressed.toon
# Decode with expansion (restores original structure)
toon compressed.toon --expand-paths safe -o output.json
# Verify round-trip
diff input.json output.json
Combined with other options
# Key folding + tab delimiter + stats
toon data.json --key-folding safe --delimiter "\t" --stats -o output.toon
Why Use the CLI?
- Quick conversions between formats without writing code
- Token analysis to see potential savings before sending to LLMs
- Pipeline integration with existing JSON-based workflows
- Flexible formatting with delimiter and indentation options
- Key folding to collapse nested wrappers for additional token savings
Related
- @toon-format/toon - JavaScript/TypeScript library
- Full specification - Complete format documentation
- Website - Interactive examples and guides
License
MIT License © 2025-PRESENT Johann Schopplich