diff --git a/README.md b/README.md index dcd1b71..c58e7ba 100644 --- a/README.md +++ b/README.md @@ -12,7 +12,7 @@ AI is becoming cheaper and more accessible, but larger context windows allow for - Writing inline primitive arrays without spaces > [!TIP] -> Wrap your JSON in `encode()` before sending it to LLMs and save ~1/2 of the token cost! +> Wrap your JSON in `encode()` before sending it to LLMs and save ~1/2 of the token cost for structured data! ## Token Benchmarks @@ -205,12 +205,11 @@ users[2]{id,name,role}: ## Key Features -- ๐Ÿ“‰ **Token-efficient:** typically 30โ€“60% fewer tokens vs JSON on GPT-style tokenizers -- ๐Ÿ“Š **Tabular arrays:** write object keys once, list rows beneath -- โœ‚๏ธ **Minimal quoting:** only when required (e.g., commas, colons, ambiguous primitives) -- ๐Ÿ“ **Indentation-based structure:** no braces/brackets for objects -- ๐ŸŽฏ **Inline primitive arrays:** written without spaces after commas -- ๐ŸŽฒ **Deterministic:** stable key order, no trailing spaces/newline +- ๐Ÿ’ธ **Token-efficient:** typically 30โ€“60% fewer tokens vs JSON on GPT-style tokenizers, based on real benchmarks +- ๐ŸŽ›๏ธ **Deterministic, tokenizer-aware output:** minimal quoting and stable ordering keep payloads compact and reproducible +- ๐Ÿงบ **Tabular arrays without repetition:** declare uniform keys once, then stream rows for dense datasets +- ๐Ÿ“ **Readable yet concise structure:** indentation replaces braces so nested data stays scannable without extra tokens +- ๐Ÿ”ข **LLM-friendly guardrails:** explicit lengths and field lists help models validate and reproduce structured responses ## Installation @@ -576,13 +575,13 @@ items[2]{sku,name,qty,price}: **Benefits:** -- Tabs are single characters and often tokenize more efficiently than commas -- Tabs rarely appear in natural text, reducing the need for quote-escaping +- Tabs are single characters and often tokenize more efficiently than commas. +- Tabs rarely appear in natural text, reducing the need for quote-escaping. **Considerations:** -- Some terminals and editors may collapse or expand tabs visually -- String values containing tabs will still require quoting +- Some terminals and editors may collapse or expand tabs visually. +- String values containing tabs will still require quoting. ##### Pipe Delimiter (`|`)