Johann Schopplich
8567df9131
fix(cli): inline tokenx
2025-11-01 00:37:11 +01:00
SangheeSon
2b882870f7
feat(cli): add --stats flag to show token savings ( #51 )
...
* feat(cli): add --stats flag to show token efficiency
- Add --stats boolean flag to display token count comparison
- Calculate approximate tokens using char length / 4 heuristic
- Show JSON vs TOON token counts with savings percentage
- Opt-in feature, default behavior unchanged
* feat: use tokenx for more accurate estimates
---------
Co-authored-by: Johann Schopplich <mail@johannschopplich.com >
2025-11-01 00:35:54 +01:00
Anton Maminov
af068f995d
docs: add Crystal implementation ( #48 )
2025-11-01 00:26:43 +01:00
Johann Schopplich
901fcc53f3
docs(spec): add main title
2025-10-31 22:13:20 +01:00
Morteza Hosseini
baf450b46c
docs: update README with badges for CI, npm version, spec, downloads, and license ( #52 )
2025-10-31 19:48:54 +01:00
Johann Schopplich
5a2040ae81
docs(spec): release v1.3
2025-10-31 13:52:18 +01:00
Johann Schopplich
617e5f1bda
docs(spec): more work on v1.3 draft
2025-10-31 13:23:55 +01:00
Johann Schopplich
9f926c4de1
docs(spec): v1.3 draft
2025-10-31 13:13:02 +01:00
Johann Schopplich
bb1f61030e
test: add test for precision preservation of repeating decimals
2025-10-31 12:40:15 +01:00
Johann Schopplich
bf592b0bba
docs(spec): better RFC/W3C compliance
2025-10-31 12:06:24 +01:00
Johann Schopplich
8c8c654a32
docs(spec): update acknowledgments and license section
2025-10-31 11:50:45 +01:00
Johann Schopplich
fe8f0615df
docs: merge installation and quick start
2025-10-31 09:27:31 +01:00
Johann Schopplich
13351a365a
docs: add rtoon as Rust implementation ( closes #41 )
2025-10-31 09:10:22 +01:00
Johann Schopplich
a3bf1965c6
docs: add implementation note
2025-10-31 09:04:19 +01:00
Johann Schopplich
753ee2cefd
docs: add table of contents
2025-10-31 08:56:42 +01:00
Johann Schopplich
b2eeaea9d0
docs: add Gleam port ( fixes #44 )
2025-10-30 21:58:14 +01:00
Johann Schopplich
3a48cd4c7c
docs: add Dart port ( fixes #42 )
2025-10-30 21:57:03 +01:00
Johann Schopplich
66212285e5
refactor(cli): re-use source constants
2025-10-30 21:33:08 +01:00
Johann Schopplich
7317b869b1
docs: update benchmark README
2025-10-30 17:38:00 +01:00
Johann Schopplich
983728e913
refactor: progress bar configuration
2025-10-30 15:24:22 +01:00
Johann Schopplich
fb43bdf527
docs: adjust padding for benchmark comparison
2025-10-30 15:19:16 +01:00
Johann Schopplich
2c4f3c4362
test: add benchmarks for compact vs. pretty JSON
2025-10-30 15:02:51 +01:00
Johann Schopplich
df68417d8b
docs: remove redundant canonical formatting rules section
2025-10-30 12:45:16 +01:00
Johann Schopplich
858797f186
docs: update social card image
2025-10-30 12:45:00 +01:00
Johann Schopplich
b93714e9b9
refactor: move gpt-tokenizer to benchmarks
2025-10-30 09:27:11 +01:00
Johann Schopplich
752118d1b5
docs: update Python library links
2025-10-30 09:18:01 +01:00
Johann Schopplich
79cebbdf15
docs: update decode example
2025-10-30 09:15:37 +01:00
Johann Schopplich
f0f1166e20
chore: release v0.5.1
2025-10-30 08:35:38 +01:00
Johann Schopplich
e41b846ea2
fix: add missing bin entry for toon CLI
2025-10-30 08:35:34 +01:00
Johann Schopplich
963c618f75
chore: release v0.5.0
2025-10-30 08:09:30 +01:00
Andreas Partsch
80acc9d4fe
feat: add cli ( #34 )
...
* feat: add cli for toon
* docs: use npx in the readme
* feat: overhaul and refactor
---------
Co-authored-by: Johann Schopplich <mail@johannschopplich.com >
2025-10-30 08:08:08 +01:00
highpofly.eth
28896e19e8
docs: add Rust port ( #36 )
...
* added the rust port to the list of ports in the readme
* chore: consolidate
---------
Co-authored-by: JadJabbour <jabbourj.87@gmail.com >
Co-authored-by: Johann Schopplich <mail@johannschopplich.com >
2025-10-30 08:07:31 +01:00
Johann Schopplich
19570fc36d
docs: move playground tip
2025-10-29 21:15:16 +01:00
Johann Schopplich
8aa40f5ac9
docs: playground by @curiouslychase ( closes #32 )
2025-10-29 20:50:14 +01:00
Ivan Starkov
40c053e7ca
docs: fix custom toon syntax ( #33 )
2025-10-29 20:43:36 +01:00
Johann Schopplich
3505f75bca
docs: add clarification on TOON as a translation layer for LLM input
2025-10-29 19:28:59 +01:00
Johann Schopplich
e7cecc0cef
chore: release v0.4.1
2025-10-29 19:04:15 +01:00
Johann Schopplich
38ea864763
docs: clarify TOON's advantages and optimal data structure
2025-10-29 19:04:04 +01:00
Johann Schopplich
810748f862
refactor: replace function
2025-10-29 18:47:32 +01:00
Johann Schopplich
df51ab0a1f
test: reorganize validation and error handling tests
2025-10-29 14:59:36 +01:00
Johann Schopplich
8d5e3c9758
docs(spec): enhance blank-line handling and clarify quoting rules in strict mode
2025-10-29 14:52:16 +01:00
Johann Schopplich
bd06e5b1ea
feat(decoder): blank line validation for strict mode in arrays and tabular rows
2025-10-29 14:51:53 +01:00
Johann Schopplich
e6c006bc67
feat(decoder): indentation strict-mode enforcement
2025-10-29 13:54:55 +01:00
Johann Schopplich
6040c018e0
fix(decoder): use default delimiter for parsing array headers
2025-10-29 13:43:05 +01:00
Johann Schopplich
ee31be3bdc
test: add case for unquoted invalid numeric formats as strings
2025-10-29 13:05:42 +01:00
Johann Schopplich
b034c4455e
refactor: move encode functions
2025-10-29 11:13:02 +01:00
Johann Schopplich
78d2a67347
refactor: encoder functions deduplications
2025-10-29 10:23:31 +01:00
Johann Schopplich
8d238f8eeb
refactor: decoding source files
2025-10-29 10:12:13 +01:00
Johann Schopplich
c4f00bd69f
refactor: simplify return statements
2025-10-29 09:03:38 +01:00
Johann Schopplich
1776ae1834
refactor: use specific error types in decoders and parser
2025-10-29 09:01:43 +01:00
