Commit Graph

11 Commits

Author SHA1 Message Date
Johann Schopplich
0710bd19e7 feat!: publish to @toon-format/toon and @toon-format/cli 2025-11-01 16:53:41 +01:00
Johann Schopplich
8567df9131 fix(cli): inline tokenx 2025-11-01 00:37:11 +01:00
SangheeSon
2b882870f7 feat(cli): add --stats flag to show token savings (#51)
* feat(cli): add --stats flag to show token efficiency

- Add --stats boolean flag to display token count comparison
- Calculate approximate tokens using char length / 4 heuristic
- Show JSON vs TOON token counts with savings percentage
- Opt-in feature, default behavior unchanged

* feat: use tokenx for more accurate estimates

---------

Co-authored-by: Johann Schopplich <mail@johannschopplich.com>
2025-11-01 00:35:54 +01:00
Johann Schopplich
753ee2cefd docs: add table of contents 2025-10-31 08:56:42 +01:00
Johann Schopplich
b93714e9b9 refactor: move gpt-tokenizer to benchmarks 2025-10-30 09:27:11 +01:00
Andreas Partsch
80acc9d4fe feat: add cli (#34)
* feat: add cli for toon

* docs: use npx in the readme

* feat: overhaul and refactor

---------

Co-authored-by: Johann Schopplich <mail@johannschopplich.com>
2025-10-30 08:08:08 +01:00
Johann Schopplich
ecf578a7dc text(accuracy): add Grok-4-fast, remove default temperature 2025-10-28 22:54:00 +01:00
Johann Schopplich
67c0df8cb0 docs: overhaul retrieval accuracy benchmark 2025-10-28 20:22:43 +01:00
Johann Schopplich
77696ce932 docs: benchmarks for XML format 2025-10-27 14:50:26 +01:00
Johann Schopplich
3c840259fe test: add LLM retrieval accuracy tests 2025-10-27 11:48:33 +01:00
Johann Schopplich
f105551c3e chore: initial commit 2025-10-22 20:16:02 +02:00