Show HN: Tokenkit – Convert LLMs to new tokenizers (incl byte-level Llama/Gemma)

1 points | by bminixhofer 5 hours ago