{"type":"link","version":"1.0","title":"文章介绍 Gigatoken，一个… · GigaToken: ~1000x… | HotDaily","description":"文章介绍 Gigatoken，一个 Rust 实现的 tokenizer，支持多种常见模型 tokenizer，可作为 HuggingFace…","url":"https://hotdaily.top/item/ff33ab59-546b-4abb-b6e1-391cc1e58067","provider_name":"HotDaily","provider_url":"https://hotdaily.top","thumbnail_url":"https://hotdaily.top/og.png","thumbnail_width":1200,"thumbnail_height":630}