{"type":"link","version":"1.0","title":"本文系统评估了三种投影共享方案（… | Do transformers… · HotDaily 每日晚报","description":"本文系统评估了三种投影共享方案（共享 KV、共享 QK、单投影）。实验表明，在 1.2B 参数的语言模型中，共享 KV 投影（Q-K=V）能减少 50%…","url":"https://hotdaily.top/item/d3278e76-1c49-4633-8bfe-00f724d2f1b8","provider_name":"HotDaily","provider_url":"https://hotdaily.top","thumbnail_url":"https://hotdaily.top/og.png","thumbnail_width":1200,"thumbnail_height":630}