Search
English

Posts from pythongiant.github.io

  1. KVBoost: Reducing LLM First Token Delay by 5–48× via KV Cache Reuse, Works Without GPU(pythongiant.github.io)

    SummaryThe open-source KVBoost was posted on Hacker News. It splits input into chunks, hashes them, and reuses the KV cache directly when the same chunk reoccurs. It reduced time to first token by 5–48 time…

    1 vote mrlatte SummaryDiscuss

Keyboard shortcuts

Choose a post with J and K or the arrow keys, then press Enter.

K ↑ / J ↓
Previous post / next post
Enter C
Open summary and comments for the selected post
O
Open the original link of the selected post
/
Search
?
Show this help
Tab
Move to the submit or comment button, then press Enter

Type normally in text fields. Tab and Enter are always available.