Announcement_2
Our paper Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding was accepted to ICML 2025!
Our paper Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding was accepted to ICML 2025!