Announcement_2

Our paper Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding was accepted to ICML 2025!