Accelerating Speculative Decoding using Dynamic Speculation Length.

Jonathan Mamou,Oren Pereg,Daniel Korat,Moshe Berchansky,Nadav Timor,Moshe Wasserblat,Roy Schwartz

CoRR（2024）

Cited 0|Views31
No score
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined