Speculative Decoding: The Free Speed Toggle Your Local LLM Is Probably Not Using

 (vettedconsumer.com)

2 points | by ermantrout 1 hour ago

0 comments