Fast Inference from Transformers via Speculative Decoding | Paper Notes

Paper notes for Fast Inference from Transformers via Speculative Decoding.