GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints | Paper Notes

Paper notes for GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints.