Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation | Paper Notes

Paper notes for Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation.