The Impact of Positional Encoding on Length Generalization in Transformers | Paper Notes

Paper notes for The Impact of Positional Encoding on Length Generalization in Transformers.