PyTorch Version Impact on ColBERT Index Artifacts: 2.7.1 –> 2.8.0

Background In a previous blog post I showed how I traced index artifact differences between colbert-ai installs using torch==1.13.1 (the current pinned version) and torch==2.1.0 (the first version which produces different index artifacts) to a difference in floating point differences in the forward pass of the underlying BertModel . In a subsequent blog post I showed how the index artifact…