How Reversible are Embeddings: Embedding Inversions and How to Protect your Data

I was recently asked to determine the sensitivity of embeddings generated from proprietary code. While it seemed natural to think that embeddings were one-way functions that could not be reversed, research revealed that substantial semantic leakage was possible—even if direct reconstruction was not. &#xA; Embeddings turn a token —a word, subword, or symbol— into a vector that encodes its semantic…