The Structural Vulnerabilities of Large Language Models