Clearing favicon caching on Safari is not simple. The commonly accepted steps are below, however in practice this doesn’t appear to work (for me, at least). I’ll update as I investigate.

• Clear caches from the develop menu
• Fully quit Safari
• Delete ~/Library/Safari/Favicon Cache entirely
• Reboot
• Launch Safari and re-test website