Why is Kṛṣṇa called the all-attractive if not everyone is attracted to Him?

Kṛṣṇa means “the all-attractive.” For devotees, it makes perfect sense, since Kṛṣṇa is so beautiful. However, a materialist, or even a follower of a different philosophy, could protest.