Is It Really Rude to Ask People to Take Off Their Shoes When They Come into Your House?

My husband thinks asking guests to remove their shoes is rude. I think shoes are basically a biohazard delivery system. Let's settle this debate once and for all.