How do you unfan clubs?

Go to your profile, click the "clubs" tab, and once you scroll over a spot's name a little x will appear. Click it and you're not a fan anymore.