For example, aliens can live in a spaceship/futuristic building, animals in a kennel, clowns in tents, ghosts in graves etc.
I feel I have too many apartments and houses because I keep trying to house everyone.
This way it is easier to keep track of which special townie I have unlocked as well.