People are pretty forgiving when it comes to other people's families. The only family that ever horrifies you is your own.
I always know exactly where my stories take place which gives me something certain so I can use my imagination for the other stuff. I worry though who wants to keep reading stories about Kalamazoo?