There's no problem at all with using the real name of a town, real streets, real houses, real businesses, etc. Writers do it all the time. Some even go to a length of detail that's incredible. If a character trips over a crack in the sidewalk, you can go there and there will be a crack in the sidewalk. And, of course, an awful lot of fictional characters have been killed on or in the Empire State Building, Grand Central Station, the New York subway, Central Park, Times Square, etc.
Some of the best fiction out there wouldn't exist if the writer couldn't use real locations, or worried about having negative things happening there. Whether or not it upsets someone simply isn't an issue.
Using real people is more problematical. It's best to change the names and descriptions, though I seldom do, if the character is peripheral. I constantly use real people in my fiction, and keep their real names and physical descriptions. But I don't have real characters do anything in fiction they could object to. Though I did once make my brother-in-law a horse thief, and made his wife a dance hall girl. In real life he's a police officer and she's a church secretary. Only the protagonist and the antagonist are fictional in most of my stories.
But I use the real name of the only store in my tiny hometown, and the real owner. I use the real name of the grain company, the real owner's name, and teh real names and descriptions of the workers. Verisimilitude. Someone may decide to drive through that town because of my writing (It's happened) and I want them to see it as it is.
Change the names and descriptions of anyone doing bad deeds, and you're fine.
You don't have to worry about slander, of course. That's spoken words. And libel is only libel if you intentionally lie about someone in a way you know is going to damage their reputation. Even a lie isn't libelous, unless you both know it's a lie, and had the intent/reasonable expectation of damaging the person.
Invasion of privacy is generally only a problem if you break the law in the process.
People can sue you anytime for any reason whatsoever, and even if you change everything, there's always a chance you'll be sued over something. But it's seldom anything to lose sleep over.
But mentioning real businesses is fine. You can certainly have a character stop to eat at a real diner in a real location, and you can have a person murdered on a real street. This, too, is done all the time. I grew up in a tiny town, only 100 people, and I've used every deatil of it in fiction. I have characters shop at the tiny local store, I've had people killed by being thrown off the grain elevator in the center of town, and I had a character murdered at the only famous place around, The Wilbur Wright Memorial. Wilbur Wright was born there. You can also have as many bad things happen in a real town as you wish. This, too, is done all the time.
Or you can just make up your own town, based on whatever real town and geographical location you wish. This, too, has its advantages. You can make things just the way you want them, put businesses where they're convenient, have a river where you need a river, etc.
If you use a private residence, it is best to build your own house and give it a fake address number.
But for verisimilitude, there's nothing at all wrong with using a real town, real streets, real businesses, real landmarks, and even real living people is perihpheral roles. Nor of using dead people pretty much any way you wish.
In nonfiction, you can write anything about anyone that you can learn from public sources, including interviewing that person's friends. There wouldn't be many magazine or newspaper articles if you had to get permission to write about someone. No one would give permission to have negative things published.
