Anchoring your story in a place and time (even if that time is "whenever-you-happen-to-be-writing-the-story") will prevent that sort of disorientation. At least, if you hope that people will still be reading your work a few decades from now.
I agree for the most part, but there are authors who purposely leave the time open for multiple reasons. I know of several songwriters who purposely eschew the use of specific items to give the stories within their songs a "timeless" feel, and often the timing doesn't really matter. The story could have happened in the Civil War or a hundred years from now and the story would remain the same.
I just finished reading Cormac McCarthy's
Child of God. That story has absolutely no details to place the story in a certain year or era--except perhaps the prices that the protagonist pays at the store mentioned briefly. It's the location that is integral to the story rather than the timing.
So, while in general I think it's helpful for a writer to give a reader details to ground the story in a specific time and place, I don't think that in all cases timing is absolutely necessary.
Now, as for how to introduce setting... just never write this sort of thing: "Bob entered the cafe. It had red walls and a black bar. There was a middle-aged white male with a craggy face standing behind it. The bathrooms were to the left and there was a small stage to the right." While there's some decent detail there, it's presented in a boring fashion (I'm sure you could already tell XD).
This may be more engaging: "Bob pushed open the small cafe's double glass doors and stepped in. He walked over the worn carpeting to the bar. 'What can I do ya for?' asked the rather hard looking man standing behind it, raising his nicotine stained hand in a feaux-friendly gesture. . .etc"
Although that may have been a little overboard to make a point