Actually, some readers care very much: there are those who skip prologues altogether.
And they got a bad name because, especially a few decades ago, "prologue" was another word for "infodump." Not all of them, of course, but enough that people got tired of slogging through them, as authors and publishers overestimated how much information needed to be frontloaded. So prologues are still looked at askance, by agents and by readers. Styles have changed, and so have reader expectations; these days, you'd be unlikely to sell a SF with a telly/explainy opening as the one that preceded the Pern books*, just as you'd be unlikely to get away with a Tolkienian, hip-deep dollop of worldbuilding before even getting to the characters and conflict. Today, readers expect to learn about your world as the story unfolds; they don't need or necessarily want it explained to them up front, nor do they necessarily need/want to start following a throwaway character/scene and becoming invested only for them to vanish as you hit Chapter One and the real story begins. (If it's that important, it's probably Chapter One anyway.)
That's not to say they're automatic poison, of course. Some prologues work, some don't. Use one if it works, don't if it doesn't... and if in doubt, then you probably don't need it. (Do not underestimate your readers, or overestimate how much you need to explain to them.)
(* - Proof that prologue skipping isn't new: despite the Pern openers explicitly stating that the humans were offworld colonists who engineered the dragons from native life forms, many just saw dragons and thought "fantasy." McCaffrey was very vocal about them being SF.)