Just remember how large a planet is. It's not a state, a country, or even a continent. It's huge, about several million square miles (possibly even billion). See how diverse we are, and so far we've only inhabited ONE planet.
Your planet doesn't have to be all vegetation, or all barren wasteland, it can be varied. You could have several thousand square miles of bleak, sandy wasteland, and several thousand square miles of desert similar to Arizona. I understand you don't want full blown forests on your planet, but you can have some vegetation and still keep the feeling of bleakness. You don't have to stick to the stereotype of planets with one single landscape that goes on forever especially since you're apparently aiming for some level of realism.
Also, a place completely unsuitable for life generally won't sustain it, and often kill life that enters it. Does the surface have to be completely dry? Even deserts have some water. For example, the Sahara desert has the Nile River, and Arizona has the Colorado River. Lakes also form, though those are usually temporary and shallow. Only the Atacama desert, the driest desert in the world, has the Loa River, and it's about as bleak as it gets, being almost completely sterile of all life.