As long as there are records from DMV, credit cards, taxes, associations you belong to, registries for ordering online, etc, you are trackable.
By changing your name legally, always paying cash, never signing up for anything either in person, on the web, on the tel., or by mail, using aliases and different email accounts for different sites--that can reduce the time your name shows up and the amount of spam you get.
We do live in an information age. According to a person's ability and comp knowledge, anything you do or have done leaves a paper and an electronic trail from the birth certificate to shopping, to voter records, etc.
You can opt to reduce or omit tracking cookies, never online bank or pay bills, don't use IM programs, don't send email, don't personalize home pages, don't upload or download anything. Never give your real name online, or to anyone who gets online.
If you have stories posted anywhere, even if you remove them, they may still be in a database somewhere.
If you're worried about identity theft, you need to contact your bank, credit card, insurance, utilites, and anyone else with whom you have a financial relationship.