I actually started my website somewhere around 1998, but I was on hiatus from freelancing at the time. I started it as practice for a work project, and it actually morphed into the most popular unofficial Disney Cruise Line site on the web! But if I were just starting in freelancing now, I would get a website ASAP. I got back into freelancing a year or so ago and immediately put up a site (paid) to showcase some clips:
www.barbnefer.com
I don't bother with business cards because I already have some for my travel agency and my counseling practice. If I really need one, I find people don't mind getting one or the other of those.
I bought my voice recorder when I started doing interview articles for a local publication early this year. I don't always use it tho' because I am a fast note taker.
As for other things you might need, if you don't want to pay for word processing software, I HIGHLY recommend OpenOffice, which is a totally free download and very stable. You can also get a free incoming fax number from
www.k7.net and a free local phone number from
www.grandcentral.com (although I don't know if they are currently accepting new sign-ups). I use a Gmail address for my writing because even tho' it's a free service, I love how they keep spam at bay, the large attachment allowance, and the practically unlimited storage. I've never had an editor bat an eye about it, at least as far as I know!
Hope this info. helps you get off and running! You will love Jenna's book.