you can also order goat cheese starter packages (for fresh 'chevre' goat cheese) from lehmen's or the new england cheese co. just heat the milk, add the packet and let it sit. this is the easiest that i've found
but
the cheapest is to get the rennet and starter and just mix it up yourself. just a couple extra steps. still super easy
www.fiascofarm.com has some nice recipes with step-by-step directions with photos. And links for supplies. I've made aged cheddar (from Rikki Carroll's book, Cheesemaking), chevre, moldy chevre, mozzarella (hard to get right, but the failures are still yummy, thank goodness) and ricotta.
Chevre is a soft cheese and is the easiest, recipe on the above link. You can make your own molds with plastic containers and a drill or a hot nail.