I'm pretty sure that the Wild Oats on Wilshire and 5th has it. I also think I've seen it at several Whole Foods stores. I'm actually kind of surprised that you're having trouble finding it.
I agree with xdrixn, goat's milk shouldn't be difficult to find. Ralphs, Vons and Pavillions all carry it. If you want to spend more you can find it at Whole Foods or Bristol Farms.
If you want goat's milk for cheesemaking, buy it at Trader Joe's; it's not the ultrapasteurized stuff that won't make good cheese. I can't remember the brand just now but it comes in plastic 1 quart jugs with green tops, for $2.99/qt.
everywhere. it's actually very easy to find
meyenberg is probably the most widely available brand - their lowfat milk is my go-to choice when i'm using dairy and not an alternative like almond or rice.
re: the one mnosync mentioned from trader joe's in the white plastic bottles, the brand is summerhill.
fyi, tj's house brand of plain goat's milk yogurt is actually made by redwood hill farms - it's good stuff.
and if you really like goat's milk products, laloo's ice cream is fantastic...