- Jons Marketplace (multiple locations)
- Kavita Grocery, 10201 Venice Blvd, LA next to Annapurna Cuisine
- any latino oriented market (zillion locations)
- Samosa House, 11510 West Washington Blvd, CC
Each kind of market has their strengths and omissions. You won't find every spice at a great price at any one market. Even at Penzeys you have to be selective - plan ahead using their website. At IndoPak markets you have to be careful Not to buy a lifetime supply in one visit!
Always buy whole spices if possible since they will last much longer. A few kinds I will also buy powdered since they are a p.i.t.a. to grind (achiote, cinnamon, clove).
Jordan Market, a really small middle-eastern type market on Westwood has a pretty good selection of middle-eastern spices. I usually go there for them and they're around $1-3 for a bag of spices. I can't really judge their freshness, but I did make some za'atar out of the spices I got there and tasted great.
Look no further than Co-Opportunity in Santa Monica. They have exactly what you are looking for. There are numerous large glass bins of just about every spice & even herbs you can imagine, plus you can take as much or as little as you like, as it is all sold by weight. (honor system consisting of attaching a small sticker to each bag where you write the price per oz so they know how much to charge you at check out.) Finally, I have found their spices to be the freshest available in these parts.
Santa Monica, CA 90404-2717
Phone: (310) 451-8902
There is a store in Torrance called Penzeys, they have wonderful fresh spices. Although they do not sell them by weight so to speak, they have several sizes to choose from. You can open a large sample jar to smell the different herbs and spices, then make your decision. You can also order online.
21301 Hawthorne Blvd, Torrance, CA 90503