I've been working my way through this area the last couple of months. My preference usually leans towards ethnic eats.
Here's a few:
Tirupathi Bhimas for South Indian. Very casual.
Spice Route for N. Indian. Slightly upscale.
Banana Leaf for Malaysian. Mid-scale.
These are all in Milpitas which is one exit south of Fremont.
Spice Route Pan-Asian Grill
400 Valley Way, Milpitas, CA 95035
1208 S Abel St, Milpitas, CA 95035