What kind of food are you into - Thai, Japanese, regional Western Canadian?
There are literally hundreds of restaurants within walking distance of the Empress - it's a very small city.
If you're looking for a spectacular view of the city I would recommend Vista 18 - not too pricey (entrees priced from $16 to $33 so a good variety), good food, locally sourced ingredients and a West Coast flair. It's 2 blocks from your hotel, in the Chateau Victoria hotel.
If you have any specific tastes, post a reply and I'll see what else I can offer. I hope you enjoy your trip to our beautiful city.
Agree with Vista 18. My wife and I were pleasantly surprised when visiting in early March. Although we have been going to Victoria for years we had nevered gone to it nor its predecessor with I think was called the Parrott House of something to that effect.
We usually avoid this type of spot as usually as is the case with many revolving restaurants for example the view far exceeds the quality of the food.
In our case, the sablefish I had was delicious.
However, if I am going to Victoria and am staying at the Empress and do not mind venturing along Goverment to Chinatown I would go to Brasserie L'Ecole which is our current favourite in Victoria.
Parisbully, Brasserie as the name suggests features French bistro cuisine with a Pacific Northwest touch vis-a-vis ingredients. Duck confit, endive, hazelnut and lardons salad, Sooke trout and steak frites amongst others complemented by Marc Morrison's excellent and well priced wine list with almost offered by the glass.