Within 4 blocks is tough. I would probably go with Toca at the Ritz hotel. There is also Le Select on Wellington and Tutti Matti on Adelaide.
364 Adelaide St W, Toronto, ON M5V1R7, CA
432 Wellington St W, Toronto, ON M5V1E3, CA
181 Wellington St W, Toronto, ON M5J 2H5, CA