I've never been a huge fan of Brandy Pete's, but I know any number of people who swear by their Buffalo chicken sandwich.
If you'd be cool with Back Bay, check out Parish Cafe at the top of Boylston. Sandwiches conceived by local celebrity chefs, and a great patio for people watching.