In the South End, brunch is the norm.
Rocca has a nice patio and during the afternoon they offer a more varied menu than pure brunch items. Don't know what times they serve it, however. It has the added bonus that the SoWa market is next door.
500 Harrison Avenue, Boston, MA 02118