In addition to charmedgirl's suggestion, consider Eggspectation or Cafe de Paris. They're both off Rte 108.
Eggspectation (on Rte 108 at Snowden River) gets crowded later in the morning, but it has a nice menu of eggs and other breakfast. It is my place to take out of town folks because it's casual, good breakfast and a broad enough menu to please everyone.
Cafe de Paris (just off Rte 108 east of Rte 29) does weekend brunch, according to the Web site. It is often listed as one of the best restaurants in Howard County.
Other people have recommended a brunch at the Sheraton on the lakefront in Columbia, but I haven't been.
Two girlfriends and I met for brunch at the Victoria Gastro Pub in January and were very pleased with our meals. I had an egg sunny side up (cooked to just the right amount of runny-ness), some toast and micro greens -- I know, not very exciting, but that's what I wanted! And my two friends each tried some decadent french toast. I think one was a banana pecan something-or-other, and the other one involved pumpkin. I had tastes of both and thought they were very good. Service was so-so, but they told us up front our server was "in training" so we couldn't be too bothered by it, the guy was clearly trying. Plus, no one seemed to mind that we sat for forty minutes after we were done eating drinking coffee. I'd definitely go back, and I've been meaning to look into it for dinner.