Downtown is the worst part of Atlanta for good food. There are some places; Teds Montana Grill isn't bad, Der Bier Garten is fun. If you do a search you'll find existing threads such as:
You might consider taking the light rail (MARTA) to Decatur, Midtown or Buckhead. Lots of threads for suggestions in those areas as well.