Sunday dinner in ATL
Don't know if you mind eating in the hotel restaurant, but the Terrace doesn't look too bad (although I haven't heard or seen review yet).
Otherwise depends what you want/how much to spend. Depends what you mean by close by....walking? short cab? MARTA? Do you have a car?
I think I did a recent post on restaurants open on Sundays.