It's been a long time, back in ATL a few days
I lived in ATL from 1999-2001 while at Emory, and loved the dining scene. I'll be visiting friends for a few days later this summer, and will have some time during the day when friends are at work, to explore with my 4 and 5 year old. The kids are foodies too, and I will take them most anywhere. Besides a few old favorites, I want to try places that weren't around when I lived there. I need two breakfasts, two lunches, and two dinners. Price is mostly not an issue, but we don't need the highest priced places where people would give me the side-eye for bringing even well-behaved children in the place.
One caveat: while I am a foodie, and my kids will try most anything as well, I don't eat organ meat (I'll eat marrow and cheeks though). For instance, at first I thought Holeman and Finch looked interesting, as I have enjoyed public house concepts in other cities; but I looked at the menu and it's all heart, liver/pate, sweetbreads, and pickles/pickled. That's not my kind of place.
I think you'd enjoy Empire State South. Here are some adiitional existing posts that may help: