It's been a long time, back in ATL a few days
I lived in ATL from 1999-2001 while at Emory, and loved the dining scene. I'll be visiting friends for a few days later this summer, and will have some time during the day when friends are at work, to explore with my 4 and 5 year old. The kids are foodies too, and I will take them most anywhere. Besides a few old favorites, I want to try places that weren't around when I lived there. I need two breakfasts, two lunches, and two dinners. Price is mostly not an issue, but we don't need the highest priced places where people would give me the side-eye for bringing even well-behaved children in the place.
One caveat: while I am a foodie, and my kids will try most anything as well, I don't eat organ meat (I'll eat marrow and cheeks though). For instance, at first I thought Holeman and Finch looked interesting, as I have enjoyed public house concepts in other cities; but I looked at the menu and it's all heart, liver/pate, sweetbreads, and pickles/pickled. That's not my kind of place.
I think you'd enjoy Empire State South. Here are some adiitional existing posts that may help:
General Muir near Emory
Delia's Chicken Sausage Stand
West Egg Cafe
Any of the numerous burger joints ie Farmhouse, Grindhouse, Flip
Also, find out where all the food trucks are and check them out