I don't know what the crowd is like for brunch and as such how kid friendly it is, but have you considered Vynl? I think they're one of the best things in the neighborhood, taking price and quality into consideration.
ditto for the vynl reco - good food and i would say they are pretty kid friendly. can get crowded for brunch - wouldn't suggest going too late. other place to consider - hudson hotel. nice space, good food, fine for kids/infants.