Please try Bernards in Ridgefield!! I know it is north of "Norwalk/Port Chester" but they are open xmas eve and xmas day. I had a very nice meal there last xmas and I will be dining there this xmas also. Nice wine list to boot!!
Schoolhouse is closed this year for xmas. I would also agree that 1020 is way below in food quality from the other places mentioned... For excellent food you might want to check Harvest Supper in New Canaan.