Can't recommend anyone in New Haven proper (I was born, grew up there and worked in the bakery business there), BUT make the 20 minute trip to Milford and order your special occasion cake from Sweet Designs.
Laurene work is unbelievable. We have used her for wedding, birthdays, anniversaries, etc.
Top notch quality and design at very reasonable prices. Well worth the trip.