There are plenty of restaurants that have great seafood dishes in town, but I can't think of anyplace that I would refer to as a seafood restaurant per se.
if you are looking for a traditional seafood restaurant i.e. lobsters, steamers... I would head out to Lenny's in Branford. If you are looking for a tasty fish dish any of the top places in town would serve you well.