Avra has a big selection of fresh fish, it's not exactly on the EUS but close , its on E. 48th Street.
Trata Estiatorio on E 70th has good fish dishes.
Atlantic Grill is a popular fish place.
If Le Bernadin were a few blocks more east, it would be on UES. don't let a few blocks stand in the way.