Oooo. You're about a year too late. There was a restaurant in Port Jervis called 20 Front. It was in an old bank. The chefs/owners were CIA graduates. It's my understanding that the 2 partners had differences and as a result the place went under. I can't think of any really nice places to eat in either of the towns you mentioned. There are OK restaurants but not really good ones, at least that I know of. If you don't mind going to Middletown, there is Nina and Blue Finn. Those are really good restaurants.
157 Dolson Ave, Middletown, NY 10940