Try going to the North Fork of Long Island. You could stay at the North Fork Inn and Table in Southhold,
which also just happens to have the best food in the area. There are many wineries to visit and Greenport is also fun to walk around in as is Orient Point. The North Fork is very rural and knd of old-fashioned. Many family farms and many places that haven't changed in decades. It's about two hours from NYC depending on where on the North Fork you're going. Here's a link for general information:
If you enjoy antiquing, either Hudson Valley in NY or the Litchfield area in CT.
If you enjoy wines, go to the North Fork of Long Island.
If you enjoy the outdoors/hiking, the Catskills.
If you like casinos then Atlantic City, NJ .
It all depends on how many days you will have and how far you are willing to drive. If you are open to flying short distances then the entire East Coast from North Carolina to Maine are possibilities.