Well, I didn't manage to get to any of the suggestions in town, due to tightness of bridge schedule, but the oysters and some other choices at Blue Point Provisions etc on the Hyatt grounds (but small drive, not a walk!) was tasty. Best swordfish pan seared I've enjoyed in a while.
Liked the area enough to plan a trip back for a long weekend
exploring. Thanks for the help.
Hopefully this is not too late, but definitely get into the town itself. Highspot is a gastropub with outstanding food and an amazing craft beer selection. Bistro Poplar is a french restaurant with a pretty high price point that has food comparable to DC. Stoked for wood-stove pizza. Jimmy & Sooks for classic Eastern Shore food.