Dinner in or near Bayville
If I don't say it, someone else will. You may want to head a little north to Toms River and Bistro 44. You can find lots of info about it on this site.
If you want to stay right in Bayville you can try Martells. I was surprised by how good it was the past two times I've gone, after having several less than great meals prior to that. It's on the bay, so the view is really nice. There's an outside bar too.
Another possibility I'll throw out is the Ocean Gate House, which is nearby. It's a nice quiet colonial type setting. I understand there are new owners that have turned the menu toward Italian. I haven't heard anything about it lately, but would like to know more if anyone has been there.
Bistro 44 is a byo while the others are not.