I'll 2nd the Keyport Fishery as my favorite. And the Oyster Creek Inn is certainly good too, and in one of the most remote locations on the Jersey Shore.
Another place I like a whole lot is the Blue Claw Crab Eatery, far away from the shore on Rt 130 in Burlington: http://www.crabeatery.com/
And finally, I miss the recently departed Chippery, less than a mile away from me in the decidedly non-seafood oriented town of Fanwood.
My one experience with both Spike's and Red's was not good.