There are a few nice quiet resorts down in Paknampran: Evason, Tanao Sri, Aleenta, etc. Not sure on prices but real hideaway stuff. Plenty of little restaurants on the beach also.
The marina is worth a look, theres an Outward Bound School there also for the adventurous.