^ I think you'll find Hua Hin quieter and more sane than Pattaya or Phuket. However, you've been visiting for 8 years so you know what you like. Pattaya and Phuket will give you convenience to many things and services not found elsewhere, but life can get complicated and stressful at times.
There are some beautiful rural coastal locations south of Hua Hin, but the price there is that you give up many conveniences and need to travel if you're a mall shopper or like the bustle of a large town.
In any event, good luck and if questions am sure they'll be answered on here. Check out the section "South of Hua Hin" to learn more about what I mentioned above. Pete