We found exactly what we were looking for being 1st time in Thailand. Lonely unspoiled seaside only for hotel guests (max 20). Close to authentic bungalows (we chose a family house) with intelligent design touch. A small, but perfect sized swimming pool for our children (6, 12, 14). Excellent breakfast.
We had our own car to drive around few hours a day. I don't think you can manage to see enough (Sam Roy Yot caves and etc) and to have dinner in nearby fishing villages without your own car.