There are not any particularly dangerous areas in Koh Samui. The only place you may want to avoid staying close to is the red-light districts in Lamai and Chaweng. These areas are loud, and the atmosphere becomes seedy late at night.