It is most certainly safe to do so, but even as small of an island as it is, you may want to bike or ride a golf cart around. There are plenty of things that are walkable near each other in Bailey Town or Alice Town.