Niue 's remoteness , as well as cultural and linguistic differences between its Polynesian inhabitants and those of the rest of the Cook Islands , have caused it to be separately administered .