It could be due to the reason that the watch is not updated to the latest version. Follow the software update steps mentioned in this article, and you can easily access contacts on your Apple Watch.