Visited only occasionally by seal hunters and trappers over the following centuries , the island came under Norwegian sovereignty in 1929 .