In this phrase, Masefield personifies the sea and the sky as being lonely. It seems without him they feel lonely.