The way the poem unfolds might imply that this is based on a memory that the Larkin might've experienced themselves. The sight of three ships disembarking stirs something inside them as it does with the speaker. He no doubt wrote the poem as a meditation on those sentiments and the kind of longing they might evoke.