It’s unknown who the speaker is in this particular poem. It’s possible that Jarrell saw himself as the child and adult in the text, but without specific evidence that this is the case, it’s better to assume that the poet was using a persona to write ‘90 North.’