If the wanderer is small, its action is like a comet. If the wanderer is larger than planets it passes, then scenarios such as pole shifts can potentially occur. This likelihood is further reduced by the magnetic potential, which is strong or weak depending on the composition of the planets and wanderer. This potential is further weakened by the relative number of life bearing planets that are dry land planets, as most life bearing planets are water planets. Life in the water, during earthquakes, is not traumatized to the degree that life on land is traumatized.
Water cushions any trajectories by braking the speed.
Thus the periodic trauma your Earth undergoes as a life bearing planet is quite unusual. Where this happens elsewhere in the Universe the inhabitants have reacted much as humans have - with denial beforehand and deliberate amnesia afterwards. In this, you are typical.