Though he pleaded self-defense, he was found guilty and sentenced to prison. His family then intervened and had his sentence changed to deportation to Siberia. He lived out the rest of his days there and died in 1811 at the age of 67. The exact location of his grave is not known but someday he may be brought back to his beloved island in the Baltic Sea. The story would end there except for the fact that his ghost is believed to still walk the halls of the palace.
Locals say that they have heard footsteps creaking on the wooden floor even though no one is there.
There have also been occurrences where the beautiful grand piano in the upstairs hall has played behind locked doors when no-one was in the room. Some of them claim to have seen Ungern-Sternberg's ghost. Furthermore, some repairmen who were working on the electrical wiring had a startling experience. Their story is made even more compelling by the fact that they knew nothing of Ungern-Sternberg and the history of the palace. These two men had used a ladder to get up into the ceiling and were working on the wiring when they heard footsteps walking up to the base of the ladder.