Revert "Make Frame virtualizable"

This reverts commit 65410bbfae1bb50d8f7e9ffea0f67c2303a258a5.
Most benchmarks got slower, only two microbenchmarks gained anything by it.

Signed-off-by: Stefan Marr <git@stefan-marr.de>