Lightweight management of transitioning between views within a scene with history