Fix a crash if the gpu doesn't load.

E.g. for invalid files with multithreading enabled.
Avoid some dereferencing in gpu FastRunLoop.
Merge pull request #4466 from unknownbrackets/perf

Cut down a bit on memory access in FastRunLoop