[gfx3d] Add an enum that specifies possible matrix modes and kill off some magic constants with those enum values. More readable in terms of reading what's going on.