Further testing revealed different behavior on different runs of the same executable as well as QNaNs, which indicates there is some uninitialized memory lying around somewhere. Haven't found it just yet.