Revert "hw: clrex during context switch (Fixes #1196)"

This reverts commit 4e28a01f9379ff1dbde54e76ac3b70f9418fc217.