Disable loading ISPC library if optimization is disabled
Cleanup