As “nominal” means “that has its nominal (aka normal) value”, the common word that comes to mind is abnormal. In writing, however, it is perfectly fine to refer to such a situation as off-nominal. This term is found in plenty of technical reports and manuals of aircraft.