Speedup common wrong usage of remove_callout_by_handle.