Inform metrics of timeout and only report once