My momentary annoyance vanished.
My fleeting annoyance disappeared.