Don't immediately retry when class is not found.

My use case is I want to be notified when a class becomes available (it
currently is not yet). It does not seem nice to spam gold for the same request
over and over again.