An implementation to rate limit sent exceptions

An initial implementation for #100
Still needs specs