Limit key removal to HTTPErrors only.

Signed-off-by: Tyler O'Meara <Tyler@TylerOMeara.com>