Before revision:  We additionally release code, a new intrinsic metric, and an annotated test set for gender bias for hatespeech .
After revision:  To aid this effort, we release code, a new intrinsic metric, and an annotated test set for gender bias for hatespeech .