Question: In which certain heads was attention disabled in experiments?
Answer: single head, disabling a whole layer, that is, all 12 heads in a given layer