Before revision:  Even without retraining, collaborative multi-head attention manages to reduce the size of the key and query projections by half without sacrificing accuracy .
After revision:  Even without retraining, collaborative multi-head attention manages to reduce the size of the key and query projections by 4 for same accuracy and speed .