Before revision:  Even without retraining, collaborative multi-head attention manages to reduce the size of the key and query projections by half without sacrificing accuracy .
After revision:  Collaborative multi-head attention manages to reduce the size of the key and query projections by half without sacrificing accuracy .