Before revision:  However, recent works have shown that  attention heads learn simple positional patterns which are often redundant .
After revision:  However, recent works have shown that attention heads learn simple , and often redundant, positional patterns .