Question: Is there any nonnumerical experiment that also support author's claim, like analysis of attention layers in publicly available networks? 
Answer: No