Query: Is syntaxis encoded with Bert model ?
Source: arxiv2_taclccby4_license.pdf
Relevant passages:
 As far as how syntaxis represented, it seems  that syntactic structure is not directly encoded  in self-attention weights.