Extracting Transformer from Event and Behavior