Cache listeners from symbols/blocks, not annotations [TORQUE-1245]