we thought the arse made a lot of sense because they're the ones who should be holding information about context and representation but I mean there's obviously a lot going on yeah as you get further along though this is a CNN in the static case on the first time step because you basically there's nothing to cancel out this is all zeroes so you just go up through like a CNN so you would expect there to be sort of different levels of representation of higher level and lower level features so it's only long story short it's