sparsely connected graph is like like the one on the right but if you have a windowed attention you can it is kind of not randomly connected but each node is connected to its neighbors like this and you can also see that if i want to go from this node to this node right here i can't do it in one step but i can do it in two steps i go here and i go here so in the terms of the attention layers if i want to go from node one to node three i have to do it in two steps because each node is only connected to its neighbors