Only propogate back on first 2 layers. Fix some things
Fixed test! It works!