Forgot to use the $1 when referring to .bundle folder. Also used incorrectly .heroku-bundle, which do not exists at that point anymore.
Also first do the path modifications and then cache the stuff.. not the other way around.