Yes, you do! I know it's annoying, but it's necessary and I promise the cookies are worth it. The dough is super wet because of the jam, and the flour needs to hydrate and absorb some of that liquid (and extra flavor) overnight. This'll firm up the dough and keep it from spreading too much in the oven.