Yes, it really needs to be chilled overnight so that the dough gets cold and firm. This way, the cookies will have the perfect body and texture. If you bake this dough right after it's made, it will spread too thin in the oven.