Revert "Revert "Attemt at cleaning up nighty packaging after https://github.com/JuliaLang/julia/pull/5095""

This reverts commit 16757b154cf417cb57e00d0d1fc1317e59851826.
Adapt to new windows .exe name