Attemt at cleaning up nighty packaging after https://github.com/JuliaLang/julia/pull/5095