Adding script to build advisories conflicts

Ping @macnibblet 
Nope: that's why I used `finally`