Adding script to build advisories conflicts

Ping @macnibblet 
Can you skip this `finally`?