Don't destory threads if dirty schedulers are available

They don't exist!
Add upgrade callback