Don't cleanup addin until closing.