Unregister from Bukkit where necessary