Explicitly pass the current time to deactivate_conf().

Some places depend on the ban not being destroyed.
server: Remove two dead stores.