Properly keep up with active vs inactive servlet handlers