Taxonomy panels overrides the rest of the taxonomy pages left out of the default page manager configuration, paths like taxonomy/term/%taxonomy_term/edit and taxonomy/term/%taxonomy_term/add.