Locate-then-edit for Multi-hop Factual Recall under Knowledge Editing

Authors: Zhuoran Zhang, Yongxiang Li, Zijian Kan, Keyuan Cheng, Lijie Hu, Di Wang
Primary area: foundation or frontier models, including LLMs
Keywords: Knowledge Editing

Abstract:
The locate-then-edit paradigm has shown significant promise for knowledge editing (KE) in Large Language Models (LLMs). While previous methods perform well on single-hop fact recall tasks, they consistently struggle with multi-hop factual recall tasks involving newly edited knowledge. In this paper, leveraging tools in mechanistic interpretability, we first identify that in multi-hop tasks, LLMs tend to retrieve implicit subject knowledge from deeper MLP layers, unlike single-hop tasks, which rely on earlier layers. This distinction explains the poor performance of current methods in multi-hop queries, as they primarily focus on editing shallow layers, leaving deeper layers unchanged. To address this, we propose IFMET, a novel locate-then-edit KE approach designed to edit both shallow and deep MLP layers. IFMET employs multi-hop editing prompts and supplementary sets to locate and modify knowledge across different reasoning stages. Experimental results demonstrate that IFMET significantly improves performance on multi-hop factual recall tasks, effectively overcoming the limitations of previous locate-then-edit methods.

Decision: reject
Reviewer scores: 6, 5, 8, 6

Reviews and discussion:
<thread>
creation date:
1730645065638

thread_type:
official_review

<thread_object>
creator: reviewer_octz

<content>
summary:
The paper introduces IFMET, a novel locate-then-edit approach for knowledge editing in Large Language Models (LLMs), specifically targeting multi-hop factual recall tasks. The authors leverage mechanistic interpretability to identify that LLMs retrieve implicit subject knowledge from deeper MLP layers in multi-hop tasks, unlike single-hop tasks, which rely on earlier layers. This insight leads to the development of IFMET, which edits both shallow and deep MLP layers. Experimental results show that IFMET significantly outperforms existing methods on multi-hop factual recall tasks.

strengths:
1. The paper provides a thorough and interesting analysis of the differences between single-hop and multi-hop tasks, highlighting the importance of editing deeper layers in LLMs.

2. The writing is clear, making the proposed method easy to understand and follow.

3. The experimental results are impressive, demonstrating significant improvements over existing methods in multi-hop factual recall tasks.

weaknesses:
1. The method may have certain limitations. Specifically, using WikiData and SPARQL queries to construct the supplementary dataset may not be applicable to non-factual or non-encyclopedic data, limiting the generalizability of the approach.

2. The organization of the paper could be improved. The experimental section is relatively short, with some important experimental tables relegated to the appendix. Additionally, the paper lacks a comprehensive ablation study.

3. The explanation and analysis of the experimental results are somewhat lacking. For instance, in Table 3, it is unclear what the values represent (e.g., accuracy) and why the performance of IFMET improves as the edit batch size increases, while the performance of other baselines decreases. More detailed explanations and discussions of these observations would strengthen the paper.

questions:
Please refer to the Weaknesses.
</content>
</thread_object>

</thread>
<thread>
creation date:
1730660957691

thread_type:
official_review

<thread_object>
creator: reviewer_baub

<content>
summary:
This paper addresses an important limitation in knowledge editing for LLMs - their poor performance on multi-hop factual recall tasks after editing. Through careful mechanistic analysis using tools like LogitLens and causal intervention experiments, the authors discover that LLMs process multi-hop queries differently from single-hop ones - they accumulate implicit subject information in middle layers before retrieving the final answer from deeper MLP layers. This explains why current KE methods, which focus on editing shallow layers, fail at multi-hop tasks. Based on these insights, they propose IFMET, a novel locate-then-edit approach that edits both shallow and deep MLP layers using supplementary knowledge sets and multi-hop prompts. Their experimental results on the MQuAKE dataset show improvements over existing methods, particularly for complex multi-hop queries.

strengths:
1. Strong Empirical Analysis: The authors provide a thorough, well-designed investigation into how LLMs process multi-hop queries differently from single-hop ones. The use of LogitLens and causal intervention experiments to track information flow through different layers is particularly impressive.

2. Novel Theoretical Insight: The discovery that implicit subject information accumulates in middle layers before being used to retrieve answers from deeper MLP layers is an important contribution to our understanding of LLM reasoning. This finding not only explains the limitations of current KE methods but also has broader implications for LLM interpretability research.

3. Good result: The proposed IFMET solution is elegant and well-motivated by the theoretical findings. This is a practical solution that improves performance on multi-hop queries.

weaknesses:
Overall, this paper is solid. But some parts of this paper are missing:

1. Why do we need to conduct "Locate-then-edit" editing when we have some very good performance RAG-based editing methods [1][2]? There is no need for this paper to compare performance with RAG-based editing in the experiments part, but a short discussion should be included on why IFMET is superior to these RAG-based methods.

2. Currently, only experiments are conducted on MQUAKE-3k; more benchmarks, such as MQUAKE-T, could be included.

[1] Shi, Yucheng, et al. "Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering." CIKM, 2024.
[2] Gu, Hengrui, et al. "Pokemqa: Programmable knowledge editing for multi-hop question answering." ACL, 2024.

questions:
See weakness
</content>
</thread_object>

</thread>
<thread>
creation date:
1730693765643

thread_type:
official_review

<thread_object>
creator: reviewer_1m6u

<content>
summary:
This paper introduces IFMET, a novel locate-then-edit method for knowledge editing for language models.
It aims to improve the multi-hop factual recall by modifying both shallow and deep layers of model weights.
Previous methods focus on shallow layers and thus struggle with multi-hop editing.
IFMET addresses this by using multi-hop prompts and supplementary sets to locate and edit knowledge across multiple layers.
This allows the language model to answer multi-hop queries more accurately post-edit.
Experimental results show that IFMET outperforms existing knowledge editing methods (such as Mello, and MEMIT) on multi-hop knowledge editing.

strengths:
1. This paper fills a gap in KE for multi-hop knowledge editing. It addresses the limitations of traditional local-then-edit methods that primarily operate in shallow layers.
2. The paper gives detailed explanations and experiments about how single-hop and multi-hop queries are handled differently within language models. The used LogitsLen and causal intervention experiments are interesting.
3. The proposed IFMET is compared with strong baselines across experiments and shows great performance.

weaknesses:
1. The used language model GPT-J (6B) is a bit outdated. More recent language models are expected to be considered.
2. How about the performance of the generality and locality of knowledge editing? The editing should also affect related facts but not affect other unrelated facts.
3. The paper lacks discussions about editing efficiency. What is the time complexity of IFMET?
4. Compared to Mello, IFMET requires supplementary set construction from external sources (same for MEMIT and ROME). This may hinder its applications in real cases.

questions:
1. The biblology style should be consistent. Some lines are underlined and others are not.
2. How does IFMET perform on other language models? Like recent Llama-3.
3. How long does IFMET take to edit one multi-hop sample?
4. Can IFMET deal with unstructured facts for knowledge editing as in [1]?
5. Line 387, cizizenship --> citizenship.
6. Figure 1, Mardrid --> Madrid.

 [1] Updating Language Models with Unstructured Facts: Towards Practical Knowledge Editing
</content>
</thread_object>

</thread>
<thread>
creation date:
1730734907809

thread_type:
official_review

<thread_object>
creator: reviewer_pi7c

<content>
summary:
The paper addresses challenges in existing locate-then-edit knowledge editing methods, particularly focusing on multi-hop knowledge editing. The authors first investigate why locate-then-edit approaches struggle with multi-hop fact editing using tools from mechanistic interpretability, such as the logit lens and causal intervention. Their findings suggest that later MLP layers play a crucial role in storing multi-hop knowledge. To better update these knowledge-storing MLPs, the authors introduce a supplementary set construction method for each edit, transforming each edit into a multi-hop chain. This supplementary set then generates virtual multi-hop prompts specifically targeting the knowledge being edited. The authors utilize two-hop templates from this supplementary set to modify the model’s later layers, thereby enhancing multi-hop knowledge editing.

strengths:
- **Comprehensive Analysis**: The paper presents a thorough analysis in Section 3, identifying that information related to multi-hop knowledge is stored in later MLP layers. Using interpretability tools such as the logit lens and causal interventions, the authors confirm this and propose edits to the last layer based on these findings.
- **Empirical Validation**: Experiments in Tables 3 and 4 show that the proposed method outperforms previous methods on multi-hop knowledge editing tasks, providing compelling evidence for its effectiveness.

weaknesses:
- **Insufficient Presentation**: Section 5.2 lacks clarity as Tables 5 and 6 are referenced but not included in the main paper, instead being located in the appendix. While space constraints are understandable, omitting key results from the main discussion detracts from readability and coherence. Additionally, the absence of descriptions for the "base" in Tables 5 and 6 and missing details on the datasets used in Table 4 (e.g., whether MQuAKE is consistently used) leaves gaps in understanding.
- **Questionable Analysis of Results**: In Table 3, performance seems to decline post-editing compared to the original, but there is no discussion on the possible causes for this drop. If editing knowledge reduces performance, the rationale for the edits becomes unclear. It appears that “original” performance refers to accuracy on the unedited answer, but if so, why wasn’t accuracy on the correct answer also reported for the original model? Clearer explanations are necessary to clarify these performance metrics.
- **Limited Novelty in Method and Analysis**: The primary contribution of this work lies in the insight, obtained through interpretability tools, that multi-hop knowledge editing requires updating the later MLP layers. However, there is no clear experimental analysis showing that editing the later layers specifically contributes to performance improvement. It raises the question of whether merely expanding the support set was sufficient for better performance, implying that gains may not be attributed solely to the proposed method. To substantiate this claim, it would be useful to report the impact of the editing layers on performance, comparing different layers with and without the supplementary set.

questions:
- **Figures**: Consider widening Figures 2(a) and 2(b) to improve readability and enlarge the subfigures in Figure 6 for better visibility.
- **Tables**: Provide a clearer explanation of the term “base” in Tables 5 and 6. It’s unclear whether this refers to the “original” in Table 3 or another baseline. Clear labels and descriptions would enhance understanding.
</content>
</thread_object>

</thread>
<thread>
creation date:
1732236537159

thread_type:
official_comment

<thread_object>
creator: authors

<content>
title:
General response

comment:
**1.Index update**
The figure and table numbers have changed and some are newly added：


| Old index | New index 
| -------- | -------- |
| Figure 6    | 7     |
| Table 5    | 12     | 
| Table 6    | 11     |
| Table 7    | 17     |
| Table 8    | 13     |
| Table 9    | 14     |
| Table 10    | 15     |




| Old index | New index | Description |
| -------- | -------- | -------- |
| None    | Figure 6     | Causal Intervention result of MLP hidden state in last token position on LLaMA-2
| None    | Table 8     | Larger version of figure 2
| None    | Table 16     | the template of the prompt we used for asking LLaMA-2-7B to generate the supplementary set.

For improved visual clarity, we have widened the figure 2 and 7 as requested and corrected the typographical errors.


**2.Performance Correction**
For the editing performance of IFMET on the MQuAKE-3K dataset with an edit batch size of 3000 (as shown in Table 3), we did not perform multiple experiments to calculate the average due to time constraints during the initial submission. This has now been rectified through additional experiments, updating the value from 16.07 to 17.4.

**3.Polishing the Presentation**
In **5 Experiments** section, we use the term **Base** refers to the original model without any edits. And We revised the terminology in Tables and Figures, to consistently refer to the unmodified model as "Base". Additionally, we included a unified explanation of this term in the **Baseline** section of **5.1 Experimental Setup** and provide detailed explanations of the reported outcomes in tables in the **Setup and Hyperparameters** section of **5.1 Experimental Setup**, ensuring consistent definitions for "unedited answer" and "edited answer". Notes have also been added below each table to clarify the meaning of these values and report Base's performence on edited answer too. 
All changes are highlighted in blue in the revised PDF file. We hope these revisions address your concerns comprehensively.

**4.Add Ablation Study and Generalizability Discussion Section**
More importantly, We have added a comprehensive ablation study and generalizability analysis in the Appendix section **E ABLATION STUDY AND GENERALIZABILITY OF IFMET**. These results demonstrate the positive contributions of the supplementary set and the interpretability-guided targeting of later MLP layers and the last token position. Importantly, they confirm that the observed performance improvements are not solely attributable to the supplementary set. Additionally, our experiments demonstrate that the proposed method can be extended to newer models such as LLaMA2. Furthermore, we have specifically explored the scalability of supplementary set construction, showing that it can be built by retrieving knowledge from within the model itself, eliminating the need for external knowledge bases.
</content>
</thread_object>

</thread>


Metareview:
metareview:
This paper examines multi-hop knowledge editing in large language models, highlighting the shortcomings of current locate-then-edit methods. The authors' mechanistic interpretability analysis reveals that multi-hop knowledge queries process information differently from single-hop queries, with a greater reliance on deeper MLP layers. Current knowledge editing methods struggle with multi-hop queries as they primarily modify shallow layers while leaving deeper layers untouched. To address this, the authors introduce IFMET, a novel locate-then-edit approach that uses supplementary sets to convert single-hop edits into multi-hop chains, demonstrating enhanced performance on multi-hop knowledge editing tasks compared to existing methods.

While the paper offers valuable insights into how different layers handle single versus multi-hop knowledge, it falls short in several critical areas. The lack of clear ablation studies makes it impossible to determine whether performance improvements stem from deep layer editing or simply from expanded support sets. The paper fails to experimentally validate that editing deeper layers contributes to the observed gains, and its analysis of efficiency and complexity tradeoffs is inadequate.

The paper exhibits significant methodological and presentation flaws that warrant rejection. The central thesis regarding the importance of editing deeper layers for multi-hop knowledge lacks proper experimental validation, as improvements could be attributed to the expanded support set rather than the proposed layer-specific editing mechanism. The paper's presentation is problematic, with crucial results hidden in appendices, poorly explained performance metrics, and inconsistent result reporting. Furthermore, practical concerns arise from the method's dependence on external knowledge sources, limited testing on older models, and insufficient efficiency analysis.

For future consideration, the authors would need to conduct comprehensive ablation studies to validate deep-layer editing's specific contribution, enhance result presentation and clarity, expand testing to contemporary models, address implementation practicality, include detailed efficiency analysis, and strengthen the validation of key mechanistic claims. These requirements necessitate substantial additional research and validation rather than simple revisions.