CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning

Venue: acmmm_org_ACMMM_2024_Conference
Published: 2024-04-08 10:00:13

Abstract: The key challenge of cross-modal domain-incremental learning (DIL) is to enable the learning model to continuously learn from novel data with different feature distributions under the same task without forgetting old ones. However, existing top-performing methods still cause high forgetting rates, by lacking intra-domain knowledge extraction and inter-domain common prompting strategy. In this paper, we propose a simple yet effective framework, CP-Prompt, by training limited parameters to instruct a pre-trained model to learn new domains and avoid forgetting existing feature distributions. CP-Prompt captures intra-domain knowledge by compositionally inserting personalized prompts on multi-head self-attention layers and then learns the inter-domain knowledge with a common prompting strategy. 
CP-Prompt shows superiority compared with state-of-the-art baselines among three widely evaluated DIL tasks. 
The source code is available at https://anonymous.4open.science/r/CP_Prompt-C126.

Main paper: 
 introduction: 
 Cross-modal models have garnered significant attention due to their capability to process and integrate diverse types of data. However, these models often encounter the challenge of different domains data feature distributions in practical applications. Domain Incremental Learning (DIL) [42] is a special incremental learning task, where the learning model is trained on a sequence of domains over time, with each domain or task presenting new and potentially information, e.g. distributional shift [1] . Under this setting, the tasks in each domain remain the same and the testing sample does not know which domain it belongs to. A vivid example is shown in Figure 1 , where the learned model was firstly trained with qickdraw-style pictures, and then tested to classify the same category under different styles, such as infographics, painting, and clipart. The key success of DIL algorithm is to adapt and learn from sequential domains without forgetting the knowledge it has acquired from previous ones.A key challenge for domain incremental learning is how to deal with the phenomenon of catastrophic forgetting [31, 32] . When learning new domains in sequence, the model may forget previous knowledge, leading to poor performance on old domains. To alleviate this issue, previous work [14, 35, 38] utilizes a buffer containing exemplars from previous tasks to facilitate learning new tasks. Then remarkable progress has recently been made in DIL tasks using prompt learning methods. Such as building prompt pool [46] , adding different classification tokens [9] , employing prompt on multi-modal pre-trained models [44] . Despite this, two challenges still remain: (1) How to make the trade-off between common and personalized knowledge within DIL process? Previous studies have shown that extracting common patterns between domains and enhancing personalized knowledge with each domain are both helpful in DIL. However, from the other side, how to balance inter-domain and intra-domain feature learning is still unaddressed. (2) How to depict the impact of domain context on embedding tokens? For the transformer which is widely adopted by DIL models, the effectiveness comes from routing information of lists of complex tokens to acquire the correlation by self-attention. However, this structure is difficult to learn information outside the fix-sized space of transformer [11] . Thus, additional domain context information should be guided into the transformer encoding process.To this end, in this paper, we present a prompt learning framework, namely CP-Prompt (Common & Personalized), to instruct a pretrained model to learn on incremental data domains with different data styles. As Figure 1 depicts, CP-Prompt adopts a twin-prompt strategy. The shared common prompts, embedding within shallow part of the model, are employed to learn knowledge of new domains sequentially and then frozen. Common prompts embedding of models can preserve knowledge among domains. The personalized prompts, called Prefix-One, embedded within the self-attention layers of the pre-trained model, contribute to model inference with domain style features. By incorporating these two prompts, the pretrained model can be continually learned without tuning its original parameters.The contributions of this paper are summarized as follows: • We present a simple yet effective prompt tuning framework CP-Prompt for cross-modal domain-incremental learning, with a parameter-efficient twin-prompting design that preserved both inter-domain common knowledge and intra-domain personalized knowledge.• We further designed Prefix-One, which can incorporate domain context information into the self-attention layer, therey guiding the transformer to fully utilize domain knowledge at different semantic levels for DIL process.• CP-Prompt is evaluated on three widely used DIL benchmark datasets and outperforms existing state-of-the-art sample-free baselines. Furthermore, only minimal additional parameters (0.22%) are tuned by CP-Prompt, and gaining at even 2.3% improvement, showing its effectiveness in both parameter efficiency and model accuracy. 
related work: 
 Domain Incremental Learning. DIL refers to a type of continuous learning scenario where the feature distribution of the same task changes across different domains [42] . In other words, the data in each domain is used to accomplish the same task but differs from each other significantly [20, 33] . The goal of DIL is to enable the model to learn about newly added domains without retraining from scratch while maintaining its generalization in the original domains. Traditionally employed methods typically include architecture-, regularization-, and replay-based approaches. Architecture-based methods create independent components for each task or focus on task-specific subnetworks to avoid interference between network parameters to alleviate forgetting, such as XdG [30] , DEN [48] , PAE [17] , and CPG [18] . Regularization-based approaches [21] [34] constrain or penalize significant model changes to keep memory on the previous domain with regularized losses such as distillation loss [25] , and parameter update loss [50] . Replaybased methods mitigate catastrophic forgetting by preserving a small subset of the previous domain and replaying them when training new tasks, such as ER [39] , DGR [2] , iCaRL [38] , BI-R [41] , and A-GEM [6] .Prompt Learning. Prompt learning originated from manually designing templates as extra instructions to pre-trained models for efficient adaptation to downstream tasks. Compared with humandefined fixed ones, treating prompts as learnable parameters significantly enhances the efficiency and effectiveness of the model instruction [19, 29, 52] . In this setting, prompt learning only needs a tiny set of parameters for training instead of tuning the entire pretrained model, benefiting much time-and cost-sensitive scenarios such as incremental learning and transfer learning [12, 13] . This parameter-efficient tuning method is primarily classified into three types, including addition-, specification, and reparameterizationbased approaches. Addition-based methods introduce extra trainable neural modules not present in the original model, such as Prompt Tuning [22] , Prefix Tuning [24] , Adapter Tuning [15] , and P-Tuning [26, 27] . Specification-based methods specify certain parameters in the original model as trainable and leave the rest frozen, such as BitFit [49] . Reparameterization-based methods transform existing parameters into a more parameter-efficient form, including LoRA [16] , AdaLoRA [51] , and QLoRA [8] .Prompt Learning for DIL.. Compared with traditional approaches, prompt learning-based DIL methods have shown prominent advantages in both model performance and efficiency. For example, Dy-Tox [9] applies the vision transformer in continual computer vision tasks, eliminating the class token and devising personalized tokens for each task. L2P [46] employs a learnable key/prompt mechanism to select prompts added into image tokens based on the similarity between the keys and tokens. It introduces the concept of a prompt pool, based on a key-value mechanism to learn specific prompts within domains and make inferences by selecting appropriate prompts from the pool. Recent approaches such as S-liPrompts [44] achieve remarkable results which independently learn a set of prompts for each domain using prompt tuning only, but still overlooking shared knowledge between domains and leaving significant room for improvement in intra-domain training methods. Not only limited ti DIL tasks, the class incremental learning (CIL) methods also employ prompt to optimize models. Dual-Prompt [45] incorporates both general and expert prompts embedded in the pre-trained model, aimed at preserving personalized knowledge for retaining global shared knowledge and category distribution. HiDe-Prompt [43] expands the distance of category distribution using a contrastive loss penalty term, and identifies different tasks by optimizing the output layers. 
preliminary: 
 Prompt Learning on Pre-trained Models. Pre-trained models follow a paradigm that trains its parameters via massive self-supervised labeled data for general ability and fine-tunes them with few labeled data for downstream tasks. Prompt learning provides a tinyparameter-sized embedding to guide a model to generate better responses, thereby significantly reducing the resource burden of model training and tuning. Taking the visual-text pre-trained model CLIP as an example, it comprises a visual encoder and a text one. In the image encoder, an image 𝑥 ∈ R 𝐻 ×𝑊 ×𝐶 in encoded as a sequence of vectors 𝒙 𝑒𝑚𝑏 ∈ R 𝐸 𝐼 ×𝐷 by the visual encoder, where 𝐻,𝑊 represents the resolution of the original image, 𝐶 is the number of channels, 𝐸 𝐼 is the feature size after convolution, and 𝐷 is the embedding dimension. To perform prompt tuning on CLIP, we can inject tiny-sized parameters into a pre-trained model and only train them to adapt to downstream tasks. To formalize, the vector of image samples 𝒙 𝑒𝑚𝑏 is concatenated with soft prompts 𝑃 ∈ R 𝐿×𝐷 ,EQUATION)where 𝐿 is the prompts length. Discovering the best prompts involves picking specific tokens, which can be achieved through either manual exploration or non-gradient-based search techniques [40] .The vector 𝒙 𝑝 is then encoded by transformer layers, resulting in a high-dimensional projection 𝒙 ℎ ∈ R 𝐻 𝐼 ×𝐷 , where 𝐻 𝐼 is the number of image features in high dimensional space. Similarly, in the text encoder, we encode words through vocabulary and positional embedding 𝒕 𝑒𝑚𝑏 ∈ R 𝐸 𝑇 ×𝐷 , which after transformer encoding also yields 𝒕 ℎ ∈ R 𝐻 𝑇 ×𝐷 , where 𝐸 𝑇 is the feature size, and 𝐻 𝑇 is the number of text features in high dimensional space. The CLIP model seeks the mapping relationship between the two high-dimensional embeddings 𝒙 ℎ and 𝒕 ℎ through a contrastive loss. When predicting new-coming data, all parameters of CLIP are frozen, and the loss Problem Definition. In this paper, we take the widely-used multimodal model-based image classification as the benchmark scenario [44] . Suppose there is a set of domains which each domain is denoted as D 𝑠 = {𝑥 𝑠,𝑖 , 𝑦 𝑠,𝑖 } 𝑁 𝑖=1 ∈ 𝑆, where 𝑥 𝑠,𝑖 ∈ R 𝐻 ×𝑊 ×𝐶 is the 𝑖-th image sample from the 𝑠 domain, and 𝑁 denotes the total number of samples. 𝑦 𝑠,𝑖 corresponds to the label associated with the sample. The feature distribution of data among different domains is highly heterogeneous, and each domain covers all the classes 𝑈 of the general task. In the DIL setting, only one domain data can be accessed by the learning model at one time. Additionally, data from previously visited domains cannot be used again when the model is training on the following domains. Formally, the learning model M begins training on D 1 and progressively learns D 2 , . . . , D 𝑆 . The crucial challenge in DIL is to ensure that under D 𝑆 , the model M can still maintain the performance on D 1 , . . . , D 𝑆 -1 . The motivation of this research is to enhance the accuracy of tasks across all domains in this learning paradigm. Eventually, the objective of DIL is to optimize the following objective function:EQUATIONwhere 𝐹 (𝑃,M ) (𝑥) ∈ R 𝑈 is the prediction projection by model parameter M as well as tuned prompts parameters 𝑃, L 𝑖 is the prediction loss in 𝑖-th domain.  
common prompts: 
 As shown in Figure 2 , we design a continually tuned common prompting strategy for guiding the learning model to extract shared knowledge across each domain. The common prompts are tiny-sized parameters that are tuned by loss gradient calculated by prediction on each domain data sample. At this moment, the entire parameters of the pre-trained model are frozen so that the generation variation of the model would only be affected by inputs and prompts.For the sake of simplification, here we describe the prompting on the image encoder side. Formally, for the 𝑖-th domain dataset D 𝑠 = {𝑥 𝑠,𝑖 , 𝑦 In the design of the common prompts, we composite promptempowered embedding 𝒙 𝑠 𝑝 by domain globally shared prompts 𝑷 𝑠 C and image tokens:EQUATIONwhere [; ] denotes the vector concatenation operation. Img 𝐶𝐿𝑆 denotes the image pre-training class tokens, and 𝑀= 𝐸 𝐼 + 𝐿 𝐶 + 1. The shared prompts information we propose are directly integrated with image tokens. As input for subsequent transformer encoding, this approach enables the multi-head self-attention (MSA) mechanism to effectively learn the prompt-guided token embeddings.After the common prompts are tuned on one domain dataset, we make a copy of these prompts as frozen ones to serve as common prompts on domain 𝑠, and we sequentially tune the original prompts to fit the next domain 𝑠 + 1, thereby obtaining 𝑷 𝑠+1 C sharing effective information and minimizing forgetting.In addition to the complementary formation of common prompts, personalized prompts are embedded across the transformer's attention layers in the form of parameters, capturing semantics at different granularities.Prefix-One Prompting. The embeddings 𝒙 𝑠 𝑝 then undergo projection transformation by the transformer layers of the pre-trained model. Therefore, inserting personalized prompts 𝑷 𝑠 P,𝑖𝑚𝑔 ∈ R 𝐿 𝑃𝐼 ×𝐷 into MSA layers can help to instruct the attention-capturing domainindividual semantics and knowledge, where 𝐿 𝑃𝐼 denotes the length of the personalized prompts.Inspired by Prefix-Tuning [24] , we incorporate prompts into the prefix section of data features. To apply domain context into the MSA layer, we add soft prompts to the 𝐾𝑒𝑦 matrix, and multiply it by the 𝑄𝑢𝑒𝑟𝑦 matrix containing only the original data, then derive attention score. The attention score calculates the original data and the contextual information related to the domain style. The attention score is then multiplied by the 𝑉 𝑎𝑙𝑢𝑒 matrix that is the same as the 𝐾𝑒𝑦. The obtained output incorporates the contextual knowledge within the current domain, and this attention extension is named as Prefix-One, as presented in Figure 3 . It enables the pre-trained model to consider the particularity of personalized domain style and achieve the effect of adapting to domain tasks with less training cost.Formally, in Prefix-One within the MSA layers, we iteratively obtain encoding by compositing personalized prompts into key and value embeddings:EQUATIONwhere 𝑙 = 0, 1, . . . 𝑅 (𝑅 indicates the number of transformer layers), 𝒉 𝑣 are calculated by:EQUATIONEQUATIONEQUATIONwhere 𝑷 Generalizing to text encoder. The Prefix-One for text-based encoder is similar to the image one. Taking our adopted CLIP architecture as an example, the complete label set 𝑌 = {𝑦 𝑗 } 𝑈 𝑗=1 is transformed to texts. The encoded label text set 𝑌 𝑒𝑚𝑏 = {𝑦 𝑗 𝑒𝑚𝑏 } ∈ R 𝑈 ×𝐷 is concatenated with the text personalized prompts 𝑷 𝑠 P,𝑡𝑒𝑥 ∈ R 𝐿 𝑃𝑇 ×𝐷 , where 𝐿 𝑃𝑇 is the length of the personalized prompt for text. The high-dimensional projection after feature extraction by the text transformer is 𝒕 𝑠 ℎ ∈ R 𝑈 ×𝐷 , and 𝐿 𝑇 represents the feature count after encoding the label set using the vocabulary and adding positional vectors.The composition of 𝑷 𝑠 P,𝑡𝑒𝑥 is similar to the shared prompts on the image side. The encoded label 𝑦 𝑒𝑚𝑏 is concatenated with the class token Tex 𝐶𝐿𝑆 and prompts 𝑷 𝑠 P,𝑡𝑒𝑥 , to derive 𝒆 𝑠 :EQUATIONAfter feature extraction by the frozen pre-trained transformer's multi-head attention mechanism, the classification token 𝒕 𝑠 ℎ is obtained by:EQUATIONwhere 𝑾 𝑠 denotes the fixed parameters of the text pre-trained model, and 𝒃 𝑠 represents the associated bias values, and the rest of this structure for text is the same as image one. Finally, the logits 𝒛 𝑠 ∈ R 𝑈 , are computed by matrix multiplication of the high-dimensional projections from the image and text sides:EQUATIONIt should be noted that, after continual training on 𝑠-th domain, 𝑷 𝑠 C is not only used as common prompts for the current domain, but also the initialization for the next one. However, the deep domainspecific knowledge-oriented personalized prompts 𝑷 𝑠 P are isolated and optimized in different domains.During the inference stage, we adopt a simple yet effective unsupervised clustering, 𝐾-Means, as domain selector to assign model extracted features with 𝐾 domain centroids F = {𝒎 𝑗 𝑓 } 𝑠 𝑗=1 as feature pool. Given a new arriving sample 𝒙 𝑛𝑒𝑤 , the domain selector selects the most relevant personalized prompts for inference by measuring the distance between 𝒙 𝑛𝑒𝑤 and F. Following the multimodal pretraining setting [44] , the model inferences prediction 𝒛 𝑠 ′ is derived by freezing prompts parameters and untuned pre-trained model:EQUATION)The goal of the model is to optimize the following loss function by tuning the tiny-sized prompts parameters 𝑷 𝑠 C , 𝑷 𝑠 P,𝑖𝑚𝑔 , 𝑷 𝑠 P,𝑡𝑒𝑥 :EQUATIONThe overall training process is formally described in Algorithm 1.We conduct model analysis to demonstrate the rationality behind the simple design of CP-Prompt. 𝒕 𝑠 ℎ Propagate by Eq. ( 8) and Eq. ( 9)9:Calculate class embeddings 𝑌 𝑒𝑚𝑏 by pre-trained model G 10:Compute the prediction probability by Eq. (11) 11:Compute the Cross-Entropy loss by Eq. ( 12) Common prompts vs. General prompts. In CP-Prompt, we design the common prompt as: 𝒙 𝑝 = [𝑃, 𝒙 𝑒𝑚𝑏 ] ∈ R (𝐸 𝐼 +𝐿) ×𝐷 , where 𝒙 𝑝 is the feature after initial encoding and 𝐿 is the prompts length. The purpose of this design is to retain shared information based on the characteristics of different data domains, and on the other hand, to enable multi-layer personalized prompts to deeply extract shared information. 𝑔 (𝑙 ) ∈ R 𝐿 𝑔 ×𝐷 is General prompts to be attached to the 𝑙-th MSA layers.We explored embedding the General prompt in MSA layers, as shown in the figure 5 . As the number of embedding layers increases, the forgetting rate of the model will increase significantly. The performance of our proposed method is better than the shallowest embedding of General Prompt.Furthermore, targeting at the domain-incremental scenario, category information in complete before the dataset transfer, while the core challenge is to model the different feature distribution. Thus, the class-incremental-oriented methods such as DualPrompt fails to capture both the category-complete information and distribution difference. In the CP-Prompt, we propose to insert common prompts before the transformer structure is better than the design in the transformer, which the shared common prompts are employed to learn knowledge of new domains sequentially and then frozen.Personalized prompts vs. Expert prompts. In CP-Prompt, personalized prompt considers the relationship between attention score and prompts, which the structure is formulated as: 𝑓 𝑃𝑟𝑒 -𝑂𝑛𝑒 𝑝𝑟𝑜𝑚𝑝𝑡 (𝑝, ℎ) = 𝑀𝑆𝐴(ℎ 𝑚 , [𝑝 𝑘 ; ℎ 𝑘 ], [𝑝 𝑘 ; ℎ 𝑘 ]). However, Dual-Prompt [45] splits 𝑝 into 𝑝 𝑘 , 𝑝 𝑣 ∈ R (𝐿 𝑝 /2×𝐷 ) , and connect them to ℎ 𝑘 , ℎ 𝑣 respectively. The method of directly adding parameters is certainly effective, but in the attention layer, there is a lack of correlation between prompts.In DIL scenarios, the parameters in the pre-training model are fixed. We argure that the attention score for the prompts should be further weighted, to learn the relationship between pre-training knowledge and domain-specific one, rather than simply adding parameters to fit new domain knowledge. As shown in Figure 5(b [44] .the original manuscript, we compare the proposed tuning strategy, prefix-one, with the prefix-tuning under the same environment setting among the three benchmarks. The result shows that CP-Prompt achieves optimal performance, with a 2% improvement. 
experiment 5.1 experiment setup: 
 Dataset and Model Setting. To evaluate the effectiveness of CP-Prompt, we test three widely used DIL benchmarks, including CDDB-Hard [23] , CORe50 [36] , and DomainNet [28] . For a fair performance comparison, we adopt the same dataset and experiment setting with the previous studies [44] . A detailed description of datasets and settings is available in supplementary materials.Baselines. We compare the proposed CP-Prompt with state-ofthe-art DIL methods, including replay-based methods including iCaRL [38] , LUCIR [14] , LRCIL [35] , distillation-based method BiC [47] , regularization-based method EWC [21] , self-supervisedbased method CaSSLe [10] , and other non-prompt methods including ER [7] , GDumb [37] , DER++ [3] , and Co 2 L [5] . Furthermore, prompting-based methods including L2P [46] , DyTox [9] and S-liPrompts [44] are also compared. In addition, we also extend two class incremental learning methods, includung Dual-Prompt [45] and HiDe-Prompt [43] , to the DIL task as baselines. A detailed 4 : Ablation results of CP-Prompt on three datasets description of these baselines is also available in supplementary materials. For a fair model comparison, all methods utilizing pre-trained models are standardized to use the image transformer encoder and text transformer encoder from CLIP.Evaluation Metrics. We employ widely used two standard metrics in DIL, average classification accuracy (AA) and forgetting rate (AF) as the evaluation metrics for comparing the CP-Prompt and other baselines. Formally, let 𝐴 𝑖,𝑛 represent the model evaluation score (i.e., classification accuracy in our experiment) on the 𝑖-th domain after training on the 𝑛-th domain. AA and AF are measured as follows:EQUATIONEQUATIONEQUATIONIt should be noted that AA evaluates the learning model's overall absolute performance, while AF measures the model's ability to overcome catastrophic forgetting. A successful DIL model should strive for high AA while maximizing AF towards 0.Main Results. Experimental results from Table 1 , 2 and 3 demonstrate that our proposed CP-Prompt method significantly outperforms other exemplar-free methods, including the recently introduced state-of-the-art domain incremental method S-liPrompt. We slightly extend the Dual-Prompt and HiDe-Prompt to adopt to the DIL setting. Both of them also take the same multi-modal pre-trained model CLIP. It is observed that the prompt design proposed by Dual-Prompt also shows a mild improvement. In contrast, adding HiDe-Prompt produces negative optimizations, showing that the idea of retaining finer-grained category features is not effective for DIL tasks. In particular, we achieved the optimal average classification accuracy in 2-class, 50-class, and 345-class DIL tasks, with the highest improvement reaching 2.32%. Additionally, we attained the optimal average forgetting rate, reduced to 0.25.Compared to traditional historical replay-based methods, our proposed prompting approach significantly enhances classification performance for data with more similar features without using an additional sample buffer. In fact, sampling a small amount of information from the original domain is likely to introduce extra noise and, consequently, fails to improve classification performance.In contrast to the other approach of prompt methods, CP-Prompt incorporates domain-wide shared prompts to facilitate the transfer of common knowledge. Additionally, our approach employs a multi-layered intra-domain prompting method, making full use of self-attention mechanisms to merge prompt information with highdimensional latent features. The combination of these two prompts optimally leverages shared information across domains and individualized information within each domain. Compared to the SOTA model, our proposed method even surpasses the upper limit of S-liPrompts on i.i.d. data in terms of the CDDB-Hard and DomainNet tasks. This observation indicates that our proposed method is more effective in handling data with similar categories and significant feature differences in highly heterogeneous domains compared to fine-tuning methods.Ablation Study. We also perform the ablation study to evaluate the effectiveness of each major component in CP-Prompt, as shown in Table 4 . We evaluate the performance by removing personalized, common, and both prompting, which is denoted as '-Personalized', '-Common', and '-Both', respectively. It is observed that both common and personalized prompts play a crucial role in improving performance for DIL tasks. Removing the common prompts leads to a decline in performance across the three tasks, as inter-domain knowledge sharing becomes impaired. Similarly, omitting the personalized prompts results in an ineffective extraction of knowledge within domains, leading to substantial performance loss.Model Parameter Analysis. We further explore the optimal layers for inserting domain prompts, as illustrated in Figure 6 . We observe that inserting prompts is widespreadly effective for transformer layers. Additionally, for new arriving DIL samples from known domains (CDDB-Hard and DomainNet), prompts within deep layers contribute to the performance more significantly by extracting high-level individual information. In the case of a sample from unknown domains (CORe50), adding prompts in both the shallow and deep layers helps to guide the model to capture the common and personalized knowledge of domains.Prompt length is a hyper-parameter of CP-Prompt. As shown in Figure 6 -(a), the model's performance is generally insensitive to the length of common prompts. However, an excessively long common prompt may introduce information specific to certain domains, leading to a slight performance decline. In the case of personalized prompts, adopting a longer prompt length than common prompts can significantly improve model accuracy to gain a larger encoding space. However, compared with fine-tuning, our method has a total parameter count of 150 million, with the actual fine-tuned parameters being 335,360, accounting for 0.22% in each domain.In Figure 6-(b) , we compare the improvement in Prefix-One design with existing methods, namely S-liPrompts and Prefix Tuning. The results indicate that our proposed solution exhibits superior performance in each domain. Moreover, in domains with lower data quality, CP-Prompt demonstrates lower forgetting rates, leading to overall better performance. In Figure 8 , we explore the effects of the number of clustering points in each domain. The results indicate that increasing the number of clustering points generally leads to an imperceptible performance improvement. Thus, the choice of 𝐾 is not a crucial setting of CP-Prompt.Common Prompt Design Analysis. We further explore contrasting different prompt design schemes between Dual-Prompt and the propsoed CP-Prompt. As introduced above, Dual-Prompt embeds the General Prompt within the attention layer, while CP-Prompt embeds the Common Prompt before the attention layer. As shown in Figure 7 , we adopted the Dino visualization scheme [4] to map the attention variation when the model continues to learn on different domains. The attention weights of the first three layers of both approaches are displayed. It is observed that the attentions of CP-Prompt keep close to the object for identification alone side with domain shifting, while the Dual-Prompt gradually lose correct focus. It is evident that for cross-domain learning processes, embedding multi-domain common knowledge before attention better preserves key information in each domain. Particularly in info-graphs with multiple informational elements, the CP-Prompt approach can more accurately identify primary characteristic information. 
conclusion: 
 In this paper, we propose CP-Prompt, which introduces common and personalized prompts into the cross-modal domain-incremental learning task. CP-Prompt integrates prompts into pre-trained models based on the transformer architecture, learning common prompts in the shallow layers and personalized prompts in the deep layers to capture semantic knowledge at different granularity. CP-Prompt significantly reduces the catastrophic forgetting rate by only tuning tiny-sized parameters. Extensive experiments also show the superiority of CP-Prompt over existing state-of-the-art approaches.  
 
 Appendix:  


Decision: This paper presents a new prompt learning framework named CP-Prompt for cross-modal domain-incremental learning, which effectively guides a pre-trained model to learn new domains while preserving existing feature distributions. The main contribution of this method lies in the integration of a twin-prompt strategy into pre-trained models. Shared common prompts are used to acquire inter-domain knowledge, while personalized prompts capture intra-domain knowledge. During inference, the method employs a K-Means algorithm to dynamically select appropriate common and personalized prompts, eliminating the need for providing a task ID. Evaluations on several widely used domain-incremental learning benchmarks demonstrate the effectiveness of the proposed method.

All reviewers found the paper interesting and well-written. The evaluations are comprehensive and the experimental results are sound. I would encourage the authors to incorporate the changes and discussions in their rebuttal into the final version.

Reviews: review: paper_summary: paper_summary: This paper introduces a new prompt learning framework named CP-Prompt for cross-modal domain-incremental learning, which effectively instruct a pre-tained model to learn new domains and avoid forgetting existing feature distributions. 

The main contribution of this method is to to effectively incorporate a twin-prompt strategy into pre-trained models. The shared common prompts is used to learn the inter-domain knowledge and the personalized prompts capture intra-domain knowledge. This method uses K-Means algorrithm to select appropriate common and personalized prompts during the inference stage, which means there is no need to provide a task ID during inference.

The paper provides a comprehensive comparison of this method on three widely used domain-incremental learning benchmark. The results indicate that CP-Prompt, outperforms the compared methods in terms of both average classification accuracy and the ability to avoiding forgetting.
strength_weakness: strength_weakness: 1. The method of this paper is well-written and easy to follow.

2. The reported results outperforms the compared methods in terms of both average classification accuracy and the ability to avoiding forgetting.

3. The paper includes sufficient experiments, and the visual analysis results clearly demonstrated the proposed method can more accurately identify primary characteristic information.
limitations: limitations: 1. The paper lacks technical novelty and fails to attract attention in terms of technical innovation (using MSA for common prompt learning and prompt information interaction in both the Common Prompts and Personalized Prompts learning approaches). Furthermore, with the advancements in effective parameter fine-tuning methods like Lora and Adapters, using prompt learning as the primary approach for continual learning lacks domain advancement. As a comparative study, another paper [1] also utilizes prompt learning for knowledge transfer.

2. The overall framework diagram of the paper could simultaneously illustrate the process during the inference stage and highlight the prompt selection process.

3. Comparing the effects with a multi-task learning framework might better reflect the task's difficulty.

4. I'm curious whether experiments related to the sequential robustness are not necessary in this continual learning setting, as the experimental results do not clearly demonstrate it.

[1] Li Y, Yang X, Wang H, et al. Learning to Prompt Knowledge Transfer for Open-World Continual Learning[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 2024, 38(12): 13700-13708.

** Possible typos **
579: figure -> Figure
637: Figure 5(b) -> Figure 6(b)?

Overall, this paper may not introduce strong technical novelty (With the proposal of more effective parameter fine-tuning methods such as Adapters and Lora, it seems a bit outdated to continue using prompt learning as the main approach to address forgetting. 

Moreover, the use of K-means to find personalized prompt parameters (similar to finding task IDs) is not technically advanced. I am a bit confused about the fact that the clustering centers in K-means have little impact on the clustering results. Shouldn't the number of personalized prompts decrease as the number of clusters increases? Does the reduction in prompt parameter space not affect the inference results? I don't quite understand this), it offers a good empirical study of lightweight continual learning techniques.
paper_summary: paper_summary: This paper proposes a simple and effective framework, CP-Prompt, to instruct the pre-trained model to learn new domains by training a limited number of parameters and avoid forgetting the existing feature distributions.
strength_weakness: strength_weakness: CP-Prompt captures domain knowledge by inserting personalized prompts on the multi-head self-attention layer, and then learns inter-domain knowledge with a common prompting strategy. The experimental results are better than baselines. Therefore, the proposed method are effective.
limitations: limitations: (1) Although this paper proposes a domain incremental learning model based on Prompt, it is weak in theoretical derivation and proof. It is suggested that the theoretical part should be enhanced to explain in detail the theoretical basis of the model design and how the proposed method can effectively control the interaction between different prompts. 
(2) Although the model performance was demonstrated on several standard datasets, there was a lack of deep analysis of the model's generalization ability. It is recommended to add relevant generalization experiments to demonstrate the robustness of the model under various conditions. 
(3) Grammatical and spelling errors: 43 lines of "qickdraw" should be changed to "quick draw".
paper_summary: paper_summary: This paper addresses the challenge of cross-modal domain-incremental learning (DIL), which involves enabling a learning model to continuously learn from novel data with varying feature distributions under the same task without forgetting previous knowledge. Existing top-performing methods still result in high forgetting rates due to the lack of intra-domain knowledge extraction and an inter-domain common prompting strategy.
The authors propose a framework named CP-Prompt, which is a simple yet effective approach that trains a limited number of parameters to guide a pre-trained model to learn new domains and prevent forgetting of existing feature distributions. CP-Prompt captures intra-domain knowledge by compositionally inserting personalized prompts into the multi-head self-attention layers of a pre-trained model. It then learns inter-domain knowledge with a common prompting strategy. The framework is evaluated over three DIL tasks.
strength_weakness: strength_weakness: 1. The paper deals with an important problem which is definitly relavent to the scope of the venue.
2. The paper is clearly written and the method description is easy to follow.
3. The proposed method demonstrate its effectiveness both on the DIL tasks and on the parameter efficiency.
limitations: limitations: 1. The model parameter analysis part claims an accounting of 0.22% fine-tued parameters. However, the comparison on the parameter counting to other methods is missing.
2. The evaluation section proposes two metrics, namely AA and AF, however, the result of AF is missing in the ablation study.
3. Minor suggestions:
 Line 207 in -> is
 Tables: You may add upper/down arrows after the metrics to indicate the desired values.
 Line 553-556, these presentations are not proper here.