Interrater reliability was evaluated by assessing the degree to which different individuals agreed on the scientific quality of a set of reports [7, 8] , the performance of AMSTAR in terms of agreement and reliability was better than that of OQAQ; overall agreement and kappa of items in AMSTAR ranged from moderate to perfect, the reliability of its total score was excellent. However, fair agreement and relatively low kappa were observed in item 9 "were the methods used to combine the findings of studies appropriate" and item 5 "was a list of studies (included and excluded) provided," indicated that there is a room for improvement on AMSTAR when applying this new tool to assess methodological quality of systematic reviews on TCM.