since the international subarachnoid aneurysm trial , endovascular coil embolization has been widely used for the treatment of intracranial aneurysms ( 1 , 2 ) . moreover , improved devices and advanced coiling techniques have made it possible to treat an increased number of aneurysms , including those with difficult configurations . among them , the stent protection technique has significantly widened the applicability of endovascular therapy ( 3 ) . however , it is relatively well known that coiled aneurysms have a relatively high recanalization rate . although digital subtraction angiography ( dsa ) is considered to be a standard test to assess recanalization , there are many reports that mr angiography ( mra ) , which is noninvasive and non - irradiating in nature , is useful as a follow - up tool in coiled aneurysms ( 2 , 4 - 6 ) . in patients treated with stent - assisted coil embolizations , however , there have been concerns of a susceptibility artifact or radiofrequency shielding by a closed - cell stent , especially with the enterprise ( codman , raynham , ma , usa ) . therefore , we evaluated the interobserver and intermodality agreement in the interpretation of the time of flight ( tof ) mra for the follow - up of coiled intracranial aneurysms with the enterprise stent for the diagnosis of recanalization and in - stent stenosis . this study was conducted with the approval of the institutional review board of the seoul national university hospital . from june 2008 to april 2012 , we performed endovascular treatment for 1254 patients with 1510 intracranial aneurysms . during this period , a total of 385 aneurysms underwent coil embolization using the enterprise stent . among patients who had a follow - up evaluation interval of greater than 6 months , 40 patients ( with 44 aneurysms ) who underwent both tof mra and dsa follow - up with an interval gap of less than 2 months were included in this study . our patients included 10 males and 30 females with a mean age of 58.8  9.6 years . the middle cerebral artery was the most common location , followed by the internal carotid artery and posterior circulation . the maximal aneurysm diameter ranged from 1.9 mm to 23.9 mm ( mean , 7.7  4.5 mm ) . initial occlusion immediately after coil embolization was classified using the 3-point raymond scale ( 7 ) , and 16 residual aneurysms were included . the mean time gap between the tof mra and dsa was 41.0  25.2 days , and the interval between the follow - up dsa and coil embolization was 14.2  25.2 months ( median 12 months ) . 1.5 tesla ( t ) ( n = 28 ) or 3 t ( n = 16 ) mr scanners were used for the acquisition of the 3d tof mra images . intracranial 3d tof mra was performed in conjunction with the conventional mri , using a multiple overlapped and acquisition technique . in the imaging with the 3d tof mra , the following ranges of parameters were used : 3d fast imaging with steady procession ; tr , 21 - 38 ms ; te , 2.4 - 7.2 ms ; flip angle , 18 - 25 degrees ; effective section thickness , 0.5 - 1.2 mm ; fov , 130 - 190  130 - 220 ( maximum intensity projection [ mip ] images ) and 175 - 240  190 - 270 ( source images [ si ] ) ; and 256 - 640  192 - 512 matrix covering an area from the clivus to the genu of the corpus callosum . both rotational mip images and si ( axial acquired partitions the dsa was performed using a biplane system ( integris allura ; philips medical systems , best , the netherlands ) via transfemoral catheterization and selective injection of contrast media into the carotid or vertebral arteries . imaging was performed to a standard and with adequate working projections as required . on both the follow - up tof mra and dsa , the degree of coiled aneurysmal stability was classified as follows : stable occlusion ( no flow or filling of the contrast within the aneurysm ) ; minor recanalization ( slight residual flow or contrast filling at the neck of the aneurysm ) ; or major recanalization ( residual flow or contrast filling of the aneurysmal sac ) ( fig . major recanalization required further treatment . in - stent stenosis was confirmed in the follow - up dsa . the degree of stenosis was represented as the ratio of the stented segment diameter to the diameter of the adjacent proximal non - stented segment . an in - stent stenosis of more than 33% on the dsa was considered significant ( 9 ) , regardless of the presence of hemodynamic alterations or potential clinical implications . the set of follow - up tof mra images were randomly arranged and two experienced neurointerventionists ( ydc , hsk ) who were blinded to the pertinent clinical and radiologic information independently reviewed the follow - up mra mip images alone ( ' mip mode ' ) , and both mip images and sis ( ' si mode ' ) 4 weeks later to evaluate recanalization . in cases of disagreement , a consensus was established by a third interventional neuroradiologist ( mhh ) . in addition , we compared the capability of the tof mra ( mip images alone and si alone , respectively ) to depict the residual flow within the coiled aneurysms and the stented parent arteries with that of the dsa ( gold standard ) . the mr images were classified into three categories : " good " ( when the images demonstrated similar features to the dsa ) , " poor " ( when an evaluation could not be made ) , and " moderate " ( when an evaluation could be made but information was lacking compared with the dsa ) ( 5 ) . the level of interobserver and intermodality agreement for the evaluation of the tof mra was analyzed by means of weighted kappa statistics . a comparison between the tof mra and the dsa for the detection of aneurysmal recanalization was made . the interpretation of  was as follows :  < 0 indicated no agreement ;  = 0 to 0.19 , poor agreement ;  = 0.20 to 0.39 , fair agreement ;  = 0.40 to 0.59 , moderate agreement ;  = 0.60 to 0.79 , substantial agreement ; and  = 0.80 to 1.00 , almost perfect agreement . all analyses were performed using medcalc software ( version 12 ; mariakerke , belgium ) . this study was conducted with the approval of the institutional review board of the seoul national university hospital . from june 2008 to april 2012 , we performed endovascular treatment for 1254 patients with 1510 intracranial aneurysms . during this period , a total of 385 aneurysms underwent coil embolization using the enterprise stent . among patients who had a follow - up evaluation interval of greater than 6 months , 40 patients ( with 44 aneurysms ) who underwent both tof mra and dsa follow - up with an interval gap of less than 2 months were included in this study . our patients included 10 males and 30 females with a mean age of 58.8  9.6 years . the middle cerebral artery was the most common location , followed by the internal carotid artery and posterior circulation . the maximal aneurysm diameter ranged from 1.9 mm to 23.9 mm ( mean , 7.7  4.5 mm ) . initial occlusion immediately after coil embolization was classified using the 3-point raymond scale ( 7 ) , and 16 residual aneurysms were included . the mean time gap between the tof mra and dsa was 41.0  25.2 days , and the interval between the follow - up dsa and coil embolization was 14.2  25.2 months ( median 12 months ) . 1.5 tesla ( t ) ( n = 28 ) or 3 t ( n = 16 ) mr scanners were used for the acquisition of the 3d tof mra images . intracranial 3d tof mra was performed in conjunction with the conventional mri , using a multiple overlapped and acquisition technique . in the imaging with the 3d tof mra , the following ranges of parameters were used : 3d fast imaging with steady procession ; tr , 21 - 38 ms ; te , 2.4 - 7.2 ms ; flip angle , 18 - 25 degrees ; effective section thickness , 0.5 - 1.2 mm ; fov , 130 - 190  130 - 220 ( maximum intensity projection [ mip ] images ) and 175 - 240  190 - 270 ( source images [ si ] ) ; and 256 - 640  192 - 512 matrix covering an area from the clivus to the genu of the corpus callosum . both rotational mip images and si ( axial acquired partitions ) were used in the evaluation of the follow - up results . the dsa was performed using a biplane system ( integris allura ; philips medical systems , best , the netherlands ) via transfemoral catheterization and selective injection of contrast media into the carotid or vertebral arteries . on both the follow - up tof mra and dsa , the degree of coiled aneurysmal stability was classified as follows : stable occlusion ( no flow or filling of the contrast within the aneurysm ) ; minor recanalization ( slight residual flow or contrast filling at the neck of the aneurysm ) ; or major recanalization ( residual flow or contrast filling of the aneurysmal sac ) ( fig . the degree of stenosis was represented as the ratio of the stented segment diameter to the diameter of the adjacent proximal non - stented segment . an in - stent stenosis of more than 33% on the dsa was considered significant ( 9 ) , regardless of the presence of hemodynamic alterations or potential clinical implications . the set of follow - up tof mra images were randomly arranged and two experienced neurointerventionists ( ydc , hsk ) who were blinded to the pertinent clinical and radiologic information independently reviewed the follow - up mra mip images alone ( ' mip mode ' ) , and both mip images and sis ( ' si mode ' ) 4 weeks later to evaluate recanalization . in cases of disagreement , a consensus was established by a third interventional neuroradiologist ( mhh ) . in addition , we compared the capability of the tof mra ( mip images alone and si alone , respectively ) to depict the residual flow within the coiled aneurysms and the stented parent arteries with that of the dsa ( gold standard ) . the mr images were classified into three categories : " good " ( when the images demonstrated similar features to the dsa ) , " poor " ( when an evaluation could not be made ) , and " moderate " ( when an evaluation could be made but information was lacking compared with the dsa ) ( 5 ) . two experienced neurointerventionists ( ydc , mhh ) reviewed the images . the level of interobserver and intermodality agreement for the evaluation of the tof mra was analyzed by means of weighted kappa statistics . a comparison between the tof mra and the dsa for the detection of aneurysmal recanalization was made . the interpretation of  was as follows :  < 0 indicated no agreement ;  = 0 to 0.19 , poor agreement ;  = 0.20 to 0.39 , fair agreement ;  = 0.40 to 0.59 , moderate agreement ;  = 0.60 to 0.79 , substantial agreement ; and  = 0.80 to 1.00 , almost perfect agreement . all analyses were performed using medcalc software ( version 12 ; mariakerke , belgium ) . among 44 aneurysms , stable occlusion was demonstrated in 25 , minor recanalization in 8 , and major recanalization in 11 . in - stent stenosis of more than 33% was observed in 5 patients . in mip and si modes , interobserver agreement was found to be good for tof mra (  = 0.835 , range 0.709 to 0.961 ;  = 0.731 , range 0.563 to 0.898 , respectively ) . the discrepancy between observers was caused by the following : the confusion between the normal branch and the recanalized portions due to signal loss induced by the stent ( n = 5 ) , measurement differences in the degree of recurrence ( n = 2 ) , and the difference of interpretation in the cases of small recanalized portions that were parallel to the axial acquisition of the stented artery ( n = 2 ) . when we compared the tof mra with the dsa , the si mode demonstrated almost perfect agreement (  = 0.892 , range 0.767 to 1.000 ) , which was better than the mip mode (  = 0.598 , range 0.370 to 0.826 ) ( fig . 2 ) . there was no significant difference between the 1.5 t ( 26/28 , 92.8% ) and 3 t ( 15/16 , 93.8% ) mr scanners . two major recanalizations on the dsa were rated as a stable occlusion in one and as a minor recanalization in the other on the mra . the recanalized portions of both aneurysms were small and located at the paraclinoid internal carotid artery with an inferior direction . the small recanalized parts were parallel to the axial acquisition of the stented parent artery , and there were signal losses related to the enterprise stents in the mip images , and overlap of the recurred portion of the aneurysm with the stented parent arteries in the si ( fig . the other case of stable occlusion on the dsa was interpreted as a minor recanalization on the mra . the discrepancy was due to suboptimal projection of the coiled aneurysm on the dsa , which hindered the revealing of a small recanalized portion covered with coils . in terms of the depiction of the internal and neck portions of the coiled aneurysms on the tof mra , the si produced better depictions than the mip image ; the rate of good or moderate depiction was 93.1% and 63.6% , respectively . with regard to the in - stent stenosis , both images showed poor depiction in most cases ( 97.7% and 95.5% ) ( table 3 ) . among 44 aneurysms , stable occlusion was demonstrated in 25 , minor recanalization in 8 , and major recanalization in 11 . in - stent in mip and si modes , interobserver agreement was found to be good for tof mra (  = 0.835 , range 0.709 to 0.961 ;  = 0.731 , range 0.563 to 0.898 , respectively ) . the discrepancy between observers was caused by the following : the confusion between the normal branch and the recanalized portions due to signal loss induced by the stent ( n = 5 ) , measurement differences in the degree of recurrence ( n = 2 ) , and the difference of interpretation in the cases of small recanalized portions that were parallel to the axial acquisition of the stented artery ( n = 2 ) . when we compared the tof mra with the dsa , the si mode demonstrated almost perfect agreement (  = 0.892 , range 0.767 to 1.000 ) , which was better than the mip mode (  = 0.598 , range 0.370 to 0.826 ) ( fig . 2 ) . there was no significant difference between the 1.5 t ( 26/28 , 92.8% ) and 3 t ( 15/16 , 93.8% ) mr scanners . two major recanalizations on the dsa were rated as a stable occlusion in one and as a minor recanalization in the other on the mra . the recanalized portions of both aneurysms were small and located at the paraclinoid internal carotid artery with an inferior direction . the small recanalized parts were parallel to the axial acquisition of the stented parent artery , and there were signal losses related to the enterprise stents in the mip images , and overlap of the recurred portion of the aneurysm with the stented parent arteries in the si ( fig . the other case of stable occlusion on the dsa was interpreted as a minor recanalization on the mra . the discrepancy was due to suboptimal projection of the coiled aneurysm on the dsa , which hindered the revealing of a small recanalized portion covered with coils . in terms of the depiction of the internal and neck portions of the coiled aneurysms on the tof mra , the si produced better depictions than the mip image ; the rate of good or moderate depiction was 93.1% and 63.6% , respectively . with regard to the in - stent stenosis , both images showed poor depiction in most cases ( 97.7% and 95.5% ) ( table 3 ) . after coil embolization for an intracranial aneurysm , a follow - up evaluation is important due to the possibility of re - opening during the follow - up period . dsa is considered the gold standard of follow - up imaging modalities ( 2 , 6 , 10 ) . however , dsa is an invasive study and requires exposure to radiation and contrast media . there have been reports showing the good diagnostic performance of the tof mra in the follow - up of patients with coiled aneurysms ( 11 , 12 ) . recently , the usage of stents has been increasing . in the follow - up evaluations , the stent - induced signal loss makes it difficult to evaluate the status of the aneurysm occlusion and stented parent artery ( 2 , 4 , 6 , 13 ) . notably , our results demonstrate that the tof mra could be accurate and effective as a follow - up imaging modality to estimate the status of aneurysm occlusion when we pay attention to the source images . although 3d reconstruction of mip images had more limitations due to signal loss , axial source imaging contributed to the improved accuracy by observation of the residual flow within the coiled aneurysms . this means that the abluminal signal loss related to the stent would be less than the luminal one , and signal masking outside of the stent would not be significant enough to hinder evaluation of the re - opening of the coiled aneurysms . therefore , we suggest that close observation of the source images in addition to the mip images is mandatory to investigate the recanalization . ( 12 ) reported that a small residual lumen and suboptimal projection at the dsa were independently associated with a discrepancy between the dsa and tof mra . ( 14 ) insisted that the helmet - style remnants yielded a higher preference of the mra compared with the dsa in the assessment of recanalization of the coiled aneurysms . in our series , we also observed a similar case . in addition , we found that it was hard to discriminate the recanalized portion from the stented parent arterial lumen if the recanalized parts were placed in a superior or inferior direction ( as opposed to a medial or lateral direction ) , even with the axial source image analysis . signal loss at the stented parent artery in the mra is caused by a susceptibility artifact and radiofrequency shielding ( 4 , 13 ) . stent - induced mra signal loss is known to be variable , depending on the thickness and cell design of the stent , raw materials used to make the stent , stented arterial tortuosity and the mr parameter ( 4 - 6 ) . the significant artifact related to the enterprise stent may be induced by the closed cell design and tantalum markers on both ends of the stent ( 5 ) . there have been many reports that enterprise stents have lower procedural complication rates than neuroform stents due to easy navigation and delivery ( 15 , 16 ) . our study showed that the tof mra was sufficient to assess re - opening of the coiled aneurysms , but it was not sufficient to evaluate in - stent stenosis of the parent artery , which is problematic due to the significant chance of in - stent stenosis . ( 17 ) reported that significant in - stent stenosis ( > 50% based on diameter ) developed in 3% of the patients treated with the enterprise stent . according to our data , there was a 12.7% chance of in - stent stenosis ( more than a 33% luminal loss ) , as demonstrated by dsa ( 9 ) . recently , there have been some reports that contrast - enhanced ( ce ) mra had better image quality of the stented parent arteries than the tof mra ( 2 , 4 , 5 , 18 , 19 ) . they also insisted that , especially in large residual aneurysms , the sensitivity of the ce mra might be superior to the tof mra . still , however , the ce mra does not seem to replace dsa in the investigation of stented artery status . the limited spatial resolution and the potential for venous enhancement are limiting factors of this imaging modality . in addition , ce mra carries a small but definite risk of nephrogenic systemic fibrosis ( 12 ) . because in - stent stenosis should be evaluated during the follow - up period in patients with intracranial stents and ce mra can not exactly reflect in - stent stenosis of the stented parent artery , we suggest that the tof mra is sufficient and effective to evaluate the aneurysms treated using enterprise stents and that the dsa should be performed at least once during the follow - up period . both tof mra and dsa were not performed on the same day in most cases . therefore , mra might not reflect the exact condition of the aneurysms and stented parent arteries compared to the dsa . another potential limitation is that the mra images had a variety of different image qualities . this was due to mra scanning using different machines in one institution and these different machines happened to be of different field strengths . these limitations also may have reflected the reality of the mra readings in a tertiary referral hospital . in the end , we could not compare the tof mra and dsa with the ce mra because the ce mra was not included in the follow - up mr protocol of the coiled aneurysms . this study on the interobserver and intermodality agreement demonstrated that the tof mra provided sufficient accuracy in the screening for aneurysm recurrence after enterprise stent - assisted coil embolization , especially with the evaluation of the si , in addition to mip images in the tof mra . this study on the interobserver and intermodality agreement demonstrated that the tof mra provided sufficient accuracy in the screening for aneurysm recurrence after enterprise stent - assisted coil embolization , especially with the evaluation of the si , in addition to mip images in the tof mra .
objectivethe aim of this study was to determine the interobserver and intermodality agreement in the interpretation of time - of - flight ( tof ) mr angiography ( mra ) for the follow - up of coiled intracranial aneurysms with the enterprise stent.materials and methodstwo experienced neurointerventionists independently reviewed the follow - up mra studies of 40 consecutive patients with 44 coiled aneurysms . 
 all aneurysms were treated with assistance from the enterprise stent and the radiologic follow - up intervals were greater than 6 months after the endovascular therapy . digital subtraction angiography ( dsa ) served as the reference standard . 
 the degree of aneurysm occlusion was determined by an evaluation of the maximal intensity projection ( mip ) and source images ( si ) of the tof mra . 
 the capability of the tof mra to depict the residual flow within the coiled aneurysms and the stented parent arteries was compared with that of the dsa.resultsdsa showed stable occlusions in 25 aneurysms , minor recanalization in 8 , and major recanalization in 11 . 
 comparisons between the tof mra and conventional angiography showed that the mip plus si had almost perfect agreement (  = 0.892 , range 0.767 to 1.000 ) and had better agreement than with the mip images only (  = 0.598 , range 0.370 to 0.826 ) . in - stent stenosis of more than 33% was observed in 5 cases . 
 both mip and si of the mra showed poor depiction of in - stent stenosis compared with the dsa.conclusiontof mra seemed to be reliable in screening for aneurysm recurrence after coil embolization with enterprise stent assistance , especially in the evaluation of the si , in addition to mip images in the tof mra .