8 21 (Estimation by Analogy EbA) EbA EbA EbA EbA EbA EbA 0.19 MER 0.26 EbA(Estimation by Analogy) MER(Magnitude of Error Relative) MRE(Magnitude of Relative Error) i
1 P1 2も4 5 6 7
1 2 3
[1] [2][3][4][5] COCOMO[2] [3] [6] [5][7][8] (Estimation by Analogy EbA) EbA EbA EbA EbA EbA EbA EbA 1 1 2 EbA 4 3 5 8 6 7 2 Estimation by analogy EbA [5][7] EbA EbA
1
2 Order[9] Normalize[5]
order: order [0,1]
3 Pa
4
k l amp(P a , P i ) (7)
4 l: 3 3.1 3.2 1 2 3 P4 Pa   Pb 1  3 P1 t t t=2 1      1 EbA 2         1 t P1 t 3         1 2   2 4 2 Pa Pb P4 3 Pb Pb 2: 3: 4 4.1 Leave-One-Out LOO [11] EbA EbA 4.2 Desharnais [12][13] ISBSG [14] Kitchenham 3 [15] . . . Desharnais Desharnais [12] 81 12 6 International Software Benchmark Standard Group ISBSG ISBSG 20 1989 2008 5052 135 5 Kitchenham 2002 Kitchenham [15] 1995 1999 145 9 5 . . 1980 77 118 131 Kitchenham 7 etc. 1 6 6 ● Desharnais ● ISBSG ● Kitchenham 4.3 MMAE   MMRE MMER[16] PRED25
N
. MMAE:Mean Magnitude of Absolute Error MMAE
. MMRE:Mean Magnitude of Relative Error mre mmre MMRE (9)
MMER:Mean Magnitude Error of Relative ● MER MER[16] MER MMER (10)
● PRED25 mre 0.25 mre 0.25 m
PRED25
(11) 4.4 Leave-One-Out
LOO 1 n – 1 4 1. 1 n – 1 2. 3. EbA MAE MRE, MER 4. 1
MMAE   MMRE MMER PRED25 n 5.
n MMRE　MMER　PRED25 MMAE 10 1 n t [17] t=1 normalize order Naist Collaborative EbA Filtering Engines[18] EbA EbA k:
k=2  ISBSG
Kitchenham 4: 5 3 Desharnais 1 2 3 1 2 Kitchenham ISBSG MMAE   MMRE   MMER   PRED25 1 Desharnais MMER MMRE PRED25 MMAE   MMRE   MMER PRED25 22.4% 27.6% 42.7% 55.6% normalize MMAE order Desharnais normalize order 2 ISBSG normalize MMER MMAE   MMRE   PRED25 MMAE MMRE　PRED25 order 3.3% MMER 2.0% 9.4% 1.1% - ISBSG MMER order MMAE   MMRE   PRED25 normalize Desharnais 3 Kitchenham normalize PRED25 12.9% MMAE MMAE MMRE　MMER PRED25 normalize Kitchenham normalize MMAE  MMRE  MMER 8.8% 41.6% 1.5% order order Desharnais
6 Desharnais order MMAE   MMRE   MMER   PRED25 55.6% 22.4% 27.6% 42.7% MMRE MMER PRED25 MMAE normalize MMRE PRED25 MMAE MMER 30.9% 12.6% ISBSG order 1.1% MMER MMRE　PRED25 MMAE 9.4% 3.3% 2.0% ISBSG International Software Benchmarking Standards Group ISBSG EbA PRED25 MMAE MMRE normalize MMER 6.0% Kitchenham order MMAE MMRE   MMER   PRED25 normalize 41.6% 8.8% MMAE   MMRE   MMER   PRED25 1.5% 12.9% 1 AUC Area Under the Curve Alberg Diagram[19] AUC Alberg Diagram MRE
k=2 Kitchenham ..
MER
MRE 0.5 mre AUC 5(b)
0.53
AUC 0.57
Desharnais AUC 0.62 MER AUC 0.5 MER
0.59 MER AUC AUC MER AUC MRE AUC 0.66 (b) ISBSG 5: 7 6 5 3 2 1 6: 7 [20] Seo [21]
Seo 2 Least Trimmed Square[23] k-means clustering[24] [21] [25] [22] .. "   " u " [26] .. EbA " 8 EbA EbA 0.19 MER EbA 0.26 EbA IT , 2006. [2] B. W. Boehm. Software Engineering Economics. Prentice Hall,New Jersey, 1981. [3] K. Srinivasan and D. Fisher. Machine learning approaches to estimation software development efforts. IEEE Transaction on Software Engineering , Vol. 21, No. 2, pp. 126–137, 1995. [4] S. D. Conte, H. E. Dunsmore, and V.Y. Shen.  Software engineering metrics and models. The Benjamin/Cummings Publishing Company, Inc, 1986. [5] M. Shepperd and C. Schofield. Estimating software project effort using analogies. IEEE Transactions on Software Engineering , Vol. 23, No. 12, pp. 736–743, 1997. [6] B. Steece S. Chulani, B. Boehm. Bayesian analysis of empirical software engineering cost models. IEEE Transactions on Software Engineering , Vol. 25, No. 4, pp. 573–583, 1999.
[8] N. Ohsugi, M. Tsunoda, A. Monden, and K. Matsumoto.  Effort estimation based on collaborative filtering. In Proceeding of 5th International Conference on Product Focused Software Process Improvement (Profes2004) , pp. 274–286, 2004. [9]
[10] C. Kirsopp, E. Mendes, R. Premraj, and M. J. Shepperd. An empirical analysis of linear adaptation techniques for case-based prediction. In Proceedings of 5th Inter- national Conference on Case-Based Reasoning(ICCBR2003) , pp. 231–245, 2003. [11] C. Kirsopp, M. Shepperd, and J. Hart. Search heuristics, case-based reasoning and software project effort prediction. In Morgan Kaufmann Publishers Inc., editor, Ge- netic and Evolutionary Computation Conference , pp. 1367–1374, 2002. [12] J. M. Desharnais. Analyse statistique de la productivitie des projets informatique a partie de la technique des point des fonction.  In Master Thesis , University of Montereal, 1989. [13] C. Mair, G. Kadoda, M. Lefley, K. Phalp, C. Schofield, M. Sheppred, and S. Webster. An investigation of machine learning based prediction systems.  Journal of Systems and Software , Vol. 53, No. Issue1, pp. 23–29, 2000. [14] ISBSG Estimating. Benchmarking and research suite release 11. International Soft- ware Benchmarking Standards Group(ISBSG), 2009. [15] B. Kitchenham, S. L. Pfleeger, B. McColl, and S. Eagan.  An empirical study of maintenance and development estimation accuracy.  Journal of Systems and Software, Vol. 64, No. Issue1, pp. 57–77, 2002. [16] B. Kitchenham, G. MacDonell, M. Pickard, and M. Sheppred. What accuracy statis- tics really measure.  IEEE Transactions on Software Engineering , Vol. 148, No. 3, pp. 85–99, 2003.
,
[18] Naist collaborative filtering engines. http://sourceforge.jp/projects/ncfe/. [19] N. Ohlsson and H. Alberg.  Predicting fault-prone software modules in telephone switches. IEEE Transactions on Software Engineering , Vol. 22, No. 12, pp. 886–894, 1996. [20] Y. S. Seo, K. A. Yoon, and D. H. Bae. An empirical analysis of software effort esti- mation with outlier elimination. In 1st International Conference on Predictr Models in Software Engineering '08, pp. 25–32, 2008.
,
7B-2), 2007. [22]
[23] P. Rousseeuw and A. Leroy. Pobust Regression and Outlier Detection. John Wiley and Sons, Inc, 1987. [24] J. Han and M. Kamber. Data mining: Concepts and Techniques. Morgan Kaufmann, 2006. [25] L. H. Putnam.  A general empirical solution to the macro sizing and estimation problem. IEEE Transactions on Software Engineering , Vol. 4, No. 4, pp. 345–361, 1978. [26] XVI FOSE 2009, pp. 229–236, 2009. [27] J. Kromrey and C. Hines.  Nonrandomly missing data in multiple regression:  An empirical comparison of common missing-data treatments. Vol. 54, No. 3, pp. 573– 593, 1994. [28] R. J. A Little and D. B. Rubin. Statistical Analysis with Missing Data 2nd edition. John Willey and Sons, 2002. 7 [26] .. ” n n mmre 4.4 mmre Desharnais 2 ISBSG 2 6 Kitchenham Desharnais 60% 40% 40% ISBSG 7 Kitchenham [26] ISBSG Desharnais Kitchenham mmre n 10% EbA 7: