Empirical Determination of the Relative Importance of Educational Objectives

EVALUATION BY definition requires a ''value judgment". Individuals interested in systematical ly evaluating programs of instruction and courses of study must be concerned with objectives which are specified adequately. It is reasonable to con clude that many individuals concerned with evalua tive research efforts have focused primarily on pro cess rather than product (2, 4). The "value judg ment" relative to the evaluative process deals pri marily with the establishment of objectives, i. e., desired end products. A typical rationalization employed for the non utilization of product criteria in educational evalua tion is that a lack of agreement exists with refer ence to basic educational objectives. Therefore, process and presage criteria are used for evalua ting educational outcomes. For example, a school may state as one of its desired outcomes for stu dents, ".. .to use their leisure time inaworth while fashion. " However, rather than assess this directly, which would of course be quite difficult, process criteria (e. g. existence of physical edu cation courses in the curriculum) may be used, and based on the fulfillment of these it is inferred that the product criterion is being achieved. It is pat ently unreasonable to infer that products are achieved, unless a functional relationship can be shown to exist between process and product. The only true test, of course, would be to assess directly the degree of accomplishment of the desired prod ucts. The crux of the problem appears to be in the as sertion that a lack of agreement exists concerning the broad general objectives of education. It is ob viously difficult, if not worthless, to evaluate ob jectives which perhaps are not perceived as objec tives by all concerned. It would appear to be worth while to attempt to ascertain whether various groups in education perceive stated objectives in the same I order of relative importance. For example, a school district may have a stated philosophy of education which lists objectives A, B, C, D, and E in hier archical order. However, would systematic assess ment of the judgments of this district's instruction al staff regarding these stated objectives reveal that the objectives are perceived in the same order of importance, or in some other manner? If, in any given educational setting, it can be demonstrated that the individuals concerned with their achieve ment of objectives agree to their relative impor tance, a second step can be taken. Statements of behaviors indicative of the agreed-upon objectives can be made and subjected to the same test. Even tually, specific skills and knowledges to be learned in order to achieve the desired behaviors and the overall general objectives can be stated. With this accomplished, there would at least be a logical con nection between classroom learning in daily situa tions and overall objectives. Evaluation procedures could then be employed to determine if, in fact, over all objectives were being achieved and, if not, nec essary changes could be made. The specific purpose of this study was to deter mine whether through the use of techniques of scal ing, the relative importance of educational obj ec tives can be determined. Parenthetically, it can be stated that if a series of educational objectives can be shown on an interval scale, this would indicate the relative importance of the objectives as well as demonstrate agreement concerning the series.