Approved For Release 2000/08/08 : c1a-RDP96-00780R002200500001-2 , ) . fuzzy set terminology, these quantities for the jth target/response pair are as follows: DW (R|NT)). Accuracy, = a, = —____——___ 2 w, Tj,& 2 (R|NTI): Reliability = m= __O—S—=" ] 2% Rj,x k and Figure of Merit = M, ™ a, x r, The sum over k is called the sigma count in fuzzy set terminology. The sigma count is defined as the sum of the membership values, uw, for the elements of the response, target, and their intersection—that is, Rj, 7}, and (RiN Ti), respectively. 2. (U) Target and Response Data | The universe of target and response elements is drawn from the August, 1988, experiment. We define three element categories: functions, relationships, and objects. These categories are weighted 1.0, 0.75, and 0.50, respectively. 7 (U) Table 1 shows the universe of target and response elements and the formal definition of T and R. All scans were considered together, rather than scan by scan. The various scaling weights are shown in parentheses adjacent to the appropriate factors. The relative weights are derived from SRI’s best assessment of the operational utility of each element. The response membership values, R(y), were determined from the raw data (see Appendices A and B). The target membership values, T(u), were determined by SRI personnel during a site visit in September, 1988. All elements, however, were determined by an SRI analyst post hoc in order to allow a more accurate assessment of reliability. Elements derived from the response were taken literally. Those elements having no corresponding element in the target (i.e., T() = 0) were assigned the average weight of elements present in the target. 7 Approved For Release 2oporosios : ciaepp96-00789R002200800001-2
SG1A Approved For Release 2000/08/08 : CIA-RDP96-00789R002200500001-2 Next 1 Page(s) In Document Exempt Approved For Release 2000/08/08 : CIA-RDP96-00789R002200500001-2
Approved For Release 2000/08/08 : CIA-RDP96-00789R002200500001-2 IV RESULTS AND DISCUSSION (VU) Table 2 shows the figure-of-merit analysis for the experiment using the fuzzy sets defined in Table 1. The target was the eC target-response intersection is shown as |T M R{, and the sigma counts of the target and response sets are shown as |T| and |R|, respectively. N is the number of elements that were identified for each category. All quantities include the relative weights shown in Table 1. "The weighted accuracy total of 0.80 (i.e., 80% of the identifiable elements at the target site were correctly described by V372) agrees well with the qualitative correspondence shown in Figures 1 and 2.* Figure 3 shows V372‘’s drawing of a plan view of the target area, which appears to match the experimental situation almost exactly. The figures of merit show that, since the first experiment in this series, V372°s ability to sense functions and objects has increased modestly, and his ability to sense relationships has increased by a factor of four. The relatively low value of 0.57 for the combined (weighted by the category weighting factors) target elements is consistent with the elaborate nature of V372’s response (see the original response in Appendices A and B). Table 2 FIGURE OF MERIT SUMMARY4 _ SS FUNCTIONS 8 10.00 11.40 12.43 0.88 0.80 0.70 RELATIONSHIPS 16 15.05 21.95 23.45 0.69 0.64 0.44 OBJECTS 48 46.20 56.70 72.92 0.82 0.63 0.52 . (U) All figures are to be taken as indicators of qualitative correspondence. The drawings and photographs have been selected to illustrate the correspondence. | 10 Approved For Release 2000/08/08 : CIA-RDP96-00789R002200500001-2