3.    INDEXES GENERATED BY MACHINE- -AUTOMATIC DERIVATIVE INDEXING

      We have noted, in the earlier statement of the scope of this survey, a distinction
between "derivative" and "assignment" indexing.             This distinction is related directly to
the question: ?~Is what can be done by machine properly termed `abstracting',        `indexing',
or  classifying'?'1 It relates also, as we have remarked, to a continuing controversy far
older than any question of the introduction of machine techniques--that between "word"
and "concept" indexing, between "uniterms" if selected directly from the text and
"descriptors'1 in the sense of their being1indexin~         terms selected so as to have "a care-
fully specified meaning for retxieval",             to say nothing of contrasts with subject heading
schemes and classification schedules.

      Some of the major arguments pro and con derivative (usually word) and assignment
(usually concept) indexing will be considered in a subsequent section of this report on the
problems of evaluating indexing methods.             Nevertheless, the present popularity of
automatic derivative indexes of the KWIC type, while subject to all the disadvantages
typically cited for all purely derivative indexing systems, does show the actuality of
automatic indexing potentialities and may in fact hold the promise of solving some of the
present-day problems of subject control.

      In this section, we shall consider first the straightforward word extraction tech-
niques used in KWIC type indexes.  Possibilities for modified derivative indexing by
title augmentation, manipulation of word groups and use of special clues in keyword
selection are then discussed, including work by Baxendale, Luhn, and Artandi.          Related
research and developments efforts work in automatic abstracting which lend themselves
to derivation of indexing terms includes proposals and experiments by Luhn, Oswald,
Edmundson, Wyllys, Doyle, and Lesk and Storm, among others.               Some comments will
be given on the quality of modified derivative indexing by machine.         Automatic derivative
indexing at the time of search, as in the natural language text searching systems of
Swanson, Maron, Kuhns, and Ray, and Eldridge and Dennis, will be discussed in a later
section of this report.

3.1   KWIC Indexes

      The development of computer-generated permuted-title keyword indexes, especially
in the issuances of Chemical Titles and B. A. S.I. C. (Biological Abstracts-Subjects-In
Context) has been hailed by some as "the miracle of the decade"~and "the greatest th7ng
to happen in chemistry since the invention of the test tube".          The major reason for
the optimistic  enthusiasm is the speed with which the computer can produce can produce
a complete index to some specific set of books, documents or papers so that publication
and dissemination of the index can be prompt and thus serve as an important tool in

1/

2I

3/

     Mooers, 1963 L423], p 3.

     See pp. 132-136.

     Quoted by D. R. Baker  statement in "U.S. Congress, Senate Committee on
     Government Operations", 1960 [619], p. ~69.

                                        40

maintenance of truly current awareness.  For example, Herner in his 1961 review of the
state- of-the - art of organizing information says:

     T11 am told that the American Chemical Society has never had a more successful
     basic science publication.  The key to the whole thing is, I believe, the extreme
     currency of Chemical Titles.  This in turn derives from the speed and simplicity
     of the KWIC process." 1/

     Conrad reports as follows:

     "Reception of B. A. S.I. C. ... has been so extremely enthusiastic . . . that we
     are excited by the possibilities of producing permuted title indexes in one or
     more additional languages.   The creation of a B.A. S. I.C. index in any language
     requires only that the titles be translated and punched on cards.   Alphabetical
     arrangement, permutation and `type-setting' iscom~1etely automated and, for
     5, 000 titles takes only two hours to accomplish. " 2/

     3.1.1   Applications of KWIC Indexing Techniques

     The KWIC type process is indeed simple and straightforward.       The words of the
author's title are prepared for input to the computer by keystroking   either to punched
cards or to punched paper tape.  Mter being read by the computer, the text of a title is
normally processed against a "stop list" to eliminate from further processing the more
common words, such as "the", "and", prepositions, and the like, and words so general
as to be insignificant for indexing purposes, such as, "demonstration", "typical'1,
 measurements", "steps", and the like.   The remaining presumably "significant" or
"key" words are then, in effect, taken one at a time to an indexing position or window,
where they are sorted in alphabetical order.  The result is a listing of each such word
together with its surrounding context, out to the limit of the line or lines permitted in a
given format.  As each keyword is processed, the title itself is moved over so that the
next keyword occupies the indexing position, and this process is repeated until the entire
title has thus been cyclically permuted.

     A number of formats are available in which the length of the line, the position of
the indexing window, and the extent of "wrap-around" (bringing the end of a title in at the
beginning of a line to fill space that would otherwise be left blank) are major variables.
Current examples of KWIC type indexing output are shown in Figures 2 through 7.
Usually, the indexing window is located at or near the center of the line with several
extra spaces to the immediate left or with other devices such as the shading of
B. A. 5.1. C. to aid the searcher in scanning down the keywords listed.  This is

1/

2/

      Herner,  1962, E266], p.10.

      Conrad, 1962 E137], p. 378A.

                                           41

  OTOLTAGE   FOR   TYOROGE   LINOGAT ION  ONRONGASESE.--  U  ON TOE  0  ZPOO-0035-2030             SOLOIST  SISTER  IS OIUOIO-LIOUID   CONOMATO00OPOI  .M SOPOR
O CONTENT   I N  THE FODDER  LICHENS   OF THE TUNTRA.=OASCDNRIC   Ad    0002-NOR?- IRON     00011101000   I NANISOONLIGO 10-01+0100100       TOOl OUSCYSCENONO
                                                                        ACSO-ROIN-2200              00000 IONS IN  TOE o .QAIE-PTASE  DUIDOTION OF   OLIFINS.0
                                                                                               SOLATIONS   IN DIPOLOWLIQA lOS   TI  TOE 000000  OF  MOONED IC
                                                                                                    USOTISCOSITI    OF LEGAtOS  CONDENS0-D   IS COPILLOMEES.
         TOTING   TI DENTATE LIGANOS.    CHLORIDE OCOTYL  ACITOSATES    JCDR-0TNO-OANI      1150  00000 FRESSANES   OF LEQOIDS.-        U METOODS FOR   COLCULA
ONPLEAESWITHOIFFENENTLIGANTS.=              SPECTRA  OFNICREL  III   C                      TION  RANTS OFROLECOLUNLIGA ITS.            + OFTINROT ITS   005000
                                                                        FTTT-NROG-3022      C ACID  IN NALFII N SPENT  LIQUOR.              C OF 01050  SUOF ON)
OS REGION   IN   I ONICT     LIGHT  TISPERNION  IN ERCITON   AMNOMPTI   FTTT-NROG-3512       SOLON  INSEWGGE-SLA0GE    LIQUOM.=R  OF  0000910  GOlDS  ANN 00010
OFFECT   OF DOYGEN ON   TOE  LINTT  EMISSION OMODUCET   NT  TISSOLUTI   ACSA-OTI~2I 13      CC CRYSTALS  OF  ZINC  ANT LITHIUM  00000009  DI  OYTROTES.WO  SING
NCE  OF  FOLARIZET HELIUM    LIGHT  ERCITEN NT  ELECTRDNS.=DTEPENOE     FTRT-012M-2222      ION OFALURINUR-COPPER-     LITHIUM  000015.0      + OS  THE FROPERT
  LOGGOITTRICOL     OPTICOL  LIGHT  FILTER  FOR OGANTITATITE   001591   0011-0010-0333            PLANTS.   ACTION  OF LITHIUM  ALUMINUM  HIDOIDE   OS THE
         OF TOE   RESULTING  LIGHT  INTUCET NT  PNTTON  IMPACT  15-35   PHTS-002W-IIWG      000001  GLASS  TO  510000. CI DOlOR AND  TOOLLOUS  IONS.      U  ELI
NCC  N    DECREASE   OF  THE LIGHT  INTENSITY  OF ELECTRO   LURINESCE   AOAH-NNIA-OISS      O 0100  NESZDIC  ACED  050 LITHIUM  MENZOATE. =0   ATOMS  OF TRITIA
ALS  UNDER  TOE   ACT ION OF LIGHT  IONG.=         U EMINNION  OF MET   IANF-0020-10N3          MOTIATION   TOMOOC  I NOITHIUR  DOPED SIOICOS.W
 ELO CTNICTRECOMRINATION     LIGHT  OF INTl UMANTIMON ION   IN NYMONG                       0055000  PDOYMORFHISO   I NOITHIUN  HYDRIDE.        TOSSIWLO  LOW-P
LY PANG   COLORO   STYMENED  LIGHT  SCATTERING  AND  RISCOSITY  OF PT                         EFFECTS  OF  SODIUM  AND LITHIOM  UPON  THE RECEPTOR   ION THE  SW
LOTIONS.                     LIGHT  SEATTEMING  fly MIRED POLYMER  NT                          FOOFOSES  RI OH 000010  LITHIUM.M  AS  ISO MAROONCULAR   ADDITIT
   TOTETMINAT ION    OF  TOO LIGHT  SCATTERING  CONSTANT  OF  RENZONE                         P00105 ROMWRODMENT    OF LITHIUM .=EWETAI-l   ACTIRITY  INDUCED 0
     IONS  IN  TOE  CASE  OF LIGHT  TARGETS MOMMORTET   MY  HEAT                                     AND CANNDN-12    I OIIHEUW-6.DI  ODYGE~I6 FROM    3.0 TO
 SUNJOCTET   TO   000150  NT LIGHT.            U  CHLORINE)  OLASIEN                          REACTIONS   CARMON-IP   I LITHIU~A.FI   ORIGIN-I?   AND C0RM0~I2
0001001  ION NYMTDLLATCTLIGHT.--UCRYSTALS            I  THE  CANE OF                            WROMIDE.   POTASSEAM.  0110100.   IODINE. MAMIDIAM    IMPARITY
TI  1001001   IN  POLUNIZETLIGTT.=TTFTMIIPOOSFHO            NITMILIE                                DOTERMINAT 10901   LITHIUM.   SODIUM. TOTOSSIUW.   CALCIUM.
NY  NOONS  OF  ALONG  I OLET LIGHT.    0 IN TEODYMINO  NUCLEIC  0010                        ON CONOETIONS   OF TOOT    011000001000   COOFOSITI ON AND  FORMAT)
UPON   CORORATUS  TOACTARAL  LIGNIN  UNITS  STANIED NYMETHOOS    OF  P                      0000000  REACTOR   OF 10.1 LION 15 000001ST   WET.  REACTOR  MITT
LNYLI-2-   POOPANONE    FROM LI GNIS.--NY-I-IA-                  0 OH                       EACTETITI   OF  PISI-TREE  LETTERS.              A AND
RN OSYL  GROUPS   OF COTTON  LIGNINS.    OMOLECULAN   WEIGHTS  ANT CA                       ACID  COMPOSITION  OF  THE LITER  AND ADIPOSE   TISSUE LIPIDS  IN
         DOTERRINAT I TN  OF LIONO  SULFON IC 0010  IN SULFITE  SPENT                                  OF  GUINEA  FIG 01910  ANN NINNEl  I N HISTAMINE  SHOCE.
          FEATIL  I ZATION.  LIME ANN  P PLACEMENT   EFFECTS  TN                            000000  MI COLOOOFONM   EN LIVER  ANT NEDNEYS   OF MOD~=       H  TN
     REACTIONS    IN 000000  LIMO- ALUMINA  MIOTUMES.                                                          EN  TOE LITER  ANT 500015 OF   NICE  AlIEN INTRO
EFFECTS   OFFENTIL liENS.    LIME.  UND  CULTITATIONS  ON YIELD.                                  ENOGONEWEST  OF  DOE LITER  050 SPOONS OF   THE 0120!  I
GIlDS   15 TOE   UPRONLEMS.  LIMITATIONS.   ANT THE  FUTURE  OF AUTOM                       INYL  FYRROLITONE  IS  TOO LEVER  AND 900105.         +  AND 0001     SATU-0197-00M7
METAl.            DETECTION  LIMITS  IN  RATIATION  ANT OPTICAL  FY00   JOSA-0052- 1307     IEOOOYMETHYL+AZO       DYE LIVER  CARCINOONNESIN  .M MEACTION OF      JRIO-NT0R-0IOI
 WITHIN   THE  TEMPERATURE   LIMITS  20-60-TOG.=T   GLASSY  TEOTOLITE   TLWS-02-1 1-053     ON IS  TOE FATE ENDS WITH  lIVER  DISEOSEN.=            0 ACID ONTO   JWOH-0230-0060
LEAR   MAGNET IC  RESONANCE  LINE OF   ZEDLITIC MATEW.=D  OF  THE NUC   CORE-0255-3000      SIN OF  00000  ACETATE  NY LiVEN ENZIMES.W                   519001   WIJO-0006-0232
MAGNETIC   RESONANCE    RITE LINE SHAPES GENERATED    MY  DM0 OMOADEN   ACSO-TNIN-2212       ACID  SYNTHISIS   IS RAT- 01000  EATNACTS.   011000  OF  0-IMMOTEA   OIFO-REGI-TE II
NOGNETIC   RESONANCE    WIDE LINE SPECTRA.     ANALYSIS   OF NUCLEON    ACSA-OTI~2IG9               010009  OF TOT  ON 01010  FUNCTION.   CELL. MORPOOLOGO.  ONT  JWCO-023W-GWIF
N IODIDE.                    LINE STRENGTHS   ANT  WIOTHS IN  HYOMOGE   ICPS-0037-2E99             MOIGHO  OF  001 ONES LIVEN GOUTAM IC ACID DEHYOPOGONASE    IN  ANIA-0102-OI IR
       HAGNEDIC   RESONANCE  LINE WIDTH   IN GANNET  ANN SPINEL  TYPE                              GATOROTION  OF  TOE LERCO  00100015  TEIEOWENGTION.=           WIJT-00W6-0365
ORGANIC   ELECTROLYTES    I NUNEAR   ANT CIRCULAR CHROMATORMAPTY        CASM- 0007-0909      5100050  RI  FEMALE-MOD-  LITER  OOMOGESATE.-                        WOPO-OTI I-El IS
N-RUNODN   DEGRODATION    OF LINEAR  CHAIN  MOLECULES.=TOFANO           JAFS-0017-INIA               TN TUITATIO    WY LIVEN  HORNOENOTES   ON METOCHONDWEO   OF  JWCO-OZ3~NG7O
  0050DM   DEGRADADION    ON LINEAR  CHAIN MOLECULES.     TON  THE  NO                            FHOSFOOMILOTION   I NLITINWITOCHONTMI   AFROMOIOTOOISECIT       JMCH-023M-NGOV
TOE  ANTI  F ERR DRAGNET  I CLIHEAW  CHAIN.           0 SPECTRUM OF     PHMT-012W-2131      EADMISISTRA lION   I   THE LITER  OF  ROTS  ANT WICE.00  WY ETOONIN
TEW-TISORTEN     THEN NY FOR LINEAR  COLLOIDS. =                    OW  JCFS-0037-2323            ALDERAT IONS IS  THE LIVER  OF  00111 ROTS UNDER   TOO  1510+0
  OF   IRE COEFFICIENT    OF LINEAR  CROONS ION OF  GLASSY  PLASTICS.   FLWS-02-l 1-036     AT 1 0010 1005SF INANE  IN LIVEN  PORTICLES. =OOFGLYCENOL    000900
OF  TOE  SPECIFI  CHEAT   OF LINER N POLYMERS  AT  LOW TEMPIFRATUWEN.   TANE-01G7-NNWO         FOOl  FATTY  ACITS  AND 01010  PATHOLOGY..   EFFECTS  OF 00050+1
    INTESTIGATION ON     THE LINERNITY   OF THE TENT  CURRE  FOR THE                            FROTUCTITS RI   HOMAN  LITER  SLICES   IN TITNO WI  AN INWUNOOR
         COANGE   OF 01391-  LI SEN ANT  THE TALUE  OF THE  INITIAL     FMMT-TNIG-ONAN       ANT  OUTYORTE  NI SHEEP-  01000  SLICES. =oACETATI.     OROPIOSATE
   OF   SPECTRAL   TYDATOEN  LINES  I NAPLANWA  .=            ANYMMET   DANE-N 107-0302      ACTIVITY  I NEITNEI   ANT LEREM  TISSUE  FROM  STARRED  090 FIN
 EAROPIAMIIIII     101551 ON LINES  IN EUROPIUM TI   WENZOYL  METHANE   JCTS-0037-2333      00011 MI  TNONSPOANTOOLOOETNOTUWOMS.O             A CHOONT  MOTMOTO
SITIES   OF THE   MANGANESE  LINES.=SOF   THE DIFFERENCE  OF  TOE TEN                        WOIONOLISM   ES DISEASED  01010.0                        SEOTTONIN
                          OFLINNAGE.=RCOMPOONNSMITHACLNNED          GA  DANE-01G7-0030       THE  OETOLOPMCNT  OF  000 LITER.                ARCOITITY   TURING
             ONETHYLEN    I C LINEAGES.  ANALYTICAL  APPLICATIONS.      CHAL-TOGG-NGN3      0111  15 MOOSE  ORAlS  ANT LIVEN.           0 ON  GOOTOMINOSE  0001
   INHINIDION    OF ENERGY-  LINRET  TI  OHOSPHO PYWITINENUCLEOTIT      JWCH-023M-OGGN      STESOISGO  TRACT   ANT THE LIVEN.         0 ONION  IN THE  009100  1
ODD  SUMNER  OFRONOME    RI C LINEN. FORMED  IN THE  THERMAL  POLYMER                       StOIC  AEON  I N MANMALIAN LIVER.         A lOOM  3-HITODOIANTHRO
NOACOTISTLAT   ION  OF  FU=ELINOLENO   TO OS ITS  MERCUWI C ACETATE  A  JATC-0039-RNI 7     AL 050  FRICANCEROUS   OAT LITER. =      001  AMINO   ACIDS ES NORM
CRANED   FRACTIOSUTION    OF LINSEED   TI L FATTY RObS.   COMFAWATIT    I `JAC-0025-0053    IN 0000101  ANT   01910910 LEVER.        0  5-TYDRORY-  TRYFONPOAN
ETITIDY   OF LIFT   PROTEIN  LIPANE  IN  TORI 005 TISSUE  NL ICES.=T A                      IWO 5000110   ACID OF  ROT 0100W.     A  NUCLIOTIDES  OF  5000000  0
 0010   ACT ION  OF FF09000  LIPASE  ONAMAST.     CELLS.            DR                        FOR  THE ACTITA  0105 OF LETEO-PIMUVOTI   0050050   SYSTEM RELATE
FUSE   I NTLIFDPWDTEINLIFGSE.          000101 DY  OF LIFT PROTEIN   LI  INSO-OROG-OlON      RIO SUMNER  GREATETHOOF-   CITES  OF  FIRST 0001010   2+STNTISOTO
 TOENIDEN   MY   PANCREATIC  LIOGSE.--AENZYM IC HYDROLYSIS       OF  N                      I NOTON  GAS  EUCOASGE  IN LIVING  ANIMOLN.T  S  OF INOMA FOLMONAR
I  INTOSTINALTFTDSOHOL IPID         COMOOSITI ON  ANT TONNOTON  IN  MA                      IC 0 000000 HORMONE  ONTO  000 DING IRPEMIMESTNNITHOORNNO COOT
                             LIPID  COMOOSITION   OF TUMOR  CELLS.                          05010  HEATING  AST ONDEM  LOODENG.=  0  OF OOPPER-NICEIO   SYSTEM    FVDI-02-EI-017
       OFOANOL   1051005  15 LIPIT  EDORACTS NY   `THIN-LAYER CHROMAT                       ON NY  FOTOZOLIC   REDIUR- LOAMY  50105.0        0 TROPERIIES  OF  S  NCSJ-0035-NRZO
ON  OF  AN ORGAN   SPECIFIC  LIOIT  RATION  IN RRAIN.=IIOENTIFICATI                         TI DZOOININDIDNCN.M    NI WLDCOLOSONSTOETICS.0        +-ANYO-2.G-T    JTMS-NNSl-I 160
       SOCROL  ANT   PHOSTHOL IPID   IN CEMEMMO SF1 NAL FLU IT ONE                            OF  NEATERIUM   00100 TN LOCAL  ASESTHOTI COCIIUITY     OF TROCAIN  ZMLD-62- 11-055
RE  OF  CERTAIN   ROCTENIAL  LIOIDEN.--T    RELATED    TO THE  STRUCOD                      NONEGNINO  FOONACTION   OF LOCAL  FERTIOIZERS.=    NISOORCEN  FOR   I
ANT  ROTH ITNINE   ON SONAR  C lOINS AND  LIFT PROTEINS.                                    O NI OSOSTHISIS   I SlOE  100000 1200105   AND 900 ROES OF INOOGODS
     OF  POLO  SACCOGA IDES  LIPIDS  AND  NUCLED  PROTEINS  OF THE                          N  ISTERTOSE  TN  SOLOWLIA LOCALIZOTION    OF ACTION OF   0010051 ON  IRWO-ONI    0757
  RETUTOLISM     OF PHOSPHOL 101 OS  AN  FUNCTION  OF AGE ANT  UNDER                              IN 101  TRESESCO  OF 0000001   APPLIED  TROPS OF  A 010010      JOWA-0OW~IIS2
        IDENTIFICATION    OF LIPIDS  IN  OLOOD THRDMWOPLASTTN.-                             TIN-RINNING   SITES.       00000105   050  MOLE  OF STENOLOOSYSTA     JONO-NONG- 133W-
     ERYTONOCYTO     FEOSPHO LIPIDS  I N THE NERRORN   INFANT.                              OCIOTROPIC  CARWOHOONOTE   LOCUS  I NSTAPRYOOCOCCAS AANOUN.0+O F      CUSC-0031-OSIW
       ANT ADIPOSE   TISSUE  L lOINS IN  THE RATS RECEITING   000010                        INSOCOICIDAL   CONTROL  OF 0000509 OIAENIGLSTRAYING.=                 WOlF-ROt ~O333
    RYO-INDNITOL    POOSPOOL 10100   OF  RYCO NACTEMIAM   TUWEMCULDSI                       OW OLANTITATIUE    EWISSIO OOGANIDHMICAO    OPTICAL LIGHT  110110 F
lION   OF ERTTHMDOSPHINGOL 10109     SERIES.   SYNTHESIS ANT   WESOLA                       S  ES ITALIAN 01100099    I OOOIOMMUOIIFOOOAMI.=+MELGT      IONSHIF   JAPS-OT 17-100W
INOTOSE   FROM   NEN-CLOTER  LIPIDS  WITH ASTHRONE.=S   OF  SULOHO  NA                         DETECT TWSINTATION   OF LOWER  DISLOCATION    IN GERMANIUM CRISO   JCPS-0037-2G21
HATE   INTO MITDCODNTRIAL    LIPtON.       U INCORPORATION   OF TOAST                        FOLOGIZONILITE  ESASDSODSGITUTE 500       AND 10099010SE  ELECTRON
            SEPARATION    OF LIFT POLY   SACCHARITE  AND  WACO 000010   JWCH-N23~0026                      OYSTERLSES  LOOT  OF  COWOLT-NI 1010 FIRRIONS.-
           OF  LOW-TENSITY   LIFT PROTEIN   IRWUNO  PRECIPITATES   IN                       Altos   INTENOCTION CDNSULORESTZ PARAMETERS      AND  RIWNAT ION-NOT
   LIPANE.     ACTIRIDY   OF LIFT PROTEIN LIPASE    IN VARIOUS  01990   IGSN-UOOG-N1NS               AND  CHRUWIUM  IS LOW  00001 STEELS ANN   STAINLESS  51110
TO  PROTEIN  LIPASE   IN  U  LION PROTEIN LITASE.      ACTIOIYY OF  LI  IOSN-TOOA-0105      00150-131  IS  WITCHES  ON LOW  ANN MODERATE FAT    150000.0     0  1
 CONCENTRATION     OF ROTA-  LIFT PROTEINS   AND  PROTEIN CORFOSITID    LAMN-OM-II-017      I YIELDS.O     1111019  OF LOR  DOSES OF  GAMMA  WODIATEOS  ON PLAN
 010000   FLOTATION   CLASS  LIPO PROTEINS   AS THE  CAUSE  OF THE      CCOT-00O7-0072      ISlAM-ZR  )F.P~GOM0AIOT    LOW  ENEOGIOS. oIMOCOAN      ISM  IN MANS
SOLEOOSIN    IN  RANNONEDO-  LIFT PROTEINS   IS CHOLE  STEM DL 000000   LAWD-OW-I1-025      INELASTIC  SCATTERING   OF LOM ENENGY   PROTONS  FROW 5105-20.0
    FOG  TETONMINATION    OF LIPO PROTEINS   OF OLOOD  SERUM   NY       LARD-RN-I 1-021W    005-3!   IF. GAMMA! SALFUO LOW 150051 RESONOSCES    ES  000 0009000
RD  FOR  DOTERMINAT ION   OF LIFT PROTEINS   OF OLOOD  SERUM.--  MOTH   LAND-NM-I 1-0210     GLANDS  = EOTNACTIDN   OF LOW  MOLECULAR   WEIGHT 0001110  TROOHIS
ISO  ONSERUOL 101 OSANOL ITT FROTEINS.=                H  AND  ROTH ION P91W-NI I 1-0579    ID FROM  C.TISOLGTION   OF LOW  MOOECALOM   WEIGHT RIND   NUCLEIC AC
   ACTIDIIY   OF  ADIPONIN.  LIPOCAINE   AND FOOLOCOIN  IN  THEIR       PEGT-00-0A-037      RIZOTITS OF   00010051  AT LOW TRESSURIS   .0    METHOD   FOR ODLIME
1000000   NT  0100W!    0 ON LIPOIOS   090 OLOOD  COAGULANILITY   IN                           EORTEOASACOOSI       OF LOW  MIS! STANCE OF   100 NEMOOWN  AND
GOLD   SENSITIZAI   ITS OFALITFOAN     ORALS ION.    PROfiLER  OF TOE   ZNFF-0007-NNRS      N  THE' U ENFLAESCE   OF  ROOM  SODIUM  DIET  ON TYSON IC 1005015   1
 NCR   ROOD TO FOR   STORING LIGUEFIED   GASES.                         ENE~TOI5-O997       OELINOS  WITH  CGOSIICULORTEMPOAOTUNIAGGOONIRATITS            DI SEP
TYL  ETHYL  OCTANE   IN  THE LINA I N AND GAS PHASES.        +01   WOO  ENET-0020-ORGO       050  0  001009  FROM  THE LOW  TEMPERATURE   NUITOIEON   OF NIONIUM  FOWl-ON) 0-0750
     INFRARED    SPECTRA  OF LIQUID  ANT  SOLID CANNON  MON  00101.                         EFORWCOALUMI0NATOMC     OF LOW  TOMFENATAMOTRONNFOOWOTIONS     IN N   NRNN-0107-ONWO
TOE  CASE  OF  STIRRING   OF LIGAI DANOSOL ID   FRASES.OIACT ION   IN                          OF LISbO   FOLIRCRSOTOOWTEWTERODUWES.         TINMADION  STEETWA   WC9J-N03~2NA0
ITT  OF  NEGOTITE    IONS IN LIQUID  ARGON.  0000005.  OENON.=AMOMIL                        0010  TOLONCE FOR  USC  AT LOW  TEMOERATARES.             0001 MANN
  EOPCRIRENTSWITOGOS-        LIQUID  NUNMLORS.=                                              ON ODMIATARE   NUCLEI  AT LOW  TORPIMATAMES. =MOSSROAEO      EFFECT  JUPS- 00)7-1801
C  GCIOS-TOEIR    FNEPGRATOLIGU ID   C-IN  SOTARAOEDWRNDCAMRTOYLI                           NOATIOS  I NMONSISI AM  AT LOW  TIMPOROTURES.0    ULTRA   SONIC OTTO  JCPS-0037-2G96
0000010   CONOUCOISITY    OF LIQUID  CANRO~NI  COOL   ALLOYS.=E AND I                       TIDLISIS  OF  5-010050  AT LOW  TENFORATAMIS. 0001001 IONS    IN  AG
         NOSIER  IN  LIDUIT- LIQUID  CONOMATDGMOOHY.R   SEPARATION                             0100101  INCOOSEONS  EN LOR-COONOS   OIGALCHADRIUR 90110.0
 ELECOMOROTITE      FORCE OF LIGGI TEOUFLES .=                 TOENMO                                    REFINED 1000  LOR-CONCENIROT ION    ORES OOSTOISING      CLCH-0O00-0616
AS  CANNON  WLACE. U         LIQUI N CRUDE  FOR OWODACTION   OF ORSON                       IPITOTENOESTEWGT ITS    OF OOM-OENSEOYO    IFO 0000115   100050 PROC  JCPS-003?-ZS?I
              TI 9009101  OF LINAID  TOUTERTOOTHANE.                                        OF NEGOTIVE   VYDROGENHLOM-1NOV01       COLLISION  CROSS SECTIONS     JCPS-0037-2097
TURING   101  0100190 WITH   LINA IT TI  TOLYL METHANE.                                              OF  000100009  MI 000-051001   OLICIMON   IMPACT SFECTROSC   0000-OIZN-2352
O  EFISSION   OF  METALS  DO LIQA IT DIELEETMICS.                FOOT                        001001  TISTOIWOTION   EN LOM-INERGY   ELECTRON- PHOTON SHOW IRS     JCFS-0037-2?2?
ICICLE   PROCESS.    SOLID-, LIQUID  EOUILIRMIUM   OF  CW-AMOMATICS.=                       000000   OF ESOIAM.        LOM-F01001N010ODI1C10I000TIE50050          CROW-00EO-OOMR
 OF  TOE  LORWOR FOIST    OF LIOUI N HELIUM  I N THIN  FILMS  AND                           MIOSIC   CONOE0TEMSITTDLOO-FNNOUESCI        OSCILLATIONS  IN  A THEN  NCNJ-003~Z0GS
         SF00111  CHEAT   OF LIQUID  OELIAM-3.=                                             GONIC  COW FOUNT S ASINOOLOM-LETCO    SEAT RON   SOURCE.    0 IN  ON
FRESSORE   OF  OEL~UW-3   IN 01001 THCL1O~N.      RIOT PROPOSALS  FOR   PORT-NI    -lOOT       TEOlONOLISIS   RATES TI LOW-MOLECALAR-RII    GOT ALEONESOLFONIL
ATARI    050 FOES  NOFLON OF LIQUID  HOLIURIIII   UNDER LONOF  TEMPER                        NINNITE.0        FOSS) 001 LOM-PWESSURO   FOLYRORFOESM   I SLEOHEOW
OS  IN   TOO WADI OLYSIS  OF LINUID HYDMOCANWONS.      S RADICAL  YIEL   IJAR-ONI 3-0093     OF 0100050+0    OS OAFTIOLOW~TEMPEOATUMN     00100111 C  TREATMENT.
ONTENSAT  I ON AT   TOE GAS- LIQUID  INTERFACE.=                FOLIO                          0110  DI COLOR) DES FOR LOW-TEMPIROTONE    TEWOUISO   OF OILS..
           OF  OYDROGEN   IN LINAIT  IRON WELT    TOE  MOILING POINT.   DOSE-O!N7-R6~W                                 OOW-OEMPEMOTANE    POOIMENEZATION  OF  ND
NODE   FTONPOORIZ=TION    OF LIQUID  IRON.   EFFECT   OF PHONFOORUS  0  SOTG-001A-031E      I OFOLIAM   IN TOINFIOMTLOWEOING      DI  TOE LAMOTA 00150   OF OlGA
EACOITITY     OF  001005  IN LIQUID  I NSO.=OOFTODNFODMUS ON        OH  SRTA-RT10-0316      0.7-At   REOTIL-0-RIWEDYOOAMOTINE0NDEM      ANAEMONIC    CONDITION.
AS.  WYALANINOTHEMWY      OF LEGAl TRANGANOUSSLAGS .=TFTOSTOOM                                    OS COFTEOIIT   OUIDEOORINESCCNCE     050 OOECTOOCONDUCOIVIOY
          FARIFICATION    OF LIQUID  FANAFFINS    WITH 51000  ETHANE.=   0110-07- 12-ROE    S  TOE  CASO OF  0  00010  LOMINISCENCE    ANT  VONIOUS  OHENDRENO  I
     COROLTATE    1111  ION. LIQUID PROSE   OYONDOONOOION AND 0000W      JElL-NON 1-0000    HI INTOSSITI   OF  ELECTR TOORINENCENCE    CELLS.     TOFOTEL tO
NSOITTMLTALLICSOLTULIQU IT P0050            TOITATION  OF   OYTNOCAMWO   TOSH-00N7-0573     00100   100101-  +   FTDTOOORINISCENEIIOCITAT I     ON SF11100 OF   S
009000   CATALYSTS   ON  THE LIQO ID PHASE  URINATION OF    0-NYLENI.    TESH~0NS7-OS73                            TOY LOMESESCESCO    FROM COTTONTERTILIS.-
  STATE  OF  THE   +0000 ANT LIQO IN PHONES  IN   PRODUCTS OF  THE       UFZH-0007-1 136       DCCUNOENCEOFEOECTROLURINESCENCE         IN ZINC  SULFIDE  915001
         ELECTRIC   STUDY OF LIQAI  TSONICONOACTON    SOLUTIONS  OF      JCFS-0037-20??     F  + 500000  00505 OF  TOE LUMINESCENCE    OF 000000 0000101  050   0
  NITTOUD  CHANGING     TOE IR LIOUI 091010 CDMOOSITION.=                MIOF-ONOP-O?25     SOOIOF   100101-  OO-NOIOOMINESCENCE       DI ORISOALLO   P00500009
 101 OF  TELLURIUM    IN THE LIQUID  50000.0                      DONS  COME-0255-3006      OF +01005  ON  TOE  101000 OAMINCSCEGCC    OF ERRAOEATED POLl         FOLA-0271-0170
50100    01N00T0101   IN THE 010010  51001.0         U OF THE  ALLOY  I FONT-RN! G-07R7     LONE  090 OOOEROTOORWOLOWINLSCENCE         OF IRNOTIODED POLIETOl     ITVT-0ROS-3630
 OIL POLNYL   NET   00101 IN 010010  SULFUR  DI   OOIDE.=TOF  CICLO NE   WCSJ-RN3~ 1006     1  OF DEFECTS   IN EUCITON LANISESCENCI    OF WOLECOLOR   00151+05.   JCFS-003?-2VI 3
ROLl    APOL lED TOOTS  010010010 SURFACE-ACTITE       METAL  =001 LOC  FMMT-O010-0757          FULOOEZATIUN   OF  1+1 LONISESCESCE    OF
   TRANSFER   MEIMEEN   GAS- LIQUID  SYSTEMS   AND THE TEAT   00000500   2FNO-0T3~2S7R      IAN S TEODINGAISOINO   TOO LOW) 51901501   DI 215090011 UELAMINOF
         000010 TIES OF  TOE LIQUID  SYSTEMS   ARGON-METHANE   AND       FHYS-002W-II9I     0015100 S.DFHOTO   ELECTROLORINESCCSCE     OF ZINC  SULFIDE  SINGLE   AFA~0OI0-0IIS
         O  SYSTEM LIQUID-   LIQUID  RIOT   HA MIDAS CONCOSTNAO IONS     ZONO-0035-2020     CRYSTALS.          IOEOTNOLOMI51NCESCE     OF ZINC  SOCIETE  SINGLE   RCSJ-0N3~2OSR
LORNOOTROSS       I 50010W!  OlGA ID.             TN  5CR001MINO OF   N  NUPH-O0G~OT3R        FTOROOC.0          CHORE LUMINISCISCI    OF 2.3.4.9-10000   000510

                                             Figure         Z.     Sa~p1e Page1                Standard IBM Format
                                                                                         4Z

NSE   OF THE  EAT  TO TOTAL
ORTALESEENSIS"     HENSELAP
 COUCH   TECHNIBURI   WHOLE
RATS   UNDER  COLD  STERNAl
CYLAURS   UN  ELEVATION   OF
HIP   TB RLOO~   PEESSURRI
ONMENTAL    TEMPERATURE   OR
REREITI   ENVIRONMENT    ANE
RLAENOPTILUS-NUTTALLIII
ANBES  AFTER   EBEACISE   IN
ECUTANROUS,    MUSCLE,   AND

TRIN   AND  AN INCREASE   IN
ATIONS   BETWEEN   SOUL  AND
VIBRATION    ON  THE ANIMAL
NETWORK   OF  THE  VITREOUS
E VIRUS   INTO   THE ANIMAL
S  IN  VIROIN  AND  DRAINED
 THE   TAREBACUM   PLOER  OF
TAETUM-SCHULTZ     FOUND  IN
F AUTOARNOUS     FROZEN  AND
E NETHE   B OREL"   CAMFINE
STA   RENORS  OF CHILE   AND
MANCUALE    PLANT  FLORA  OF
B BY   ATOMIC  OR  HYOROORN
CROAK    OF CERCOSPORRE   OF
CIRN   OF ALTERNARIR   FROM
         ERRANT  CANCER   IN
ONS   ON THE  NUTRITION   OF
BACCO    MOSAIC  VIRUS.  THE
ETERMINATION     OF PEPTIOR
BONE   FROM  HETEROGENEOUS
O  THERAPYI   RADIULOBICAL
AND   TO THE  INCIDENCE   OF
ULPHRTRMIA    THE  CAUSE  OF
NOICATIONS    AND  REAULTAI
ZEN   AND BOILED   CYLINDER
K RUNE   TO  CULTURED  CALF
NE  FEVER   VIRUS  IN S~INR
ROHO   PHOSPHBTR-F"32"    IN
INO   AND OF  INJECTION   OF
LENTATION    OF  HOMOLOGOUS
RATION   OF  THE THEORY   OF
S.  ABSORBED   DONE  TO  THE
UN  OF   STORED  AUTOLTGUUN
F  THE   BLOOD PICTURE   AND
   IMMUNITY   RESPONSE   AND
   IMMUNITY   RESPONSE   AND
*  IMMUNITY   RESPONSE   AND
*  IMMUNITY   RESPONSE   AND
TE  ANTIEBOIRS   FULLOWIND
UNDAMENTAL    SUBSTANCE   OF
NYALLY   INJURED   ALVEOLAR
ERALIZATION    IN  ERCHITIC
ETAROLIAM    OF  GLUCOSE  RU
 OSTEOMA    OF THE  FRONTAL
NCY   DURING  LACTATION   ON
CONTENT   OF  HUMAN  FINDER
 MARULANDI    THE  ATLANTIC
 BLOB    PLUMARIA-ELEORNA"
TO  GENESIS   UP SCALES   IN
B  RELATIONS   BETWEEN   THE
 OF   THE FEATURES   OF  THE
BIRD   AND  THE  ARO-FOBTED
I  ANTIGENIC   RESPONSE   TO
MINIMAL   SENSITIZING    AND
OPLESMIN.    THE EFFECT   OF
AGNOSTIC    AND  PATHOGENIC
 PLANTS   UN  THE  NORTHERN
SENSITIZINO    ACTIVITT   OF
HE  CATALASE   ACTIWBEY   OF
   ARNOFLIES   AND  ARNOFLY
  IN   THE STUDY OF  TARTAR
O  MANAGEMENT    PRACTICESI
U  MATTER   PRODUCTION   AND
               INDO  SOVIET

OLTONII,    NEW  SPECIES  OP
ORRENCE   OF  THE  NOOTHERN
NURININO    THE  BORLIUT  OF
  THE  BLOOD  SERUM  DURING
N  CRERAGEI    ISOLATION  OF
ACID"    EDUA"l  REMOVAL  OF
AJA-LINTEA-FRIES     AU  THE
OF  A GLYCO   PROTEIN   FROM
HUMAN TORERCOLDAIS      FROM
  ANAPLASMA-MARGINALE     IN
DAIS   AND  PROPHYLABIS   OF
              ESPERIMENTAL
EVATIONS    ON IMMUNITY   TO
  ANIMALS   NEOTRALISING    A
IC  RELATIONSHIP    RETWERN
 IDNI  FURTHER   STUDIES  OF
NIB   VIRUS  PEOPAGATRO   IN
RITOL,   A  CONSTITUENT   OF
ART    CHARACTERIZATION   OF
            GYI  INFECTIOUS
-MOUTH   DISEASE   VIRUS  IN
OBSTRATE    UTILIZATION   IN
-MOUTH DISEASE     VIRUS  IN
TYIC   TEST  IN  CANINE  AND
NCR    AND  DISTRIBUTION  OF
  STATISTICAL    STUDIES  ON
       SWEDISH   STUDIES  ON
    MICHIBAN.    PATHOLOOTI
             BIOPSY  OF  THE
       EXPERIMENTAL   VIRAL
 TION  AGAINST   CONTROIDOS
RDWTH    OF RR.-ARDRUOS   IN
ED  EFFECT   OF  INFECTIOUS
  VIRUSES   AND  INFECTIOUS
FECTION     WITH INFECTIOUS
   IDNI  PRECIPITATION    OF
U  SUESTANCES    PRESENT  IN
MISSION     AND ETIOLOGY  OF
APHYLOCOCCII     STUDIES  UN
CARBONIC    ANHYDRASE   IN  A
MIND   ACID  ANALYSIS   OF  A
 OW FOE  FERUHET   CULTURED
RENTIRTION    OF   HUMAN AND

      BODY

BUOY  IR RADIATION~     EFFECT  OF THE  DES      4427
BOOT  SIZE   AND TEMPERATURE    SENSITIVIT       4332
BUOY  SUPERFICIAL    IR  RADIATION   WITH  S     4390
ROUT  TEMPERATURE    AND  WORK  DECREMENT        4335
BUOY  TEMPERATURE    DURING  EXERCISEI   EF      EUSA
RUBY  TEMPERATURE    IN  PACIFIC  ISLANDER       7242
BUOY  TEMPEBATURE    OF  RARRITI  ENVIRONM       6343
BUOY  TEMPERATURE.    INFLUENCE   OF  ENHIR      4343
BOOT  TEMPERATURE,   OBYGEN    CONSUMPTION       4305
BOUT  TEMPCRATURES   AND   HEART  RATES  OF      4325
BODY  TEMPERATURES    IN  ANESTHETIZED   MA      6341
BODY  WATER   AND  HEAT  POLTPNEA  IN  DUOS      E327
BODY  WEIGHTI   CHUNGES   IN SPIDER   WEBS       E492
RUDY.  ITS   PLACE  IN  PSYCHULDOICAL   AND      4073
VOOTI  DADA   ON THE CUMBINCO    EFFECT  OF      4451
EDDYI  EAPERIMENTAL     RESEARCHES   ON THE      N941
BUOTI  THE   PATHOGENESIS   OF  HOG  CHOLER      7341
EDOSI  OESERVATIONS     CONCERNING   THE MI      7563
VUHOSLANI                                        74NE
ROHUSLAN,    WESTERN  SWEDEN.   SOME  NOTES      7644
BUlLED  CYLINDER    BONE  GRAFT  REPLACEME       4407
BOLGE"I    PALYNOLOGIC   RESEARCH  IN  THE       7E7B
BOLIVIA.   DIATOMS"  BACILLARIOPHYCEAR"          TARE
RULSHUI    LTAKHUV  INLAND  NOVOSIBIRAKI         7454
RGMR  EAPLOSION.    EBOID-CHEMICAL    ANALT      TAUT
BOMEAT  STATRI   CBNTRIAOTIONS    TO  OUR  K     TS9R
BUMRAY-MAHARASHTBAI      A NEW  APE              7604
BOMBATI                                          7100
BOMRYCILLA-AARAALUS      IN CAPTIVITY'   DR      ESEB
BONDS  BETWEEN   PROTEIN   SUBUNIYSI   ACTI      BASS
RONOTI  THE   BIURET  REACTION.   CHANGES        4124
BONE  BANE   IN THE  DIAPHYSEAL   OSTEOSYN       SAVE
BONE  CHANGES   IN  CUNHINGS   SYNDROME   AN     5093
BONE  DISEASRI   METABOLIC    STUDIES  IN  A     5097
BONE  GYSIRUPHIES    IN  CHRONIC  RENAL   BE     SEAN
BONE  FROM   HETEROGENEOUS    RUNE RANK   IN     ABBE
BONE  GRAFT    REPLACEMENT  IN  FEMURAL   DR     44E7
BONE  IMPLBNTATIGN    IN  DOGS,  THE  VESPO      5E94
RUNE  MARROW   AND  EUFFY  COAT  CALOURESI       1419
RUNE  MARRoW   CELLS  IN  VITRO.  EFFECT   U     4433
RUNE  MARROW   CELLS  ON  THE  EFFICIENCY        4444
BONE  MARROW   DURING   ACUTE  RADIATION   S     4420
RUNE  MARROW   GRAFTING   AS TREATMENT    OF     4470
RUNE  MARROW   IN  THE  RAT AND  THE  MOOSE      4414
RUNE  MARROW   IN  THE  TREATMENT  UP  ADBA      4479
BONE  MARROW   OF  ALBINO  RATS  UNDER  THE      SETE
HONE  MARROW   REPLACEMENT.    B SYMPOSIUM       4479
BONE  MARROW   REPLACEMENT.    B SYMPOSIUM       4470
BONE  MARROW   REPLACEMENT.    A SYMPOSIUM       4465
BONE  MARROW   REPLACEMENT.    A SYMPOSIUM       4431
BONE  MARROW   TRANSPLANTATION    ANBEB   CO     EASE
RUNE  MARROWI   EAPERIMENTAL     INVESTIGAT      695B
BONE  TO   CULTURED  CALF  BONE  IMPLANUBY       5094
BONE.  ALPHA   RADIOGRAPHIC    AND MICRO   H     5902
VUNEI  AERORIC    M                              5079
AUNEI  USTEDIT                                   5092
BONES  ANO    TEETH OF  RBTS~  EFFECT  OF  T     5904
BONESI   THICKNESS   OF   THE CORTICAL  LAY      SETS
BONITO,    SARDA-SARDA,   IN  NORTHERN  CHE      4647
BONNEM"    SCHMI  THE EFFECT   OF LIAHY   ON     7544
RUNT  FISHI    THE ON                            ESOB
AUNT  LABYRINTH    AND  THE CAUDAL   CRANID      4495
AUNT  OREITI   A  STMPLE  DEMONSTRATION          4499
ROURTI   TEMPERATURE    REGOLATION    IN THE     4325
BOOSTER    DOSE OF  DIPHTHERIA   AND  TETAN      7073
ROOSTER    OUSES OF  THE  TISSUE  ARD  NERO      EROS
BORATE   ION   ON THE UXIDASE   ACTIVITY   0     4542
BORDERLINES    RETWEEN   HYPER  DENSIVE   DI     SAAB
BORDERS    OF  THE SAHARAI  WATER  ECONOMY       7707
EORBETELLA-PERTUSSISI      A  NEW METHOD   F     4575
BURDETELLA-PERTUGSINI      SOME  NOTES  ON       4449
VURNE  DISRASESI                                 7131
BORNE  DISEASESI    RECENT  ADVANCES             7144
BOTANICAL    COMPOSITION   OF  PRAIRIE   VEA     4550
BOTANICAL    COMPUSITIONI   EFFECTIVENESS        7909
BOTANICAL    ERPEDITIONI                         4203
BOTANICAL    NOTESI                              TAUT
BOTHIDAR   IN  THE  MEDITEERANEANI    ARNOD      B520
BOTTLE-NOSED    WHALE.   HYPEROODON-PLANI        5562
BOTTLED    MINERAL  WATEAS/   METHODS  FOR       7552
EDUILLAUDS     DINERSE  AND  IN NORMAL   INO     49DB
BOUND  ASCOERIC    ACID"  ASCURRIGEN    PRO      0115
BOUND  NUCLEOTIDE    AND  CALCIUM  OF  0-  A     4R24
BOUNDARY   RETWEEN   THE  NORWEGIAN   AND  U     0555
BOVINE   ADETAI   ISOLATION                      NT'S
BOVINE   BACILLI."   ITS  RELATIVE    FARBUE     4909
EOVTNE   RLUOD  PLATELETBI    STUDIES  IN  A     5291
BOVINE   REUCELLOSIS    IN THE  DEPARTMENT       7370
BOVINE   COCCIDIOIAOMYCOSIS~                     7417
BOVINE   CUTANEOUS   PAPILLOMAUOSI~~     FUR     7442
BOVINE   ENTERO   VIRUSI  A  SURSTANCE   IN      4532
BOVINE   ENTERO   VIRUSES  AND   INFECTIOUS      7431
BOVINE   ENTEROVIRUSES.    TENTATIVE   ACHE      7266
BOVINE   EPIDEEMAL   CELLS/   ANTIORNICITY       7444
BOVINE   PORTAL   FLUIDS  WHICH  STIMULATE       7452
BOVINE   GASTEINI   PREPARATION,   ASSAY,        SiTS
BOVINE   KERETO   CONJUNCTIVITIS.     ETIOLO     7391
BOVINE   KIDNEY   CELL  SUSPENSIUNSI   BROW      74S1
BOVINE   KIDNEY   CULTURE  CELLS  INFECTED       4909
BOVINE   KIDNEYS   AND  BLOOD  AS RELATED        7392
BOVINE   LEFTUSPIRONISI    EVALUATION    OF      TUNA
BOVINE   LEUKUSIS    IN SWEORNI  STUDIES   U     7443
BOVINE   LEUKOSISI                               73EV
BOVINE   LEUKUSISI                               73B4
BOVINE   MALIDNANT   CATAREHAL   FEVER   IN      7279
BOVINE   MAMMARY   OLANDI                        T2RB
BOVINE   MASTITISI                               1344
BOVINE   PEEl  PNEUMONIAI    NOTE ON  INTER      7445
BOVINE   PHAAOCYTES~    THE CHEMICAL   RASI      7452
BOVINE   RHINO  TRACHEITIA    VIRUS   AND PA     734B
BOVINE   RHINO  URACHEITIS    VIRUSI  SEROL      7431
BOVINE   RHINO  URACHEITIS    VIRUSI  THE  R     7337
BOVINE   SERUM   ALBUMIN  BY  THIOCYANATE        4791
BOVINE   SERUM  FOR  FRESHLY   CULTURED   RD     1441
BOVINE   SHIPPIND   FEVER'   STUDIES  ON  TV     TUAT
BOVINE   STAPHYLUCOCCAL    MASUITIS   1.  CM     7413
BOVINE   SURMABILLAET     GLAND  EBURACTI        5913
BOVINE   SURMADILLARY     MUCOIDI BUANUITA       5912
BOVINE   TUREVCLE    RACILLII  STUDIES   OF      7441
BOVINE   TUVEECLE   BACTERIAl   NEW   METHOD     4944

SERUMS   PEON  INTRADEEMAL
OS,   RESULTS OBTAINED   IN
FERENCE   TO  STRAINS   FROM
CCI   ASSOCIATED   WITH  THE
DOERS   ISOLATED   FROM  THE
CHARACTERISTICS     OF  SOME
THE   MECONIUM  WITHIN   THE
ATIVE   STOOTI  METHODS  OF
R WOOD   USED  FOE  STORAGE
OR   OF SEVERELY   RETARDED
NO   MASCULINITY   IN TOUNO
VERY   OF THE  VICINITY  OF
TIMOLATES    THE GROWTH  OF
EMETUM   MELIANTHEMETOSOM
 DISEASEBI    ORLITERATIVE
CHRNG,-1941"    TREMATUOR.
S AND   EVOKED  ELECTRICAL
 BEHAVIORAL    EFFECTS   AND
URIC   ACID"  GARB"  IN  THE
 LIPID   BID  SYNTHESIS   IN
 OP   NOR MORPHINE   IN  RAT
CONDITIONS    OF THE  BLOOD
l  THE  INHIBITION   OF  RAT
N OF   SUBSYRATE-SPECIFIC
E MORPHOGENIC     ACTION OF
F  P  SUBSTANCE   AND OTHER
STEERSE   ACTIVITY   IN  EAT
SEA   FOLLOWINO  AELECTIVE
 ON   THE  LOCALIZATION  OF
TATUS   OF  SEROTONIN   AS  A
STUDIES    ON ACI~SDLUBLE
 AND   LACTIC  ACID  IN  THE
ACID   COMPOSITION   OF  THE
ND   AND OF  KIDNEY  DURING
-PHOSPHATE    LEVEL  OF  EAT
ICOLAE-FbRMATION     OF  THE
MENTAL   ABSCESSES   OF  THE
LIOSIDE    IN MATURING   EAT
OS   IMPLANTED  IN  THE  EAT
VOGEN   METABOLISM   OF  THE
OLLOWINO    LESIONS  OF  THE
ONDING   FRETS  OF  RARRITI
W  NEURONS   FOAMED  IN  THE
VERAL   ELECTRODES   IN  THE
 THE   PRESENCE   OF BUNDLE
      REVERSION   OF BUNDLE
El   COMPLETE  LEFT  BUNDLE
         BILATERAL   BUNDLE
IC   STUDY  OF LEFT  BUNDLE
K  BLOCK   AND LEFT  BUNDLE
OF   COMPLETE  LEFT  BUNDLE
 SUBJECTS.    EIGHT  BUNDLE
C  SOEJECTS.   LEFT  BUNDLE
MENTAL   BILATERAL   BUNDLE
 OF    INTERMITTENT  BUNDLE
   COMPLETE   RIOHY  BUNDLE
ROIDOKAM    IN LEFT  BUNDLE
  INCOMPLETE   LEFT  BUNDLE
SYNTHESIS    OF NOVIUSE,    A
BETWEEN    UNSATOEBTED   AND
E  METABOLIC   FUNCTION   OF
PORT   ON  FLOOKIOBTION   IN
-1595"-DUWSDN,-1939,      IN
PANESE   PEOPLE   LIVING  IN
PLASMOSIS     IN SA~FAULD,
F  THE  FLUKE  OF  S"UTHERN
WATER   RELATIONS   OF  SOME
~DOKEl.     ISOLATION   FROM
INO    SPOIL AND  MAY  19441

IC   LESIONS  IN  THE  BROAD
                        ISRI
OF   EXERCISE  END  O"2"  ON
CRERTINE    TREATMENT   UPON
KIN    OF THE COMMON   SOLEI
GITAL   PEESSUKE   AND  DEEP
            EFFECT  OF  0"2"
  BYSTEMEC   EFFECTS   AFTER
URONG   POSITIVE   PRESSURE
P  AS  RELATED   TO SEASON,
  THE  DISPEESION   AND  THE
           LEAST  TERN'  THE
BATIONSOF     THE CHOICE  OF
SE   FREE"  PATHOGEN   FREER
LICATION    OF GENETICS   TO
CAL    PROBLEMS  IN LUCERNE
K  HYBRID   FORAGE  SORGHUM
        FLORIDRI   AUTUMNAL
TAMIC   ACID  FORMATION   IN
CAL   COMPOSITION   OF  SAKE
DUPINGI    STUDIES  ON  SAKE
  WATERI   STUDIES  ON  SAKE
MONO   COMPONENTS   OF  SAKE
CE   BY ELECTRONIC   MEANSI
  THE  CURINE  PROCESS   FOR
K  RESPONSES   IN  A SIMPLE
     A DEVICE  FOR  FERDINO
OF   PLANT  PHYSIOLDOISTS,
OF   PLANT  PHYSIOLOGISTS,
OF   PLANT  PHYSIDLOGISTS,
ULE    WITH HIGH  MOUNTAIND
     THE GENUS  ASELLOS   IN
CIES   OP  LITEBISID NEW  TO
N  POTATO   CRD"S  IN  OREAT
  MAN-MADE    ACTIVITIES  IN
IZATION    IN THE  HANDS  OP
  IN   THE WEST  INDIES  AND
BIOLOGICAL FLORA      OF THE
RIOLDAICAL    FLORA  OF  THE
            ABERRATIONS   OF
HOlES,    THE GUIAMAS,   AND
YTILUS-EDULIS-L.      IN THE
CLERDUIC    LESIONS   IN THE
  OF   THE DISTRIBUTION   OF
F  ISOLAYED FRACTIONS     OF
RAIN   DIFFERENUIATION    OF
UWO    VARIETIES  OP  AWOOTH
DL   STUDIES  OF  SOME  WEED
  A PROURO LYTIC    ENZUME,
SPECIAL    REFERENCE   TO S-

      BROMO                                      B 15

BOVINE   TUREECULIN    REACTORS  AND  NONTO      7490
BOVINE   TUBERCULOSIS    WITH  AN  ANTIRIOT      7499
BOVINE   UDDER.   PATHUGENICITYI   STUDIES       7410
BOVINE   UBTERI   A STUDY  OF  THE SUAPHYL       7441
BOVINE   UDUERI   STAPHYLOCOCCIC   PHASES.       7346
BOVINE   VIERIUSI   RIO  CHEMICAL  ANA  CDL      7430
BOWEL   OF  THE NEWEORNI   CALCIFICATION         4459
BOWEL   PERPARATION    POE SIAMUIDOSCOPT.        S234
BOTESI   WASUADE   OF  APPLES  IN  RELATION      5154
ROYAl   A MULTIDIMENSIONAL     STUDY  OF  TM     4107
ROYAl   PARENTS   SELF-REPORTS,    CHILDREN      6095
BOZENI   CONTRIBUTION    TO THE  FLORISTIC       7471
ER.-ARURTUS    IN  BOVINE  PHAGOCTURSI    TV     74S2
BR.-EL.   ARTE  OF  THE  ARA-LANGOEDOC"    B     4S40
BRACHIOCEPHALIC     ARTERITIS"   POLSELESA       5591
AEACHTCBELIIDRRAI      STUDIES  ON THE  MOM      0323
BRAIN   ACUIVIUTI   THE  EFFECT  OF  2 METH      42S4
BRAIN   AMINE  CONTENT   IN RAUSI                EISS
BRAIN   AND  INTERNAL   ORGANS  OF WICRI   I     4902
BRAIN   AND LIVERI   A  COMPARATiVE   EVALO      S027
BRAIN   AND  LIVERI  THE  METHYLATION            4157
BRAIN   AND OTHER   BLOOD-  TISSUE   BAERIE      4514
BRAIN   CHULIN  ESUREASE   AFTER   ADMINIAT      4216
BRAIN   ESIRRASEA   BY  STARCH  GEL  ELECER      4839
BRAIN   EATEACT   ON THE  IN-VITRO   COLTUR      4441
BRAIN   EXTRACTS   ON  THE CENTRAL   NEEVOD      6177
BRAIN   HDMDBENAUESI    THE IMPORTANCE    OF     4072
BRAIN   LESIONS   `N 00051  UISBNHIEITION        5992
BRAIN   LESIONS   WITH   I.53G"-LABELLEO   P     4057
BRAIN   NEDEB  HORMONE   AND  IN ACTION   OF     4145
BRAIN   NOCLEOTIDES    AND INCORPORATION         4972
BRAIN   OF  THE  EAT DURING   ONTOGENTI   TM     4978
BRAIN   OF  YOUNG  AND  OLD CHICKENSI   EFF      7290
BRAIN   OPERATIONS   UNDER  PHYSICAL   HUED      4019
BRAIN.   AN  IMPROVED   EBTEACTION   TECHNI      4234
VERIN-STEMI    A  NEW  TYPE OF  CELL  IN  TM     S9SS
ERAINI   B  METHOD  OF  DETAINING   RAPERI       4054
BRAINI   BANG                                    4990
REBINI   GONADOTEOPIC    ACTIVITY   OF  NEON     5842
BRAINI   NIT                                     EVES
VERINI   RENAL   TUBULAR  NECROSIS   F           5724
BRAINI   TWO  TYPES  OF  PATTERN   OF HIPPO      4037
BRAINS   OF  ADULT  MAMMALSI   ARE  NE           S973
BRAINS   OF  ALBINO  ERUSI  A  METHOD   FOR      4910
ERANCH   BLOCK   PATTERNS.  RN  EAPREIMENT       5400
BRANCH   BLOCK   WITH  STEROIB  THERAPTI         5490
BRANCH   BLOCK.   B PHYSIULOBIC    FATHOLUG      5449
BRANCH   BLOCKI                                  SSSU
BRANCH   BLOCKI   A RALLISTO   CARDIOGRAPH       5479
BRANCH   BLUCKI   A-V  DISSOCIATION   WITH       5349
BRANCH   BLUCKI   ELECTED  CARDIUGEAPHIC         S333
ERANCH   ELOCKI   ELECTED  CARDIOGEAPHIC         7098
BRANCH   ELUCKI   ELECTED  CARDIDGEAPHIC         7102
BRANCH   BLUCKI   BAPERI                         5261
BRANCH   BLUCKI   MECHANISMS   INFLOENCIND       SSES
BRANCH   BLOCKI   PATHOLOGY   OF THE  CONDO      5450
ERANCH   BLOCKI   THE  VECTOR  CA                5443
BRANCH   ELOCKI   THE  VECTOR  CARDIOGRAM        5512
BRANCHED    CHAIN  MONO  SACCHARIDRI    THE      4S94
BRANCHED    FATTY  ACID  ISOMERS   BY GAS  C     4747
VEANCHED-CHAIN     VOLATILE   FATTY  ACIDS.      5174
ERANDUN,    MANITURAI   DENTAL  EFFECTS   OF     5910
ARASSICA    SEBDI  A METHOD   FOR  THE  ORTE     AlSO
BRAZILI   GASTRIC   CANCER  IN  JR               7113
BEAZILI   ORSERYATIONS    ON  CANINE   TOAD      5209
BRAZILI   ORIGINS   U                            4577
BRAZILIAN    VEDEURTION   TYPES.   WITH APR      4553
BRAZILIAR    WILD  RODENYSI   MICRUSPORUM        7133
BREAM    TAGGINO  EAPERIMENUS   IN  RANT  DI     4609
BREAST   CANCER   IN ROMBATI                     7100
BREASTED    BRONZE  TORKETI   THE  INFLORNC      7310
BREATH   HALOINO   AT  AEGINNINE   OF EBEEC      5742
ERRATH   MOLGINGI   INFLUENCE                    STEB
BREATHING    ENERGETIC   OUTPUT  AND  ARBOR      4984
BREATHING    MOVEMENTS   IN ENUDROELLA-SO        8324
BREATHING    ON  PATIENTS  WITH  ADAMS  lTD      S522
BREATHING    ON  PULMONARY  COMPLIANCRI          5745
BEERUHINA    POTENT  MEDICATED   AREOSOLSI       5754
BREAUMINGI    DIAPHRAGM   ACTIVITY   AND  RH     5734
BREED,   SEX,   AND SEMEN  GOALITTI   THE   U    7254
BREEDING    BEHAVIOR   OF THE  RAVEN  WITH       0544
BREEDING    BIOLOGY  AND  ETHOLOGY   OF THE      4S9S
BREEDING    RIOTYPEI   THE STATE   OF DEVEL      4593
BREEDING    COLONTI  FROGEESS   REPORT.   DI     7371
BREEDING    DOMESTIC   ANIMALSI  APP             4544
BREROINO    IN CONNECTION   WITH   FEETILIT      7905
BREEDING    IN  HUNOARTI  THE  PRESENT  PUS      7907
AREEDING    OF BOAT-TAILED    ORACKLEA  IN       8553
AREVIERCTRRIOM-FLRVOMI      SIGNIFICANCE         4497
BREWING   WATER   AND  THEIR  GROOPINGI   ST     5159
BREWING   WATER.   CHEMICAL   COMPOSITION        5159
BREWING   WATER.   RELATIONSHIP    AMONG  CO     5140
BREWING   WATERI   STUDIES  ON  BAKE  BREWI      SlED
RRID~ING    OP  INTERRUPTED   ATEID  VENTRI      5434
BRIGHT-LEAF     UDRACCOI  STEADY-STATE    TM     7848
BRIGHTNESS    DISCRIMINATION    UNDER   01FF     4525
BRINE    SHRIMP  TO FISHESI                      4485
BRISBANE    MAT  ANEBI   LEAF  TEMPERATURE       7716
BRISBANE    MAT  19451   THE CUTICLE   IN EU     7497
BRISBANE    MAT  09611  THE EFFECTS   OF  MO     7703
BRISKET"    DISEASE  AND  IN  EXPERIMENTAL       7274
EEl TRINI                                        8342
BRITRINI    PTLOSIA~ORUOSR-HEREICH-SCHA          8419
BRITAIN.    1952-ADI   EXTENT  OF  PROTECTI      8199
BRITISH   COLOMBIBI    THE EFFECTS   ON FEE      4643
BRITISH   FISH   FILLETERSI   COLD  WASODIL      4334
BRITISH   GOIRNAI   EASTERN   ERUINE  ENCEP      7487
BRITISH     IDLES. RRRHENAUHERUM-ELRTIUS         7482
BRITISH   ISLES.   FRADINOS-EXCELSIDR-LI         7490
BRITISH   LEPIDOPUREAI                           8413
ERITIAH-HDNDURASI      PRESENT  AND  POTENT      7050
REITISH-ISLES     AND  THEIR  RELATIONSHIP       BEER
BROAD    BREASTED   BRONZE TORKETI   THE   IN    7310
BROAD-LEAVED     EVERGREEN  TREES,   BASED       4S44
BROKEN   CMLOEOPLRSUSI    HILL  ACTIVITY   0     7728
EROMEGRASS    MOSAIC   VIRUSI  PORIFICATID       01ST
REOMEDRASSI     EFFECT   OF CERTAIN  FEETIL      7914
RROMEORBSSRSI     LIFE  CYCLES  AND  CONTE       7950
BROMELAINI    SYSTEMIC   RID  CHEMICAL  CHA      6259
EROMO    DRURY ORIDINRI   IONIZATION    OF 0     4204

                        Figure 3.  Sample Page, B. A.S. I. C.
                                        43

       FREQUENCY DOUSLING    IN ANISOTROPIC FERRITES.      I SINGLE
                             MAGNETIC  SPIN PLANES   IN MAGNETITE
  MULTIPLE ThIN DOMAINS      AND  DOMAIN WALLS   IN NICKEL- OXIDE
PARAMAGNETIC    RESONANCE   OF  THE COBALT  ION  IN RUTILE   SINGLE
AGNETIC ANISOTROPY MEASUREMENTS OF        ANNEALED  NICKEL- OXIDE
TUS FOR   MEASURING MAGNETIZATIONS.     APPLICATION TO     A COBALT
ESONANCE   ABSORPTION   OF  DIVALENT  NICKEL  IN CORUNDUM    SINGLE
LL ON SLOW NEUTRON     SCATTERING BY A UNIAXIAL     FERROMAGNETIC
FFECT AND THEORDERING       PROCESS  IN A  NICKELI3)   IRON  SINGLE
        MAGNETIC BEHAVIOR    OF A  TETRADONAL  ANTIFERROMAGNETIC
ISTRIBUTION    OF DISLOCATIONS    OVER THE  CROSS   SECTION  OF THE
RELAXATION OF    TRIVALENT   ERBIUM  IN CADMIUM-    IRDNI2)  SINGLE
EARTH-DOPED    YTTRIUM  IRON GARNET.   I  CONTRIBUTION OF    STATIC
OLYCRYSTALLINE MANGANESE- ZINC-       FERROUS  FE/  PERMEABILITY,
RITE- MAGNETITE     AND MAGNESIUM FERRITE- MAGNETITI       MAGNETIC
ALl.   I LITHIUMIO.5)- ALUMINUMI2.51      OXYGENI4)   I
0.                                                   HYDROTHERMAL
 SOLUTION VANADIU~ OXYGEN(41- CDBALTI2-2X1-           NICKEL 12X)I
C PROPERTLES    OF  POTASSIUM MANGANESEIII)    FLUORIDE.   PART-i.
ICROWAVE   ACOUSTIC  LOSSES   IN  YTTRIUM  IRON GARNET.    I SINGLE
R- CHLORIDE    DIHYDRATE,   COBALT-CHLORIDE   HEXAHYDRATE    SINGLE
IIENTATION AND ON THE METHOD       OF DEMAGNETIZATION    IN  SINGLE
BALANCE   FOR  MEASURING ABSOLUTE    SUSCEPTIBILITIES    OF  SINGLE
ON,  AND  PLASTIC DEFORMATION.     COERCIVITY OF    NICKEL   SINGLE
              SYMMETRY  OF  TRANSITION METAL    IMPURITY   SITES  IN
                   SPECIFIC HEATS OF   SINGLE COPPER-    MANGANESE
                                   GROWTH  OF ALPHA-   IRON  SINGLE
PART-I   A NEW  METHuD  OF  PREPARING  MAGNETITE    SINI GROWTH OF
LI MAGNETIZATION     PROCESS  IN  UNIAXIAL  FERROMAGNETIC    SINGLE
ESE  OXIDE,   ALUMINUM  OXIDE,  MANGANESE   SPINEL  AND MAGNETITE
TIONS.              GROWTH  SEQUENCE  OF  GADOLINIUM-IRON    GARNET
                           FORMATION  OF  MAGNETOPLUMBITE    SINGLE
RESONANCE   TRIVALENT   IRON  AND DIVALENT   MANGANESE   IN  SINGLE
                     MICROWAVE    RESONANCE  LINEWIOTH   IN  SINGLE
IMENSIONS.       DEPENDENCE   OF  THE RESONANCE   FIELD  IN  SINGLE
lOF  TITANIUM ON    THE LOW  TEMPERATURE   TRANSITION   IN NATURAL
RIABLE   WAVELENGTH.                MAGNETIC  ANALYSIS OF    SINGLE
IATION WITH    DEMAI   INITIAL PERMEABILITY OF    SINGLE   AND POLY
                                    MAGNETORESISTANCE    OF  SINGLE
                                                           FERRITE
OPERTIES.                               THERMODYNAMIC    THEORY OF
                                DISLOCATIONS    IN  FERRITE  SINGLE
                            ACOUSTIC  PARAMAGNETIC    RESONANCE   IN
                        PHONON-MAGNON   INTERACTION    IN MAGNETIC
          SYMMETRY   PROPERTIES   OF WAVE  FUNCTIONS   IN MAGNETIC
                           DISORDER  STRUCTURE   IN TERNARY   IONIC
 X-RAY AND MAGNETIC     STUDIES   OF CHROMIUM- OXYGENI2I     SINGLE
     THEORY OF   THE   MAGNETIC SCATTERING OF    SLOW NEUTRONS    IN
                             MAGNETIC  SPIN LEVELS    IN MAGNETITE
             NUCLEAR ORIENTATION    IN ANTIFERROMAGNETIC     SINGLE
 THEORY   OF  NUCLEAR ACOUSTIC    RESONANCE  LINE   SHAPE  IN CUBIC
                           ON MAGNETIC  RESONANCE   SATURATION    IN
 PARAMAGNETIC RESONANCE      OF NICKEL    IONS IN DOUBLE- NITRATE
          ASYMMETRIC   SHAPE  EFFECTS  IN  DIA- AND   PARAMAGNETIC
                     GROWTH  OF YTTRIU~ALUMINUM GARNET       SINGLE
    RESEARCH   AND DEVELOPMENT    OF YTTRIUM   IRON GARNET   SINGLE
                             GROWTH OF REFRACTORY     OXIDE  SINGLE
                            GROWING YTTRIUM    IRON GARNET   SINGLE
IFFUSION OF    IRON  AND CHROMIUM   IN CORUNDUM AND RUBY     SINGLE
 EFFECT   OF  SIXTH  DEGREE  CUBIC FIELD   ON RARE-EARTH   IONS   IN
ALENT CHROMIUM AND     IRON  RELAXATION TIMES    IN RUTILE   SINGLE
WAVES   IN  RHOMBIC  ANTIFERROMAGNETIC AND WEAK      FERROMAGNETIC
C  INTERACTION OF    CERIUM  AND COBALT   IONS  IN  DOUBLE NITRATE
IC DOMAIN PATTERNS ON NICKEL-COBALT        ALLOY AND PURE    COBALT
NEALING EFFECT ON THE      ANISOTROPY OF   COBALT   FERRITE  SINGLE
RESONANCE OF    TRIVALENT    IRON  IONS IN SYNTHETIC   ZINC-  OXIDE
ANCE OF   DIVALENT   MANGANESE  IONS  IN SILVER CHLORIDE     SINGLE
ATTERNS   ON ThO~PHASE    NICKEL- COBALT   ALLOY  AND PURE   COBALT
 OF  TRIVALENT   IRON  IONS  IN SYNTHETIC   CUBIC   ZINC-  SULPHIDE
CTRON NUCLEAR DOUBLE RESONANCE       OF   PARAMAGNETIC DEFECTS    IN
PY OF   THE  FERROMAGNETIC   PRECIPITATE   IN GOLD-NICKEL    SINGLE
UN~STATE     POPULATION CHANGES OF    NEODYMIUM   IN  ETHYLSULFATE
    CREEP   AND BASCULATION EFFECTS     IN IRON- ALUMINUM    SINGLE
I  I               CRYSTALLINE  ELECTRIC   FIELDS   IN SPINEL-TYPE
                       ELASTORESISTANCE    EFFECT   IN IRON  SINGLE
STARK EFFECTS AND SPIN-PHONON       INTERACTION   IN  PARAMAGNETIC
LORIDE FROM    II TO   300K. MAGNETIC OROBRING    IN  LINEAR  CHAIN
SORPTION AND MANGANESE-      MAGNESIUM- COBALT-     FERRITE  SINGLE
 THE   FERRIMAGNETIC RESONANCE     LINEWIOTH   OF LITHIUM FERRITE
TERIAL.    PART-i A  NEW METHOD    OF PREPARING MAGNETITE    SINGLE
 ON THE MAGNETIC     DOMAIN  STRUCTURE    OF IRON-  SILICON  SINGLE
PORATION    OF ALPHA- HEMATITE     INTO MANGANESE   FERRITE  SINGLE
IFECTS    IN YTTRIUM-  IRON  AND GADOLINIUM-IRON GARNET      SINGLE
 LOW-INDEX FACEI     DISLOCATIONS   IN MANGANESE    FERRITE  SINGLE
ISTRIBUTION    OF  I DISLOCATIONS   IN MANGANESE    FERRITE  SINGLE
TRIC   PROPERTIES.                                     SYMMETRY OF
LO SPLLTTINGS OF     DIFFERENT    IRON COMPLEXES.   I PARAMAGNETIC
  OF ORIENTED NUCLEI.     I  FERROMAGNETIC  OR ANTIFERROMAGNETIC
                                        SUPERCONDUCTIVITY    IN THE
FUNCTION    AND RELATED NONCROSSING     POLYGONS  FOR THE  SIMPLE-
CE  IN RUBIDIU~~     MANGANESE-   IRONI3I. DISCOVERY OF    A SIMPLE
                             FERRO- AND ANTlFERROMAGNETISM      IN A
ADOLINIUM    ION.
          THEORY OF  NUCLEAR ACOUSTIC RESONANCE      LINE  SHAPE  IN
ITICE    RELAXATION OF  S-STATE    IONS,  DIVALENT  MANGANESE   IN A
                                             SPIN WAVE  THEORY FOR

CRYSTAL  LINCIZI- YTTRIUM)
CRYSTAL.
CRYSTAL.
CRYSTAL.
CRYSTAL.
CRYSTAL.
CRYSTAL.
CRYSTAL.
CRYSTAL.
CRYSTAL.    I THEORETICAL    I
CRYSTAL.    /PART-2.   LOGE  AND SCREW DISLOCATIONS,     D
CRYSTAL.    IRAMAINETIC   RESONANCE   AND  SPIN-LATTICE
CRYSTAL-FIELD      EFFECTS TO THE   LINE-~IDTH   IN RARE-
CRYSTALLINE     ANISOTROPY   AND MADNETOSTRICTION    OF  P
CRYSTALLINE     ANISOTROPY   IN THE  SYSTEMS  NICKEL   FIR
CRYSTALLINE     ELECTRIC  FIELDS   IN SPINEL-TYPE   CRYST
CRYSTALLIZATION OF      YTTRIUM-   IRON GARNET   ON A  SEE
CRYSTALLOGRAPHIC AND      MAGNETIC   STUDY OF   THE SOLID
CRYSTALLOGRAPHIC      STUDIES.                    MAGNETI
            I             TEMPERATURE   DEPENDENCE   OF  M
            I /IVITY   IN AN  ANTIFERROMAGNET.    I COPPE
            AND A  POLYCRYSTAL   OF  O.SPERCENT   ALUMINI
            AND DILUTE   SOLUTIONS.   ~SITIVE   MAGNETIC
            AS  A  FUNCTION  OF TEMPERATURE,    ORIENTATI
            AS  INFERRED FROM OPTICAL    SPECTRA.
            BETWEEN   1.4 AND  5K.
            BY  HALOGEN  REDUCTION.
            BY  THE CHEMICAL   TRANSPORT   OF MATERIAL.
            FOR  THE  CASE OF  A VERTICAL MAGNETIC     PIE
            FROM 3 TO 300K.    ICONDUCTIVITY    OF MANGAN
            IN  MOLTEN  LEAD  OXIDE- BORON-   OXIDE  SOLO
            IN  THE PRESENCE   OF  THALLIUM OXIDE.
            OF  CALCIUM OXIDE.           ELECTRON   SPIN
            OF  COBALT-SUBSTITUTED    MANGANESE   FERRITE
            OF  FERRITES  ON TEMPERATURE    AND SAMPLE   0
            OF  HAEMATITE.   I ELECTRON  SHADOW METHODI
            OF  IRON BY ELECTRON DIFFRACTION WITH       VA
            OF  IRON-  5 PERCENT   ALUMINUM AND   ITS VAR
            OF  T~ANSITI0N   METALS.
            USING AN ARC   IMAGE   FURNACE.
            WITH FERROELECTRIC     AND FERROMAGNETIC    PR
            WITH HEXAGONAL    STRUCTURE.
            WITH   IONS IN S-STATE.

                      M
         A NLW  APPARA
       PARAMAGNETIC   R
 EFFECT  OF  DOMAIN  WA
MAGNETIC  ANNEALING   E

CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS.
CRYSTALS,
CRYSTALS,
CRYSTALS,

                                            0
                                         THE
                                        TRI V
                                       SPIN
                                     MAGNET I
                                FERROMAGNET
                                MAGNETIC   AN
                              PARAMAGNETIC
                         PARAMAGNETIC  RESON
                   FERROMAGNETIC    DOMAIN  P
                   PARAMAGNETIC    RESONANCE
                 FREQUENCY   SPECTRA OF  ELE
        OBSERVATION   BY ELECTRON MICROSCO
    DIRECT OPTICAL    DETECTION OF   THE GRO
 I DEFECTS
 I LITHIUMIO.51-   ALUMINUMI2.5I    OXYGEN(4
 I MAGNETDSTRICT~ON    I.
 I THEORETICAL   I
 lAND ENTROPY   OF COPPER AND   CHROMIUM CH
 IL POWER FOR   THE CASE  OF  SUBSIDIARY   AB
 IL, THERMAL,   AND CHEMICAL   TREATMENT   OF
 ISTALS BY  THE  CHEMICAL TRANSPORT    OF  MA
 /TERNAL   STRESSES AND OF   FIELD  STRENGTH
 EFFECT ON DISLOCATION DENSITY.        INCOR
 PART-I.   ETCHING AGENTS FOR IARNETS,     0/
 PART-i.   OBSERVATION   OF DISLOCATIONS ON
 PART-2.   EDGE AND SCREW DISLOCATIONS,     0
 EXHIBITING FERROMAGNETIC     AND  FERROELEC
 GARNETS   I                        ZERO FIE
 THEORETICAL    I IMA RAYS FROM ASSEMBLIES

CUAL2ICi6I  CRYSTAL   CLASS.
CUBE LATTICE.    HIGH-TEMPERATURE    ISING  PARTITION
CUBIC  ANTIFERROMAGNET,    ANTIFERROMAGNETIC RESONAN
CUBIC CLUSTER OF    SPINS.
CUBIC CRYSTAL   FIELD  SPLITTING   OF  THE TRIVALENT   G
CUBIC CRYSTALS.
CUBIC  ENVIRONMENT.   I THEORETICAL    I        SPIN-LA
CUBIC  FERROMAGNETICS PART-3    MAGNETIZATION.

Figure 4.  Sarnple, Bell Laboratories Format

                     44

i9-066
04-036
06-062
12-046
06-063
17-032
12-016
01-070
03-031
06-021
04-073
12-057
11-020
04-068
04-147
04-091
18-003
01-064
05-035
11-113
06-050
03-065
17-019
03-007
16-031
16-029
18-019
18-022
02-091
16-027
18-002
18-021
12-030
11-081
11-032
01-009
03-062
03-011
09-006
18-013
02-095
04-082
12-002
01-021
01-022
01-063
01-065
01-097
04-035
06-014
11-115
12-008
12-036
14-015
18-001
18-015
18-020
18-024
12-032
14-040
12-031
06-005
05-038
10-015
04-108
12-024
12-044
10-022
12-025
12-014
05-022
14-012
03-013
04-091
03-043
13-005
16-023
11-082
11-089
18-022
10-017
04-025
04-012
04-072
04-073
01-024
12-015
13-006
15-062
02-067
06-038
02-065
13-051
11-115
12-005
02-011

 68        have  antiperasitic act ion
 69         has  entiparasitic   action
 70   not  have  antiparasitic   acti on
 71         has  antiparasitic action
 72         has  entiparasitic action
 73         has  antiparasitic action
 74        have  anti pares it Ic action
126         of emebic   colitis caused
127         of emebic colitis caused
126         weakLV have   toxic action
 25
158
158
 20
 21
150
150
150
  8
  B
  5
  5
119
 42
 46
 46
162
166
 32
 36
 37
 35
 32
 34
 33
119
 32
 32
157
157
 64
 53
 63
 53
 55
 63
 63
136
135
131
132

     THE LENGTH OF ACTION AND THE
  ouebein   ver~ strongL~    increases
      TENSION AND THE RATE OF NET
   of   hexobarbitel    b~ ml crosomal
   of   hexobarbitel    b~ microso.eL
h~dro ergokr~ptine    with    di h~dro
 h~dro ergocorni ne   end     di h~dro
          tolezoline    end   di h~dro
      but,    action antagonized b~
  of rabbit,    action  increased b~
dog end cet~    action reversed b~
 action reversed b~       ergotami ne
            Streptococcus pyoomnes,
            in human   accompanied b~
p~rroLidone causes     aggregation of
 A SYNTHETIC MACROMOLECULE ON THE
                chloramphenicol   end

 acid in  acid-solubLe    fraction of
 amino  uridine   inhibits growth of
        c~tidine    inhibit growth of
 amino  uridine   inhibits growth of
fluoro  uraciL   has  toxic  action on
 amino  uridine   inhibits growth of
  deox~ uridine     inhibit growth of
 growth  of Staph~Lococcus aureus.
    pimeLic acid     in ceLl waLLs   of
  content   of N-ccet~L hexos amine

    AFTER GENERAL ANESTHESIA WITH
     c~cLo pent~L propionate      and
         THE TERATOGENIC ACTION OF
 increases    excretion of    estrone

excretion of     estrone   estredioL
                                 URINE
   methox~estra-l.3.5-tri      ene has
progestati onal   action on   immature
progestati onal action on     immature
progestati onal   action  on  immature

133  progestationeL    action  on
143          action on   immature
 63
  5
144
144
148
133
131
132
 43
 44
 43
 13
 16
 14
 12
 80
 80
113
145
145
145
146
145
145
 80
 80
140
139
139
 83

           increases excretion
     phen~L)-2-(iso prop~l    amino)
                  2-di meth~L   amino
 THE EFFECTS OF   2-01 METHYL AMINO
           suLfate   choLine  phen~l
    sterone,   Less effective   than
               more effective   than
     sterone.   equaL in action   to
   ANTAGONISM OF LYSERGIC ACID DI
 recognition of    l~sergic  acid di
 recognition of    L~sergic acid di
  cetechoL  cmi nes caused b~    phen
  catechol  am I nes caused b~   phen
  catecho L am I nes caused b~   phen
  catechoL  emines caused b~     phen
   more effective   than   a-3-(2-di
                           8-3-( 2-di
       substituted benz~L   and phen
            tri eth~l  tin and    tri
 THE ACTION OF TRI   ETHYL TIN.   TRI
OF TRI  ETHYL TIN,  TRI  ETHYL LEAD.

                                  tri
                  THE ACTION OF TRI
       than   e-3-(2-di  Cth11L amino
              8-3-(2-di  Cth11L amino
    given as   saLts with di  benS11L
                                 m-9-
 morphen and    8- 5,9-di  meth11l-2-
              1-(2-p- amino phen11L)

on Entameba histoL~tice
on Entameba histoL~tica
on Entemebe himtoL~tice
on Entamebe histoL~tice
on Entemeba histol~ticc
on Entemeba histoL~tica
on Entameba histoL~tica
b~ Entameba histoL~tice
b~ Entemeba histoL~tica
on Entamebe histoL~tica
   ENTERAL  RESORPTION OF

in  rat [weenling]
in  ret [weaniing]
in  rat [weanling]
in  rat [weanling] and wackl~ has      toxi
in  ret [weenling]
in  rat [weanling] and has     toxic actio
in  ret [weenLingi and have     toxic  acti
in  ret [1275723.1275724.    and  1275725
in  rat [1275732 as di(3-    h~drox~-2- n
in  vitro  and do not   or weckl~  allevic
 DIGITOXIGENIN- MONO DIGITOXOSIDE(Dt2

entr~ of calcium and strongL~      increases   resting   tension of
ENTRY OF CALCIUM-45     IN  ISOLATED PERFUSED RABBIT VENTRICLES
enz~mes of   Liver
enz~mes of    Liver
ergocornine    and    di h~dro ergocristineLh~dergine]      inhibit
ergocristine[h~dergine]     inhibit   action of     vesopressin bu
ergokr~ptine   with    di h~dro ergocornine    and    di h~dro erg
ergotamine   at  higher  dosage
ergotamine at    Low dosage but,   action   antagonized b~    ergot
ergotamine     ergotoxin    guanethidine and      phen~lephrine bu
ergotoxin      guenethidine   and  phen~lephrine but     in rat.  cc
ErsipeLothri x   I nsidiose end Streptococcus egelactem      in wit
er~thema [miLd] given b~      in~ection   into skin  Lesions
er~throc~tes   in  bLood of hamster given     intrc-artericLL~
ERYTHROCYTES OF THE BLOOD
er~throm~cin   strongL~   inhibit endotrophic     sporulation of B
ERYTHROMYCIN- AND STREPTOMYCIN-LIKE ANTIBIOTICS AS BLEACHI
Escherichic coLi
Escherichie    coIl  and Neurospora
Escherichia coIl     but do not   inhibit  growth of Neurospore
Escherichia coLi     K-12.  action reversed b~    glutethione L-
Escherichie    coIl  whiLe  organism  is growing cctivmL~.    ectio
Escherichla coIl,     action reversed b~      glutathione   ;,  acti
Escher I chic  co Li. action  reversed b~    ur I dine   c~ti dine
Escherichla coIl,     SaLmonella   tliphoae. PesturelLe muLtocida
Escherl chic col i;   increases content    of N-ecet~l hexos amin
esters and diamino pimelic acid       in acid-soluble    fraction 0
esti L general   anesthetic   decreases urinar~ output end      incr
EST IL.
estre di  ol   valerete hormone cause edeac end thickening of
ESTRADIOL AND THYROXINE ON MUELLER'S DUCT         IN THE CHICKEN E
estredioL     estrioL and   total neutral   17- keto steroids    in
estradioL    inhibits formation of Mueller's      duct of chicken
estrediol with     th~roxine   strongl~   inhibit formation of    st
astrioL  and totaL    neutral  17- keto steroids    in urine of ~o
ESTROGEN RESPONSES TO HUMAN CHORIONIC GONADOTROPIN          IN YOUN
estrogenic    action
estrogen-primed rabbit and does       not  inhibit  growth  of  adre
estrogen-primed rabbit      given orcll~
estrogen-primed rabbit given       orcll~

immature estrogen-primed rabbit      given orcll~
rabbit [estrogen-primed] given       subcutaneousL~
     of   estrone   estradioL    estrioL  and total   neutral  17- keto ate
          ethanoL  have h~potensive    action on barbiturate narcotized
          ethanoL  increases  incorporation of phosphorus      Into phospha
          ETHANOL  ON BRAIN PHOSPHO LIPID METABOLISM
          ether  bromide   DMPP  and   hist cams    acid phosphate   in isol
          ethin~L  testo  sterone moderateL~    have progeatationaL    cctio
          ethln~L  tasto  sterone  strongL~ has progestational     action 0
          ethin~L  testo sterone   atrongL~ have progestationd       action
          ETHYL AMIDE BY CHLORPROMAZINE AND PHEN OXY BENZ AMINE.
          eth~L  emide  in human  if given aimultcneouaL~
          eth~L  amide  In human onl~   if given previous    to Latter
          ethVl  amine
          eth~L  amine
          eth~l  amine  end does not   inhibit  secrstion of catechoL     cmi
          eth~L  amine  nicotine   and    carbachoL
          ethVl  amino  eth~L)  amino  tropine  bis math   iodide has nicot
          eth~L  amino  eth~L) amino   tropine  bia meth   iodide. more eff
          eth~L  h~dr ezines have    toxic action [L050 292,4000+.     400+,
          eth~L  Lead ver~ ctrongL~    inhibit metaboLism of      gLucose b~
          ETHYL LEAD.   ETHYL MERCURY AND OTHER     INHIBITORS ON THE META
          ETHYL MERCURY AND OTHER    INHIBITORS ON THE METABOLISM OF BR
          eth~l  mercur~ chLoride    chlorpromazine     malonic acid [CS S
          eth~L  tin and   tri  eth~l  Lead ver~ strongL~    inhibit matabo
          ETHY~ TIN.  TRI  ETHYL LEAD.   ETHYL MERCURY AND OTHER     INHIBIT
          eth~L) amino tropine    bia math   iodide has nicotinic    bLockin
          eth~L) amino tropine    bis math   iodide,  more effective   than
          eth~Lenc  diamine
          eth~L-2'- h~drox~-2.5-di     meth~L-6.7- benzo morphen and       8-
          eth~L-2'- h~drox~-6.7-benZ0 morphan weakL~ heve         toxic acti
          eth~L-2- meth~L-3     phen~l-3- propion 0511 p11rrolidine has

                    Figure 5.      Sample Page, ChemiCal BiologiCal ACtivities

                                                       45

NON-IRRADIATED     ABSORPTION   OF  0-GLUCOSE   BY  SEGMENTS OF  INTESTI
                   NE   FROM  ACTIVE AND HIBERNATING,     IRRADIATED  AND
                     NOM-IRRADIATBO   GROUND    SQUIRRELS,  CITELLUS  IR)
                   DECEMLINEATUS        NASA  N63-110021K)    $2.60  0126
NON-ISOTHERMAL     CORRELATIONS     IN A  NON-ISOTHERMAL   PLASMA
                                            AD-290   0531K)   $1.10  0196
NON-LINEAR         INVESTIGATION    OF  MICROWAVE  NON-LINEAR   EFFECTS
                   UTILIZING   FERROMAGNETIC    MATERIALS
                                            AD-29Q   5721K)   $2.60  0481
NON-METALLIC       BIBLIOGRAPHY     AND TABULATION   OF DAMPING PROPERT
                   IES   OF NON-METALLIC   MATERIALS
                                            AD-289   8561K)   $3.00  0502
NON-MILITARY       NOTES   ON NON-MILITARY    MEASURES  IN  CONTROL  OF  I
                   NIURGENCY                60-290   2371K)   $1.60  0696
NON-MOVING         JUDGMENTS   OF   VISUAL VELOCITY   AS A  FUNCTION  OF
                   THE   LENGTH OF  OBSERVATION   TIME  OF  MOVING OR  NO
                   N-MOVING   STIMULI       PB  162  5491K)   $1.60  0125
NON-RELATIVIST)    TABLES   OF NON-RELATIVISTIC    ELECTRON   TRAJECTORI
                   ES   FOR FIELD   EMISSION  CATHODES
                                            60-290   6961K) $14.50   0239
NON-SIMILAR        NON-SIMILAR   NUMERICAL    METHODS  OF  SOLUTION  FOR
                   ELECTRODE   BOUNDARY   LAYERS  IN  A CROSSED  FIELD  A
                   CCELERATOR               60-290   525(K)   $5.60  0185
NONDESTRUCTIVE     NONDESTRUCTIVE    SYSTEM   FOR INSPECTION   OF FIBER
                   GLASS-REINFORCED     PLASTIC  MISSILE   CASES
                                            60-289   8251K)   $1.60  0632
NONDESTRUCTIVE     X-RAY    IMAGE SYSTEM FOR NONDESTRUCTIVE     TESTING
                   OF SOLID   PROPELLANT   MISSILE  CASE   WALLS AND  WEL
                   OMENTS                   60-289   821(K)   $3.60  0631
NONDISSIPATIVE     MAGNETOHYDRODYNAMIC     STABILITY   OF  VORTEX FLOW  -
                     A NONOISSIPATIVE,    INCOMPRESSIBLE    ANALYSIS
                                           ORNL-TM-4121K1     $3.60  0615
NONEQUILIBRIUM     SCALE   EFFECTS  FOR   NONEQUILIBRIUM   CONVECTIVE  HE
                   AT TRANSFER   WITH   SIMULTANEOUS   GAS  PHASE AND  SO
                   RFACE   CHEMICAL  REACTIONS.   APPLICATION   TO HYPER
                   SONIC   FLIGHT  AT HIGH  ALTITUDES
                                            60-291  0321K)    $1.60  0025
NONLINEAR          APPLICATION   OF  VARIATIONAL   EQUATION   OF MOTION
                   TO THE   NONLINEAR   VIBRATION  ANALYSIS   OF HOMOGEN
                   EDUS  AND  LAYERED   PLATES  AND  SHELLS
                                            60-289   8681K)   $2.60  0667
NONLINEAR          EXTENSIONS   IN  THE   SYNTHESIS  OF TIME  OPTIMAL  OR
                     BANG-BANG  NONLINEAR   CONTROL   SYSTEMS.  PART  I.
                   THE   SYNTHESIS  OF  QUASI-STATIONARY    OPTIMUM  NONL
                   INEAR   CONTROL  SYSTEMS
                                            PB  162  5411K)   $4.60  U235
NONLINEAR          EXTENSIONS   IN  THE   SYNTHESIS OF  TIME  OPTIMAL  OR
                     BANG-BANG  NONLINEAR   CONTROL   SYSTEMS.  PART  I.
                   THE   SYNTHESIS  OF  QUASI-STATIONARY    OPTIMUM  NONL
                   (NEAR   CONTROL  SYSTEMS
                                            PB  162 5471K)    $4.60  0235
NONLINEAR          NONLINEAR   FLEXURAL   VIBRATIONS   OF SANDWICH   PLAT
                   ES                       60-289  8711K)    $2.60  0669
NONLINEAR          OPTIMUM NONLINEAR      CONTROL FOR  ARBITRARY  DISTUR
                   BANCES               NASA  N62-158901K1    $2.60  0682
NONRECURRENT       A  TECHNIQUE  FOR  NARROW-BAND   TELEMETRY   OF NONRE
                   CURRENT    PULSES        60-290  6911K)    $2.60  0571
NONUNIFORM         ELECTROMAGNETIC    SCATTERING   FROM  A  SPHERICAL  NO
                   NUNIFORM   MEDIUM.   PART  II. THE  RADAR  CROSS  SECT
                   ION OF   A FLARE         60-289  6151K)    $2.60  0747
NONUNIFORM         ELECTROMAGNETIC    SCATTERING   FROM  ASPHERICAL   NON
                   UNIFORM MEDIUM.    PART  I.  GENERAL  THEORY
                                            60-289  6141K)    $2.60  0748
NORMAL             PROBABILITY   INTEGRALS    OF MULTIVARIATE   NORMAL  A
                   ND MULTIVARIATE-T        60-290  7461K)    $8.60  0160
NORMAL             RESONANCE   ABSORPTION   OF  GAMMA-RAYS  IN  NORMAL  A
                   NO SUPERCONDUCTING     TIN
                                            60-289  8441K)    $3.60  0826
NORMS              NORMS   FOR ARTIFICIAL   LIGHTING
                                            60-290  5551K)    $1.10  0734
NORTH              FACTORS    INFLUENCING  VASCULAR   PLANT ZONATION   IN
                     NORTH CAROLINA   SALTMARSHES
                                            60-290  9381K)    $1.60  0603
NORTH              SONAR   STUDIES  OF  THE DEEP  SCATTERING   LAYER  IN
                   THE  NORTH  PACIFIC      PB  162 427(K)    $2.60  0587
NORTH              THE  DEVELOPMENT   OF  RESCUE  AND  SURVIVAL  TECHNIQ
                   UES  IN  THE NORTH   AMERICAN  ARCTIC
                                            PB  162 4101K)  $12.00   0085
NOSE               THE  FLORA  OF  HEALTHY  DOGS.  I.  BACTERIA  AND  PUN
                   GI OF   THE NOSE,  THROAT,   AND LOWER   INTESTINE
                                                   LP-21K)    $2.60  0458
NOZZLE             FABRICATION   OF  PYROLYTIC   GRAPHITE   ROCKET NOZZL
                   B  COMPONENTS            PB  162 3111K)    $1.10  0351
NOZZLE             FABRICATION   OF  PYROLYTIC   GRAPHITE   ROCKET NDZZL
                   E  COMPONENTS            PB  162 3701K)    $1.10  0353
NOZZLE             FABRICATION   OF  PYROLYTIC   GRAPHITE   ROCKET NOZZL
                   E  COMPONENTS            PB  162 3121K)    $2.60  0352
NOZZLE             THIRD   SYMPOSIUM  ON  ADVANCED  PROPULSION CONCEPT
                   S  SPONSORED  BY  UNITED   STATES  AIR FORCE OFFICE
                   OF SCIENTIFIC    RESEARCH  AND  THE  GENERAL  ELECTRI
                   C  COMPANY FLIGHT    PROPULSION  DIVISION   CINCINNAT
                   I, OHIO OCTOBER    2-4,  1962.  PLASMA   PLOW IN  A MA
                   GNETIC   ARC NOZZLE      60-290  0821K)    $2.60  0147
NOZZLES            HEAT  TRANSFER   AND PARTICLE   TRAJECTORIES   IN  SOL
                   10-ROCKET   NOZZLES      60-289  6811K)    $5.60  0030
NKOTC              DEVELOPMENT   AND  STANDARDIZATION    OF FORMS  3  AND
                     4 OF  THE NROTC  CONTRACT   STUDENT  SELECTION   TES
                   1                        60-290  1841K)    $1.10  0201
NROTC              EVALUATION   OF  NROTC  AVIATION   INDOCTRINATION   F)
                   ELD  TOURS  FOR  1961-1962
                                            60-290  3561K)    $1.60  0581
NUCLEAR            A  7090  CODE FOR  THE  CALCULATION   OF ELECTROMAGN

                   ETIC  BLACKOUT   FOLLOWING   A HIGH  ALTITUDE  NUCLEA
                   R  DETONATION            60-291  1411K)    $8.60  0312
NUCLEAR            ACCURATE   NUCLEAR  FUEL  BURNUP  ANALYSES
                                             GEAP-4062)KI     $1.60  0362
NUCLEAR            APPLICATION    OF NUCLEAR  POWER   SUPPLIES  TO SPACE
                     SYSTEMS                 TID-173061K)     $8.60  0141
NUCLEAR            CAROLINAS-VIRGINIA     NUCLEAR  PO~ER  ASSOCIATES,   I
                   NC.,  RESEARCH   AND DEVELOPMENT    PROGRAM  QUARTERL
                   Y  PROGRESS  REPORT  FOR  THE  PERIOD  APRIL  - JUNE
                   1962                       CVNA-1561K1     $6.60  0839
NUCLEAR            COMPUTER   PROGRAMS  FOR  OPTIMUM   START-UP  OF  NUCL
                   EAR  PROPULSION   SYSTEMS
                                             310-161301K)     EE.IQ  0112
NUCLEAR            DOSE-TIME-DISTANCE     CURVES  FOR  CLOSE-IN  FALLOUT
                     FOR LOW  YIELD  LAND-SURFACE   NUCLEAR   DETONATION
                   S                        PB  162 5561K)    $1.60  0573
NUCLEAR            EXTRUDED   CERAMIC  NUCLEAR   FUEL  DEVELOPMENT   FROG
                   RAM                      ACNP-62550)KI     $4.60  0092
NUCLEAR            FEASIBILITY    DETERMINATION   OF  A NUCLEAR  THERMID
                   NIC  SPACE  POWER  PLANT
                                            60-290  0681K)    $2.60  0031
NUCLEAR            HIGH  -  ENERGY  NUCLEAR  PHYSICS   RESEARCH  PROGRAM
                                            AO-291   140(K)   $1.60  0314
NUCLEAR            HIGH-ENERGY    NUCLEAR  REACTIONS   OF NIOBIUM  WITH
                   INCIDENT   PROTONS  AND  HELIUM   IONS
                                            UCRL-104611K1     $2.25  0222
NUCLEAR            INVESTIGATIONS    ON  THE DIRLOT   CONVERSION  OP NUD
                   LEAR  FISSION  ENERGY   TO ELECTRICAL   ENERGY  IN  A
                   PLASMA   DIODE           60-290  7271K)    $9.60  0385
NUCLEAR            NUCLEAR  SUPERHEAT   DEVELOPMENT    PROGRAM
                                              GNEC-2541K1   $14.00   0386
NUCLEAR            PRODUCTION   OF  TRITIUM  BY  CONTAINED  NUCLEAR  EXP
                   LOSIONS  IN  SALT.  I.  LABORATORY   STUDIES OF   (SOT
                   OPIC  EXCHANGE   OF TRITIUM   IN THE HYDROGEN-WATER
                     SYSTEM                  ORNL-33341K1     $.50   0617
NUCLEAR            STRIKING   EFFECT  OF  NUCLEAR  EXPLOSION
                                            60-290  824(F)  $21.00   0083
NUCLEAR            THE  NUCLEAR   PROPERTIES  OF  RHENIUM
                                            60-291  1801K)    $1.60  0310
NUCLEAR            VARIATIONS   IN  THE TOTAL   ELECTRON  CONTENT  OF  TH
                   E  IONOSPHERE  AFTER   THE HIGH  ALTITUDE  NUCLEAR   E
                   XPLOSION            NASA  N63-104861K1     $1.10  0142
NUCLEAR            6306  MARITIME   NUCLEAR  STEAM  GENERATOR
                                              GEMP-1601K1     $8.10  0349
NULL-ZONE          THE  ESTIMATION   PROBLEM  IN  NULL-ZONE   RECEPTION
                   FEEDBACK   SYSTEMS       60-290  3251K)  $11.00   0599
NUMBERS            FUNDAMENTAL    SOLUTION  TO  THE DIFFUSION   BOUNDARY
                     LAYER  EQUATION  FOR  MEARLY  SEPARATED  FLOW   OVER
                     SOLID  SURFACES  AT  VERY  LARGE  PRANOIL  NUMBERS
                                            60-291  0311K)    $2.60  0023
NUMBERS            LOCAL  PRESSURE   DISTRIBUTION   ON  A BLUNT  DELTA  W
                   ING  FOR ANGLES   OF ATTACK   UP TO  35-DEGREES   AT M
                   ACH  NUMBERS   OF 3.4  AND 4.7
                                       NASA  N63-)08001K1     1.75   0516
NUMERICAL          A  MAINTENANCE   PROGRAM  FOR  NUMERICAL   CONTROL  SY
                   STEMS  ON  MACHINE  TOOLS
                                             TIO-173761K1     $2.60  0809
NUMERICAL          A  PRIORI  BOUNDS  ON  THE SISCRETIZATION    ERROR  IN
                     THE NUMERICAL   SOLUTION   OF THE  OIRICHLET  PROBL
                   EM                       60-290  3221K)    $4.60  0464
NUMERICAL          NON-SIMILAR    NUMERICAL  METHODS   OF SOLUTION   FOR
                   ELECTRODE   BOUNDARY   LAYERS  IN  A CROSSED  FIELD  A
                   ODELERATOR               60-290  5251K)    $5.60  0185
NYSTAGMUS          MANIPULATION   OF  AROUSAL   AND  ITS EFFECTS  ON HUM
                   AN  VESTIBULAR   NYSTAGMUS   INDUCED BY  CALORIC  IRR
                   (GAllON  AND   ANGULAR  ACCELERATIONS
                                            60-290  3481K)    $1.60  0252
OAK                A  SAFETY  REVIEW  OF  THE OAK  RIDGE  D~TIDAL    EXPE
                   RlMENTS  FACILITY       ORNL-TM-3491K)     $5.60  0612
OBJECTS            DRAG  OF OBJECTS   IN  PARTICLE  -  LADEN  AIR PLOW  P
                   HASE  IV.  BLUNT  BODIES  AND  COMPRESSIBILITY    EFFE
                   OTS                      60-291  1181K)    $6.60  0752
OBSERVATORY        TONTO  FOREST  SEISMOLOGICAL    OBSERVATORY
                                            60-291  1481K)    $3.60  0815
OCEAN              A  SAMPLE  TEST  EXPOSURE  TO  EXAMINE  CORROSION AN
                   O  FOULING  OF EQUIPMENT   INSTALLED   IN  THE DEEF  0
                   DEAN                     60-291  049(K)    $1.60  0582
OCEANOGRAPHIC      OCEANOGRAPHIC    CRUISE  TO  THE BERING  AND CHUKCHI
                     SEAS,  SUMMER  1949.  PART  I SEA  FLOOR STUDIES
                                            PB  162 426(K)    $2.60  0585
OCEANOGRAPHIC      OCEANOGRAPHIC    AND UNDERWATER    ADDOUSTICS  RESEAR
                   OH                       60-290  252(K)    $2.60  0848
OCEANOGRAPHIC      OCEANOGRAPHIC    CRUISE  TO  THE BERING  AND CHUKCHI
                     SEAS,  SUMMER  1949.  PART  IV.  PHYSICAL  ODEANOOR
                   APHID  STUDIES.   VOL.  I. DESCRIPTIVE   REPORT
                                          PB 162  428-1(K)    $3.60  0584
OCEANOGRAPHIC      OCEANOGRAPHIC    CRUISE  TO  THE BERING  AND  CHUKCHI
                     SEAS,  SUMMER  1949.  PART  IV.  PHYSICAL  OCEANOOR
                   APHID  STUDIES.   VOL.  1. DESCRIPIlVE   REPORT
                                          PB 162  428-IlK)    $3.60  0584
OCEANOGRAPHIC      OCEANOGRAPHIC    CRUISE  TO  THE BERING  AND CHURCH)
                     SEAS,  SUMMER  1949.  PART  IV PHYSICAL  ODEANOGRA
                   PHID  STUDIES.   VOL.  2. DATA  REPORT
                                          PB 162  428-21K)    $4.60  0586
OCEANOGRAPHIC      OCEANOGRAPHIC    CRUISE  TO  THE BERING  AND CHURCH)
                     SEAS,  SUMMER  1949.  PART  IV PHYSICAL  ODEANOGRA
                   PHID  STUDIES.   VOL. 2. DATA   REPORT
                                          PB 162  428-2(K)    $4.60  0586
OCEANOGRAPHIC      PROCEEDINGS    OF INTERINDUSTRIAL    OCEANOGRAPHIC   S
                   YMPDSIUM    (ND.  11, BURBANK,   CALIFORNIA,   5  JUNE
                     1962                   PB  162 587(K)    $2.60  0451
OCTYL              RUBBER   ELASTICITY  IN  HIGHLY  CROSSLINKED   SYSTEM

            Figure 6.  Sample, CEIR Format for Qffice of Technical Services

                                           46

                                            DIABETES   ROLATED   LITERATURE       REYWORD   INDEX  i96B

   CHANGES  OF GLYCEMIA    IN  THE UMBILICAL   VEIN   FOLLOWING
   INTRAVENOUS   ADMINISTRATION    OF  GLUCOSE   TO MOTHER.
   Z A  STEMBERA.   J HODR  *  CESE OTHER   V24  P6TE~A.  OCT  59  CO

   MODIFICATION   OF  THE  GLYCAMIA    LEVEL.  PTRUVIC  ACID   LEVEL AND  THE
   LEVEL  OF  INORGANIC   PHOSPHORUS   BY  APPLICATION    OF GLUCOSE   DURING
   LABOR  WITH CONSIDERATION      TO HYPOXIA   OF  THE  FETUS.  e J  90DM,
   J HEROHANN.   J  JAN05  *  Z GEBURTSH   GTNAEE  010.4  P57-~S  0959   GEM

   EFFECTS  OF THE  ADMINISTRATION     OF  SULFONAMIDE    BY WAY  OF THE
   EXOCRINE  DUCTS  ON   THE  GLYCAMIA   AND HISTOLOGICAL    STRUCtURE    OF
   THE  PANCREAS.   * A  LOUBATIERES,    A SASSINA.   M M   HARIANI.
   C FRUTEAU   DE LACLOS   *  C H SOC  BIOL  PAR   0154 P155-S.   1960   FR

   EFFECT  OF  SODIUM   ACETOACETATE   ON  GLYCERIA.    * M TOTH.   L DARTA
   ACTA HOD   ACAD  SC   HUNG  ViS P343-A.   1960  FR

   MODIFICATIONS    IN GLYCEMIA   AND  OLUCOSE    LOADING   CURVE  IN
   ANIMALS  WITH   CHRONIC   LESIONS   OF THE  SFINAL   CORD *
   G  PINNA.  M S  DECHERCHI      BOLL SOC   ITAL  BIOL SPER   035  PlEAS-B.
   Ti DEC  59  IT

   THE  GLYCEMIC   CYCLE  COMPAVED   WITH  THE   INDUCED  HYFEMGLTCEM,'A
   TEST   AND THE  FASTING   GLYCEMIA,   ITS IMPORTANCE     IN DIABETICS.
   EVEN   IN THOSE  APPARENTLY    IN EOUILISRIUM,   BIMPLIFIED
   PERFORMANCE   OF TEST    USING ADTX-HICRO-SAHPLINGS.
   C  PEREZ  * TUNISIE   MED  V3B P1V9-0X9.    MAO AX   FR

   EFFECT  OF  OVERSTIMULATION    OF   THE CNS ON  ILTOEHIA    IN  MAYA
   IN VARIOUS  CONDITIONS.     *  H SUBOVA   * CESE FYSIOL   VS  PNSS.
   NOV  59 Cl

   THE  GLYCAMIC   CYCLE  COMPARED   WITH   THE  INDUCED  HYPERGLYCEMIA
   TEST   AND THE  FASTING   GLYCEHIA,   ITS IMPTOTANCE     IN DIABETICS
   AVON   IN THOSE  APPARENTLY    IN EGUILIAVIUM.     SIHFLIFIEO
   PARFDRMANCE    OF  TEST  USING AUYO-MICMD-SAHFLINXS,        * C PEREZ  A
   TUNISIE   MED  OTE  P199-ZOR.  MAR  AX  FM

   EFFECT  OF  INSULIN   OR  GLYCEHIA    STUDIES  AT  MEANS OF  TEMPONAVO
   AND  PERMANENT   METHODS   OF  LIGATION   oF  THE  V.  PORToE  AND  V.
   HEPAYICUM   IN  OATS.   * R  EDRAC  * CESE  FYSIDL   V9  P28.  JAN  BA CO

GLYCEM IC

   THE  AMINOACIDEHIC    AND  GLYCEHIC   RESPONSE     N ULCER  PATIENTS
   AFTER   INTRAVENOUS   LOAD   OF AHINO  ACIDS.      I 0100Gb.    V OLIVA
   BOLL   SOC ITAL  BIOL   SPAR  9~S P1064-B.    15 SOFT  59   IT

   EFFECTS   OF  CHLORPROHAZINE    ON  CERTAIN   GLYCERIC   TESTS  IN
   CHILDREN.   *  V TISCHLER,    J JACINA.   B HRUBA.   0 PAVEORCEROVA
   CASE   PEDIAT  V14 fAll-BR.    AUG  59 CX

   190  GLYCEHIC   CYCLE   COMPAHED  WITH   THE  INDUCED  HYPERGLYCEHIA
   TEST   AND THE  FASTING   GLYCAMIA.   ITS   IMPOATANCE   IN DIABETICS.
   EVEN   IN THOSE  APPARENTLY    IN EGUILIBRIUM.     SIMPLIFIED
   PERFORHANCE    OF  TEST  USING  AUTO-MICWO-XAHOLINGS.
   C  PEREZ  * TUNISIA   MED   VTS P1RV-OCV.   VAR  oD  FR
   NEURAL   REGULATION   OF   INDUCEC  GLYCEHIC   REACtION.      E GUTHARN.
   B  JAEDUBEE   * CASE  FYSIOL   OR P404-s,   SEPT   59  CX

GLYCEHIC    CURVE

   CHANGES   OF  GLYCAMIC   CURVE  FOLLOWING   THE  ADMINISYVATION     OF
   GALACTDSE   IN  HEAD   INJURIES.      I VOOLIN     CESE  FYSIOL   VB P017.
   JULY   TV CZ

   EXPERIMENTAL    CONTRIBUTION    TX  THE  STUDY  OF  THE  INFLUENCE
   EXERTED   BY  PERIPHERAL    TISSUE  ON  GLYCERIC   HOHEOSTASIS.   II.  THE
   GLYCAHIC   CURVE   FROV  ADRENALINE.    * C CORDOVA.   G  D BOMPIANI.
   O  PALMA  * BOLL   SOC  ITAL  SIOL  SPAR  VTS  P1566-9,   15  DEC SM   IT

   EXPERIMENTAL    CONTRIBUTION    TO  THE  STUDY  DF   THE INFLUENCE
   EXERTED   BY  PERIPHERAL    TISSUES   ON GLYCEHIC   HOMEOSTASIS.    III.
   THE  GLYCEHIC   CURVE   FROM   INSULIN.   G   PALMA.   C COADOVA,
   O  D BOHPIANI    * BOLL  soq   ITAL BIOL  SPER  035  P1570-3.   15  DEC  59
   IT

   GLYCAMIC   CURVES   IN  NORMAL  SHEEP   FOLLOWING    THE ADMINISTRATION
   OF   CHLORINATED   HYDROCARBONS.    * E  EDNA  * CASE  FYSICL   VS  P320.
   JULY   59 CZ

GLYCAHIC    HOHEOSYASIS

   EXPERIMENTAL     CONTRIBUTION   TO  THE  STUDY  OF   THE INFLUENCE
   EXERTED   BY  PERIPHERAL    TISSUE  ON  GLTCEHIC   MOHEOSTASIS.   II.  THE
   GLYCAMIC    CURVE  FROM  ADRENALINE.      C CORDOVA.   0  D  SOMPIANI.
   O  PALMA  * BOLL   SOC  ITAL  WIOL  SPAR  VTV   P1556-V,  55  DEC 59   IT

   EXPERIMENTAL     CONTRIBUTION   TO  THE  STUDY  oF   THE INFLUENCE
   EXERTED   CT  PERIPHERAL    TISSUES   ON GLOCEMIC    HOHEOSTASIA.    III.
   THE  GLYCEMIC    CURVE  FROM   INSULIN.  *  0 PALVA.   C CORDOVA.
   O  I BOMPIANI    * BOLL   SOC  ITAL BIOL  SPoR  VTS  PIS7X-T.    15 DEC  59
   IT

 GLYCERATE   EINoSE

   PHOSPHORTLATION     OF  D~BLTCEVIC    ACID  to  2-PHOSPHO.-D-GLYCAMIC
   ACID    WITH GLYCERATE    RINABE  IN  THE LIVER.    I. ON THE
   BIOCHEMISTRY     OF FRUCTOSE   METABOLISM.     II.  * B  LAHPRECHT,
   T  DIAMANTSTEIN.    F  HEINZ,  P  BALDE     HOPPE   SAYLER  Z PHTSIOL  CHEM
   9310    P97-lIZ. 31   SEPT  59 GEM

 1953

BLYCERIC    ACID  0

   PHOSPHORTLATION     oF 1-GLYCERIC    ACID   To Il-PHOSPHO-D-GLYCERIV
   ACID  WITH  BLYCIDRATE  AINASE    IN THE  LIVAR.   I. ON  THE
   BIOCHEMISTRY     OF FRUCTOSE   METABOLISH.    II.  * B  LAMPRECHT,
   T  DIAHANTETEIR.    F HEINZ.   P BALDE   *  HOPPE  SETLER   T PHYSIOL   CHAR
   VOlO  P97-112.   35  SEPT  59  OAR

SLYCERIDE

   INFLUENCE   OF   INSULIN  ON  THE  INCORPORATIOR    OF  2-14  C-SODIUM
   PTRUVATE    INTO GLYCERIDE    GLYCEROL   IN DIABETIC    ANDRORMAL
   BABOONS.      N  SAVAGE.  J  GILLMAN.  C  GILBERT   * NATURE   LORD  ViES
   pi*S-9,   16  JAN  60

GLYCERIDE    GLYCEROL

   METABOLIC   ROLE   oF GLUCOBE.   A  SOURCE  OF  GLYCERIDE-OLYCEROL      IN
   CONTROLLING    THE  RELEASE   OF FATTY   ACIDS  BY  ADIPOSE   TISSUE.   *
   F  C WOOD JO..   B  LABOAUF.   0 F  CAHILL  JR.   * DIABETES   99  P261-3.
   JULY-AUG    AX

GLYCEROL

   EFFECT   oF EPIREAMMIRE     ON GLUCOSE   UPTARE   AND GLYCEROL   RELEASE
   BY  ADIPOSE   TISSUE   IN VITHO.   * B  LAEDAUF.   B FLINO.   0 F  CAHILL
   JR.     PROC  SOC  EXP  AIOL  MAD  0110  PBZ7-R.   OCT-DEC   59

   INFLUENCE   OF   I~SULIR  ON  THE  INCORPORATION    OF  2-14  C-SODIUM
   PYRUVATE    INTO GLYCERIDE    GLYCEROL   IN DIABETIC    ANIT NORMAL
   BABOONS,    * N  SAVAGE.  J  GILLMAR,   C GILBERT   * NATURE   LONO  ViES
   P168-V.   10  JAN  60

   UNIMPAIRED    SYNTHESIS   OF  FATTY  ACIDS   AND  ALTERED   SYNTHESIS   OF
   GLYCEROL    OF TRIOLYCORIDES     IN DIABETIC   BABOONS   P.  URSIRUS.   *
   N  SAVAGE.  J  GILLHAN.   C  GILBERT     S  AFM J  HAD  SCI  025 P19-TO.
   APR  AX

GLYCIDA

   MATERNAL    OLYCIDE  NORMAL   ASSIMILATION.    TOHATO   BABY,  PRECEDENTS
   OF  HACROSOMIA   AND  FATAL   MORTALITY.      B SALVADOMI.
   O  CAGNAZZO,   A DALEONARDIS       HINARVA  PEOIAT   012  P117.
   11  FEE  60 IT

GLYCINE

   AN  INSULIN   ASSAY  BASED   TN THE  INCDRPORATION    OF  LABELLED
   OLYCINE   INTO   PROTEIN  oF  ISOLATED   RAY  DIAPHRAGM.    *
   A  L MANCHESTER.    P  J RANDLE.   F 0  YOUNG  *  J ENDOCR   019 P059-AZ,
   DEC   59

   MAINTENANCE    OF   CARBOHYDRATE   STORES   DURING  STRESS   OF COLD  AND
   FATIGUE   IN  RATS  PREFAD   DIETS  CONTAINING    ADDED  OLYCINA.   *
   S  R  TODD. H  ALLEN   * USAF  ARCTIC   AERORED   LAB TECHN   RAP  957-34
   P1-lA.   JUNE  AX

GLYCINA    C14

   RATE  OF  ASSOCIATION   OF   STS  AND C14   IN PLASMA   PROTEIN  FRACTIONS
   AFTER   ADMINISTRATION    OF  NA2ST5IR.   GLYCINE-C14.    OR  GLUCOSE   C14.
   *  J  A RICHMOND     J  BIOL  CHAM  0234  PZTlT-A,   OCT  59

OLYCOGAR

   GLTCOGAN    OF THE  ADRENAL   CORTEX   AND  VEDULLA.  INFLUENCE    OF AGE
   AND   SEX.  * H  PLANEL.  A  GUILOEM   * C  V SOC BIOL   PAR  9153  P844-B,
   1059  FR

   AFFECT   OF DIET    ON THE  BLOOD  SUGAR  AND  LIVER  GLYCOGEN   LEVEL   OF
   NORMAL   AND  ADRANALECTOHILED     RICA.     B P  BLOCE,  0  5 CDX  *
   NATURE   LORD  9184  BUPPL   II P721-Z.   OR  AUG  59

   LIVER   GLYCOGAR    AND BLOOD  SUGAR  LEVELS    IR ADRENAL-DEHADULLAYAO
   AND   AORERALECTOHIZAD    RATS  AFTER   A SINGLE   ODGE  OF  GROWTH
   HORMONE.    * C  A  Do BROOT  * ACTS   PHYSIOLPHARRACOL      REERL  OR
   PlI7-2D,    HAY  Al

   A  HICROHATHOD   FOR   SIMULTANEOUS    DETERMINATION    OF  GLUCOSE  AND
   AETONE   BODIES    IN BLOOD  AND  GLYCOGAR   AND  EATORE  EDDIES    IR
   LIVER.      0  HANSEN  * SCARD   J CLIR  LAB  IRVAET  012   P1A-Z4.  1960

   AN   IRVEREE  RELATION  BETWEEN    THE  LIVER  GLYCOGAR   AND  THE  BLOOD
   OLUCOSE   lo   THE  RAT ADAPYAD   TO A  FAT  DIET.   * P  A HAYES  * NATURE
   LONG  VSB~  P005-A,    23  JULY 60

   LIVER   BLUCOSYL    OLIOOAACCHARIDES    AND  GLYCOGAR   CAREOR-14
   DIDOIDE   ESPERIHERTS   WITH   HYDROCORYISORE.     * H  0 SIE.
   J  ASHMORE.   R  HANLAR,   W H FISHHAR   *  NATIVE   LORD 9184  P1380-I.
   31  OCT  59

   STUDIES   ON  GLYCOBER  BIOSYNTHESIS     IN  GUINEA  PIG  CORNEA   BY
   MEANS   OF  GLUCOSE LABELED    WITH  C14.   * R  PHAUS,
   J  OBERBERGEM.   J  VOTOCEOVV    * CASE  FYSIOL   OR P45-~.   JAR  Al Cl

   GLYCOGEN    CONTENT  sOD   CARBOHYDRATE   METABOLISM    OF  THE LEUROCYTES
   IR  DIABETES   HELLITUS.    * 0  HAEHR    BIER   Z INN  HAD  940 P3TX-4.
   SEPT  59  OEM

   GLYCOGEN    LIVES.   AN IATROOERIC     ACUTE  ABDOMINAL   DISORDER   IR
   DIABATES    MELLITUS.   *  A SCHOTTE.   H A  LAREAMP,   H FREREAL   *
   NED   Y GEREESA    01ST PZ2SE-62.   7  NOV  SR OUT

   ACUTE   GLYCOGEN    INFILTRATION   OF  THE  LIVER   IN DIABETES  MALLITUS.
   2.    THE EFFECTS   OF  GLUCAGON   THERAPY.   *  A SCHOYTE.    H A LAREAMP.
   H  FRENEEL  *  RED  T  GEREESE   0104  P1288-Ri.   0 JULY   AX OUT

Figure 7.  San~p~e Page, Diabetes Index

                   47

cssenti4ly the original Luhn format, and it should be noted in this connection that while
Luhn recognized that the origin of the KWIC principle lay in the making of concordances,
he claimed in particular the use of machines to achieve speed, completeness, and accu-
racy, and a novel format. 1/

     The most common variant to the center position for the indexing window (or keyword
position) is at the left or the beginning of the line.  Netherwood's selected bibliography of
logical machine design, which is probably the first of the modern permuted title indexes
to appear in the open literature, used the left-most positions for the index entry word in
each title listing.  Slant marks were also printed to show the breaks in the normal order
of the title (Netherwood, 1958 L437])  A proposed subscription service, advertized in
1958 but never actually brought into operation, would also have used the left-hand
position.

     In these left position examples, the keyword-in-context principle is kept only
partially intact since the word in the index position is directly adjacent to its most
specific right-hand context, not to its left-hand.     In variations such as developed at
Stanford Research Institute, however, the index word is extracted from its context and
printed separately in the left-hand margin, with the title in its normal order printed to
the right.  This type of variation has been called "KWOC", for keyword-out-of-context,
and is illustrated in Figure 6, which shows the format developed by C. E.I.R., Inc. for
the OTS index to U.S. Government Research Reports.

     Table 1 lists a number of KWIC index projects for which computer programs are or
might be made available to interested additional users.      Computer programs have been
written specifically for the IBM 650, 704, 1620, 709, 7090, and 7094 data processing
systems, the G.E. 225 computer, the Deuce Computer in England, the UNIVAC 1103 and
1107 systems, and the Japanese computer JEIPAC, among others.          In addition, some
permuted title indexes are produced manually, or with the use of simple business office
machine equipment.     For example, an index to the MBS Bulletin for 1951-1961 has been
so produced by the American Institute of Biological Sciences. 3/

1/
     Private communication, excerpt of letter from H.P. Luhn to C. L. Bernier,
     December 27, 1960:      "With respect to the origin of the KWIC Index, you are,
     of course, right that it is a form of concordance, as stated in my original
     paper.    Furthermore, keyword indexing has been practiced in various forms
     as far back as a hundred years ago.   All of these methods were, however, de-
     pendent on manual effort.   I would say that the significance of the present KWIC
     Index is based on the fact that it is produced automatically by machine, affording
     speed of compilation, accuracy and completeness.         As far as the particular format
     of the Index is concerned, this is novel to my knowledge, in accordance with in-
     formation I have been able to ascertain from others."

2/
     "PILOT--a permutation index to this month's literature", see p.8 and Figure 1.
     A left-most window full-title format was developed at Stanford University in co-
     operation with the IBM San Jose Laboratories.  It has been applied by the Com-
     putation Center to the titles of computer pro~rams for the benefit of users of the
     Program Library   Computation Center, Stanford University, "The KWIC Index",
     1963.  See also Marckworth, 1961 L393]

     National Science Foundation's CR&D Report No. 11, L430], p.10; Janaske, 1962
     [299~; Shilling, 1963 Lsso] and [55~J

                                      48

3/

                                          Table 1.  KWIC Type Indexes and Programs

                                                                                         References

Issuing Organization
and/or Investigator    Name of Index or Program

                                             and
When Issued       Format         P9m?u~    Remarks

Service Bureau Corp-    "Bibliography and Auto-Index, First edition Z-column, 60-char-   IBM 709  Basic Luhn KW
oration - H.P. Luhn     Literature on Information Re- Sept. 1958    acter single line title
                        trieval and Machine           Second edition center window
                        Translation"                  June 1959

Chemical Abstracts      Chemical Titles               Semi-monthly  Standard Luhn IBM    1401
Service

Chemical Abstracts      Chemical Biological           Bi-weekly-lst Single column        1401
Service                 Activities                    issue Sept.   Center window,  lZ0-
                                                      196Z          character line, upper
                                                                    and lower case, 1Z0-
                                                                    character 1403
                                                                    printer

Biological Abstracts    B. A. S.I. C.                 Semi-monthly  Standard Luhn IBM    1440     Modified Luhn
                                                                                                  gram: shading
                                                                                                  used as an aid
                                                                                                  scanning.

Biological Abstracts    Biochemical Title Index       Monthly       Luhn, Chem.          1440
                                                                    Titles Formats

Bell Telephone Lab-     -Index to the Literature of   Annually      Single column,  lZO  7090     BE-PIP Progr~
oratories                Magnetism                                  character line,               available throu
                        -BTL talks and papers         Annually      center window                 SHARE organiz

All-Union Inst. for                                                 " ... an index of             Mikhailov, 196
Scientific and Tech-                                                the `Chemical                 [418]
nical Information                                                   Titles' type."

                                                                I

                                                          Table 1. (cont.)

                                                                                                  References
                                                                                                    and
  Issuing Organization
  and/or Investigator   Name of Index or Program      When Issued         Format         Compute   Remarks

  American Bar          Index to Current State        Initial issue,                              Eldridge and DE
  Foundation, Bobbs     Legislation                   1963                                        196Z [183]
  Merrill

  American Diabetes     Diabetes-related              First of        Z-column, left     GE-ZZB,
  Association           Literature Index              proposed series, window, KWOC,     Western
                                                      covering litera- full citation for Reserve
                                                      ture for 1960,  each entry.        program
                                                      issued 1963

  American Meteoro-     Meteorological and            April 1961,     Standard Luhn      704      Includes a Syst
  logical Society       Geoastrophysical Titles       Oct. 1961,      IBM                         UDC -Subject HE
                                                      Jan. l96Zand                                Index as well a
0                                                     following                                   modified KWIC

  Armour Research       Key words in context                          Two column,        1103,
  Foundation            (reports received in                          60-character       1107
                        document library)                             line, center
                                                                      window

  ASTIA (Defense        Keywords-in-context           Irregularly No.                    IBM
  Documentation         title index. A list of        1, Oct. 196Z
  Center)               titles for ASTIA docu-        No. Z, Feb.
                        ments not previously          1963
                        announced.

  English Electric                                                    KWIC-type          Deuce    See Black, 1962
  Company                                                                                         Dowell and Ma
                                                                                                  196Z [159].

                                                  Table 1. (cont.)

                                                                                      References

Issuing Organization
and/or Investigator    Name of Index or Program

                                              and
When Is sued       Format         Computer   Remarks

General Electric       General Bibliography on                    Single column,     GE-ZZ5
Computer Dept.         Information Storage and                    center window
Phoenix                Retrieval

Gmelin Institute       Information Journal for                                                See Koelewijn,
                       Atomic Energy                                                          196Z [330].

Japan Information                                                                    JEIPAC   "The JEIPAC,
Center of Science                                                                             transistorized
and Technology                                                                                mation proces
                                                                                              machine.. .
                                                                                              been program
                                                                                              for automatic
                                                                                              mg designed a
                                                                                              the IBM KWIC
                                                                                              mg system."
                                                                                              DNo. 11, [43
                                                                                              p. lZ0-lZl.

Lockheed Missiles      KWIC Index of Reports                      Modified Bell      1401/    See Carroll ai
and Space Division                                                Labs.              7090     Summit, 196Z

Mimosa Frenk           KWIC Index to Neuro-         August 1961   Standard Luhn      IBM
Foundation for         chemistry                                  IBM
Applied Neuro-
chemistry

M.I.T.                 KWIC Index to The            1st Edition,  Standard Luhn      704
                       Science Abstracts of         December      IBM
                       China                        1960

                                                    Table 1.  (cont.)

                                                                                        References

Issuing Organization                                                                                and
and/or Investi~ator    Name of Index or Pro~ram     When Issued         Format         Computer
                                                                                                   Remarks
National Bureau of     A Bibliography of Foreign    July 1963         Single column,   7090      Byproduct in~
Standards              Developments in Machine                        lZO-character              from Flexowr
                       Translation and Informa-                       line, center               tape, citation
                       tion Processing                                window                     including uppE
                                                                                                 lower case, p
                                                                                                 tape to punchE
                                                                                                 card conversi
                                                                                                 Walkowicz, 1'
__________________________________________ _________________________________________             [6z9].

National Bureau of     -Index to the Communi-                         Single column,   7090      Youden, 1963
Standards, W. W.       cations of the ACM                             lZO-character              and [660].
Youden                 -Index to The Journal                          line, center
                       of the ACM                                     window

Radio Corporation      Significant Words                                               RCA       Unpublished r
of America             Indexed From Title                                              301       by D. Chmen.
                                                                                                 and M. Becim

Stanford Univ. IBM     Dissertations in Physics     1961              Keyword-out-     IBM       Marckworth,
San Jose Labs.                                                        of-context,                [393].
                                                                      left window

Union Carbide Oak      Key Word Index Labora-       1st issue 1963,   Bell Labs.
Ridge National Lab-    tory Reports Received        monthly           System
oratory Libraries      Semi-annual Index            thereafter
                       January-June 1963

U.S, Atomic Energy     Index to Conferences         December          Bell Labs.
Commission, Division   Abstracted in Nuclear        1963              System
of Technical Info rmatior Science Abstracts

                                                             Table 1. (cont.)

                                                                                                   References
                                                                                                      and
   Is suing Organization
   and/or Investigator   Name of Index or Program     When Issued       Format          Computer    Remarks

   University of Califor- Key-word-in-title (KWIT)    Various        Single column,     1401/7090  Records can be
   nia Lawrence Radia-   index for reports            issues         120-character                 machine seard.
   tion Laboratories                                                 line, center                  with and, or an
                                                                     window                        not logic

   University of         Unclassified Reports         Biweekly       Single column,     1401       By-product pre
   California3           Titles List                                 120-character                 paration from
   Lawrence Radiation                                                line, center                  owriter of libr~
   Laboratories                                                      window                        cards. Turner
                                                                                                   Kennedy, 1961

   University of Kansas  Kansas Slavic Index          Initial issue  60-character       1401       Farley, 1963
                                                      July 1963      Modified

  JI                                                                 Chemical
  LA)
                                                                     Titles
   University of Kansas, (Space Law collection)                                         1401       "Current rese~
   University of Okla-                                                                             and developme:
   homa                                                                                            No. 11, p. 44~

   Western Periodicals   Permuted Indexes to          As available   Standard Luhn                 Advertised reg
   Company               Scientific Symposia                         IBM                           ly in various p
                                                                                                   icals, e.g., JS
                                                                                                   Libraries

     In addition to the regularly issued KWIC indexes by Biological Abstracts, Chemical
Abstracts Service, the American Meteorological Society and others, a large number of
special field, one time, or limited collection coverage indexes of this type have been and
are being produced both in the United States and in other countries.  Well-known examples
include the programs developed at the Lawrence Radiation Laboratories, University of
California, which simultaneously produce catalog, cross-reference and subject authority
cards, I' and the programs developed at the Bell Telephone Laboratories from 1959 on-
ward (Kennedy, 1962 [310]).

     Other KWIC indexing efforts cover a wide variety of subject matter.    In the field
of law, applications of KWIC type indexing include work on the legislation of the 50 states,
a joint project of the American Bar Foundation and the Bobbs-Merrill Company (Eldridge
and Dennis, 1962 [183], 1963 [182]), the ninth annual edition of the Index to Legal
Theses and Research Projects, July 1962, (Eldridge and Dennis, 1963 [182]); and a co-
operative program between the libraries of the Universities of Kansas and Oklahoma to
prepare an index to the latter's `1Space Law) collection. 2/ In 1960, the KWIC Index to
the Science Abstracts of China was prepared for an AAAS Symposium) (Henuerson, 1~b1
[ 263]; Farley, 1963 [192]).    At the University of Kansas Library also, the Kansas
Slavic Index is being produced, with coverage of 3, 000 articles from more than 200 Slavic
journals. ~/ In the computer technology field, Youden (1963 [659] and [660]) has com-
piled KWIC type indexes to both the Journal of the ACM and the Communications of the
ACM and the Western Periodicals Company offers KWIC indexes to the proceedings of
the Joint Computer Conferences as well as to the proceedings of other conferences and
symposia including those in fields of electronics, aerospace and quality control. 4/   A
special-purpose application is in the use of a KWIC-index in lieu of cross-references in
a revised edition of Current Medical Terminology.   5/

     Examples of KWIC indexing projects abroad include work at the Japanese Informa-
tion Center of Science and Technology, Tokyo,      an index `1of the `Chemical Titles'type"
at the All-Union Institute for Scientific and Technical Information (VINITI) U.S.S.R__7/
an information journal for the atomic energy field being prepared at the Gmelin
Institute, (Koelwijn, 1962 [330]), and work in Great Britain both at the English Electric
Company 8/and the IBM British Laboratories (Black, 1962 [65]).

1/
     Nation Science Foundation's CR&D Report, No.11, [430], p.42.

2/

3/

4/

5/

6/

7/

8/

     Ibid, pp.44 and 171.

     Ibid, p.43; University of Kansas, 1963 [307].

     See advertisements in journals such as American Documentation.

     Gordon and Slowinski, 1963 [236], p.55.

     National Science Foundation's CR&D Report, No.11, [430], p.120.

     Mikhailov,1962 [418], p.50.

     Dowell and Marshall, 1962 [159], p.323; Black, 1962 [65], p. 316.

                                      54

                      1/
Trans-Canada Air Lines - is using a KWIC System, and at the EURATOM ISPRA labora-
tories a KWIC type program has been developed with up to 600-character context and a
left-most indexing position. 2/

     3.1.2 Advantages, Disadvantages and Operational Problems of KWIC Indexing

     Luhn's original acronym, KWIC, is peculiarly apt for permuted title word indexing.
As both proponents and critics have noted, the resulting product may be relatively crude
in terms of indexing quality, but it is quick.  The speed achievable both by elimination of
human intellectual effort and by use of machine (especially computer) processing is indeed
the major single advantage of this type of automatic indexing.  Closely related, however,
are the advantages of currency of announcement and the availability of these indexes for
individual use.

     Some typical claims with respect to speed and currency are as follows:

     "The permuted index was invented as a means of adequately controlling
     (essentially, of indexing) the literature without further intellectual effort,
     and thus eliminating indexing delays " 3/

     "The great merit of this particular method. . . is that it enables information
     concerning new articles to be made available very much more quickly than if
     there were the inevitable delays of human abstracting and indexing " 4/

     "In spite of the disadvantages which are pointed out, perhaps the greatest
     advantage is the timeliness and the speed with which permuted-title indexes
     can be prepared." 5/

     Specific examples of high speed are given by Biological Abstracts, where one hour's
computer time suffices to prepare and arrange entries for over 150,000 items. 6/
Kennedy reports for the Bell Laboratories System that:

     "Editorial scanning is very fast; only several lines of print must be read for
     each report and the required text markings are trivially few.   Keypunching,
     the largest single task, takes about two minutes per report. .. Main-frame time
     ... was 12 minutes for 1703 reports " 7/

1/

2/

3/

4/

5/

6/

7/

     Simons,1963 [556], p.34.

     Meyer-Uhlenried and Lustig, 1963 [417], p. 229.

     Tukey, 1962 [611], p. 13.

     Cleverdon, 1961 [125], p.108.

     Janaske, 1962 [299], p.3.

     See Biological Abstracts, 36:24, p. xii.

     Kennedy, 1961 [311], p. 123.

                                       55

      Skaggs and Spangler claim:

      "The most obvious advantage of permuted indexing by computer is speed.     In
      a test of one permuted indexing system, input of 3, 000 punched cards contain-
      ing titles and running text produced a permuted significant word index of
      12,190 index entry lines, with approximately 85 minutes of computer time
      required for the permuting and sort operations.  The output was printed at
      some 500 lines per minute.   ` 1/

      In many cases, greater speed and timeliness are achieved at significantly lower
cost.  This is particularly true if the preparation of the input -- title, author, item
identification and other descriptive cataloging information- - serves multiple purposes
from a single  keystroking operation.  Thus, the MATICO System provides from a single
input (1) KWIC indexes as required, (2) selective dissemination notices to potential users
of new acquisitions, (3) records on magnetic tape for the information retrieval file, and
(4) book catalogs covering specialized areas of the collection, all at a net savings over
previous methods of $0.39 for each title processed. 21

      Another advantage which is typically claimed for KWIC indexes is the use of the
author's own terminology.   The display of different words as they have been used in
title context with any word looked up introduces "suggestiveness" so that different mean-
ings and different browsing clues are shown.  Kennedy makes the following typical points:

      "The use of the author's own terms--the alive currency of new ideas--rather than
      the considered reshapings to the indexing system may often be of advantage.    The
      automatic generation as index entries of all the separate words in multi-term
      concepts is definitely so. Access is direct, under any one of the component
      terms, in the unrestricted manner of uniterm indexing.  And context minimizes
      false drops; the author has supplied the term coordination." 3/

      Others, however, consider some of these same factors to be definite disadvantages.

      In general, even among enthusiasts of KWIC, there is more agreement as to the
values of the technique as a device for current awareness scanning and as a dissemination
index than for its use for more extensive searching.  It was, in fact, primarily as a
dissemination index that Luhn first proposed the KWIC technique.  He pointed out that
such indexes could be prepared with minimum effort and be ready for dissemination in
the shortest possible time, justifying publication by inexpensive printing means.  He also
noted the following additional advantages:

1/

2/

3/

     Skaggs and Spangler, 1963 [557], p.30.

     Carroll and Summit, 1962 [102], p.4.

     Kennedy, 1962 [310], p.184.

                                       56

    "1.   Because of the mechanical method of preparation, more information
          may be displayed than would have been practicable by conventional
          means.

    "2.   Keywords-in-context permit the cross-correlation of subjects to an
          extent not realizable by conventional procedures." 1/

    The most common type of complaint against the KWIC indexing method is, as we
have noted earlier, identical with that which is applied to word indexing in general--the
lack of terminological control.  Where the indexing terms are restricted to those used by
the author himself, in his title or even full text, there arise many serious problems of
synonyms, near-synonyms, homographs, neologisms, and eponyms.           The effects of
machine inability to resolve these problems are redundancy, scatter of references
throughout the index, `1haphazard groupings"  2/ and retrieval losses because the user is
forced to guess at the terminology the author actually used. ~ These problems are
severely aggravated when only the title is used as the basis for index-word extraction.

    Thus, a first and major question in attempting to appraise the effectiveness of KWIC-
indexing techniques is that of the adequacy of titles alone as the source of subject content
clues.  Spurred on at least in part by the existence of KWIC-type indexes, several
investigators have studied this question, with somewhat different results.   Williams has
explored for some years the possibilities of developing systematic procedures for title
elaboration, especially making explicit information that is implied.  Her conclusions are
that indexing by title and direct elaboration of the title would produce index information
equivalent to that found in Chemical Abstracts for about 50 percent of the documents
studied, but that other procedures would be required for the remainder. 4/

    Specific studies of title adequacy for a particular journal or field have been under-
taken by both the American Institute of Physics and the Biological Sciences Communica-
tions Project.  In the A. I. P. experiments, graduate physics students were asked to
locate from limited clues certain specific articles appearing in The Physical Review, and
search times were checked for their use of permuted title and other indexes. Another
group of students compared the subject index entries in Physics Abstracts and Chemical
Abstracts with the words in the titles of 25 papers from The Physical Review.    In the case
of Physics Abstracts, 69 percent of the entries for these papers were found in the words
of the title and 63 percent of the titles contained all of the information supplied by the
set of index entries. In the case of Chemical Abstracts, the corresponding percentages
were 47 and 23.5/ These latter findings, for the chemical index, are closely corroborated

1/

2/

3/

4/

5/

    Luhn, 1959, [381]   p.295.

    Olney, 1963, [458], p. 44.

    See, for example, Dowell and Marshall, 1962, [159], p.324:   "This problem of
    `conceptual scatter' becomes a nightmare when highly idiosyncratic author
    language is used as a basis for subject indexing."

    Williatns, 196~ [643) , pp. 36~ -363.

    Maizell, 1960[392], p. 126.

                                         57

Bernier and Crane who report that for the non-organic chemistry items covered by
Chemical Abstracts, 34 percent of the entries can be derived from the titles. 1/

    With respect to the Biological Sciences Communications Project studies, Shilling
reports as follows:

    `1Titles of scientific articles are being utilized at present in a great many ways
    under the general assumption that there is a positive correlation between the
    title and the content of the article. A study was undertaken to analyze the
    accuracy of titles in describing the content of biomedical articles. It was conducted
    in two parts. In part one, a group of scientists were asked to predict the content
    of selected scientific articles, in their area of interest, from the title, the author1s
    name, and the name of the journal in which it appeared.    The results of the first
    phase of the study on the first trial journal were so diverse as to make analysis
    impossible, and this part of the study was not pursued further.  From this small
    segment of the study it appears that scientists are deluding themselves when they
    search by title only and then decide what they wish to read.

    "In the other half of this experiment, the article without title, author1s name, or
    journal name was sent to 20 scientists, selected as experts in the scientific field
    of the article, who were asked to write a meaningful title.  Fifty articles were
    used, five from each of ten selected biomedical journals.   From this part of the
    study it is apparent that if the article is in a field which is relatively well
    standardized and has an accepted vocabulary, it is possible for a group of titlists to
    agree remarkably well on an appropriate title.  However, if the article is loosely
    organized, contains more than one subject, or is in a specialty in which there is
    no standard vocabulary, then titling scientists fail to agree to a rather alarming
    extent. _

    Other studies involving the question of usefulness of titles alone for indexing purposes
include those of Doyle, Lane, Montgomery and Swanson, O'Connor, Ruhl, Swanson, and
White and Walsh, among others.  Doyle checked the retrieval loss likely to result from
the synonymity-scatter problem for a permuted title index compiled in 1958 to the internal
reports of the System Development Corporation.     He found, for example, that for 12
direct references to McGuire Air Force Base, there were one to "New York Air Defense
Sector", two to "New York Sector", ten to "NYADS" and five to "N.Y. Sector".

1/

2/

3/

    Bernier and Crane, 1962 [56], p.120.

    Shilling, 1963 [551], pp.205-206.

    Doyle,~96~ [166], p. 11.

                                         58

    Ruhi (1963 [506]) found that between 50 and 90 percent of author-prepared titles (the
variation depending on subject field and other circumstances), did fully reflect the index
terms assigned to these documents by human indexers.  Lane and White and Walsh have
also made studies directly related to the question of KWIC index effectiveness.   The latter
two investigators report only 52 percent retrieval effectiveness for a permuted title index
to the Abstracts of Computer Literature, 1962, which they attribute to the changing
terminology in the still new field of computer technology. ~1/ Lane made counts of titles
that would be "acceptable" and those that would not for a KWIC index for 50 titles drawn
from each of 10 published indexes.  He concluded that, if there were judicious pre-editing,
technical articles in the technical subject indexes could be quite adequately covered, and
papers in the fields of law, business, and the humanities somewhat less satisfactorily so,
but that for the material indexed in the Reader's Guide to Periodical Literature, the KWIC
technique would fail 58 percent of the time. ~l

    Montgomery and Swanson have studied, as has O'Connor is even more detail, the
adequacy of "machine-like indexing by people".  Montgomery and Swanson took as their
test corpus the September 1960 issue of Index Medicus and found that for 4, 770 items,
85.8 percent contained either the word itself or a synonym for the subject heading
assigned, slightly over 11 percent did not, and in the remaining cases the investigators
could not clearly decide.  They concluded, therefore, that: "Most of the articles studied
could have been indexed by machine on the basis of machine `inspection' of article titles
alone." 3/ O'Connor, however, typically reports that of a random sample of 50      papers
manually indexed under the term "Toxicity", five had titles which contained the word
"toxic" or the word "toxicity" and 34 had titles which were not even indirectly connected
with the term. ([;443], [444], [445], [447] and [448]). With respect to the Montgomery-
Swanson conclusions as such, Carlson raises the further critical questions of over-
assignment and false drops and suggests that: "a simple machine processing of titles
would give us way too much or practically nothing." 4/

    Research activities at the American Bar Foundation have included checking of
KWIC type indexing of several thousand legal articles with the subject headings assigned
under the "Index to Legal Periodicals" system   (Kraft, 1962 [333]).  It is reported that:

1/

2/

3/

    White and Walsh, 1963 [639], p. 346.

    Lane, 1964[345], p.46.

    Montgomery and Swanson, 1962 [421], p. 359.   In another study (1962 [534], p. 468),
    Swanson reports findings for several thousand entries in classified bibliographies
    where approximately 90 percent of the sampled items contained title words that were
    identical, or similar in meaning, to the subject headings under which they were
    indexed.  He notes, however, that similar results could have been produced by
    machine processing with the sigrnficant p7oviso that the machine have available an
    adequate synonym dictionary or thesaurus.

    G. Carlson, 1963 [100], pp.328-329.

                                        59

4/

    "Interpretation of data revealed, among other things, that 64.4 percent of the

    title entries contained as keywords one or more of the ILP subject heading words
    under which they were indexed, and 25.1 percent contained logical equivalents.
    The remaining 10.5 percent of the title entries had non-descriptive titles.

    The difficulties with titles as sources of the indexing information stem from at least
three distinct types of determining factors:  (1) the language habits, background,
interests, and idiosyncracies of the author; (2) the interests, familiarity with the subject
matter, language habits, imagination, and idiosyncracies of the user, and (3) factors
largely extrinsic to either the particular author or the particular user.  In the first case,
we find especially the problem of the witty, punning, deliberately non-informative title,
the so-called `1pathological title".  Janske gives the provocative example, in the literature
of information selection and retrieval itself, of "The Golden Retriever". 2/ Even in the
non-pathological case, however, there is the serious question of whether the author him-
self is likely to be a good indexer 3/

    On the user side,  the normal critical problems of "bringing the vocabulary of
indexer and searcher into coincidence" (Bernier, 1953 [55]) are aggravated by the facts
that the user of KWIC must anticipate the terminology used by a large number of
different "indexers" (i. e. , the authors), that title words spelled the same but with quite
different meanings in different special applications are grouped together in the same
place in the index, and that the same concepts may be expressed in quite different
phraseology depending on the author's, rather than the user's, field of specialization.
these aggravating circumstances there must be added in turn the psychological accept-
ability to the individual user of the scatter and redundancy, to say nothing of the format
and legibility, of a particular published index.

                                                                              To

    Such factors affecting the particular user will of course vary with the nature and pur-
post of his search.  Kennedy points out, for example, that the location of a document from
only a single clue, a single title word, is particularly easy with a permuted title index
and he emphasizes that the "index purpose, use, size, statement and array are other
factors of considerable moment in judging the value of title indexes".

1/

2/

3/

    National Science Foundation's CR&D Report No.11, [430], p. 62.

    Janaske, 1962 [299] , p.4.

    See, for example, a report on a conference on better indexes for technical literature,
    ASLIB Proceedings, 13:4, April 1961, with a number of statements on the author as
    a poor indexer.  See also Crane and Bernier, 1958 [144], p. Si5: "Not even authors
    are qualified to index their own work unless they are equipped for the task by train-
    mg and experience

4/
    Kennedy, 1961 [311], p. 125.

                                        60

      A major question in the area of user acceptability, however, is that of the adequacy
of title alone to tell the searcher whether or not a specific document is relevant to  his
query or interest.  A number of investigators, both documentalists and user-scientists,
suggest that this is rarely the case. 1/ In fact, for many users, titles alone provide only
a negative searching device--in an announcement bulletin or abstract journal the user's
scanning of titles merely tells him whether or not he should read the abstract and then
perhaps go on to the paper itself.

      It is for reasons of this type, in all probability, that Montgomery and Swanson found
less effectiveness of titles on *re1evance~judgment tests than might be suggested by their
more optimistic findings as to the success of machine procedures for replicating human
subject heading assignments.  Whereas they have claimed that about 90 percent of test
items could have been as successfully indexed by machine as by manual procedures,
(Montgomery and Swanson, 1962 [421]; Swanson, 1962 [584]), they have also reported
that:  1'Comparison of title relevance judgment with judgment based on full text examina-
tion indicates that titles are only about one-third effective (i.e., two-thirds of the relevant
articles would be judged irrelevant) as the basis for estimating the relevance of the
article to a given question". 2/ They go on to suggest, therefore, that ". .  indexing should
be based on more than titles and. . . a bibliographic citation system should present to the
requester something more than titles. 1' 3/ Similarly, Jahoda reports in an analysis of 281
actual search requests at Esso Research and Engineering that only two-thirds could have
been answered with a shallow index based on titles and major section headings of the
documents    and that answering the remainder of the requests would have required an index
of considerable depth. 41

      The obvious factors affecting the utility of titles as the source of indexing~searching
clues include, first, the limitation of most titles to the principal subject matter, the main
topic or topics of the document.  The display of title context does to some extent provide
for modifications of the topic to the special aspects treated, but it is of course  obvious
that a title cannot possibly provide clues to subject content not implied in the words of that
title.  In many cases, the potential user wants information contained in the paper, or even

1/

    See, for example, Atherton and Yovich, reporting on evaluations by physicists of
    experimental citation indexing, 1962 [26], p. 22:   "The reliance on titles of papers
    for retrieval purposes was not sufficient"; Levery. 1963 [359], p.235. "Titles are
    usually insufficient to furnish a correct index to the text"; Hocken, 1962 [274], p. 93:
    "The titles were not explicit enough"; Crane and Bernier, 1959 [145], p. 1053:
    "Li sts of titles can be prepared rapidly, but they are inadequately useful in selecting
    articles of interest, and they provide little or no directly usable  ~
    Dowell and Marshall, 1962, [159], p.324:  "Frequently titles either lack sufficient
    detail or are in fact misleading"; Connolly, 1963 [136], p.35:     "Most titles are
    inadequate as descriptions of the contents of papers."

2/

3,

4'

    Montgomery and Swanson, 1962 [421], p.364.

    Ibid, p. 366.

    Jahoda, 1962 [298], p. 75.

                                       61

in its appendices, which was not the principal concern of the author and may not even have
been considered significant by him.  The claim that the author, who knows his own subject
best, has already indexed his paper best by his choice of words and emphasis in text, and
especially in his title, is pertinent only to that main subject to which he addresses himself,
not to the other potentially useful information which he may also disclose.

    Other extrinsic factors affecting title adequacy and hence the effectiveness of title-
indexes are the size and the relative homogeneity or heterogeneity of the collection or set
of documents so indexed, the breadth or narrowness of the subject field or fields covered,
the time period covered and whether for one or many fields.   Whether or not material in
more than one language is included is a special factor.  These various factors interact in
various ways, usually with disadvantageous effects when even the most "nondescript"
human indexer (that is, one who accepts only words from the text itself) is replaced by
"a keypunch operator whose job it is to convert the keywords into machine-readable form,
and a machine whose job it is to assimilate machine-readable text and print out its per-
mutations with each significant word serving as an access point." 1/

    The difficulties of subject scatter,  synonymy, homography, redundancy, and the
like, however, will also occur in human indexing that relies heavily1on title only, which
is perhaps more frequently the case than is generally recognized, - just as much as for
machine-generated indexes involving the permutations of keywords in titles.  Such dis-
advantages must therefore be balanced not only against the advantages of speed, timeliness,
having an index announcement tool personally available at low cost, and the like, but also
against the probability of obtaining as useful a tool within the limits of available human
indexing resources and justifiable costs.   Cleverdon, for example, comments as follows:

    "There are those who would say that this [KWIC] can in no way be called indexing,
    and that the value of such indexing must be very much lower than that done by
    intelligent trained human beings.    This is a comfortable thought, but such small
    evidence as is at present available makes it appear doubtful as to whether it is
    entirely true.  This is not to say that a human being cannot do a better job, but it
    certainly appears likely that the cost of employing a human being to do it is of
    doubtful economic value." 3/

1/

2I

    Herner, 196z [266], p.4.

    See, for example, Moss, 1962 [425], p.39:   "I am convinced that a great many of
    the UDC and other numbers which are provided on millions of cards in technical
    libraries up and down the country, and which look so erudite, are, in fact, no more
    than cards transliterating titles, with occasionally similar transliteration of a few
    randomly chosen words from the abstracts as well. . . We are, in effect, already
    largely using title indexing and complicating it unnecessarily by magic numbers."
    See also Crane and Bernier, 1958 [144], p. 514:   "Some indexes to periodicals,
    particularly word indexes, are merely indexes of titles of papers or of abstracts."

    Cleverdon, 1961 [125], pp.107-108.

                                       62

3/

    It is also of interest to note, moreover, that the very existence of machine-generated
permuted title indexes should greatly increase the likelihood that authors will use better
and more useful titles. 1/  At a seminar on word and vocabulary byproducts of permuted
title index~ng held at Biological Abstracts headquarters on October 8,   1962, Rigby of
Meteorological and Geoastrophysical Abstracts reported informally that as of that time
there was already discernible improvement in titles covered by their KWIC index.      In the
same year (1962), Tukey similarly stated that:  "Chemjcal Titles has been heavily enough
used to affect the construction of titles of papers on chemical subjects. " 2/  Instructions
to authors of the previously mentioned 11Short Papers" 3/ for the A. D. I. 1963 Annual
Meeting specified that at least six significant words should be included in their titles and
nearly all authors did in fact comply.  Two of the "Short Papers" are specifically directed
to the topic of improvements that authors can make in writing their titles (Brandenberg,
1963 [80]; Kennedy,   1963 [312]).

    Instructions of this type can be effectively used for situations where all authors are
under the same administrative control, as in the internal reports prepared in a single
organization.    This type of situation, incidentally, is one for which KWIC proponents are
often most enthusiastic (Kennedy, 1962 [310]; Black,   1962 [65]; Linder, 1960 [362]).
Finally, there is considerable promise that pressures brought to bear by journal editors
of the publications of professional societies, notably the American Institute of Chemical
Engineers and other cooperating member societies of the Engineers Joint Council, will
result in improved adequacy of titles and thereby increased effectiveness of title word
indexes.

    Certain other disadvantages of KWIC indexing techniques, however, relate specif-
ically to operational problems and requirements in the machine production of these indexes.
There is, first, the problem of the amount of context that is usually displayed--that is, the
question of line length--and the related problems of title truncation and wrap-around.   As
Kennedy notes:    "Progressive shifting of the title to bring a given word to the indexing
column frequently causes portions of the title to exceed the line space available, first at
the right margin, then the left, or even both simultaneously. " 4/  A case in point is the
perhaps apocryphal "EROTIC TENDENCIES AMONG TRAPPIST MONKS" where
"ATHEBOSCL" had been dropped off at the left.

    For multi-column KWIC indexes, in particular, where the line length is typically
58-60 characters, "much of the relevance is lost because the reader sees the wrong slice
of the title". 5/  The Bell Laboratories KWIC index, 6/ Chemical-Biological Activities, 7/

1/

2/
    Tukey, 1962 [611], pp. 9-10.
3/
    Luhn,  1963 [376] and [377].
4/
5/
6/

7/

See for example, Black,  1962 [65],

Kennedy,  1961 [311], p. 117.

Brandenberg,  1963 [80], p. 57.

Kennedy,  1961 [311], p. 118.

Figures 4 and 5.

p. 317; Youden, 1963 [658], p. 332.

63

and Youden's indexes to ACM papers (1963 [659] and [660]) illustrate single-column
formats that alleviate this problem by extending the title line to 103-106 characters, ex-
clusive of the identification code.  Youden has calculated that for the titles in the field of
computer literature which he analyzed 30 percent of the titles would have been truncated
in 60-character title line formats, but that only 2 percent would have been chopped by 103-
character title length limits. 1/

    A second disadvantageous effect of machine production requirements in most KWIC
indexes is the tedious sequential scanning necessary because of the unbroken organization
of the page format and the long blocks that occur for frequently occurring word entries.
Doyle (1959 [168], 1961 [166]) has investigated this problem of block length and suggests
either that alphabetization be carried out to the 1words following those in the indexing
window or that the entries in the block be permuted also in a second-order cycle.  The
latter suggestion has the advantage of facilitating any two-term coordinate indexing
type of search, "because one can now look up directly any pair of subject words, regard-
less of whether or not they occur adjacently in a sentence.' 2/

    Redundancy in KWIC indexes, which aggravates the sequential scanning and the long-
block fatigue effects, is in large part the result of difficulties in establishing the most
appropriate bounds for exclusion or "stop" lists.  We have previously distinguished
machine-generated indexes of the derivatiy e type from certain of the machine-compiled
indexes primarily on the basis that in the first case, the criteria for determining the
significance of the keywords to be used as the index access points are applied auto-
matically during the machine processing, even if the selectivity so achieved is only
"negative selectivity. "   The amount of index entry redundancy, of too many entries
and of irrelevant entries is, in simple KWIC indexing, a direct function of the length and
contents of the stop list.

    In Luhn's original proposals for both KWIC and other types of automatic indexing,
he pointed out the importance of the rules which must be established in order to
differentiate the significant words from the nonsignificant.  He says, for example:

    "Since significance is difficult to predict, it is more practicable to isolate it
    by rejecting all obviously nonsignificant or `common' words, with the risk of
    admitting certain words of questionable value.  Such words may subsequently be
    eliminated or tolerated as `noise'.   A list of nonsignificant words would include
    articles, conjunctions, prepos4tions, auxiliary verbs, certain adjectives, and words
    such as `report','analysis', `theory', and the like."   4/

1/

2/

3'

4/

    W. W. Youden, 1963 [458], p.331.

    Doyle, 1961 [166], p. 13.

    Artandi, 1963 [zo], p.15.

    Luhn, 1959 [381], p.289.

                                        64

    Interesting variations are to be noted in the current practices of using stop lists.
Some lists are quite short, and others extend to several thousand words.  Parkins reports
that a mere 14 words on the stop lists used for B. A.S.I.C. are responsible for 80 percent
of the title lines that need not be printed, but that their original list of 200 stop words grew
quite rapidly to more than 1, 000 now in use. 1/ ChemicalAbstracts Service representatives
reported in 1962 an initial list of about 1, 000 words which dropped to 300 at one time and
then was increased again to the original level. 2/ Using a stop list of 82 words eliminated
30 percent of a 42, 000-word corpus of internal reports at the System Development
Corporation, (Olney, 1961 [456]).

    Critical questions in the establishment of stop lists relate to the problem of balancing
the economics of the number of title lines to be printed and to be subsequently scanned
against the loss of retrieval effectiveness if certain words are omitted from the search
entry positions.  How this balance should be achieved may vary from one subject field to
another and between different organizations.  In several regularly published KWIC indexes,
the actual list used to exclude the presumably nonsignificant words is printed so that the
user can check before proceeding to actual search.  Williams has suggested that each
excluded word be listed once, in its proper alphabetic place in the index, if it occurs in
the titles of the particular set of items being indexed. 3/

    In general, however, not enough is yet known about the requirements of particular
subject fields and particular types of organization to arrive at the most effective compro-
mises in establishing exclusion lists for keyword indexing.  Noting that stop lists in
actual use vary from only a few function words such as prepositions and conjunctions to
lists several hundred words long, Brandenberg points out that:

    11At the present state of the KWIC indexing art the selection of stop words appears
    to be largely arbitrary and a comparison of half a dozen stop lists shows that they
    have about two dozen words in common. 11 4/

Kennedy and Doyle both specifically suggest that more research on the contents and
effects of stop lists is necessary, (Kennedy, 1961 [311], 1962 [310]; Doyle, 1963 [162]),
but Kennedy points out the ease with which the machine programs themselves can be used
for modification of the lists. 5/

1/

2/

3/

4/

5/

    Parkins, 1963 [466], p.27.

    F. A. Tate, discussions at seminar on the word and vocabulary byproducts
    muted title indexing, Biological Abstracts headquarters, October 8, 1962.

                                                                          of per-

    T. M. Williams, discussions at seminar on word and vocabulary byproducts of per-
    muted title indexing, Biological Abstracts headquarters, October 8, 1962.

    Brandenberg, 1963 [80], p. 57.

    See also Clark, (1960 [123], p.459), who suggests:   "It is very probable.. .that the
    cut-off points [for most common, for very infrequent, words] will have to be adjusted
    to the material we actually use.  The effect on the process of such factors as style,
    size of text, the complexity of the subject matter, and the like, is as yet not clearly
    seen.  The collection of large amounts of text and their analysis will undoubtedly be
    the best way of determiningthe effects of these variables."
                                           65

    Some of the reasons for keeping stop lists short, however, may reflect unnecessary
programming difficulties.  Turner and Kennedy have reported that in the SAPIR system a
title word is compared only with the group of nonsignificant words that have the same
number of characters, in order to reduce the machine time required for the exclusion
list search. 1/ Skaggs and Spangler give an account of an exclusion list system developed
for general text processing as follows:

    "A representative form developed by General Electric is composed of three groups
    of words, high frequency, special and standard.     The high frequency words (25)
    occur most frequently in English text.  A compression of approximately 35 percent
    will occur for most kinds of text when these 25 words are deleted.  The special
    words are derived from the particular body of text being processed    The com-
    position of this group is left to the program user.  Normally the words for this
    group  are selected by making an Editing list in alphabetical sequence.  The words
    appearing in the index position on the preliminary listing are then reviewed.

    "Standard words are words that occur with a relatively high frequency in most
    types of text and therefore are appropriate for a general purpose screen.  In the
    GE program, 375 words are used in this group.

    "To minimize computer processing time, it is desirable that words in the Ex-
    clusion Dictionary be arranged in approximate order of their frequency of
    occurrence."    2/

It should be noted, however, that in most cases stop list searches can be programmed in
the form of so-called "logarithmic", "partitioning" or "bifurcation" searches in which
the number of machine operations required is only log2N + 1, where N is the number of
words in the list.

    The more words excluded, the fewer the title entry lines that must be included in
the final index.  This is a factor involving first of all the user in the sequential scanning
he must do, where, as Coates has remarked, the retrieval effectiveness is usually in
inverse proportion to the amount of such scanning required. 31 Secondly, longer stop lists
help to minimize the long block problem, since it is obviously the most frequently
occurring title words that have not been excluded that cause the longest blocks of entries.

1/

2/

3'

    Turner and Kennedy, 1961 [614], p.7.

    Skaggs and Spangler, 1963 [557], p. 29.

    Coates, 1962 [134], p. 430.

                                      66

The important economic factor, however, is the total number of lines to be printed in the
index, which is directly reflected in page costs.  The effects of page costs, in turn,
engender compromises in printing quality, such as page format and size of type.   These
are among the serious unresolved problems that affect user acceptance of KWIC indexes
and involve questions of format, legibility, character sets, and size of the index.

    In general, however, in the present state of the art of KWIC indexing, the consensus
seems to be that of qualified praise, especially for the early announcement and dis-     1/
semination applications.  The KWIC index is recognized as responding to a definite need,-
as having merit for fields in whi~h more conventional indexes do not exist as well as for
current awareness searching,21 as receiving excellent response from users "because
they can take a handy booklet, sit down at a table and look under the words they know and
use, and which they expect other engineers to use in titles.  3/ Bernier and Crane, after
considering comparative effectiveness data for subject as against word indexing, come to
the following conclusions:

    `1Title lists keyed by words have value for quick distribution and fast use since time
    is often a very important element in the obtaining of information.  Such lists do not
    serve adequately for thorough searching. ... A title concordance may be more use-
    ful than would seem from the . . . data on index entries. However, it must obviously
    be incomplete, must have many unnecessary entries, and would not prove suggestive
    enough to users who lack background in the subjects sought." 4/

    Additional benefits can quite readily be obtained by taking advantage of the biblio-
graphic information once it is in machine-readable form to provide selective KWIC
indexes (Ba1z and Stanwood, 1963 L28],' Black, 1962 [65j; Carroll and Summit, 1962 [lOZj')
machine retrieval of item citations by specified keywords.   (Kennedy 1961 ~11]) and
selections of items geared to a Selective Dissemination of Information System (Barnes and
Resnick, 1963 [36]; Balz and Stanwood, 1963 [28]).    Gallianza and Kennedy at the
Lawrence Radiation Laboratory, for example, report as being under development
programs for the IBM 1401 and 7090 computers which will combine KWIC type indexing
features with the logical search operators "AND", "OR", and "IF" in order that users
may specify subject searches in ordinary English language terms.
1/
    Clapp, 1963 [122], p. 7

2/

3/

4/

5/

    Markus, 1962[394], p.19.

    Black, 1962 [65], p.316.

    Bernier and Crane, 1962 [56], p.120.

    National Science Foundation's' CR&D Report No.11, [430], p.42.

                                       67

3.2 Modified Derivative Indexing

    Some of the more obvious of the disadvantages of KWIC indexing techniques can be
reduced if not eliminated by a variety of human and machine procedures.  These include
augmentation of titles to provide additional clues to subject aspects, manual post-editing,
and synonym reduction through such devices as thesaurus lookups.

    The ink was scarcely dry on the first issues of a KWIC index before a number of
suggestions for improvements, modifications, and augmentations were proffered in the
literature.  In fact, both Luhn and Baxendale considered various possible refinements in
their original proposals.  The first systematic review of work in the field of automatic
extracting- -whether to produce indexes or abstracts, or both- -was made by Edmundson
and Wyllys in 1961[(181].   They covered not only the KWIC type indexes as such, but also
modifications suggested by Baxendale, Luhn,   Oswald and others, and they themselves
advanced a number of additional possibilities.  Of the various modifications and refine-
ments that have been suggested, the most obvious is that of title augmentation.

    3.2.1 Title Augmentation

    The machine-prepared index that was probably the first to go into productive opera-
tion is actually one involving title and subject indicators rather than pure keyword-from-
title permutations.  The CIA project, beginning in 1952, is based upon manual pre-
editing of the titles themselves, with the words to be picked up as index entries being
underlined.   In addition, it involves assignment of other words, descriptors or terms
from a hierarchical classification schedule to indicate additional access points (Veilleux,
1961 [624].

    In later KWIC type indexing, the possibilities of improving effectiveness by pre-
editing or post-editing to modify and expand titles have been suggested and explored by a
number of investigators.   The semi-automatic indexing reported by Janaske adds
descriptive words or phrases in parentheses at the end of titles and uses them as
additional indexing points (Janaske, 1962 [299]).   At Biological Abstracts Service,
improvements have been obtained (without sacrifice in the speed desired in order to index
5,000 abstracts twice a month) by title supplementation as well as by an improved stop
list and by post-editing word divisions and word recombinations. 1/ Titles for each of
two 12, 000-item bibliographies in the field of radiobiology are reported as being edited
considerably before KWIC type processing. 2/ Other examples3?f modified derivative
indexing based on title augmentation include Chemical Patents -, the Applied Physics
Letters indexing project at Oak Ridge National Laboratory, which provides for an author-
prepared form to describe features of property and method not covered in the title, 4/
and the KWIC Index to Neurochemistry ([420]).

1/

2/

3/

4/

    Parkins, 1963, [466], p.27.

    Davis, 1963 [lS0i,p.238.

    See Markus, 1962 [394], p. 19, and ref. [662].

    Connolly, 1963 [136], p.35.

                                       68

    To some extent, however, the use of human editors to improve the product of KWIC
type indexing defeats the initial purpose of a quick and purely clerical or mechanical
process.  Thus, Dowell and Marshall argue:

    "...The basic permuted-title index can be substantially improved by editing and re-
    writing the titles before they are submitted to the computer. . . . But this of course,
    destroys the great advantage claimed for the permuted title index, `that it is a
    purely clerical process'.  Intellectual effort has entered the picture again and we
    are back where we started.'   1/

In the extreme case, the re-introduction of intellectual effort is in effect the re-introduc-
tion of conventional human indexing, with the machine's role limited to that of compilation,
as in the case of the "notation-of-content" statements prepared for NASA's STAR
System (Slamecka and Zunde, 1963 [561]; Newbaker and Savage, 1963 [430]).

    Kennedy suggests instead, therefore, that the augmentation might be accomplished by
the authors themselves.  However, it may then be pointed out, as by Bernier and Crane,
for example, that the supplementation of titles before publication in order to provide
suitable additional indexing words would be "awkward, space~consuming and difficult".
They continue:

    "It would call for the attention of index experts at the manuscript stage, which would
    delay publication and expand the total indexing effort.  Furthermore, good, thorough
    indexes are based on the full information of abstracts and papers, not on their titles
    only." 2/

    An alternative method for title augmentation to improve the quality of KWIC indexing
is therefore to establish procedures for machine selection of significant words from more
of the text than just the titles alone.  In fact, Luhn himself did not limit his technique as
originally proposed to titles only but indicated that the process could be performed at
various levels: title, abstract, or full text. 3/ In the 1958 permuted index to the ICSI
preprints, entries were derived from titles, author's names, author affiliations, headings
withinthe paper, figure and table captions, and sentences and phrases taken directly
from text. ~4I Combinations of human and machine procedures based on sentences and
phrases selected from text are described by Herner who cites a two-fold advantage:
"First, it is not wholly dependent on the informativeness or lack of informativeness of
titles and bibliographic citations, and, second, it affords a greater depth of analysis than
is generally possible where titles or bibliographic descriptions alone are used."  5/

1/

21

3'

4/

5/

    Dowell and Marshall, 1962 [159], p. 324-325.

    Bernier and Crane, 1962 [56], p.117.

    Luhn 1959 [381], p. 289.

    Citron, et al, 1958 [120], p. i.

    Herner, 1963[264], pp. 1-2.

                                       69

    Taking more text as the basis for automatic derivative indexing adds, of course, the
problems and costs of keystroking additional input material.  At the same time, most of
the major problems of scatter of references, synonymity, redundancy and exclusive
reliance on the author's own language and terminology not only remain but may quite
probably be intensified.  The problems of establishing suitatle rules for selection of
significant words are aggravated, not only by the far larger number of different words to
be processed, but because of unresolved problems in effectively relating length of index
and depth of indexing to the length of the document. 1/

    There are, however, a number of practical suggestions by which machine augmenta-
tion of titles might be accomplished.  First is the invariant selection of words that are
capitalized, other than those that begin a sentence.   As Wyllys points out, this type of
selection criterion would emphasize proper names, and these in turn might be particularly
valuable clues, especially in a military intelligence situation. 3/ It has also been
suggested that the selection criteria should depend on particular pre-specified contexts,
such as being preceded by the words:   "the results were...,", "in conclusion ...", and
the like.

    A second type of machine selection procedure is the converse of the exclusion or
stop list, namely, an inclusion list or dictionary which may involve especially significant
words for a particular subject matter area or words that are of importance to a particular
organization.  In the discussions of the Area 5 ICSI papers it was remarked:

    "Another complication is that mechanized indexing finds in a paper what was
    important to the author.   What happens if there is something in the paper not
    important to the author but of importance to the indexer?  One possibility is
    to have a list of words and phrases expressing the interests of a particular
    collection, which the machine looks for in the papers.  If this word or phrase
    occurs even once, it should be picked up as an indexing term." 4/

1/

2I

3/

4/

    See, for example, Wyllys, 1963 [653], p.22.

    See Luhn, 1959 [371], p. 52; [384], p. 8.

    Wyllys, 1963 [653], p.15.

    ~ee Ref. [578], p. ~263.   See also, among others, Luhn, l9~9 [37~] , p. 52: "Just as
    common words have been eliminated by look-up in a special index, certain essential
    words may be looked up in another special index for the purpose of listing them under
    any circumstances".

                                           70

This approach to the selection problem can be combined with other devices, as in the
"Selective Dissemination" system described by Kraft in which keyword extraction indexing
is applied to abstract, title, author's name and manually assigned index terms, after
processing of all input material against both "in" and "out" dictionary lists. 1/

      The use of abstracts rather than full text as source material makes the selection
criteria problems somewhat less severe.  In addition, there is evidence to suggest that
the abstract does contain much of the significant information that would normally be
indexed and the text of the abstract is therefore a fertile field for title augmentation.  In
experiments conducted by Slamecka and Zunde on the comparison of indexing terms
manually assigned with the occurrences of the names of these terms in abstracts used in
NASA's STAR system, it was found that 80.4 percent of the assigned terms were contained
in the abstracts. 2/ Swanson, on the other hand, suggests that, at least for short articles
having homogeneous subject matter, title and first paragraph "are nearly as good as full
text ,  3/

      A combination inclusion-exclusion list system may involve prior "weighting for
relevance "of words that are judged by human analysts to be significant for purposes of
search and retrieval, as suggested by Swanson, for example:

      "The computer first separates those words which are important for purposes of
      information retrieval from those which are unimportant.    This is accomplished by
      means of looking up each word in an alphabetized word list with which the computer
      is furnished. Each word in this word list carries a `weight' which reflects an
      estimate of its importance for retrieval purposes. Words of zero weight are
      completely unimportant and discarded by the computer for indexing entries."        4/

Continuing work at Thompson Ramo-Wooldridge on automatic indexing methods includes
further investigation of assignments of relevance weight estimates to words and phrases,
(1959 [490] and[491], 1963 [602]).

      3.2.2 Book Indexing By Computer

      For internal indexing, that is, the subject indexing of the contents of a single book or
report, automatic indexing experiments are usually directed toward the processing of
full text, with use of stop lists of various lengths.  The work of Artandi for her doctorate

1/

2/

3/

4/

    Kraft, 1963E334], pp.69-70.

    Slamecka and Zunde, 1963 [561].   In addition they report (p. 139) that a large number
    of the terms not found were "either broad, general terms (i.e., `device') or generic
    level concepts of terms contained in the abstracts."

    Swanson, 1963[580J, p. 1.

    Ibid, p. 1.

                                          71

at Rutgers in indexing of a book by computer programs (1963 [zo] and [22]) is an example
of such modified derivative indexing.  Specifically, Artandi's method involves:

    (1)    Establishment of a list of key terms appropriate to a given subject
           area to be used as an inclusion list for word extractions from text.

    (2)    Application of an appropriate syndetic apparatus to be used in the
           compilation and ordering of the inde~ entries.

    (3)    Means for the automatic selection of index entries other than those
           on the pre-specified inclusion list, especially for the selection of
           proper names.

    The text used by Artandi for her study consisted of a 59-page chapter on halogens
from J. W. Mellor1s Modern Inorganic Chemistry.     This text was keypunched with
special tags being assigned to indicate the page numbers and the incidence of capitalized
words in the text.  Text words greater than three characters in length were first checked
against the inclusion dictionary of `1detection terms".  There was, in addition, an
"expression term" dictionary which constituted the vocabulary of the final index and in
which a given expression term might or might not be identical with the corresponding
detection term.   Cross-references were supplied by a program routine which checks the
index term list against a list of expression terms with their detection terms grouped
under them and which compiles cross-reference entries, one for each detection term
associated with an expression term appearing on the index list.

    For her experimental corpus, Artandi's program developed 363 page references,
138 different index entries and 35 cross-references.    She compared these results with
those obtainable by conventional human indexing with respect to the factors of heading
density (ratio of number of entries to number of words in the book), entry density (ratio
of the number of page references to the number of pages), and distribution (ratios of
entries for chemical compounds, proper names, and subject entries to the total number
of entries.  No indexing errors were found in the computer-generated index for a 5
percent random sample of the pages of the corpus, but five Omissions were found in the
machine indexing of these sample pages.   Artandi concluded, however, that although the
quality of indexing appeared favorable, the costs, which approximated $1.50 per page
indexed, were impractically high.

    Book indexing by computer has also been investigated by Maloney, Dukes, and Green
at the Army Biological Laboratories, Fort Detrick,              1/
                                                    Maryland.~ Input is based on the by-
product paper tape generated when the manuscript is typed on a tape typewriter.  The
paper tape is in turn converted.to punched cards which are then processed by a UNIVAC
SS-90 II computer in an editing run that deletes unrecognizable codes and then stores page,

1/
    C. J. Maloney, private communication.     A report by C. J. Maloney, J. Dukes, and
    S. Green, "Indexing reports by computer" is in process of preparation for
    publication.

                                            72

line, sentence number and other reference identifications.  After re-processing against
a stop list of common words, all other words in the edited text are selected as
candidate index entries, these are then sorted into alphabetical order with subsequent
printout giving each word occurrence followed by the entire sentence which contained it
and the page and other location identifications.  This computer output is then post-edited
manually not only to eliminate trivial entries but also to normalize terms and phrases
used.

    3.2. 3Modified Derivative Indexing - Baxendale's Experiments

    As has been previously noted in the introduction to this report, the name of Phyllis
Baxendale together with that of H. P. Luhn is generally accorded credit for pioneering
efforts in the entire area of automatic indexing.Baxendale in particular is generally
credited with the first actual experiments in modified derivative indexing.  In investiga-
tion beginning in the late 1950's, she has explored not only statistical approaches to
automatic selection of index terms (based for example on word frequencies) but also the
use of word pairs, word groups, contextual associations, and in particular the subject-
indicating clues of prepositional phrases (Baxendale, 1958 [41], 1961 [40], 1962 [42];
Becker, 1960[44]; Edmundson and Wyllys, 1961 [181]).

    Baxendale began by considering the patterns of scanning that humans typically use
to select `1topic" sentences, phrases and words, and she then proceeded to simulate by
computer program the selection of phrases consisting primarily of nouns and modifiers.
In her first experiments, (1958 [41]) she used two methods of automatic selection.   In
the first procedure, words serving the grammatical functions of pronoun, article,
auxiliary verb, conjunction and the like, were deleted by stop list lookup.  Frequency
count statistics were then derived for the remaining words.  In her second procedure,
the computer was programmed to select prepositional phrases from text and to use the
four words succeeding the preposition as index entries unless an additional preposition or
a punctuation mark is first encountered.

    In later experiments, Baxendale has explored possible grammatical models "which
would select all and only nouns or adjective-noun combinations". 1/ Taking as an initial
corpus a sample of document titles, rules were devised to reject for human analysis titles
with question-marks and the like, to eliminate numeric information and single symbols,
and to segment the title into its component clauses and phrases by the detection of
commas, periods, and similar clues.  By list lookup, certain words are identified as
capable of serving the syntactic functions of being quantifiers, prepositions, or clause
introducers. Special subscripts are then assigned to these words and the subscripts are
examined by machine to provide further segmentation; to delete quantifiers, auxiliary
verbs, or words ending in "ed" or "mg" and preceded by an auxiliary verb, and to deter-
mine relationship functions between the remaining, presumably substantive, words.

    Still other work by Baxendale has been directed toward the development of frequency
of co-occurrence or textual association of candidate indexing terms.  She reports as
follows:

1/
    Baxendale, 1961 [40], p. 209.

                                        73

    "[In the frequency matrix~ . . the diagonal elements . .  give the total frequency of an

    index term and the off-diagonal gives the frequency of co-occurrence of two terms.
    The diagonal of the `context' matrix represents that portion of the total vocabulary
    with which an individual term has been coordinated, and the off-diagonal the extent
    to which two terms have common context. . . Such matrices give a basis for examining
    the extent to which terms are generic or specific within the context of the collection
    of documents.  One can speculate that terms occurring with high frequency and wide
    context, i.e., with frequencies distributed amongst all or nearly all off-diagonal
    elements of the matrix are of such broad connotation as to be indifferent discrimina-
    tors of content . . . The frequency and context matrices can again be used to deter-
    mine the modifiers with which they can most r~eaningfully be coupled for the
    collection of documents being considered. 11 11

    Finally, Baxendale notes that on the basis of her studies it should be possible to
select quasi-subject headings based on frequency counting criteria, but then to order the
remaining vocabulary of selected terms   according to contextual measures of association
which are semantic, syntactic, or statistical in nature.    Fxperimental results for a
collection of 1, 500 documents included semantic associations between "searching" and
"retrieval", syntactic associations of "machine" or "literature" with "retrieval", and
the apparently misleading association of ~~metal~! with `1retrieval" which, however, had
statistical significance within the particular document sample. 2/

    Other investigators who have explored noun-adjective clues for selection include
Anger, Chonez, Langleben and Shumilina, and Swanson.        Anger looked for relationships
indicated by syntactic dependencies or by noun-adjective and adjective-adverb linkages,
and gave in an appendix a suggested program for phrase inversions. 3/ Chonez has
described a computer program which by recognizing "separating" words, especially
prepositions, and applying "pseudo-grammatical" rules compiles an index to English
language items in the fields of ionized gas physics and thermonuclear fusion.  It is
claimed that:

    "The subject index thus prepared is similar in presentation to Luhn's KWIC indexes,
    but is fundamentally different in conception and is in fact intermediate between...
    (this) ... and the conventional alphabetic subject indexes." 4/

    Langleben and Shumilina are concerned with machine-aided procedures for trans-
lation from natural language materials to an intermediary or documentation language.

1/

2/

3/

4/

    Ibid, pp.215-216.

    Ibid, pp. 216-217.

    Anger, 1961 [151 pp. III-6ff.

    Ghonez, et al, 1963 [119], p. 31.

                                      74

They indicate, for example, that the preposition 1from1' serves as a key for the treatment
of two nouns connected by it. 1/ Swanson, describing research project progress at Ramo
Wooldridge as of 1960, reported to the National Symposium on Machine Translation with
respect to multiple meaning problems as follows:

    `1We are also investigating the possibility of discovering semantic attributes of
    words based upon certain automatically recognizable statistical features of the
    context.  Our initial endeavor in this direction has been to attempt to discover
    a classification system for nouns based upon their frequency spectrum of cate-
    gories of modifying adjectives, these categories being automatically recognizable.

3.3 Derivative Indexing From Automatic Abstracting Techniques

    While Baxendale's work has had certain points in common with automatic abstracting
or extracting processes, particularly in the use of word frequency statistics and the
consideration of possibilities for first selecting topic sentences, her major interests in
this area have been in automatic indexing as such, rather than in machine selection of
sentences from text to serve as an automatic extract or derivative abstract of the
document.   Much of the machine processing to date of full text for documentation
purposes, however, has had the latter goal as the principal research objective.

    As we have previously noted, the subject of automatic abstracting or auto-
condensation is not in itself a primary concern of this survey.  Nevertheless, the signifi-
cant words occurring in the abstract of a document, whether generated by man or by
machine, are obviously good candidates for indexing terms.     Moreover, it has been
strongly suggested that the questions of using positional, editorial, and syntactical clues
in order to improve automatic indexing techniques will profit by research that is being
done in both automatic extracting procedures and in other types of linguistic data pro-
cessing based upon full text. 3/

    3.3.1 Auto-Condensation and Auto-Fncoding Techniques of H. P. Luhn

    Although Luhn's work in the field of documentation aided by machine has had its best
known and most popular acceptance with respect to the KWIC index proper, even more
provocative possibilities lie in the development of some of the auto-condensation and auto-
encoding techniques which he also proposed, especially for full text processing.  In this
area, although he himself has also suggested a variety of possible improvements and
refinements, the actual experimental work done by him and by his associates has mostly
been done on the basis of word frequency statistics.

1/

ZI

3/

    Langleben and Shumilina, 1962 [347~, p.109.

    Swanson, 1961 [585], pp. 391-392.

    See, for example, Wyllys, 1963 [653], p.7.

                                        75

    Considering first the most frequently occurring words in a given text as too common
to be subject-indicative (those usually stopped or purged by a suitable exclusion dictionary
or stop list, for example) and next the least frequent words as being rarely topical in a
content-revealing sense, Luhn settles upon a middle range of frequency of word occur-
rence as the basis for his auto-condensation processes.   The actual frequency counts are
computed, together with indications of page, line, and occurrence within the same
sentence.  When this has been done for the complete text, each individual sentence is then
checked for the I!scorel! of relatively high frequency words occurring in it, and sentences
with the highest scores are then automatically selected, in textually-occurring order, and
are printed out as an abstract, more properly an extract, of the document.

    The automatic encoding of documents may be achieved either by taking the high
ianking words of the selected sentences or by selecting the highest ranking of the words
in the entire document as index entries.    Luhn typically justifies these procedures as
follows:

    "Of various automatic procedures for deriving typical patterns for characterizing
    documents, the systems here proposed are based on operations involving
    statistical properties of words . . .  It is held that the more often a certain word
    appears in a document the more it becomes representative of the subject matter
    treated by the author. In grading words in accordance with the frequency of usage
    within a document, a pattern is derived which is typical of that document and unique
    amongst all similarly derived patterns of a collection of documents.  It is proposed
    that the more similar two such patterns are the more similar is the intellectual
    contents of the documents they represent...

          The creation of an encoding pattern may consist of listing an appropriate
    portion of the words ranking highest on the word frequency list derived from a
    document.   Experiments conducted so far on documents ranging in size from 500
    to 5000 words have indicated that word patterns consisting of from ten to twenty-
    four of the highest ranking words furnish adequate discrimination and resolution
    for retrieval, sixteen such words being a likely average.  1/

    At Wright-Patterson   Air Force Base     an automated information selection and
retrieval system has been developed jointly by Air Force and IBM personnel
(Gallagher and Toomey, 1963 L205~).       It involves both auto-indexing and auto-
abstracting techniques following the Luhn word-frequency-counting techniques.    Pre-
editing is applied to demarcate fields (e.g. , title, author) and to flag certain text words,
particularly proper names, for special treatment.    Special treatment, over and above the
frequency-based selection score, is also given to words in the title field.

    On the abstracting side, modifications to the original Luhn formula involve
segmenting sentences in terms of strings of both high and low valued words separated
by either periods or continuous strings of low valued words, on the assumption that
long consecutive strings of low value words should weight negatively.  The automatic
extract consists of the highest ranking 20 percent of the sentences subject to the
restriction that no less than 7 and no more than 20 sentences should be selected. On the
indexing side, the investigators report:

1/
    Luhn, 1959 [37l~, p.47.

                                             76

    "As it is currently run, the auto-indexing program selects about one word in ten
    as a keyword in articles of three thousand words or less.  In articles longer than
    three thousand words it tends to pick about one word in fifteen.  This high incidence
    of keywords naturally increases the amount of noise results returned by the query
    program, although good search strategy cuts them down considerably."

    As of October 1963, the system was reported to be fully operative although not as
yet extensively tested in actual use.  Gallagher and Toomey give illustrative auto-extract
results on two tested papers, one being Luhn's own "Automatic Creation of Literature
Abstracts".  They give comparative results for manual versus machine selection of key-
words as index or search terms with 88.6 percent agreement, the human indexers having
selected, in 6 tests reported, 132 words and the machine method 117.    Modifications
under consideration include pre-edit flagging of terms in author and cited-reference
fields for special weighting, setting the length of the abstract as a function of the total
number of worQs in an item, and, in the search program, generating additional search
terms by means of association factor techniques such as those suggested by Stiles.

    To the basic approach of straight-forward word frequency counting, Luhn himself
has suggested that improvements might be obtained from considering closely adjacent
words, 2/word pairs, y/ and reference to vocabularies specific to a given field. 4/
Other possibilities are capitalized words and lookup against an inclusion list.  He also
suggests:

    "If certain words could be given in their relationships to other words, more
    specific meanings may be identified by such combinations.   These relationships
    may range from the mere co-occurrence of certain words within a phrase or
    sentence to the combinations of specific parts of speech. " 5/

    Various investigators have proceeded to explore these and other possible improve-
ments, including incorporation of relative frequency information, use of information
about distances between high-ranked si~nificant words, word pairs and word n-tuples,

1/

2/

3/

4/

5/

    Gallagher and Toomey, 1963 [205], p.51.

    Luhn, 1959[384], p.10.

    Luhn, 1962[373], p.11.

    Luhn, 1959 [384], pp. 8 and 10.

    Ibid, p. 5.

                                       77

and other devices to improve detection of significant clues to subject content.  Repre-
sentative examples of such work will be discussed below.  In addition, investigators
abroad have developed modifications to the basic Luhn word frequency approach which
appear to be necessary when it is applied to languages other than English. 1/

    Thus, for example, Purto reports various investigations conducted by V. A. Argayev
and V. V. Borodin and by himself with respect to Russian language documents. _ Purto
notes first that the Luhn method as applied to Russian language materials selects
sentences which, while having the largest "significance coefficients", were not those most
essential to the meaning and further that:  "an abstract in Russian made by Luhn's method
results in a choice of sentences not conveying basic information and not logically connected
with each other. ` 3/ The reasons for such failure he attributes to the fact that words with
different frequencies are considered equally important within a sentence for sentence
selection purposes and to the lack of consideration for semantic and grammatical
connectivity between significant words and between sentences.  He then discusses several
methods for determining connectivity, such as the rule that the sentences most closely
connected with each other will be those in which the greatest number of the same signifi-
cant words occur. 4/

    A somewhat different example of difficulties occurring when the basic Luhn technique
is applied to material in languages other than English is given by Levery.  He describes
a study of thirty French texts concerned with the development and manufacture of glass.
He reports as follows:

    "While we followed the classical idea that a relationship between the frequency of
    a word and its significance exists, the fact that we worked with French texts forced
    us to discount the value of frequency alone.

    "French authors generally do not like to repeat the same words, and they vary their
    vocabulary... It was necessary to combine the frequencies of words with the same
    meanings or related to the same idea."

    `A dictionary of synonyms was constructed. . . (and) different versions of the same
      ~d had to be regrouped." 5/

1/
    Note, however, that in the automatic abstracting program at Thompson Ramo-
    Wooldridge, small-scale experiments suggest that automatic abstracting is
    as feasible for other Indo-European languages as for English, (1963 [603], p. ii).
    Also, at the Centre d'Etudes Nucle'aire Saclay, automatic extraction experiments
    are being applied to texts both in French and other languages, see National Science
    Foundation's CR&D report No.6, [430], p. ZO.

3'

4/

5/

    Purto, 1962 [484].   He refers to a report "The problem of automatic abstracting
    and a means of solving it", by Argayev and Borodin, apparently available only as
    a typescript dated 1959.

    Ibid, p. 3.

    Ibid, pp. 3-4.

    Levery, 1963 [359], p.235.

                                           78

    3.3. ZFrequencies of Word n-tuples - Oswald and Others

    The first alternative to the basic Luhn word frequency approach in automatic ab-
stracting techniques to be actively explored was apparently that of Oswald and his
associates.  (Oswald et al, 1959 [459]; Edmundson et al, 1959 [180]).     Like Baxendale,
Oswald was interested in word pairs and word groups, particularly compound-noun and
adjective-noun compositions, as more revelatory of meaning than single words.     Unlike
Baxendale, however, he was interested in the word group itself as selection criterion,
whereas she had used word group or phrase clues for the selection of (usually) single
indexing terms.  Differences between their two approaches, both representing very early
efforts in the field, are summarized by Edmondson and Wyllys as follows:

    "Oswald's experiment in automatic abstracting differs from Luhn's and Baxendale's
    techniques in that it combines the notion of significance as a function of word
    frequency and the notion of significance as a function of word groupings, by employing
    juxtapositions of significant words as the basic unit for measuring the importance
    of a sentence...

    "It may further be observed that Baxendale's exhibited indexes are made up of single
    words rather than word groups, in spite of the strong case she makes for using
    groups...

    "Baxendale's work is concerned solely with the automatic construction of indexes;
    she does not extend her treatment of word significance into the area of automatic
    abstracting." 1/

    Oswald's "multiterms", however, were intended to overcome, in the areas of both
automatic indexing and automatic abstracting, at least some of the difficulty that concepts
are often expressed in compound nouns, word pairs, and longer groups of words consist -
mg of n-tuples of substantive words or of phrases.  The result of considering both word
frequency and word-group frequency is that in Oswald's selection~groups it is usually the
case that only one word of the group has an individually high frequency but the co-
occurrence feature heightens the significance of the relatively lower frequency words
with which it appears.  Thus, for automatic indexing, Oswald proposed significant word
groups as indexing terms, and his criteria for selection of sentences to be included in
machine~generated extracts are similarly based on the number of significant groups in
the sentences chosen.

    Other investigators who have stressed the importance of word pairs and longer groups
as necessary to reflect concepts include Bar-Hillel (1959 [33]), Black(1963 [64]), Clark
(1960 [1z3]), Doyle (1959 [165]), and Salton (1963 [519]).      Doyle says succinctly that
"when a phrase, or some other aggregation of words, stands for a single idea, its
frequency in a document ought to interest us more than the frequencies of its component
words." 2/ Salton considers it desirable to use word groups rather than individual words

1/

2/

    Edmundson and Wyllys, 1961 [181], pp.231-232.

    Doyle, 1959 [165], p. 11.

                                        79

for purposes 0 identifying document contents and to use data on the joint occurrence  of
words in the same sentence or similar contexts as grouping criteria.     Clark points out in
particular that the use of ordered pairs and longer sequences of words to express a single
concept may be highly characteristic of the special technical language used in a specific
subject field, and notably those of the social sciences. 1/

     Others who have explored word n-tuples as selection criteria for automatic extraction
operations include such investigators as Szemere, Levery, and Yakushin.      Szemere
reports an investigation of 39 Swedish patent specifications in the field of
switching circuits looking for significant word-pairs, with emphasis on noun-adjective
combinations (1962 L591J)    The objectives of a project headed by Levery at IBM - France
have been reported as follows:

     `1A series of experiments is planned in the fields of automatic indexing of
     technical texts and technical vocabulary analysis.

     "A statistical method will be tested to determine the degree of closeness in
     meaning of words.    The method will consist of studying the pairs of words which
     appear together in the majority of texts and calculating a coefficient of corre-
     lation from the frequencies. Such work will result in a standard list of notions
     frequencies for a particular kind of information.

     "Starting from this list, new experiments will be made so as to obtain a list
     of keywords representing each text. The method will use statistical comparison
     between the distribution of frequencies of notions contained in a text and the
     standard distributions obtained for the entire corpus." 2/

     Yakushin(1963 [654~) develops a variation of the word-pair principle in which he
looks for those pairs where the words are, or suggest, names of objects, such as
11table-leg'1.  He suggests, further, that so-called `1basis nouns" can be established for
a given scientific field and entered into an inclusion dictionary, which also contains codes
for the lexical classes to which the word can belong and codes for determining whether or
not the word can join with another as a "basis term".  Machine routines are then
suggested to develop whether or not given terms are jointly part of the same text, whether
one textually precedes another in a given text, whether or not there is a "nomenclator"
pair.  Depending upon the frequency of occurrence of identical or semantically related
nomenclator constructions, it is claimed that subject concepts can be detected.   That is:

     "The method is founded on the finding in a text of so-called basis terms,
     established by list, and of the words which explain them. These explanatory
     words, which in different contexts refer to one basis term, are grouped and
     ordered according to definite rules into a subject concept." 3/

1/

2/

3/

    Clark, 1960 [123], p.460.

    National Science Foundation's CR&D report no. 11, [430], p. 118.

    Yakushin, 1963 [654], p.16.

                                      80

    3.3.3 Relative Frequency Techniques - Edmundson and Wyllys, and Others

    The first comprehensive critique of word frequency approaches to automatic extract-
ing and indexing was undoubtedly that of Bar-Hillel (1959 [33], 1960 [34]), followed closely
by Edmundson and Wyllys (1961 [181]), who themselves have experimented with various
alternative or improved methods for obtaining measures of word significance by statistical
analysis.  These critics have been in agreement both on many points of specific criticism
and on suggested possibilities for amelioration of observed difficulties, especially in
terms of considering relative word frequencies within a particular subject field.   In
addition, several other investigators independently proposed a relative frequency approach
at about the same time. 1/

    Some typical expressions of opinion on the importance of relative frequency criteria
are as follows:

    "Let me propose here a system of auto-indexing which, to my knowledge, has never
    been publicly proposed before in this form and which seems to me superior to any
    other system I have heard of ... Assume that ... we are given a list of the average
    relative frequencies of all English `words' . . . It would then be possible, for any
    given document, to rank-order all the `words' occurring in this document according
    to the excess of their relative frequency within the document over their average
    relative frequency.  By some mechanically implementable standard or other, an
    initial segment of this list is selected as the index-set." 2/

    "Very general considerations from information theory suggest that a word's
    information should vary inversely with its frequency rather than directly, its
    lower probability evidencing greater selectivity or deliberation in its use.  It is
    the rare, special, or technical word that will indicate most strongly the subject
    of an author's discussion.  Here, however, it is clear that by `rare' we must
    mean rare in general usage, not rare within the document itself.  In fact it would
    seem natural to regard the contrast between the word's relative frequency f
    within the document and its relative frequency r in general use ... as a more re-
    vealing indication of the word's value in indicating the subject, matter of a
    document." 3/

1/
    Compare, for example, Kochen, 1963 [327], p.7:    "The idea of contrasting words
    which occur frequently in a document against the frequency of this word in the
    background language for purposes of selecting index terms seem to have been
    suggested first by Bohnert and the author, then described in more detail by
    Edmundson and Wyllys, and tested empirically by Damerau.    Something similar
    was suggested even earlier by Bar-Hillel." See Bar-Hillel, 1962 [35], p.418,
    footnote, with respect to himself, Edmundson, and Bohnert.  See also, however,
    Doyle 1962 [163], p.388:    "Edmundson and Wyllys were probably the first to
    publicly advocate contrasting word frequencies within a document to word fre-
    quencies within a given field and using these relative frequencies as criteria for
    scoring and selecting sentences."

2/

3'

    Bar-Hillel, 1959 [33], pp 4-8-9.

    Edmundson and Wyllys, 1961 [181], p.227.

                                       81

    "We naturally find that the words of greatest interest are those for which there
    exists the greatest contrast between general usage frequency and local (within the
    article) usage frequency. 11 1/

    "Luhn has bypassed syntactical analysis by taking advantage of the information
    content of the most frequently used topical words in articles ... Edmundson et al
    take a further step in a desirable direction by bringing in information from outside
    the article being analyzed: words and terms are given greater topical value as the
    contrast increases between the frequency of use within the article and the rarity of
    general usage." 2/

    `1A further refinement of the process of automatic analysis would be the develop-
    ment of special sets of reference frequencies for special fields of interest.  This
    would have two benefits:  it would become possible to classify documents as to
    field, and it would become possible to note the significance of words which are
    frequent in the document and frequent in a very large reference class c0 of
    literature (i.e. , these words would not be significant with respect to c0) but which
    are rare in the special field.  For example, the word `emotion' might be too
    common in general usage to seem significant, but frequent occurrence of the word
    would stand out in a paper on electronic circuitry (e.g. , of a robot) when compared
    with its frequency in general electrical engineering literature."

    "One of the . .. goals is to investigate a relative-frequency approach to the cate-
    gorization of documents. .. For this investigation it will be necessary to develop
    sets of reference frequencies for words used in different subject fields.   It was
    suggested by Fdmundson and Wyllys that these sets of reference frequencies,
    when developed, could be used to categorize a document as belonging to a particular
    subject-field, by means of measuring the degree of matching (e.g. , with the chi-
    squared test) between the proportional frequencies of words in the documents and
    the sets of reference frequencies." 4/

    Two points in the comments quoted above appear especially worthy of note.      The first
is that of introducing at least some measure of reference to material other than the
individual author's own choice of linguistic expression and specific terms.   We shall dis-
cuss this factor in more detail in a later section of this report.   The second point,
derived in part from the first, is the specific suggestion of movement away from purely
derivative indexing by machine in the direction of automatic assignment indexing and
automatic categorization or classification.

1/

2/

3/

4/

    Doyle, 1959 [165], p. 9.

    Doyle, 1961 [169], p. 3.

    Edmundson and Wyllys, 1961 [181], p.228.

    Wyllys, 1963 [653], p. 10.

                                       82

    Actual experiments in application of relative frequency techniques to automatic ex-
tracting processes have been pursued since 1959 by various investigators.  Edmundson
and Wyllys and Damerau (1963 [148])were certainly among the first.    Edmundson and
Bohnert were engaged in experimental investigations at Planning Research Corporation
in 1959, Iland the following year Edmundson, Oswald, and Wyllys worked on the auto-
indexing and auto-extracting of the 40, 000 words of text contained in nine articles in the
subject field of missilery. 2/ Wyllys has continued work on relative frequencies
(1963 [6533] ).   At the System Development Corporation Doyle, in some of his work,has also
explored the relative frequency approach (1961 [161]).   An example in Europe is work
reported by Meyer-Uhlenried and Lustig, where significant keywords from abstracts are
used not only as indexing terms directly, but by means of keyword lists and micro-
thesauri can also be used to assign documents to specific subject fields (1963 [417]).

    3.3.4 Significant Word Distances

    Another technique that has been investigated for the improvement of automatic ex-
traction operations based on the statistics of word frequencies is that of distances between
significant words.    The desirability of attaching greater weight to n-tuples of immediately
adjacent words and to the co-occurrences of words within the same sentence has been
mentioned previously.    Savage, in relatively early work developing some of the initial
proposals of Luhn, considered intra-sentence distances between significant words as
follows:

        The criterion is the relationship of the high-frequency words to each other,
    rather than their distribution over the whole sentence.   Consequently, it seems
    reasonable to consider only those portions of sentences which are bracketed by
    high-frequency words and to set a limit for the distance at which any two such
    words shall be considered as being significantly related . . . An analysis of many
    sentences and many documents indicates that a useful limit is four or five non-
    significant words between a~y two high-frequency words " 3/

    Doyle has also noted the tendency of words that are in fact highly related in a content-
revealing sense to co-occur in the same sentence or as quite direct neighbors.   The same
investigator has also suggested that word distances can be used to provide "clustering"
effects that might, for example, sort out the possibly different topics cove re~/in intro-
ductory or background discussions, the main text, and various appendices. -

1/

2/

3/

4/

    National Science Foundation's CR&D Report No.5, [430], p33;   Bar-Hillel
    1962 [35], p.418.

    National Science Foundation's CR&D Report No. 6 [430], pp 43-44.

    Savage 1958 [521], p.4.   Later related work has included a method for generating
    auto-extracts which adds to the high-frequency word sentence scores a correction
    factor for the number of words in gaps between such words.  (See Rath et al, 1961
    [493;)

    Doyle 1961 [166], p. 7.

                                          83

     Related research efforts in more general areas of linguistic data processing suggest
inter-sentence distances as criteria for the selection of words and word groups in auto-
matic indexing and abstracting processes.  In natural language text searching, for example,
the work of both Swanson (1960 [587], 1961 [586], 1963 [583]), and of Maron and Ray!,
suggests that limitation of searching to a four-sentence span would eliminate a number of
irrelevant responses to search requests specifying the joint occurrence of two or more
words.

     Swanson's findings indicated that if two words or phrases contained in the sear~h
request were found in textual proximity within these limits, they were highly likely to bear
a semantic relationship that is what was intended by the requester.   Applying the four-
sentence proximity criterion, it was found that the amount of irrelevant material retrieved
by the text searching system could be reduced by 60 percent without serious loss of
relevant information. 2/ Black cites the four-sentence proximity criterion and notes
further that it might be used also to retrieve only a paragraph or similar small portion of
the full text, reducing the amount of material to be read by the user, perhaps by as much
as 90 percent. 3/

     Artandi, in her book-indexing studies, suggested as a topic for further investigation
the possibility that proximity of index term candidates as derived from the same section
of the text could serve to improve the quality of the indexing. Since her computer program
checks for duplicate potential entries occurring on the same page, this feature could be
used for further analysis, on the assumption that the number of occurrences of the same
entry for the same page is an indication of the importance of the discussion of the subject
on that page. 4/

     3.3.5 Uses of Special Clues for Selection

     Intra- and inter-sentence distances between words are relatively crude examples of
clues to selection of words and word-pairs which, because of their implied relationships,
may be especially significant for indexing, sentence extraction, or document categoriza-
tion.  They can be quite readily detected by machine, but the implication that physical
proximity is a good measure of significant co-occurrence is often false.   Other clues
which can be detected equally well, mechanically, are those which have to do with position
and format.

1/

2/

3/

    Ray, 1961 [494], p. 92.

    Swanson, 1963 [5831, p. 9, 1961 [586], pp.298-299.

    See Black, 1963 [64], p.20 and footnote:   "The figure 90 percent is derived from
    experience in previous experiments, wherein the amount of relevant material
    was scanned and a subjective judgment was formed that the relevant material was
    actually about 10 percent of the total verbiage retrieved.  That is, about 10 percent
    of each document contained the relevant material; 90 percent of the document was
    of no relevance but the document as a whole was relevant."

4/
    Artandi, 1963 [20], p.47

                                       84

    Such obvious positional clues as occurrences of words in titles, chapter or section
headings, figure captions, have already been mentioned.   To these can be added first and
last sentences of paragraphs, 1/ or of first and last paragraphs as such. 2/ Wyllys
observes that other criteria which are detectable in the text by straightforward machine
procedures can be based on such features as italicization, capitalization, or punctuation.
He notes, however, that such "editorial" criteria vary from journal to journal so that
their usefulness would need to be related to the particular practices of individual
journals. 3/

    Somewhat more difficult for machine implementation, but certainly feasible in the
present state of the programming art, is the use of specific semantic or syntactic clues.
Here again, Luhn, Baxendale, and Edmundson and Wyllys all anticipate their critics and
later investigators.  Luhn recognized the fact that in at least some applications the
characterization of documents by isolated words alone would fail to provide an effective
degree of discrimination.  He, therefore, suggested operations to establish word
relationships, whether based on co-occurrences or combinations of specific parts of
speech. 4/ Baxendale clearly uses both syntactic and semantic clues, detectable by
built-in table lookups.

    Representative suggestions by Edmundson or Wyllys or both as co-authors include
the following:

         We have in mind a glossary or dictionary of perhaps one to two thousand
    words that act either as cue words which signal the importance of a sentence
    or as stigma words that signal the insignificance of a sentence for purposes of
    abstracting." 5/

1/
    See, for example, Wyllys, 1963 [653], p.27:    "One of the first published studies
    in automatic document-content analysis, that of Miss Phyllis Baxendale, brought
    out the importance of the first and last sentences in a paragraph as bearers of
    a good deal of the content of the paragraph."  See also Marthaler, 1863 [399],
    p.25.
2/

3/

4'

5/

    Compare Swanson, 1963 [580], p. 1: ". .  Some evidence exists to show that for
    short homogeneous articles title and first paragraph are nearly as good as full
    text.

    Wyllys, 1963[653], p.28.

    Luhn, 1959 [384], p. 5.

    Edmundson,1962 [178], p. 11.

                                       85

    "The criteria for attributing significance to words . . . may be positional (in virtue of
    their occurrence in titles or section headings), or semantic (in virtue of their
    relation to words like `summary'), or perhaps even pragmatic (in the case of names
    of specialists mentioned in text footnotes, or bibliography

    "A cataloguer or abstract-writer would naturally give more weight to a technical
    word that appears in a title, in a first paragraph, or in a summary. A machine
    can be programmed to do the same.    It can be instructed to recognize the title by
    position and capitalization . .. It can place first-paragraph indications... It can
    test every heading or subtitle for the words rsummaryt or `conclusions' and place
    a summary indication after each word in the summary paragraphs." 1/

    "The statistical criteria . . . by no means exhaust the potential clues to the
    representativeness of sentences.  Among other plausible clues are certain words
    and phrases ... authors use words such as `conclusion', `demonstrate', `disclose',
    `prove', `show', and `summary' (and related forms of these) with high frequency in
    sentences that contain concise statements about the topic or topics of the article.
    The occurrence in a sentence of such a phrase as `it was found that...',    `the
    experiment proves. . . `, or `the central problem is . . . ` would indicate probably
    even more sharply than any single word could that the sentence was likely to be
    highly representative of the topics..." 2/

    3.3.6 Recent Examples of Mixed Systems Experimentation

    It is quite obvious from the above samples of suggestions for the use of various
special clues for automatic extraction, that improved systems will largely depend upon
a mixture of means for determining subject- representativeness of words, phrases, and
sentences   Many of the clues suggested by Edmundson and WyUys are continuing to be
explored, as mixed systems, at RAND 3/ and the System Development Corporation, (1962
[590]), for example.   Two specific recent examples of mixed systems experimentation
are the automatic abstracting experiment programs at Thompson Ramo-Wooldridge and
the work involving detection of first incidences of nouns at the Harvard Computation
Laboratory.

    The TRW programs to investigate possibilities of computer generation of document
auto-abstracts, involving both English and Russian language texts are based upon a
combination of four different methods to measure significance and determine representa-
tiveness.  These four methods are briefly described as follows:

         The Key method has its source of machine recognizable clues the specific
    characteristics of the body of the document and is based on a Key Glossary of
    content words taken from the body pf the document.

1/

2/

3/

    Edmundson and Wyllys, 1961 [181], pp. 227 and 229.

    Wyllys, 1963L653J, p.25.

    See National Science Foundation's CR&D report No. 11, [430], pp. 314-315.

                                      86

       * . The Cue method has as its source of machine recognizable clues, the general
    characteristics of the corpus that are provided by the bodies of the documents and
    is based on a Cue Dictionary of function words apt to appear in the body of a
    document.

    ..... The Title method has as its source of machine recognizable clues, the specific

    characteristics of the skeleton of the document, i. e. , title, headings, and format,
    and is based on a Title Glossary compromising those content words found in the
    title, subtitles, and headings, but excluding certain words of the Cue Dictionary.

       * . The Location method has as its source of machine recognizable clues, the
    general characteristics of the corpus that are provided by the skeletons of the
    documents and uses a Heading Dictionary of certain function words that appear
    in the skeletons of documents.'1 1/

    The Harvard work involving detection of the first incidences of nouns as sentence
selection and indexing clues is part of a larger-scale program for mechanized informa-
tion selection and retrieval under the general direction of Salton (1961 [siz], 1962 [513],
1963 [514] and [515]).    The specific mixed system involving frequency data, syntactic
identification clues, and positional criteria is primarily the result of investigations by
Lesk and Storm (1961 [577], 1962 [358]).    Related work takes advantage of computer
techniques for predictive syntactic analysis and automatic dictionary lookup also under
development at the Harvard Computation Laboratory (Kuno and Oettinger, 1963 [339],
[340], [341]).

    The Lesk-Storm experiments have involved investigations where the hypothesis
assumed is that the points in a text where the author has first introduced a specific noun
or nominal phrase, or where he has used, with higher frequencies, a combination of
first-referred-to-nouns, are most likely to be especially indicative sections of text with
respect to subject-content representativeness.  The assumption is  further,that areas in
which specific `1new" ideas, not mentioned previously in the text, are first introduced is
particularly rich in topical-content concentration. 2*

    The_mixed-system emphasis followed by Lesk and Storm, however, is revealed in
the following comments:

    `11t is not, of course, apparent that a count of initial occurrences of nouns . . . is by

    itself sufficient to reveal areas of significant information content for purposes of
    abstracting or indexing.   Accordingly, the method suggested here must be used
    together with other available means, and is not expected to provide by itself an
    acceptable abstracting algorithm.    3/

    In their actual investigations, Lesk and Storm first made manual counts of initial
noun occurrences in various sample texts, noting paragraph, sentence, and first
incidence-of-word identifications.   The computer was then used to carry out three
distinctive tasks: (1) calculation of the number of new nouns for each sentence in the text;

1/

2/

3'

    Thompson Ramo Wooldridge, 1963 [603], p. 1.

    Lesk and Storm, 1962 [358], p. 1-6.

    Storm, 1961 [577], pp. I-i and 1-2.

                                       87

(2) computation of functions proportional to the number of initially occurring nouns for
each sentence, and (3) the preparation of a normalized graph for initial noun occurrences
by plotting the functional values against each sentence in the text.!' Sentence selection
can then proceed by processes to detect "peaks" on the graph, using a relative criterion
or weighting function to minimize the effect of high first-noun counts in the beginning
sentences of a paper.

    Trials were made with a number of different weighting formulas, and the best of these
involved the obtaining of moving averages of first-noun counts over several adjacent
sentences.   A particular formula covering a span of seven sentences gave results that
appear to emphasize contextual effects and to reduce the effects of a particular single
sentence with a large number of new nouns, such as a listing of proper names.    The
resulting abstracts are quite lengthy (e.g. , comprising 20 percent or more of the original
text), and contain some relatively uninformative sentences.  The investigators think that
the results with respect to satisfactory abstracting are inconclusive but provocative.  They
also conclude that the possibilities for indexing are more immediately promising:  "Most
key definitions are retained in the successful summaries, and the vocabulary reflects the
topics covered in the texts." 2/

    Qther examples of mixed-system experimentation, especially involving the use of
syntactic and semantic considerations, include the work at the General Electric Computer
Department under Spangler, and work by Jacobson and Plath.     In the Phoenix laboratories
of General Electric, a KWIC type indexing program can be applied both to titles and to
running text and a contemplated extension is intended to "generate indexes by means of
word analysis, taking into consideration syntactic and semantic aspects of text lines". 3/
Jacobson describes rules for machine determinations of same-meaning occurrences of
words which may be homographic and for selection of descriptors for indexing simple
paragraphs by choosing words occurring at least twice with a high probability of having the
same meaning. 4/ Plath reports:

          "Although sentences occur in which the key term or phrase lies buried
          deep down in the structure, preliminary observations indicate that there
          are many others in which the semantic hierarchy closely parallels that
          of the syntactic structure. This suggests that more sensitive vocabulary
          statistics for purposes of automatic abstracting may be obtainable by
          considering only words occurring in positions above a predermined cut-
          off level in the sentence structure. Alternatively, one might count
          occurrences of words on each level, and then multiply by a fixed
                                                                           "5/
          weighting factor in each instance before taking the overall totals. -

1/

2/

3/

4/

5/

     Lesk and Storm, 1962 [358], pp. 1-2, I-~ ff.

     Ibid, p. 1-31.

     National Science Foundation's CR&D Report No. 11, [430], p. 21.

     Jacobson,  1963 [292], p.  191-192.

     Plath,  1962 [474], p. 190.

                                              88

3.4 Quality of Modified Derivative Indexing by Machine

    Most of the modified derivative indexing techniques that have been proposed to date
have few or no indexing results to provide comparative data for purposes of evaluation.
Moreover, those techniques which are primarily directed to the generation of document
abstracts rather than indexing terms have been reported to date with a paucity of actual
examples. I' One of the main reasons for this lack of product~effectiveness data is un-
questionably the high cost and difficulty of obtaining substantial corpora of representative
document text in machine-readable form.     For the most part, the few examples of
automatic abstracts produced by machine are sadly lacking in pertinency, relevancy, 2/
and in continuity for scanning or reading by comparison with conventional human abstracts,
whether prepared by author, editor, volunteer specialist in the subject field, or pro-
fes sional documentalist.

    A few studies have been made for a somewhat larger numbers of examples of "auto-
abstracts'1 with respect to differences between several different machine-extraction
formulas, random sentence selections, and sentences extracted manually.    A project
conducted by IBM's Advanced Systems Development Division for the ACSI-matic program,
(1960 [289], 1961 [290]), involved 70 to 90 articles on military intelligence items.     The
comparisons were of "auto-abstracts'1 as against titles, full texts, "pseudo-auto-
abstracts1 comprised of the first and last 5 percent of the sentences of each text, and
sets of sentences selected randomly, without reference to conventional types of manually
prepared abstracts and without respect to the quality as such.  Similarly, Thompson
Ramo Wooldridge data (1963 [601]) on machine-extracted and randomly-extracted,
sentence sets compare these "abstracts" against manual selection of 25 percent of the
sentences of each item, rather than against a conventional type of abstract.

    There are however, almost no data available on the possible results of using sentence
and word-group extracting techniques, applied to machine-usable texts, to the develop-
ment of indexing entries rather than to the generation of substitutes for document
abstracts.  For this reason, as well as because discussion of the difficulties of evaluation
in general will be deferred to a later section of this report, the question of the quality of
modified derivate indexing will be briefly considered below, largely in terms of non-
quantitative judgments.

    First and foremost, as has been noted previously, is the objection that word-indexing
typically produces redundancy, scatter of references among synonyms and near-synonyms,
inclusion of many irrelevant entries at high page and user-scanning costs, omission of

1/
    Purto expresses regret that the studies of Agrayev and Borodin, intercomparing
    results of human abstracting, use of Luhn's method, and their own modification,
    used only a single paper (1962 [484]).   Storm, (1961 [577]), evaluating the initial
    noun occurrence technique as a measure of sentence and index-term extraction
    significance, reports  results for only two papers, both by Quine.  Only nine
    articles, with no more than 40, 000 words of text in toto, were used by Edmundson,
    Oswald    and Wyllys in their 1960 experiments ([180]).

2/
    Compare, for example Lesk and Storm, 1961 [358], pp. 1-29 and 1-30 as follows:
    "A final problem is the ambiguity that may arise by removing two sentences from
    context; two sentences alone do not always permit comprehension.  Worse yet, the
    meaning may actually be inverted upon removal from context.  For example. . . a
    quote is selected which an unsuspecting reader might think the author supports,
    when he is really attacking the position."

                                       89

many properly indexable topics or points of interest because the authors did not emphasize
them or used new and unusual terminology to describe them, failures to achieve con-
sistency both of reference and index-vocabulary control for the papers of more than one
author, and the like.

    Additional difficulties are engendered, for word indexing by machine from text as
against word indexing by people, because of complexities required in pro ramming to
achieve recognition of even such simple indicia as endings of sentences,  -  incon~is -
tencies of capitalization 2/ and misspellings.~3/ Context distinctions between multiple
meanings of homographic words are even more difficult.    Difficulties in achieving good
indexing quality are increased if only titles are used; those of keystroking and machine
cost requirements increase as the amount of input material grows.

    For these reasons, early criticisms such as those of Bar-Hillel are largely as
pertinent today as they were when statistical techniques for computer generation of
document extracts and index terms were first proposed.    For example:

    tiThere can be no doubt but that computers are in a position to select out of the
    words or word-strings occurring in the encoded form of the original document
    those words or strings which fulfill certain formal, statistical conditions, such
    as occurring more than five times, occurring with a relative frequency at least
    double the relative frequency in general. . . However, it is . . . unlikely that the
    set obtained thereby will be of a quality commensurate with that obtained by a
    competent indexer.    First, there will be serious difficulties as to what is to be
    regarded as instances of the same word ... Second, there arises ... the problem
    of synonyms.  Third, and most important, this procedure will yield at its best a
    set of words and word strings exclusively taken from the document itself    4/

    On the other hand, there are many situations where, because of time factors or lack
of conventional indexing resources, even unmodified derivative indexing by machine is
itself of value and therefore modifications to improve the quality of results, whether
made by man or by machine, may be well worthwhile.    As Anzlowar claims:     `1The in-
creasingly widespread KWIC indexes . .. can save so much in time and effort that they
surely deserve better than the somewhat haphazard `slash-dash -mg' now done in most
                                                             5/
in most instances as the only cerebral operations thereon.   -

1/
    See Luhn, 1959 [384], p.22:    `1Amongst the difficulties encountered in the processing
    of machine readable texts, inconsistencies in the use of punctuation marks, com-
    pounds, capitals, spacing and indentations have been a problem way out of propor-
    tion with respect to the simple functions these devices stand for.  For instance,
    even with the aid of a dozen different tests performed by the machine, the true end
    of a sentence cannot be determined with certainty."

2/

3/

4/

5'

    See Artandi, 1963 [20], pp. 52ff, on problems of capitalization of proper names.

    See Wyllys, 1963 [653], p.  15.

    Bar-Hillel, 1962 [35], pp.417-418.

    Anzlowar, 1963 [16], p. 104.

                                         90

     Modifications to derivative indexing techniques that tend toward normalizations of
terminology and word usage, and increasingly sophisticated proposals for machine use
of syntactic, semantic, and contextual clues hold out the promise of transition to more
truly `1subject" indexing and to automatic assignment indexing systems.