HDTenEightyP/NetNews huggingface dataset:
From: eugene@amelia.nas.nasa.gov (Eugene N. Miya)
Subject: [l/m 4/6/92] New FAQ scaffold (6/28)		c.be FAQ
Keywords: who, what, where, when, why, how
Organization: NAS Program, NASA Ames Research Center, Moffett Field, CA
Date: Tue, 6 Oct 92 11:25:11 GMT
Reply-To: eugene@amelia.nas.nasa.gov (Eugene N. Miya)

6	Temporary scaffold of New FAQ material			<this panel>
7	Music to benchmark by
8	Benchmark types
9	Linpack
10
11	NIST source and .orgs
12	Benchmark Environments
13	SLALOM
14
15	12 Ways to Fool the Masses with Benchmarks
16	SPEC
17	Benchmark invalidation methods
18
19	WPI Benchmark
20	Equivalence
21	TPC
22
23	RFC 1242 terminology (network benchmarking)
24
25	Ridiculously short benchmarks
26	Other miscellaneous benchmarks
27
28	References
1	Introduction to FAQ chain and netiquette
2	Benchmarking concepts
3	PERFECT Club/Suite
4
5	Performance Metrics

Terminology
	Evaluation
	Analysis
		Mean Value Analysis
	Measurement
Model
Equivalence
	Languages
	Surrogates

Minimal benchmarks
	Kernels
	Tests
Simulations of benchmarks
Results data base
Source code
	Version control
Reduciability
Representativeness
	Functionality, how do you know it works? (correctness)
Testing

Workloads.

Output
	Analysis
	Interpretation
	Statistics, Composites, Averages, means, variance,
		Normalized numbers
	Graphics

Who
Virtual work
Application characterization

Kinds of benchmarkers
People who have to take numbers by faith.
People who reproduce but do so blindly.
People with the time and energy to do so.

                   ^ A  
                s / \ r                
               m /   \ c              
              h /     \ h            
             t /       \ i          
            i /         \ t        
           r /           \ e      
          o /             \ c    
         g /               \ t  
        l /                 \ u
       A /                   \ r
        <_____________________> e   
                Language
From: marcouil@ireq.hydro.qc.ca (Luc Marcouiller)
Newsgroups: comp.benchmarks
Subject: FTP site for benchmarks
Date: 1 Oct 92 20:25:26 GMT
Reply-To: marcouil@ireq.hydro.qc.ca
Organization: Hydro-Quebec

Hi folks,

Subject line sez it all.  You know the problem, we are in the process
of choosing between different options for a number cruncher and are
getting conflicting figures on MFLOPS and SPECmarks from different sources
(vendors, magazines and so on).  In a nutshell our applications are CFD
(finite elements, boundary elements) wich are matrix oriented floating
points calculations (lots !! i.e. 5 days of cpu on a SGI 4D/30).  Net
wisdom would be appreciated on how to correlate benchmarks to real world
applications (I've read throught flames about this topic here).

On the hardware side of things, we currently have a SGI 4D/440 GTX and
are looking at three possibilities as how to spend the money we have:

  - Upgrading the 440 to a 2 X R4000 50 MHz MP system.  They are not
    available until 1993 and SGI claims 16 MFLOPS for one cpu...
  - buy a RS/6000 - 580 or...
  - buy a HP/9000 - 750 or better (if it exists!)

So any pointers by users of those machines or benchmarks specialists would
be appreciated, thanx ! (e-mail or post)

Share and Enjoy

Luc

-- 
   Luc Marcouiller,                  Institut de Recherche d'Hydro-Quebec,
   Chercheur                         1800 Montee Ste-Julie, Varennes,
   Service Mecanique                 P. Quebec, Canada, J3X 1S1
                                     Tel: 514-652-8152 Fax: 514-652-8309
   Repondre a: /  Reply to: -------> marcouil@ireq.hydro.qc.ca
Newsgroups: comp.benchmarks,comp.unix.aix
From: ichihara@rikvax.riken.go.jp
Subject: NFS performance of RS/6000 ?
Organization: RIKEN (The Institute of Physical and Chemical Research) Wako, Saitama,  351-01, Japan
Date: Thu, 1 Oct 1992 14:42:05 GMT

   Hi folks,

   I am now investigating the NSF performance of the IBM Power
station/server series. Because now we are planning to use a
power server 980 as a network file server over FDDI together as 
a computing server.  As for a computing server, I can get some 
performance values (Specmark89, SPECint92, SPECfp92, Linpack, TPP
etc.). But As for a NFS server, I can not obtain any performance 
report of the IBM Power station/sever.

   Does anyone have any performance report of the NFS of the
IBM power station/server series  ?  Especially I want to know 
the relative NSF performance of the power station/server compared 
with the Auspec 5500 server and the SUN SPARC server.

  Thanks for any information, and comments.

----------------------------------------------------------------------
   Takashi Ichihara
   RIKEN (The Institute of Physical and Chemical Research)
      (Internet/Bintet)  Ichihara@rikvax.riken.go.jp
      (HEPnet/span)       RIKEN::ICHIHARA (41910::Ichihara)
From: jwreilly@mipos2.intel.com (Jeffrey Reilly)
Newsgroups: comp.benchmarks
Subject: Re: Spec 92 *details* wanted
Summary: SPEC
Date: 30 Sep 92 15:21:39 GMT
Distribution: na
Organization: Intel Corporation, Santa Clara, CA USA

In article <1992Sep30.030558.10536@news.acns.nwu.edu> gof@casbah.acns.nwu.edu (Gerald Fountain) writes:
>I don't think this is in the FAQ but...
>
>I am looking for information about the individual Spec92 programs, ie. what
>each emphasizes.  The names seem kind of cryptic.  Anyone have this info?  Or
>is there a pamphlet from the Spec administration which details this?
>
>
SPEC can be contacted at:

SPEC
c/o NCGA
2722 Merrilee Drive, Suite 200
Fairfax, Va 22031-4499

Phone: 703-698-9600, ext 318
Fax: 703-560-2752

If you contact them, they should be able to provide you with an
information package.

The information is also included in the $SPEC/README file that is sent
with each suite and in the DESCR* file in each benchmark directory.

A quick summary of application class includes:

CINT92
008.espresso: circuit theory
022.li: LISP interpreter
023.eqntott: logic design
026.compress: data compression
072.sc: Unix spreadsheet
085.gcc: GNU C compiler

CFP92
013.spice2g6: Circuit design
015.doduc: Monte Carlo Simulation
034.mdljdp2: Quantum chemistry
039.wave5: Maxwell Equations
047.tomcatv: Coordinate Translation
048.ora: Optics Ray Tracing
052.alvinn: Robotics; neural nets
056.ear: Human ear modeling
077.mdljsp2: Single precision version of 34.mdljdp2
078.swm256: Shallow water model
089.su2cor: Quantum physics
090.hydro2d: Astro physics
093.nasa7: NASA math kernels
094.fppp: quantum chemistry

Jeff
SPEC Release Manager For SPEC CINT92/CFP92

Jeff Reilly			| "There is something fascinating about
Intel Corporation		| science. One gets such wholesale returns
jwreilly@mipos2.intel.com	| of conjecture out of such a trifling
(408) 765 - 5909		| investment of fact" - M. Twain
From: ca@informatik.uni-kiel.dbp.de (Claus Assmann)
Newsgroups: comp.benchmarks
Subject: Where to find 'Stanford Integer Benchmarks' ?
Keywords: stanford,integer,benchmarks
Date: 30 Sep 92 17:55:11 GMT
Organization: Universitaet Kiel, Germany

Since I don't have full internet access, I have problems to locate a site for
the 'Stanford Integer Benchmarks'. I haven't found a reference in the FAQs.
These benchmarks are often used for comparison of raw processor speed. They
contain: bubble, matmul, perm, queens, quick, sieve and towers (at least these
are the names which are used in an article in front of me). I would like
to use them to compare my processor against those found in other articles.

Thanks in advance,

Claus

---
Experience is that marvelous thing that enables you recognize a
mistake when you make it again.  -- F. P. Jones
From: rjf@eecg.toronto.edu (Bob Francis)
Newsgroups: comp.benchmarks
Subject: WANTED Specmark for SUN 4/370
Date: 30 Sep 92 20:12:34 GMT
Distribution: na
Organization: University of Toronto


Does anyone know the Specmark for a SUN-4/370.  I'm trying to compare 
CAD algorithm performance reported on different machines.

Please reply by email to rjf@eecg.toronto.edu

	thanx,
	Bob Francis
Newsgroups: comp.benchmarks
From: rrao@pima.intel.com (Ravi Rao)
Newsgroups: comp.benchmarks
Subject: Benchmark gurus help sought......
Keywords: fp,IEEE format...
Date: 28 Sep 92 19:58:35 GMT
Organization: Intel Corporation

Hi folks,
	Do the floating-point routines in Linpack,Whetstone,Dhrystone,Stanford
	require IEEE-format rounding off, truncation etc or do they just run
	the tests w/o any IEEE-format compatibility issues/concerns??

Thanks.
Ravi



--
-----------------------------------------------------
Ravi S. Rao
SP1-82	Intel Corpn, Chandler, AZ
e-mail: rrao@hopi.intel.com, rrao@pima.intel.com

Customary Disclaimers apply.
-----------------------------------------------------
Newsgroups: comp.benchmarks
From: kirchner@uklira.informatik.uni-kl.de (Reinhard Kirchner)
Subject: Re: Benchmark gurus help sought......
Organization: University of Kaiserslautern, Germany
Date: Tue, 29 Sep 1992 15:46:49 GMT

From article <BvB0tq.MFH@inews.Intel.COM>, by rrao@pima.intel.com (Ravi Rao):
> Hi folks,
> 	Do the floating-point routines in Linpack,Whetstone,Dhrystone,Stanford
> 	require IEEE-format rounding off, truncation etc or do they just run
> 	the tests w/o any IEEE-format compatibility issues/concerns??
> 
It is a clear pity: but NO programming language ( or nearly no )
allows specification of rounding. So ALL these benchmarks do round just
as the hardware does.

The ONLY known languages are those from the -XSC family, Pascal-, Fortran-,
C-XSC. And these are often slow because 
- on machines without rounding hardware all MUST be done in software
- on IEEE hardware in typical interval arithmetic the rounding mode
  in the global state has to be changed after nearly every operation.

You may see: I am a little biased to these things, do have good connections
to those guy's, in fact was one many years ago.

There is hope that things get better with Alpha since it is the ONLY processor
which has rounding mode IN the opcode.

Reinhard Kirchner
Univ. of Kaiserslautern, Germany
kirchner@informatik.uni-kl.de

Newsgroups: comp.benchmarks
From: eugene@amelia.nas.nasa.gov (Eugene N. Miya)
Subject: [l/m 4/28/92] References	(28/28)		c.be FAQ
Keywords: who, what, where, when, why, how
Organization: NAS Program, NASA Ames Research Center, Moffett Field, CA
Date: Mon, 28 Sep 92 11:25:10 GMT
Reply-To: eugene@amelia.nas.nasa.gov (Eugene N. Miya)

28	References						<This panel>
1	Introduction to FAQ chain and netiquette
2	Benchmarking Concepts
3	PERFECT
4
5	Performance Metrics
6	Temporary scaffold of New FAQ material
7	Music to benchmark by
8	Benchmark types
9	Linpack
10
11
12	Measurement Environments
13	SLALOM
14
15	12 Ways to Fool the Masses with Benchmarks
16	SPEC
17	Benchmark invalidation methods
18
19	WPI Benchmark
20	Equivalence
21	TPC
22
23
24
25	Ridiculously short benchmarks
26	Other miscellaneous benchmarks
27

References
	Pending publication of Miya, Saavadera-Barerra, and Smith.

@article{LeCl82,
author="H. M. Levy and D. W. Clark",
title="On the Use of Benchmarks for Measuring System Performance",
journal="Computer architecture news",
month=dec,
year=1982}

@article{CoHw91,
author="T. M. Conte and W. W. Hwu",
title="Benchmark characterization",
journal="IEEE Computer",
month=jan,
pages="48-56",
year=1991}

                         ^  
                        /.\  
                       / . \  
                    e /  . O\ S
                     /   .  p\  
                  r /n   .C  e\ o
                   /o   C.o   r\  
                a /i     .m    a\ f
                 /t     P.p     t\  
              w /a       .i      i\ t
               /c       U.l       n\ 
            d /i         .e        g\ w
             /n          .r          \ 
          r /u           .           S\ a
           /m           y.L           y\
        a /m         r.  N  .i         s\ r
         /o       o.  a     o  .b       t\
      H /C     m.  t           t  .r     e\ e
       /    e.  a                 a  .a   m\
      /  M.  D                       t  .r  \
     / .              D a t a           i  . \
    <_________________________________________> 
               A p p l i c a t i o n
From: harrisp@wl.aecl.ca
Newsgroups: comp.benchmarks
Subject: REQUEST: LINPACK Benchmark for DEC VS-4000-90
Date: 27 Sep 92 20:16:30 GMT
Organization: AECL RESEARCH


 Has anyone out there actually done any benchmarking on a VS-400-90. The
literature says that it is 3 times faster than a VS-4000-60. We are looking
into buying a workstation for our group, and it has pretty much boiled down
to either a VS-4000-90 or a SUN SparcStation 2. We have a SparcStation 2 to
run some benchmarks on, but no 4000-90's at our site yet.

Please E-mail, as I don't often read this group.
                                Thanks in advance
                                                Phil
From: larose@thud.cs.utk.edu (Brian LaRose)
Newsgroups: comp.benchmarks
Subject: Re: Linpack Benchmark and VS-4000-90
Followup-To: larose@cs.utk.edu
Date: 28 Sep 92 17:28:45 GMT
Organization: University of Tennessee, Knoxville - Department of Computer Science
Distribution: world
Reply-To: larose@thud.cs.utk.edu (Brian LaRose)
NNTP-Posting-Host: thud.cs.utk.edu
Keywords: Linpack Benchmark Dongarra Jack

>>     <IRT>run linpack
>>     Please send the results of this run to:
>>     
>>     Jack J. Dongarra
>>     Mathematics and Computer Science Division
>>     Argonne National Laboratory
>>     Argonne, Illinois 60439
>>     
>>     Telephone: 312-972-7246
>>     
>>     ARPAnet: DONGARRA@ANL-MCS


You have an older version of the linpack benchmark which lists the
old address for Jack.

Please use the following address:

      Jack J. Dongarra
      104 Ayres Hall
      Computer Science Department
      University of Tennessee,
      Knoxville, TN 37996

      email to:    dongarra@cs.utk.edu

thanks,

-- 

    -------------------------------------
    | Brian LaRose |  974-3647          |
    | Ayres 217    |  larose@cs.utk.edu |
    -------------------------------------
From: acs_brath@rivers.acc.uwrf.edu
Newsgroups: comp.benchmarks
Subject: Wanted: Corollary & HP benchmarks
Date: 2 Oct 92 11:48:57 -0600
Organization: University of Wisconsin - River Falls

I am looking for SPECinfo (or whatever ratings are pertinent) ratings to
compare some possible system upgrades.

Our current system uses a AMI 486DX-33 EISA Motherboard. There is no brand
name because we assembled the computer from mail order.  We are looking to
buy either some type of HP business series (RISC or other) machine or a
Corollary machine. The standard configuration would be about 3Gigs of hard
drive space and  64Megs of fast ram.  With the Corollary machine we are
looking at either a  one or two processor 486DX2-66Mhz machine.  We are
running SCO ODT 2.0 and will be using a cluster of machines, about 5, to
distribute processing. The main types of processing are finincial number
crunching and heavy disk  caching.  I would like to have the system use
disk striping to store the data.  I know of software to do that for SCO but
I am not that familiar with HP.

-Shane
shane.s.brath@uwrf.edu 
Newsgroups: comp.benchmarks
From: eugene@amelia.nas.nasa.gov (Eugene N. Miya)
Subject: [l/m 3/17/92] Other misc. benchmarks (26/28)		c.be FAQ
Keywords: who, what, where, when, why, how
Organization: NAS Program, NASA Ames Research Center, Moffett Field, CA
Date: Sat, 26 Sep 92 11:25:11 GMT
Reply-To: eugene@amelia.nas.nasa.gov (Eugene N. Miya)

26	Other miscellaneous benchmarks	<This panel>
27
28	References
1	Introduction to the FAQ chain and netiquette
2
3	PERFECT
4
5	Performance Metrics
6
7	Music to benchmark by
8	Benchmark types
9	Linpack
10
11
12	Measurement Environments
13	SLALOM
14
15	12 Ways to Fool the Masses with Benchmarks
16	SPEC
17	Benchmark invalidation methods
18
19	WPI Benchmark
20	Equivalence
21	TPC
22
23
24
25	Ridiculously short benchmarks

RhosettaStone:
Speech synthesis and recognition benchmark:
	e.g., How to recognize speech.
        How to wreck a nice beach.
An interesting benchmark because it does not take a machine to become confused.
Who: me
What: examples of different problems in speech and language
recognition and synthesis.  The examples are collected for a naive
user community.  Those in the field are dealing with a highly specialized
media.  This file keeps the experts in check.
Where: eos.arc.nasa.gov.
How: confusion, discriminatory sounds
Further examples always sought.

                   ^ A  
                s / \ r                
               m /   \ c              
              h /     \ h            
             t /       \ i          
            i /         \ t        
           r /           \ e      
          o /             \ c    
         g /               \ t  
        l /                 \ u
       A /                   \ r
        <_____________________> e   
                Language
 
Newsgroups: comp.benchmarks
From: eugene@wilbur.nas.nasa.gov (Eugene N. Miya)
Subject: Re: Benchmark gurus help sought......
Organization: NAS, NASA Ames Research Center, Moffett Field, CA
Date: Tue, 29 Sep 92 20:00:57 GMT

In article <1992Sep29.154649.25389@uklirb.informatik.uni-kl.de>
kirchner@uklira.informatik.uni-kl.de (Reinhard Kirchner) writes:
|From article <BvB0tq.MFH@inews.Intel.COM>, by rrao@pima.intel.com (Ravi Rao):
|> Hi folks,
|> 	Do the floating-point routines in Linpack,Whetstone,Dhrystone,Stanford
|> 	require IEEE-format rounding off, truncation etc or do they just run
|> 	the tests w/o any IEEE-format compatibility issues/concerns??
|> 
|It is a clear pity: but NO programming language ( or nearly no )
|allows specification of rounding. So ALL these benchmarks do round just
|as the hardware does.

COBOL.
But I don't know of the Chevron COBOL benchmark includes rounding constructs
in it.  I still have to get back to the FAQ.....

Talk to the architects.

--eugene miya, NASA Ames Research Center, eugene@orville.nas.nasa.gov
  Acting Associate Editor, Software and Publication Reviews
  Scientific Programming
  {uunet,mailrus,other gateways}!ames!eugene
Seeking Books to buy:	Bongard, Pattern Recognition
			Imhof, Cartographic Relief Presentation
			Books on or by Benjamin Whorf
Xref: sparky comp.benchmarks:1486 comp.sys.sun.misc:4495 comp.lang.c:14472 comp.lang.fortran:3837
From: thomax@uropax.contrib.de (Thomas Kaulmann)
Newsgroups: comp.benchmarks
Subject: lookin' for benchmark
Date: 5 Oct 92 22:30:58 GMT
Organization: Contributed Software GbR


hi,

i'm looking for a free but extensive benchmark which works on all common
hardware/os plattforms (MS-DOS, Apple MacIntosh, Amiga, Atari ST...).
the benchmark should meassure CPU, compiler and the main perepheries
(harddisk, crt (character throughput), serial i/o, printer test...).

the harddisk, CPU and compiler tests are minimum requirement.

the benchmark should be available in (ANSI) C source code and should only use
standard library functions.

if you know something like that (it must not meet all requirements)
you can mail me the source, the ftp address or how i can get the source
on other ways (anonymous uucp, floppy, mailserver.....).

please, please help me!

with kind regards

thomax
-- 
Contributed Software, Thomas Kaulmann, Graefestr. 42, 1000 Berlin 61
G N U  &  N E T W O R K S  &  U N I X  Tel. : +49 30 694 69 07
Mail: thomax@contrib.de                Modem: +49 30 694 (6182|6749|6809)
Newsgroups: comp.benchmarks
From: gof@casbah.acns.nwu.edu (Gerald Fountain)
Subject: Spec 92 *details* wanted
Organization: Northwestern University, Evanston Illinois.
Distribution: na
Date: Wed, 30 Sep 1992 03:05:58 GMT

I don't think this is in the FAQ but...

I am looking for information about the individual Spec92 programs, ie. what
each emphasizes.  The names seem kind of cryptic.  Anyone have this info?  Or
is there a pamphlet from the Spec administration which details this?




-- 
Jerry Fountain                       
Northwestern University                        gof@stokes.chem-eng.nwu.edu
Department of Chemical Engineering             (708) 491-3555 (Office)
2145 Sheridan Road, Evanston, IL  60208        (708) 491-3728 (FAX)
From: mark@csd4.csd.uwm.edu (Mark Bamberg)
Newsgroups: comp.benchmarks
Subject: CPU, OS Benchmarks
Date: 28 Sep 1992 21:57:28 GMT
Organization: Computing Services Division, University of Wisconsin - Milwaukee
Distribution: na
NNTP-Posting-Host: 129.89.7.4
Originator: mark@csd4.csd.uwm.edu



Where can I get public domain CPU & Operating system 
benchmark programs?  
	
Preferred traits:
			
- previously compiled under the GNU suite 
					
- C code
							
- emphasis more on OS performance (i.e. context switching,
				  network performance)
									  
- used in standard benchmark suite (i.e. SPECmark)



Newsgroups: comp.benchmarks
From: jan@pallas.neuroinformatik.ruhr-uni-bochum.de (Jan Vorbrueggen)
Subject: Re: Benchmark gurus help sought......
In-reply-to: kirchner@uklira.informatik.uni-kl.de's message of Tue, 29 Sep 1992 15:46:49 GMT
Organization: Inst. f. Neuroinformatik, Ruhr-Universitaet Bochum, FRG
	<1992Sep29.154649.25389@uklirb.informatik.uni-kl.de>
Date: 30 Sep 92 13:06:45

In article <1992Sep29.154649.25389@uklirb.informatik.unikl.de> 
kirchner@uklira.informatik.unikl.de (Reinhard Kirchner) writes:

   > Hi folks,
   > 	Do the floatingpoint routines in Linpack,Whetstone,Dhrystone,Stanford
   > 	require IEEEformat rounding off, truncation etc or do they just run
   > 	the tests w/o any IEEEformat compatibility issues/concerns??
   > 
   It is a clear pity: but NO programming language ( or nearly no )
   allows specification of rounding. So ALL these benchmarks do round just
   as the hardware does.

Occam. Actually, the support for rounding modes comes with a subroutine
directly supported by the compiler; I would expect it to generate the
appropriate inline code, but haven't checked. If not, it would be easy
to define your own functions which can be inlined.

   There is hope that things get better with Alpha since it is the ONLY 
   processor which has rounding mode IN the opcode.

Possibly. But the T800's way of doing it (set rounding mode before operation,
reset to default afterwards) shouldn't be that much harder or inefficient.

Jan Vorbrueggen

Newsgroups: comp.benchmarks