A heterogeneous network of workstations would contain machines running different operating systems . HPF High Performance Fortran. See the HPF section of the HPCinfo data-parallel software page. The time taken to start up an operation. Typically message latency is the time delay incurred between one processor starting a message send operation, and the recipient processor completing the receive operation.
Startup latency is the constant commicationn overhead incurred in sending a zero length message.
Communication networks are often rated in terms of latency and bandwidth . Linear speedup Speedup that is directly proportional to the number of parallel processors used. Linear speedup is the ideal for any parallel program, since Amdahl's Law restricts speedup based on the amount of the program that is still serial. Super linear speedup is sometimes achievable due to other factors related to the processor architecture. Load balance A measure of how evenly work is distributed among a set of parallel processors.