GPUs are mostly used for graphics-related calculations and have been designed so they are very good at doing video processing and less executive work.  Multiple GPUs are used for maximum performance for identical or repetitive tasks in research, forensics, cryptocurrency mining, and other fields.