They often feature thousands of CPUs, customized high speed interconnects, and specialized computing hardware.