Patent ID: 8788243

Claim:
A video game testing system for externally testing performance of game software on game platforms, comprising: a plurality of game platforms running a video game including for each of the game platforms a processor running a first game subsystem and a second game subsystem; a communications hub communicatively linked with the game platforms; and a metrics gathering framework running on a computer system communicatively linked with the communications hub, the metrics gathering framework requesting a metric value from the game platforms via the communication hub, receiving the metric values from the game platforms, and storing the metric values in memory of the computer system, each of the metric values relating to performance of a corresponding one of the game platforms during the running of the video game, wherein messages requesting the metric values are configured based on a client-side communications library providing communication protocols for the communications hub, wherein the communications hub receives the metric value-request messages and generates game platform test messages from the received messages based on differing communication libraries for each of the game platforms, and wherein, for at least one of the game platforms, the metrics gathering framework uses the metric values to determine and compare performance of the first and second game subsystems to determine which is a poorer performing subsystem.