Take all rendering times into account for the average frame time