Moved millisecond multiplication to do only once.

The view multiples Task timestamps by 1000 to get milliseconds all over
the place. Do that multiplication only once to save multiplication in
the most frequent loops.

Review: http://reviews.apache.org/r/16250