Track latestTimestamp for video and audio streams separately.