Move time out of extra (cc #8784)
auto merge of #12411 : Arcterus/rust/time, r=alexcrichton

More work towards finishing #8784.