libtime: Fix adding negative duration to Timespec.

Changing from `Timespec` to `Duration` introduced a bug for negative durations. This fixes that.