Simplify what we store for timeline for each user.