It's all to do with something Daniel Kahneman hypothesises in Thinking, Fast And Slow: the peak-end rule. This involves the gap between the experiencing self (how we feel when we're actually doing something) and the remembering self (how we feel looking back on it or bringing the experience to mind again later).