It worries me that before I thought too hard about it, I was having a pretty good time.
Once the speaker thought about it, they were no longer enjoying themselves.