That's what worries me. It's like waking from a dream. H. M. had bilateral lesions of the hippocampus, with some amygdala damage as well. These patients can feel pain and remember it, but it doesn't bother them in the way that it bothers normal people. The conclusion is that conscious experience and memory are inextricably intertwined from start to finish.
Experience requires memory and is made meaningful by other memory.
And different aspects of consciousness are supported by different kinds of memory with distinct neurological organizations. On the evolution of consciousness and language. Commentary on Bridgeman on Consciousness.