Then he was alone in his mind with his memories--mostly of the last day when he'd still been alive.
The only thing that was with him was his memories. 
mnli hypothesis: The only thing that was with him was his memories.  premise: Then he was alone in his mind with his memories--mostly of the last day when he'd still been alive.