If it's not, throw it out the window. Don't hope in a memoir to preserve your memories. Because it is a certain way to lose them. You can't put together a memoir without cannibalizing your own life for parts. The work battens on your memories.
Fiction has to make sense.
The writer's only responsibility is to his art. He will be completely ruthless if he is a good one. He has a dream. It anguishes him so much he must get rid of it. He has no peace until then.