Keep the timeline memory around in the graph structure so it cqn be freed later