Parsing should mostly not cross frame boundaries

We want to know when it does.
Store the entire previous flags object