Annotate frame data with original state when derived from sourcemap