Expanded extraction of layout and interaction data