WIP: add E2E test suite unrelated to docs examples

This is ongoing, bear with me while I hack on this :<
It would be helpful to have a file level comment of what this does.