add verbosity and logging, and record creation and other improvements