pyTest is a tool for automatic testing of non-interactive commandline applications.