run: Give more helpful message when user chooses an invalid test type

This is a solution for issue #175.

With the recent switch kvm-> qemu, it's natural that
people mistake those for a while. We haven't been handling
that case well. So let's establish valid test types and,
if the user chooses an invalid one, give him/her an
understandable error message.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
run: When creating an empty set, ask user to verify input

This is a solution for issue #176.

If you did type a test name that is not available for
the guest type you want the test to run, explain
carefully to the user that he/she needs to double
check the input, explaining some common mistakes.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
standalone_test: Show filters applied in config file

This is a solution for issue #178.

Display options values when displaying the list of
tests. That will explain the filters applied in the
config set generated by the config file.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
host kernel install: adjust temporary directory used during kernel compilation

/tmp used to be a safe bet, but now with some systems using a tmpfs based /tmp,
it looks like /var/tmp is a better choice.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
download.d: New resource file for Fedora 18 x86_64

Here mostly for convenience (you want to install F18 to
run some tests in it). Eventually we will enable the
ability to perform network installs of the mentioned
Fedora, but this still will take some time.

With this, you can execute:

tools/download_manager.py

And select the Fedora 18 ISO to be downloaded.

CC: Eduardo Habkost <ehabkost@redhat.com>
Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
virt-libvirt: fix bug in libvirt_xml

Signed-off-by: yangdongsheng <yangds.fnst@fujitsu.cn>
virt-libvirt: add configuration for virsh start

Signed-off-by: yangdongsheng <yangds.fnst@fujitsu.cn>
virt-libvirt: add test for virsh start

Signed-off-by: yangdongsheng <yangds.fnst@fujitsu.cn>
Fedora 18 ks: Disable tmp on tmpfs

This new feature of F18 completely kills a lot of the
tests that copy tmp files to there. Let's disable it in
our kickstart.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
cartesian_config: Keep track of extra config parsed programatically

We have cartesian config files, and the test runner
modifies them according to the options passed in the
command line. It's hard to figure out what is config
file and what was programatically added by the parser,
so introduce new utility methods that can be used to
display exactly which is which.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
run: Make the option processing use the new cartesian parser methods

So we can improve the information displayed to users
with regards to how the test list is generated.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
standalone_test: Be consistent among logs and --list output

Create a method that inspects the cartesian file for all
extra filters that the test runner add, and display the
same information for both the output of --list-tests and
the debug log. For example:

"""
Tests produced by config file /path/to/tests.cfg

The full test list was modified by the following:

Filters applied:
    only JeOS.17.64
    only smp2
    only qcow2
    only virtio_net
    only virtio_blk

Different guest OS have different test lists

Assignments applied:
    mem = 512
    qemu_binary = /bin/qemu-kvm
    qemu_img_binary = /bin/qemu-img
    qemu_io_binary = /bin/qemu-io
    nettype = user

Assignments override values previously set in the config file

1 balloon_check.base
...
"""

Hopefully that provides enough context information so
people get less confused on what the test runner is doing.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
virt-libvirt: add configuration for virsh vcpuinfo

Signed-off-by: Li Yang <liyang.fnst@cn.fujitsu.com>
virt-libvirt: modify vcpuinfo() in libvirt_vm.py

Signed-off-by: Li Yang <liyang.fnst@cn.fujitsu.com>
virt-libvirt: modify vcpuinfo() in virsh.py

Signed-off-by: Li Yang <liyang.fnst@cn.fujitsu.com>
virt-libvirt: add test for virsh vcpuinfo

Signed-off-by: Li Yang <liyang.fnst@cn.fujitsu.com>
qemu - timedrift: Fix IndexError on Windows guests

Assign the host load cmd to a variable, so we can get
its PID without resorting to using a index list -1 to
retrieve it later. This avoids a IndexError on Windows
guests.

Signed-off-by: Lucas Meneghel Rodrigues <lmr@redhat.com>
virt-libvirt: Fix virsh vcpuinfo test config typo

Signed-off-by: Chris Evich <cevich@redhat.com>