Fix repeating the test path already fetched

This also improves performance by using os.walk direct and removing the
generation of paths list

Fix issue #48