travis-ci: go back to old directory when pygnutls is built

Signed-off-by: Daniele Ricci <daniele.athome@gmail.com>