Travis: Don't run performance tests

They take too long. They also run into weird problems with
compilations (I guess OOM).