I think this can be simplified to:

``` ruby
unless path
  pending "Skipping CallerFilter specs since your RSpec files are in a weird directory"
  return
end
```

`pending` is perfect for this, and I tend to prefer the early exit `return` over `if/else`, but that's just preference (that I don't feel strongly about).