Make sure directories aren't getting tested
auto merge of #4072 : frewsxcv/servo/test-files, r=jdm

Fixes #3910