Better check to exclude directories from fd listener