Fix JENKINS-13444: Do not follow symlinks with ant pattern

Do not follow symlinks when ant patterns are used. To make it the same
behaviour as without ant patterns.