SPARK-1795 - Add recursive directory file search to fileInputStream

Added recursive directory search to fileInputStream. Want spark to be able to find files in the subdirectories rather than just the parent directory. 
With below new implementation we can call this
val filePaths: Array[Path] = if (recursive) 
        recursiveListDirs(List(fs.getFileStatus(new Path(directoryPath)))).toArray