Project: springxd
Issue XD-876: Create FsShell based module to copy a File to HDFS
Spring batch workflows are great for complex hadoop operations but if I want to create a simple processor that executes some hadoop fs in groovy, it would be nice to do this: {code}	def outputPath = "${hdfsPath}"	fsh.put("-", outputPath) {code} The goal of this hadoop script is to use in a stream like this:"file | script" that puts a file byte for byte to hdfs. An enhanced hdfs sink that's optimized for binary data like images/pdfs might be more elegant but I was hoping that this would work. This script gets ignored by Spring XD. But even if it didn't, I am not sure the "-" stdin put would work as hoped.
Story points: 1