[SPARK-3546] InputStream of ManagedBuffer is not closed and causes running out of file descriptor

@rxin Exactly, it's not make sense and I noticed the InputStream is closed via NextIterator#close.
So, I revert this part of change.