svn merge -c 1344970, 1308485 FIXES: HDFS-3486 and HADOOP-8242


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1359821 13f79535-47bb-0310-9956-ffa450edef68
merge -r 1359891:1359892 from branch-2. FIXES: HADOOP-8573

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1359896 13f79535-47bb-0310-9956-ffa450edef68
MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli.
svn merge -c 1359910 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1359913 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1358788 FIXES: MAPREDUCE-2220. Fix new API FileOutputFormat-related typos in mapred-default.xml. Contributed by Rui Kubo. (harsh)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1360253 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1359866 FIXES: HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1360264 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1360448 FIXES: HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1360738 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1298978 FIXES:MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1361385 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1361389 FIXES: MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1361392 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1361397 FIXES: MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1361399 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3622. Backport HDFS-3541 to branch-0.23 (bobby via daryn) 


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362150 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1362209 FIXES: MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362214 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1301182 FIXES: HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362259 13f79535-47bb-0310-9956-ffa450edef68
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov.

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362297 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1362495 FIXES: MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362497 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1362052 FIXES: MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362549 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1362608 FIXES: MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362610 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1362618 FIXES: MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't init. (Jason Lowe via daryn)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362625 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1362976 from trunk for HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1362981 13f79535-47bb-0310-9956-ffa450edef68
svn merge -c 1353800 FIXES: HDFS-3516. Check content-type in WebHdfsFileSystem.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1363000 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever (Kihwal Lee via daryn)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1363368 13f79535-47bb-0310-9956-ffa450edef68