HDFS-496. Backport: Use PureJavaCrc32 in HDFS.  Contributed by Brandon Li


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1365881 13f79535-47bb-0310-9956-ffa450edef68
HDFS-2533. Backport: Remove needless synchronization on some FSDataSet methods.  Contributed by Brandon Li


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1365882 13f79535-47bb-0310-9956-ffa450edef68
HDFS-2751. Backport: Datanode may incorrectly drop OS cache behind reads even for short reads.  Contributed by Brandon Li


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1365883 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3727. When using SPNEGO, NN should not try to log in using KSSL principal. Contributed by Aaron T. Myers.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1365892 13f79535-47bb-0310-9956-ffa450edef68
MAPREDUCE-782. Use PureJavaCrc32 in mapreduce spills. (Todd Lipcon, backport by Brandon Li via sseth)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1366280 13f79535-47bb-0310-9956-ffa450edef68
MAPREDUCE-1906. Lower minimum heartbeat interval between tasktracker and JobTracker for smaller clusters. (Contributed by Todd Lipcon, backport by Brandon Li)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1366285 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1366295 13f79535-47bb-0310-9956-ffa450edef68
HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1366467 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3679. merging change 1366545 from trunk

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1366549 13f79535-47bb-0310-9956-ffa450edef68
Adding HDFS-3679 to CHANGES.txt

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1366551 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3163. TestHDFSCLI.testAll fails if user name is not all lowercase. Contributed by Brandon Li.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1367337 13f79535-47bb-0310-9956-ffa450edef68
Merge remote-tracking branch 'apache/branch-1' into dev
add auto memory calculation
activate it
MAPREDUCE-4036. Streaming TestUlimit fails on CentOS 6. (tucu)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1368134 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3667.  Add retry support to WebHdfsFileSystem.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1368350 13f79535-47bb-0310-9956-ffa450edef68
HDFS-528. Backport: Add ability for safemode to wait for a minimum number of live datanodes. 


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1368353 13f79535-47bb-0310-9956-ffa450edef68
HDFS-3697. Enable fadvise readahead by default. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1368621 13f79535-47bb-0310-9956-ffa450edef68
MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Brandon Li)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1368724 13f79535-47bb-0310-9956-ffa450edef68
MAPREDUCE-987 change description modified to to keep it within 80 chars

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1@1368762 13f79535-47bb-0310-9956-ffa450edef68