Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.23.5.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add a separate logger for block state change logs to enable turning off those logs | Major | namenode | Kihwal Lee | Kihwal Lee | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Tests setLevel(Level.OFF) should be Level.ERROR | Minor | test | Andy Isaacson | Andy Isaacson | | | Print thread dump when tests fail due to timeout | Major | test | Andrey Klochkov | Andrey Klochkov | | | Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests | Minor | test | Ivan A. Veselovsky | Ivan A. Veselovsky | | | Better error message when hdfs fsck is run against a ViewFS config | Major | . | Stephen Chu | Stephen Fritz | | | Upgrade to Surefire 2.12.3 | Major | build, test | Todd Lipcon | Todd Lipcon | | | JNI-based user-group mapping modules can be too chatty on lookup failures | Major | security | Kihwal Lee | Kihwal Lee | | | hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data | Major | util | Gopal V | Gopal V | | | Cumulative code coverage calculation | Major | test | Andrey Klochkov | Andrey Klochkov | | | Counter names' memory usage can be decreased by interning | Major | jobtracker | Todd Lipcon | Miomir Boljanovic | | | Reduce MR AM memory usage through String Interning | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | RM should point tracking URL to RM web page for app when AM fails | Blocker | resourcemanager | Jason Lowe | Jason Lowe | | | repair test org.apache.hadoop.mapreduce.security.TestUmbilicalProtocolWithJobToken | Minor | . | Ivan A. Veselovsky | | | | JVM metrics for history server | Minor | jobhistoryserver | Jason Lowe | Jason Lowe | | | Too many INFO messages written out during AM to RM heartbeat | Minor | applicationmaster | James Kinley | Jason Lowe | | | Remove jquery theming support | Major | . | Todd Lipcon | Robert Joseph Evans | | | Takes a long time to load the task list on the AM for large jobs | Major | mr-am, mrv2, webapps | Ravi Prakash | Ravi Prakash | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete | Major | . | Sandy Ryza | Sandy Ryza | | | MiniDFSCluster:waitClusterUp can hang forever | Minor | test | Andy Isaacson | Andy Isaacson | | | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li | | | TestCompositeService fails on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | Hadoop examples secondarysort has a typo "secondarysrot" in the usage | Minor | . | Robert Justice | Robert Justice | | | rm "Only deletes non empty directory and

| Major | documentation | Bertrand Dechoux | Jing Zhao | | | hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu) | Major | scripts | Christopher Berner | Christopher Berner | | | RM is missing ability to add include/exclude files without a restart | Major | resourcemanager | xieguiming | xieguiming | | | Incorrect ACL properties in capacity scheduler documentation | Major | capacityscheduler | Ahmed Radwan | Ahmed Radwan | | | Secure cluster cannot use hftp to an insecure cluster | Critical | hdfs-client, security | Daryn Sharp | Daryn Sharp | | | Move the apache licence header to the top of the file in MemStore.java | Trivial | resourcemanager | Devaraj K | Devaraj K | | | Add debug log removed in HDFS-3873 back | Minor | . | Eli Collins | Eli Collins | | | TestHftpURLTimeouts fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | Job Credentials are not transmitted if security is turned off | Major | job submission, security | Benoy Antony | Benoy Antony | | | Historyserver links expire before the history data does | Critical | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe | | | TestNMWebServicesApps, TestRMWebServicesApps and TestRMWebServicesNodes fail on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | TestHftpDelegationToken fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | Bug in check for DN re-registration with different storage ID | Minor | . | Eli Collins | Jason Lowe | | | paths with multiple globs are unreliable | Critical | fs | Daryn Sharp | Daryn Sharp | | | back-port HDFS-3582 to branch-0.23 | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | mapreduce.user.classpath.first incompatibility with 0.20/1.x | Major | mrv2 | Jason Lowe | Ravi Prakash | | | Yarn Common has multiple compiler warnings for unchecked operations | Major | api | Chris Nauroth | Chris Nauroth | | | TestResourceTrackerService fail intermittently on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | Task startup time in JHS is same as job startup time. | Major | jobhistoryserver | Ravi Prakash | Ravi Prakash | | | TestApplicationTokens fails intermintently on jdk7 | Major | . | Thomas Graves | Vinod Kumar Vavilapalli | | | Retrieving container log via NM webapp can hang with multibyte characters in log | Major | nodemanager | Jason Lowe | Jason Lowe | | | Fix parameter order in assertEquals() in TestCombineInputFileFormat.java | Major | test | Mariappan Asokan | Mariappan Asokan | | | Reducer can fail to make progress during shuffle if too many reducers complete consecutively | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe | | | only .jars can be added to the Distributed Cache classpath | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | TestNodeStatusUpdater is failing in trunk | Major | nodemanager | Robert Joseph Evans | Vinod Kumar Vavilapalli | | | getFileChecksum() result incompatible when called against zero-byte files. | Critical | hdfs-client | Kihwal Lee | Kihwal Lee | | |

fails when a child filename contains a colon | Critical | fs | Jason Lowe | Jason Lowe | | | CapacityScheduler - adding a queue while the RM is running has wacky results | Critical | capacityscheduler | Thomas Graves | Arun C Murthy | | | Fix custom ProcessTree instance creation | Critical | . | Radim Kolar | Radim Kolar | | | Capacity scheduler - containers that get reserved create container token to early | Critical | capacityscheduler | Thomas Graves | Arun C Murthy | | | Interrupted Exception within AsyncDispatcher leads to user confusion | Major | api | Nathan Roberts | Vinod Kumar Vavilapalli | | | WARN and ERROR messages logged during normal AM shutdown | Minor | applicationmaster, mrv2 | Jason Lowe | Vinod Kumar Vavilapalli | | | AM crashes due to OOM while serving up map task completion events | Blocker | applicationmaster, mrv2 | Jason Lowe | Jason Lowe | | | Invalid event: T\ATTEMPT\SUCCEEDED at SUCCEEDED | Blocker | mrv2 | Robert Joseph Evans | Jason Lowe | | | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov | | | Server$Call object is never released after it is sent | Critical | ipc | Robert Joseph Evans | Robert Joseph Evans | | | RM web ui applications page should be sorted to display last app first | Major | resourcemanager | Thomas Graves | Thomas Graves | | | capacity scheduler doesn't allow capacity \< 1.0 | Major | capacityscheduler | Thomas Graves | Thomas Graves | | | job history web ui applications page should be sorted to display last app first | Major | jobhistoryserver | Thomas Graves | Thomas Graves | | | deadlock in RM - AMResponse object | Blocker | resourcemanager | Thomas Graves | Thomas Graves | | | The MR Application Master does not have a config to set environment variables | Major | applicationmaster | Robert Parker | Robert Parker | | | job history UI not showing all job attempts | Major | jobhistoryserver | Thomas Graves | Vinod Kumar Vavilapalli | | | KeyFieldBasedPartitioner not partitioning properly when configured | Major | mrv2 | Jason Lowe | Jason Lowe | | | Reduce recommissioning overhead | Critical | namenode | Kihwal Lee | Kihwal Lee | | | CapacityScheduler can take a very long time to schedule containers if requests are off cluster | Critical | capacityscheduler | Jason Lowe | Jason Lowe | | | Fetch failures can take way too long for a map to be restarted | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | NN's health report has severe performance problems | Critical | namenode | Daryn Sharp | Daryn Sharp | | | NLineInputFormat skips first line of last InputSplit | Blocker | client | Mark Fuhs | Mark Fuhs | | | Some malformed and unquoted HTML strings are returned from datanode web ui | Minor | datanode | Derek Dagit | Derek Dagit | | | JobImpl does not handle asynchronous task events in FAILED state | Major | applicationmaster, mrv2 | Ivan A. Veselovsky | Jason Lowe | | | TestApplicationCleanup.testContainerCleanup occasionally fails | Major | resourcemanager | Jason Lowe | Jason Lowe | | | AM stuck in KILL\_WAIT for days | Major |

| Ravi Prakash | Vinod Kumar Vavilapalli | | | TestJobMonitorAndPrint is broken | Major | test | Ravi Prakash | Robert Parker | | | namenode does not URI-encode parameters when building URI for datanode request | Minor | namenode | Derek Dagit | Derek Dagit | | | Speculation + Fetch failures can lead to a hung job | Critical | mrv2 | Siddharth Seth | Jason Lowe | | | Job End Notification retry interval is 5 milliseconds by default | Major | mrv2 | Ravi Prakash | Ravi Prakash | | | Hadoop distcp tool fails to copy file if -m 0 specified | Major | . | Haiyang Jiang | Jonathan Eagles | | | org.apache.hadoop.tools.TestCopyListing failing | Major | . | Robert Joseph Evans | Jonathan Eagles | | | LeaseManager tries to double remove and prints extra messages | Critical | namenode | Kihwal Lee | Kihwal Lee | | | NM state machine ignores an APPLICATION\CONTAINER\FINISHED event when it shouldn't | Blocker | nodemanager | Nathan Roberts | Nathan Roberts | | | MiniMRYarnCluster launches RM and JHS on default ports | Major | . | Robert Parker | Robert Parker | | | SecondaryNameNode leaks NameCache entries | Critical | namenode | Todd Lipcon | Robert Joseph Evans | | | LocalContainerAllocator can loop forever trying to contact the RM | Major | applicationmaster | Jason Lowe | Jason Lowe | | | Browser thinks History Server main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash | | | logSync() is called with the write lock held while releasing lease | Critical | namenode | Kihwal Lee | Kihwal Lee | | | ShuffleHandler can generate large logs due to prematurely closed channels | Critical | . | Jason Lowe | Jason Lowe | | | RMContainerImpl does not handle event EXPIRE at state RUNNING | Major | resourcemanager | Jason Lowe | Jonathan Eagles | | | Browser thinks RM main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash | | | Distributed cache conflicts breaks backwards compatability | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Fix tests in org.apache.hadoop.ipc.TestSocketFactory | Major | mrv2 | Devaraj K | Devaraj K | | | Log Aggregation generates a storm of fsync() for namenode | Critical | . | Kihwal Lee | Kihwal Lee | | | Coverage fixing LinuxContainerExecutor | Major | resourcemanager, scheduler | Aleksey Gorshkov | Aleksey Gorshkov | | | Coverage fixing for CapacityScheduler | Major | capacityscheduler | Aleksey Gorshkov | Aleksey Gorshkov | | | NM should aggregate logs when application finishes. | Critical | nodemanager | Robert Joseph Evans | Robert Joseph Evans | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Split StateMachine state from states seen by MRClientProtocol (for Job, Task, TaskAttempt) | Major | applicationmaster, mrv2 | Siddharth Seth | Siddharth Seth | | | Create Yarn trunk and commit jobs | Major | . | Eli Collins | Robert Joseph Evans | | | remove Ant remnants from MR | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Split MapReduce and YARN sections in documentation navigation | Major | documentation | Tom White | Tom White