Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.4.1.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | BlockManager#invalidateWork should print logs outside the lock | Minor | . | Jing Zhao | Jing Zhao | | | Lower the log level in UserGroupInformation | Minor | security | Nicolas Liochon | Nicolas Liochon | | | Excessive logging in RM | Minor | scheduler | Siddharth Seth | Jian He | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestRMAdminService fails due to inconsistent entries in UserGroups | Major | . | Mit Desai | Mit Desai | | | When there is an exception, ipc.Server should first check whether it is an terse exception | Major | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | hsadmin cmd is missing in mapred.cmd | Major | . | Jian He | Jian He | | | Bug in Configuration.java exposed by Spark (ConcurrentModificationException) | Major | conf | Nishkam Ravi | Nishkam Ravi | | | TestMoveApplication.testMoveRejectedByScheduler randomly fails | Major | . | Tsuyoshi Ozawa | Hong Zhiguo | | | Rolling upgrade rollback on Windows can fail attempting to rename edit log segment files to a destination that already exists. | Minor | namenode | Chris Nauroth | Chris Nauroth | | | DataNode rolling upgrade does not correctly identify current block pool directory and replace with trash on Windows. | Major | datanode | Chris Nauroth | Chris Nauroth | | | Distributed shell with custom script has permission error. | Major | applications/distributed-shell | Tassapol Athiapinya | Vinod Kumar Vavilapalli | | | TestRMApplicationHistoryWriter#testRMWritingMassiveHistory runs slow and intermittently fails | Major | . | Mit Desai | Mit Desai | | | Wrong error message for upgrade | Minor | . | Kihwal Lee | Kihwal Lee | | | TestCallQueueManager is still flaky | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | DFSUtil.substituteForWildcardAddress may throw NPE | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | TestRBWBlockInvalidation may fail | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK | Minor | test | Arpit Agarwal | Arpit Agarwal | | | DataNode caching can leak file descriptors. | Major | datanode | Chris Nauroth | Chris Nauroth | | | TestAMRMTokens fails on windows | Major | . | Xuan Gong | Xuan Gong | | | TestPipesNonJavaInputFormat.testFormat fails in windows | Major | . | Xuan Gong | Xuan Gong | | | TestFileSystemApplicationHistoryStore.testMissingApplicationAttemptHistoryData fails in windows | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows | Major |

| Varun Vasudev | Varun Vasudev | | | Killing Container on NEW and LOCALIZING will result in exitCode and diagnostics not set | Major | . | Zhijie Shen | Zhijie Shen | | | STATE\STORE\OP\_FAILED happens when ZKRMStateStore tries to update app(attempt) before storing it | Critical | . | Arpit Gupta | Jian He | | | Fix NPE in TestMRAppMaster | Blocker | client, mrv2 | Gera Shegalov | Akira Ajisaka | | | DistributedShell unit tests fail on Windows | Major | . | Varun Vasudev | Varun Vasudev | | | DFSClient hangs infinitely if using hedged reads and all eligible datanodes die. | Major | hdfs-client | Chris Nauroth | Chris Nauroth | | | TestHistoryServerFileSystemStateStoreService.testTokenStore fails in windows | Major | . | Varun Vasudev | Varun Vasudev | | | TestMapFile and TestBloomMapFile leak file descriptors. | Minor | test | Chris Nauroth | Chris Nauroth | | | TestDatanodeConfig#testMemlockLimit fails on Windows due to invalid file path. | Trivial | datanode, test | Chris Nauroth | Chris Nauroth | | | Docs still refer to 0.20.205 as stable line | Minor | . | Robert Joseph Evans | Mit Desai | | | TestFileJournalManager can fail on Windows due to file locking if tests run out of order. | Trivial | namenode, test | Chris Nauroth | Chris Nauroth | | | Race condition in failover can cause RetryCache fail to work | Major | ha | Jing Zhao | Jing Zhao | | | OfflineEditsViewer throws a NPE on edits containing ACL modifications | Major | tools | Stephen Chu | Akira Ajisaka | | | ImageServlet should use Time#monotonicNow to measure latency. | Minor | namenode | Chris Nauroth | Chris Nauroth | | | TestMapReduceJobControl fails on JDK 7 + Windows | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | TestAMRestart and TestNodeHealthService failing sometimes on Windows | Major | . | Jian He | Jian He | | | TestAMRMRPCNodeUpdates fails ocassionally | Major | . | Zhijie Shen | Zhijie Shen | | | Potential NPE in ZKRMStateStore caused by handling Disconnected event from ZK. | Blocker | resourcemanager | Rohith Sharma K S | Karthik Kambatla | | | docs for map output compression incorrectly reference SequenceFile | Trivial | . | Todd Lipcon | Chen He | | | Private API change in YARN-1824 in 2.4 broke compatibility with previous releases | Blocker | applications | Thomas Graves | Sandy Ryza | | | Javascript injection on the job status page | Blocker | . | Mit Desai | Mit Desai | | | datanode fails to start with a bad disk even when failed volumes is set | Major | . | Arpit Gupta | Arpit Agarwal | | | JniBasedUnixGroupMapping mishandles errors | Critical | . | Kihwal Lee | Kihwal Lee | | | TestSpeculativeExecutionWithMRApp fails | Major |

| Zhijie Shen | Zhijie Shen | | | Few tests in TestJobClient fail on Windows | Major | . | Jian He | Vinod Kumar Vavilapalli | | | Fix incorrect return code and allow more retries on EINTR | Major | . | Kihwal Lee | Kihwal Lee | | | uber job doesn't terminate on getting mapred job kill | Major | mrv2 | Sangjin Lee | Sangjin Lee | | | Used resources shows escaped html in CapacityScheduler and FairScheduler page | Major | resourcemanager | Nathan Roberts | Mit Desai | | | Killing Task might cause the job to go to ERROR state | Critical | . | Ming Ma | Ming Ma | | | TestMRAppComponentDependencies causes surefire to exit without saying proper goodbye | Major | test | Jinghui Wang | Jinghui Wang | | | DN continues to start up, even if block pool fails to initialize | Major | datanode | Todd Lipcon | Vinayakumar B | | | DeadLock in RM when automatic failover is enabled. | Blocker | resourcemanager | Rohith Sharma K S | Karthik Kambatla | | | TestAMAuthorization fails with local hostname cannot be resolved | Minor | resourcemanager | Nemon Lou | Wangda Tan | | | Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager | Critical | . | Suresh Srinivas | Suresh Srinivas | | | DN can't finalize upgrade | Blocker | datanode | Rahul Singhal | Rahul Singhal | | | WebHdfs does not work if HA is enabled on NN but logical URI is not configured. | Blocker | . | Kihwal Lee | Kihwal Lee | | | WebHdfs may use the wrong NN when configured for multiple HA NNs | Blocker | webhdfs | Daryn Sharp | Kihwal Lee | | | Tracking url missing http protocol for FAILED application | Major | . | Yesha Vora | Junping Du | | | Yarn getApplicationRequest start time range is not honored | Major | resourcemanager | Venkat Ranganathan | Junping Du | | | In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE | Critical | . | Jon Bringhurst | Hong Zhiguo | | | IFile merge allocates new byte array for every value | Major | performance, task | Todd Lipcon | Todd Lipcon | | | WebHdfs ACL compatibility is broken | Blocker | webhdfs | Daryn Sharp | Chris Nauroth | | | TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id | Major | nfs | Yongjun Zhang | Yongjun Zhang | | | InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID | Blocker | namenode | Arpit Agarwal | Arpit Agarwal | | | Suppress findbugs warning for failure to override equals and hashCode in FsAclPermission. | Trivial | namenode | Chris Nauroth | Chris Nauroth | | | Wrong field is referenced in GetApplicationsRequestPBImpl#mergeLocalToBuilder() | Minor |

| Ted Yu | Hong Zhiguo | | | Append should fail if the last block has insufficient number of replicas | Major | namenode | Konstantin Shvachko | Keith Pak | | | NN shows inconsistent value in deadnode count | Critical | . | Mohammad Kamrul Islam | Mohammad Kamrul Islam | | | NFS failed to refresh the user group id mapping table | Major | nfs | Brandon Li | Brandon Li | | | TestDistributedShell fails after YARN-1962 | Minor | applications/distributed-shell | Hong Zhiguo | Hong Zhiguo | | | nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it | Major | nfs | Zhongyi Xie | Brandon Li | | | HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3 | Blocker | . | Jason Lowe | Akira Ajisaka | | | TestMiniKdc failure: login options not compatible with IBM JDK | Major | test | Gao Zhong Liang | Gao Zhong Liang | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon. | Major | test | Chris Nauroth | Chris Nauroth | | | TestProcfsBasedProcessTree must only run on Linux. | Trivial | nodemanager | Chris Nauroth | Chris Nauroth | | | TestNodeStatusUpdater#testNMRegistration is incorrect in test case | Major | nodemanager | Ming Ma | Wangda Tan | | | TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently | Major | . | Jian He | Jian He | | | TestZKRMStateStoreZKClientConnections fails intermittently | Major | resourcemanager | Karthik Kambatla | Tsuyoshi Ozawa | | | TestRMContainerAllocator fails ocassionally | Major | . | Zhijie Shen | Zhijie Shen | | | TestMRKeyValueTextInputFormat failing on Windows | Major | . | Varun Vasudev | Varun Vasudev | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Document RM HA | Blocker | resourcemanager | Karthik Kambatla | Tsuyoshi Ozawa | | | Improve default paths of timeline store and generic history store | Major | . | Gera Shegalov | Tsuyoshi Ozawa | | | Timeline server is enabled by default | Major | . | Mohammad Kamrul Islam | Mohammad Kamrul Islam | | | Both RM stuck in standby mode when automatic failover is enabled | Blocker | resourcemanager | Arpit Gupta | Karthik Kambatla | | | ProportionalCapacitPreemptionPolicy handling of corner cases... | Major | resourcemanager | Carlo Curino | Carlo Curino | | | Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts | Major | resourcemanager | Sumit Mohanty | Wangda Tan | | | Standby RM's conf, stacks, logLevel, metrics, jmx and logs links are redirecting to Active RM | Major | resourcemanager | Yesha Vora | Xuan Gong |