Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.5.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Remove lsr in OfflineImageViewer | Major | tools | Haohui Mai | Haohui Mai | | | Remove deprecated methods in DistributedFileSystem | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Document "fileId" and "childrenNum" fields in the FileStatus Json schema | Minor | documentation, webhdfs | Akira Ajisaka | Akira Ajisaka | | | Refactor timeline classes into server.timeline package | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Support utf-8 text with BOM (byte order marker) | Major | . | bc Wong | zhihai xu | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add support for proxy server | Major | util | Daryn Sharp | Daryn Sharp | | | Provide option to use the NFS Gateway without having to use the Hadoop portmapper | Major | nfs | Aaron T. Myers | Aaron T. Myers | | | Fair Scheduler Dynamic Hierarchical User Queues | Major | scheduler | Ashwin Shankar | Ashwin Shankar | | | Add capability for NFS gateway to reject connections from unprivileged ports | Major | nfs | Aaron T. Myers | Aaron T. Myers | | | Add support for specifying a static uid/gid mapping for the NFS gateway | Major | nfs | Aaron T. Myers | Aaron T. Myers | | | Write metrics sink plugin for Hadoop/Graphite | Major | . | Chu Tong | | | | Common side changes to support HDFS extended attributes (HDFS-2006) | Major | fs | Uma Maheswara Rao G | Yi Liu | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Extending DistCp through a custom CopyListing is not possible | Major | distcp | Srikanth Sundarrajan | Srikanth Sundarrajan | | | Invalid NaN values in Hadoop REST API JSON response | Major | . | Kendall Thrapp | Chen He | | | ProxyUsers does not work with NetGroups | Major | security | Benoy Antony | Benoy Antony | | | Fix a generic type warning in FairScheduler | Minor | scheduler | Junping Du | Chen He | | | Elapsed time for failed tasks that never started is wrong | Major | . | Rushabh S Shah | Rushabh S Shah | | | Update documentation about short-circuit local reads | Minor | documentation | Masatake Iwasaki | | | | Provide more snapshot information in WebUI | Minor | snapshots | Haohui Mai | Shinichi Yamashita | | | Clean up dead code for OfflineImageViewer | Major | . | Haohui Mai | Haohui Mai | | | Remove unused field and imports from SaslRpcServer | Trivial | security | Benoy Antony | Benoy Antony | | | Sanitize the the inputs (groups and hosts) for the proxyuser configuration | Minor | security | Benoy Antony | Benoy Antony | | | In Fair Scheduler, avoid creating objects on each call to AppSchedulable comparator | Minor | scheduler | Hong Zhiguo | Hong Zhiguo | | | Relocate the non-public API classes in the

package | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Provide FileContext version of har file system | Major | . | Kihwal Lee | Kihwal Lee | | | Disable quota checks when replaying edit log. | Major | namenode | Kihwal Lee | Kihwal Lee | | | Remove the o.a.h.hdfs.server.common.UpgradeStatusReport | Major | . | Haohui Mai | Haohui Mai | | | Provide diagnostics for reducers killed during ramp down | Major | mr-am | Gera Shegalov | Gera Shegalov | | | Make FairScheduler resource ratio calculations terminate faster | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot | | | FileInputStream is not closed in ProcfsBasedProcessTree#constructProcessSMAPInfo() | Minor | resourcemanager | Ted Yu | Fengdong Yu | | | Clean up ImageVisitor and SpotCheckImageVisitor | Major | tools | Akira Ajisaka | Akira Ajisaka | | | Create HTML5-based UI for SNN | Major | . | Haohui Mai | Haohui Mai | | | Create new index page for JN / DN | Major | . | Haohui Mai | Haohui Mai | | | Few NN metrics data points were collected via JMX when NN is under heavy load | Major | namenode | Ming Ma | Ming Ma | | | Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers | Major | namenode | Arpit Agarwal | Arpit Agarwal | | | Provide backward compatibility for ProxyUsers.authorize() call | Minor | security | Benoy Antony | Benoy Antony | | | Make the retry numbers in ActiveStandbyElector configurable | Minor | . | Jing Zhao | Jing Zhao | | | re-add testIncludeByRegistrationName | Minor | test | Colin P. McCabe | Colin P. McCabe | | | Identify full path for a given INode | Major | snapshots | Jing Zhao | Jing Zhao | | | Improve documentation on log aggregation in yarn-default.xml | Major | documentation | Sandy Ryza | Akira Ajisaka | | | Add ability to read principal names from a keytab | Major | security | Benoy Antony | Benoy Antony | | | Make job context available to OutputCommitter.isRecoverySupported() | Major | mr-am | Mohammad Kamrul Islam | Mohammad Kamrul Islam | | | NameNode Audit Log should differentiate between webHDFS open and HDFS open. | Major | namenode, webhdfs | Eric Payne | Eric Payne | | | Consolidate the logic of path resolution in FSDirectory | Major | namenode | Haohui Mai | Haohui Mai | | | MAX\_SUBST and varPat should be final in Configuration.java | Major | conf | Gera Shegalov | Gera Shegalov | | | BlockPlacementPolicy does not work for cross node group dependencies | Critical | namenode | Nikola Vujic | Nikola Vujic | | | Add "decommissioning" state and node state filtering to dfsadmin | Major | . | Andrew Wang | Andrew Wang | | | DynamicInputFormat should allow overriding of MAX\CHUNKS\TOLERABLE | Major | distcp, mrv2 | David Rosenstrauch | Tsuyoshi Ozawa | | | Add toLowerCase support to auth\to\local rules for service name | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | ExtendedBlock#hashCode should use both blockId and block pool ID | Minor | federation | Colin P. McCabe | Benoy Antony | | | Wrapper for leveldb DBIterator to aid in handling database exceptions | Major |

| Jason Lowe | Jason Lowe | | | Job overview in History UI should list reducer phases in chronological order | Trivial | jobhistoryserver | Gera Shegalov | Gera Shegalov | | | Client failover proxy provider for IP failover based NN HA | Major | . | Kihwal Lee | Kihwal Lee | | | Improve MiniYarnCluster for log aggregation testing | Major | nodemanager | Ming Ma | Ming Ma | | | Example NFS mount command must pass noacl as it isn't supported by the server yet | Trivial | nfs | Harsh J | Harsh J | | | HA: Add check to active state transition to prevent operator-induced split brain | Major | ha, namenode | Todd Lipcon | Rushabh S Shah | | | finishedSubMaps field in LocalContainerLauncher does not need to be volatile | Minor | . | Ted Yu | Tsuyoshi Ozawa | | | Better audit log messages for caching operations | Major | namenode | Andrew Wang | Abhiraj Butala | | | Enhance distcp to support preserving HDFS ACLs. | Major | distcp | Chris Nauroth | Chris Nauroth | | | CBZip2InputStream is not threadsafe | Major | . | Xiangrui Meng | Xiangrui Meng | | | Add snapshot related APIs to webhdfs | Major | namenode, webhdfs | Suresh Srinivas | Jing Zhao | | | Remove support for ACL feature from INodeSymlink | Minor | . | Andrew Wang | Charles Lamb | | | Replace BytesMoved class with AtomicLong | Major | balancer & mover | Benoy Antony | Benoy Antony | | | FairScheduler: QueuePlacementPolicy and QueuePlacementRule are missing audience annotations | Major | scheduler | Anubhav Dhoot | zhihai xu | | | Support incremental data copy in DistCp | Major | distcp | Jing Zhao | Jing Zhao | | | Remove SingleNodeSetup.apt.vm | Minor | documentation | Akira Ajisaka | Akira Ajisaka | | | Fair Scheduler: allow default queue placement rule to take an arbitrary queue | Major | scheduler | Ashwin Shankar | Ashwin Shankar | | | adding more slow action log in critical write path | Major | datanode | Liang Xie | Liang Xie | | | Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs | Minor | nfs | Brandon Li | Abhiraj Butala | | | BlockReaderLocalLegacy should set socket timeout based on conf.socketTimeout | Major | hdfs-client | Liang Xie | Liang Xie | | | Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts | Minor | test | Zesheng Wu | Zesheng Wu | | | use Time#monotonicNow to avoid system clock reset | Major | datanode, namenode | Liang Xie | Liang Xie | | | Fix typo in DatanodeLayoutVersion | Trivial | datanode | Tulasi G | Tulasi G | | | balancer should timestamp the completion message | Trivial | balancer & mover | Allen Wittenauer | Juan Yu | | | Clarify behavior of AclStorage#createFsPermissionForExtendedAcl in comments. | Trivial | namenode | Aaron T. Myers | Chris Nauroth | | | Listing extended attributes with the search permission | Major | namenode | Andrew Wang | Charles Lamb | | | let sync\file\range() system call run in background | Major | datanode | Liang Xie | Liang Xie | | | Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found | Minor | . | Andrew Wang | Andrew Wang | | | Revisit logging levels in ZKRMStateStore | Minor | resourcemanager | Karthik Kambatla | Ray Chiang | | | Document

BlockReader#available() can return more bytes than are remaining in the block | Trivial | . | Ted Yu | Ted Yu | | | Add CLI testcases to reflect new features of dfs and dfsadmin | Major | test | Dasha Boudnik | Dasha Boudnik | | | Use StateMachine to simplify handleStoreEvent() in RMStateStore | Major | . | Junping Du | Binglin Chang | | | Allow wordcount example job to accept multiple input paths. | Minor | examples | Chris Nauroth | Chris Nauroth | | | RMAppAttemptImpl should return the DummyApplicationResourceUsageReport for all invalid accesses | Minor | resourcemanager | Sandy Ryza | Ray Chiang | | | Fix typo of DFSAdmin restoreFailedStorage | Minor | tools | Zesheng Wu | Zesheng Wu | | | ability to support storing extended attributes per file | Major | namenode | dhruba borthakur | Yi Liu | | | Refactor refresh\*Protocols into a single generic refreshConfigProtocol | Minor | . | Chris Li | Chris Li | | | Copy command with preserve option should handle Xattrs | Major | fs | Uma Maheswara Rao G | Yi Liu | | | Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance | Minor | . | Yongjun Zhang | Yongjun Zhang | | | Documenting Hadoop metrics | Major | documentation, metrics | Hong Tang | Akira Ajisaka | | | Improve the readability of 'hadoop fs -help' | Minor | tools | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Expose thread-level FileSystem StatisticsData | Major | fs | Sandy Ryza | Sandy Ryza | | | Trace logging for RemoteBlockReader2 to identify remote datanode and file being read | Minor | hdfs-client | Anubhav Dhoot | Anubhav Dhoot | | | Use NativeIO#renameTo instead of File#renameTo in FileJournalManager | Major | namenode | Yongjun Zhang | Yongjun Zhang | | | Better logging in SchedulerNode#allocateContainer | Trivial | resourcemanager | Ray Chiang | Ray Chiang | | | Add XAttrs to TestOfflineImageViewer | Minor | test | Stephen Chu | Stephen Chu | | | Remove Copyright /d/d/d/d Apache Software Foundation from the source files license header | Minor | documentation | Henry Saputra | Henry Saputra | | | FsShell -cp -pa option for preserving extended ACLs | Major | fs | Akira Ajisaka | Akira Ajisaka | | | Finalizing rolling upgrade can make NN unavailable for a long duration | Critical | . | Kihwal Lee | Kihwal Lee | | | InputSplits should indicate which locations have the block cached in memory | Major | . | Sandy Ryza | Sandy Ryza | | | Support create-time xattrs and atomically setting multiple xattrs | Major | namenode | Andrew Wang | Andrew Wang | | | Add metrics for log warnings reported by JVM pauses | Major | datanode, namenode | Yongjun Zhang | Yongjun Zhang | | | Improve DFSAdmin to support HA cluster better | Major | tools | Zesheng Wu | Zesheng Wu | | | FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper | Major | namenode | Zhilei Xu | Zhilei Xu | | | add toString method to DatanodeStorage for easier debugging | Major | . | Yongjun Zhang | Yongjun Zhang | | | Make Hadoop Authentication Handler loads case in-sensitive | Minor | security | Benoy Antony | Benoy Antony | | | Clean a piece of code in ResourceRequest | Trivial |

| Wei Yan | Wei Yan | | | RM/NM UIs and webservices are missing vcore information | Major | nodemanager, resourcemanager, webapp | Nathan Roberts | Nathan Roberts | | | Move SnapshotDiffInfo out of INodeDirectorySnapshottable | Minor | namenode, snapshots | Jing Zhao | Jing Zhao | | | Support configurable retries on SASL connection failures in RPC client. | Minor | ipc | Chris Nauroth | Chris Nauroth | | | Rewrite the PureJavaCrc32 loop for performance improvement | Major | performance, util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Configure the maximum threads allowed for balancing on datanodes | Minor | balancer & mover, datanode | Benoy Antony | Benoy Antony | | | Support multiple group mapping providers | Major | security | Kai Zheng | Kai Zheng | | | Separate AM failures from hardware failure or YARN error and do not count them to AM retry count | Major | resourcemanager | Bikas Saha | Xuan Gong | | | Missing '\\n' in the description of dfsadmin -rollingUpgrade | Trivial | . | Akira Ajisaka | Chen He | | | Clean up unused code in Ls shell command. | Trivial | fs | Chris Nauroth | Chris Nauroth | | | Add XAttr with ACL test | Minor | test | Stephen Chu | Stephen Chu | | | Define behaviour of Seekable.seek(), write tests, fix all hadoop implementations for compliance | Major | fs | Steve Loughran | Steve Loughran | | | swifts should throw FileAlreadyExistsException on attempt to overwrite file | Minor | fs | Steve Loughran | Steve Loughran | | | Strictly define the expected behavior of filesystem APIs and write tests to verify compliance | Blocker | fs, test | Steve Loughran | Steve Loughran | | | Snapshot docs should specify about preserve options with cp command | Major | namenode | Uma Maheswara Rao G | Stephen Chu | | | Typo in DataChecksum classs | Trivial | . | Jingguo Yao | Jingguo Yao | | | Document better sample requests for RM web services for submitting apps | Major | documentation | Varun Vasudev | Varun Vasudev | | | Annotate all hadoop-sls APIs as @Private | Minor | . | Wei Yan | Wei Yan | | | Update compatibility doc to capture visibility of un-annotated classes/ methods | Blocker | documentation | Karthik Kambatla | Karthik Kambatla | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address | Minor | test | Ivan Mitic | Ivan Mitic | | | Extend UserGroupInformation to return a UGI given a preauthenticated kerberos Subject | Major | security | Larry McCay | Larry McCay | | | Fix a couple isTerminals in Fair Scheduler queue placement rules | Major | scheduler | Sandy Ryza | Sandy Ryza | | | FS: AppSchedulable.assignContainer's priority argument is redundant | Minor | scheduler | Sandy Ryza | Naren Koneru | | | NaN can be created by client and assign to Progress | Major |

| Chen He | Chen He | | | Fair scheduler gabs incessantly about reservations | Major | scheduler | Sandy Ryza | Sandy Ryza | | | \*nix: Allow a way for users to augment classpath of YARN daemons | Trivial | client | Sandy Ryza | Jarek Jarcec Cecho | | | Add audience annotations to MiniMRYarnCluster and MiniMRCluster | Major | test | Sandy Ryza | Anubhav Dhoot | | | Typo in help printed by hdfs dfs -help | Major | . | Mit Desai | Mit Desai | | | Fair Scheduler UI not showing apps table | Major | . | bc Wong | bc Wong | | | Update hadoop-pipes examples README | Minor | pipes | Jonathan Eagles | Mit Desai | | | HttpServer's jetty audit log always logs 200 OK | Major | . | Daryn Sharp | Jonathan Eagles | | | InputFormat and JobConf JavaDoc Fixes | Trivial | documentation | Ben Robie | Chen He | | | TestFetcher.testCopyFromHostExtraBytes is missing | Minor | mrv2, test | Jason Lowe | Jason Lowe | | | update capacity scheduler docs to include necessary parameters | Major | . | Chen He | Chen He | | | Replace junit.framework.Assert with org.junit.Assert | Major | . | Karthik Kambatla | Chen He | | | NFS Gateway docs are incorrect for allowed hosts configuration | Minor | nfs | Aaron T. Myers | Aaron T. Myers | | | SaslRpcClient should not assume that remote principals are in the default\_realm | Major | security | Aaron T. Myers | Aaron T. Myers | | | Decomissioning on NN restart can complete without blocks being replicated | Critical | namenode | Kihwal Lee | Rushabh S Shah | | | Simplify the JMX API that provides snapshot information | Major | . | Haohui Mai | Shinichi Yamashita | | | Remove unnecessary conf load in Limits | Major | . | Sandy Ryza | Sandy Ryza | | | Incorrect property name for RefreshUserMappingProtocol in hadoop-policy.xml | Major | conf | Joey Echeverria | Joey Echeverria | | | Checkpointing should use monotonic time when calculating period | Minor | namenode | Andrew Wang | Charles Lamb | | | distcp V2 doesn't preserve root dir's attributes when -p is specified | Major | tools/distcp | Yongjun Zhang | Yongjun Zhang | | | minor textual fixes in DFSClient | Trivial | tools | Charles Lamb | Charles Lamb | | | DF#getFilesystem is not parsing the command output | Major | . | Akira Ajisaka | Akira Ajisaka | | | TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success | Major | test | Chen He | Chen He | | | Fix the wrong property names in NFS user guide | Trivial | documentation, nfs | Brandon Li | Brandon Li | | | dead node count / listing is very broken in JMX and old GUI | Blocker | . | Travis Thompson | Haohui Mai | | | WebHdfsFileSystem open should throw FileNotFoundException for non-existing paths | Blocker | . | Gera Shegalov | Gera Shegalov | | | ConcurrentModificationException in AbstractDelegationTokenSelector.selectToken() | Major | security | Arpit Gupta | Jing Zhao | | | TestContainerAllocation assumes CapacityScheduler | Minor | resourcemanager | Karthik Kambatla | Robert Kanter | | | TestSafeMode occasionally fails | Major | test | Ted Yu | Arpit Agarwal | | | Storage#tryLock() should check for null before logging successfull message | Major | datanode | Vinayakumar B | Vinayakumar B | | | BUILDING.txt should mention openssl dependency required for hadoop-pipes | Major | . | Vinayakumar B | Vinayakumar B | | | TestFileUtil fails on Windows due to bad permission

| Trivial | fs, test | Chris Nauroth | Chris Nauroth | | | Metrics system FileSink can leak file descriptor. | Major | metrics | Chris Nauroth | Chris Nauroth | | | TestDirectoryScanner leaks file descriptors. | Minor | datanode, test | Chris Nauroth | Chris Nauroth | | | TestDoAsEffectiveUser fails on JDK7 due to failure to reset proxy user configuration. | Trivial | security, test | Chris Nauroth | Chris Nauroth | | | HA NameNode transition to active or shutdown may leave lingering image transfer thread. | Major | ha, namenode | Chris Nauroth | Chris Nauroth | | | Create new tests for ByteRangeInputStream | Major | . | Haohui Mai | Akira Ajisaka | | | Fix typo in RandomTextWriter | Trivial | . | Akira Ajisaka | Akira Ajisaka | | | Remove unnecessary job.setNumReduceTasks in SleepJob.createJob | Minor | . | Liyin Liang | jhanver chand sharma | | | Webhdfs has poor throughput for files \>2GB | Major | webhdfs | Daryn Sharp | Daryn Sharp | | | Avoid protocol buffer RPC namespace clashes | Blocker | datanode, journal-node, namenode | Ralph Castain | Colin P. McCabe | | | deleteAsUser() terminates early without deleting more files on error | Major | . | Kihwal Lee | Rushabh S Shah | | | MR AM handles an oversized split metainfo file poorly | Major | mr-am | Jason Lowe | Eric Payne | | | ShellScriptBuilder does not check for some error conditions | Minor | nodemanager | Remus Rusanu | Remus Rusanu | | | Update hadoop-metrics2.properties examples to Yarn | Major | conf | Akira Ajisaka | Akira Ajisaka | | | Chance for Stream leakage in CompressorStream | Minor | . | SreeHari | Rushabh S Shah | | | Decommission on standby NN couldn't finish | Major | namenode | Ming Ma | Ming Ma | | | TestDataNodeConfig failing on Jenkins runs due to DN web port in use | Minor | test | Steve Loughran | Andrew Wang | | | Both NameNodes could be in STANDBY State if SNN network is unstable | Critical | ha | Vinayakumar B | Vinayakumar B | | | hadoop-config.sh - bug in --hosts argument | Major | . | Sebastien Barrier | Sebastien Barrier | | | Rumen doesn't understand JobQueueChangedEvent | Major | tools/rumen | Nathan Roberts | Nathan Roberts | | | MRAppMaster fails when checking on uber mode | Critical | . | Haohui Mai | Haohui Mai | | | Datanode upgrade in Windows fails with hardlink error. | Major | tools | Huan Huang | Arpit Agarwal | | | TestRMContainerAllocator#testReportedAppProgress Failed | Major | . | Hong Shen | Jason Lowe | | | Secondary namenode status page shows transaction count in bytes | Minor | . | Benoy Antony | Benoy Antony | | | DFSInputStream Pread doesn't update ReadStatistics | Minor | . | Juan Yu | Juan Yu | | | RefreshCallQueue fails when authorization is enabled | Major | ipc | Chris Li | Chris Li | | | Block Scanner rescans blocks too frequently | Major | . | Andy Isaacson | Andy Isaacson | | | TestClientRMTokens is failing irregularly while running all yarn tests | Major | . | Omkar Vinit Joshi | Ming Ma | | | Issues with webhdfs and http proxies | Major | webhdfs | Daryn Sharp | Daryn Sharp | | | Give

public scope | Major | security | Jason Dere | Benoy Antony | | | RemoteException's unwrapRemoteException method failed for PathIOException | Major | . | Yongjun Zhang | Yongjun Zhang | | | HA failover can fail if there are pending DN messages for DNs which no longer exist | Critical | ha | Aaron T. Myers | Aaron T. Myers | | | Add s3 server-side encryption | Major | fs/s3 | David S. Wang | David S. Wang | | | Setfacl testcase is failing due to dash character in username in TestAclCLI | Major | test | Uma Maheswara Rao G | Uma Maheswara Rao G | | | InputStream in MiniKdc#initKDCServer for minikdc.ldiff is not closed | Minor | test | Ted Yu | Swarnim Kulkarni | | | InputStream is not closed in two methods of JarFinder | Minor | test, util | Ted Yu | Ted Yu | | | TestUserGroupInformation#testGetServerSideGroups fails because groups stored in Set and ArrayList are compared | Major | . | Mit Desai | Mit Desai | | | SPNEGO should work with multiple interfaces/SPNs. | Critical | . | Kihwal Lee | Daryn Sharp | | | History server uses short user name when canceling tokens | Major | jobhistoryserver, security | Mohammad Kamrul Islam | Mohammad Kamrul Islam | | | Document yarn.resourcemanager.hostname in ClusterSetup | Minor | documentation | Karthik Kambatla | Ray Chiang | | | Use INode IDs to avoid conflicts when a file open for write is renamed | Major | namenode | Colin P. McCabe | Colin P. McCabe | | | Expose upgrade status through NameNode web UI | Major | namenode | Arpit Agarwal | Mit Desai | | | Datanode disk error check may be incorrectly skipped | Major | . | Kihwal Lee | Rushabh S Shah | | | EnumSetParam$Domain#parse fails for parameter containing more than one enum. | Major | webhdfs | Yi Liu | Yi Liu | | | Retry polices ignore interrupted exceptions | Critical | ipc | Daryn Sharp | Daryn Sharp | | | WebHdfs response decoding may throw RuntimeExceptions | Critical | webhdfs | Daryn Sharp | Daryn Sharp | | | fat jar with \*-default.xml may fail when mapreduce.job.classloader=true. | Major | mrv2 | Gera Shegalov | Gera Shegalov | | | NM Recovery. ShuffleHandler should handle NM restarts | Major | . | Karthik Kambatla | Jason Lowe | | | Failed job leaves hung AM after it unregisters | Major | mr-am | Jason Lowe | Jason Lowe | | | Fix divide-by-zero, improper use of wall-clock time in BlockPoolSliceScanner | Major | . | Colin P. McCabe | Colin P. McCabe | | | Nodemanager version is not updated when a node reconnects | Major | resourcemanager | Jason Lowe | Jason Lowe | | | Web UI fails to display in intranet under IE | Major | datanode, journal-node, namenode | Haohui Mai | Haohui Mai | | | Issues with OIV processing PB-based fsimages | Blocker | . | Kihwal Lee | Kihwal Lee | | | Fix a typo in INodeReference.java | Trivial | documentation | Binglin Chang | Binglin Chang | | | ShellBasedUnixGroupsMapping#getGroups does not always return primary group first | Major | util | Colin P. McCabe | Akira Ajisaka | | | Cannot execute "hdfs oiv\_legacy" | Critical | tools | Akira Ajisaka | Akira Ajisaka | | | Workaround for jetty6 acceptor startup issue | Major |

| Kihwal Lee | Kihwal Lee | | | DFS.listCacheDirectives() should allow filtering based on cache directive ID | Major | caching | Lenni Kuff | Andrew Wang | | | TestBalancerWithNodeGroup.testBalancerWithRackLocality fails | Major | . | Kihwal Lee | Binglin Chang | | | Creating MapReduce REST API section | Major | documentation | Ravi Prakash | Tsuyoshi Ozawa | | | Deleting file through fuse-dfs when using trash fails requiring root permissions | Major | fuse-dfs | Stephen Chu | Colin P. McCabe | | | .gitignore should ignore .orig and .rej files | Major | . | Karthik Kambatla | Karthik Kambatla | | | UserGroupInformation#getTokens and UserGroupInformation#addToken can lead to ConcurrentModificationException | Major | . | Jing Zhao | Robert Kanter | | | 2.0.4 JobHistoryParser can't parse certain failed job history files generated by 2.0.3 history server | Major | jobhistoryserver, mrv2 | Vrushali C | Rushabh S Shah | | | Fix LogCLIHelpers to create the correct FileContext | Major | . | Ming Ma | Ming Ma | | | Fix vecsum.c compile on BSD and some other systems | Major | libhdfs | Jason Lowe | Mit Desai | | | Fix typo in log message about NameNode layout version upgrade. | Trivial | namenode | Chris Nauroth | Chen He | | | DeleteSnapshot should be a DELETE request in WebHdfs | Major | webhdfs | Jing Zhao | Jing Zhao | | | Diskspace quota usage should be updated when appending data to partial block | Major | namenode | Jing Zhao | Jing Zhao | | | Fair Scheduler: Add a utilization threshold to prevent preempting resources when cluster is free | Critical | scheduler | Karthik Kambatla | Karthik Kambatla | | | Race in TestRMRestart#testQueueMetricsOnRMRestart | Major | . | Anubhav Dhoot | Anubhav Dhoot | | | Fix MiniQJMHACluster related test failures | Minor | test | Zesheng Wu | Zesheng Wu | | | ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts | Major | . | Jing Zhao | Colin P. McCabe | | | Configuration: names should be trimmed when putting/getting to properties | Major | conf | Wangda Tan | Wangda Tan | | | Line records longer than 2x split size aren't handled correctly | Critical | . | bc Wong | bc Wong | | | Use scheduling policies throughout the queue hierarchy to decide which containers to preempt | Major | scheduler | Sandy Ryza | Wei Yan | | | FileAlreadyExistsException was thrown : Temporary Index File can not be cleaned up because OutputStream doesn't close properly | Major | client | Kousuke Saruta | Kousuke Saruta | | | Documentation has broken "Go Back" hyperlinks. | Trivial | documentation | Chris Nauroth | Akira Ajisaka | | | Hadoop-client is missing jackson libs due to inappropriate configs in pom.xml | Major | . | Zhijie Shen | Zhijie Shen | | | Use Time#monotonicNow to compute duration in DataNode#shutDown | Trivial | datanode | James Thomas | James Thomas | | | NFS: fsstat request fails with the secure hdfs | Major | nfs | Yesha Vora | Brandon Li | | | FileBasedKeyStoresFactory initialization is not using default for SSL\REQUIRE\CLIENT\CERT\KEY | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | Updating hadoop-daemon.sh to work as expected when nfs is started as a privileged

| Major | nfs | Manikandan Narayanaswamy | Manikandan Narayanaswamy | | | Better defaults for YARN ZK configs for retries and retry-inteval when HA is enabled | Major | resourcemanager | Karthik Kambatla | Karthik Kambatla | | | HttpFS should use a 000 umask for mkdir and create operations | Major | . | Alejandro Abdelnur | Mike Yoder | | | YARN status web ui does not show correctly in IE 11 | Major | webapp | Chuan Liu | Chuan Liu | | | fix typo in webapps/hdfs/explorer.js | Trivial | . | Juan Yu | Juan Yu | | | Clean up NFS config settings | Major | nfs | Aaron T. Myers | Brandon Li | | | Inconsistency between viaProto flag and initial value of SerializedExceptionProto.Builder | Major | . | Binglin Chang | Binglin Chang | | | NPE in FairSchedulerAppsBlock#render | Critical | fairscheduler | caolong | Anubhav Dhoot | | | Possible race condition in RetryInvocationHandler | Major | . | Jing Zhao | Jing Zhao | | | blockReport doesn't need to invalidate blocks on SBN | Major | . | Ming Ma | Ming Ma | | | With Fair Scheduler, cluster can logjam when all resources are consumed by AMs | Major | scheduler | bc Wong | Wei Yan | | | DEFAULT\PROXY\ADDRESS should use DEFAULT\PROXY\PORT | Major | . | Anubhav Dhoot | Anubhav Dhoot | | | Support multiple xattr.name parameters for WebHDFS getXAttrs. | Major | webhdfs | Yi Liu | Yi Liu | | | distcp to support preserving HDFS extended attributes(XAttrs) | Major | distcp | Uma Maheswara Rao G | Yi Liu | | | String Format Exception in SwiftNativeFileSystemStore.java | Minor | fs/swift | Gene Kim | Gene Kim | | | TestStandbyCheckpoint#testSBNCheckpoints is racy | Major | . | Mit Desai | Mit Desai | | | Make TestAvailableSpaceVolumeChoosingPolicy deterministic | Minor | test | Colin P. McCabe | Colin P. McCabe | | | In AllocationFileLoaderService, the reloadThread should be created in init() and started in start() | Major | scheduler | Karthik Kambatla | Robert Kanter | | | FairScheduler: Incorrect calculation of amResource usage | Major | . | Wei Yan | Wei Yan | | | ZKRMStateStore.ZKAction#runWithRetries doesn't log the exception it encounters | Major | resourcemanager | Karthik Kambatla | Vamsee Yarlagadda | | | Snapshot shouldn't be removed silently after renaming to an existing snapshot | Blocker | snapshots | Junping Du | Tsz Wo Nicholas Sze | | | Add note about setfacl in HDFS permissions guide | Minor | documentation, namenode | Charles Lamb | Chris Nauroth | | | SSLFactory expects truststores being configured | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | TestNetUtils.testNormalizeHostName fails | Major | . | Chen He | Aaron T. Myers | | | HA functionality that uses ZooKeeper may experience inadvertent TCP RST and miss session expiration event due to bug in client connection management | Major | ha | Chris Nauroth | Chris Nauroth | | | TestGridMixClasses tests timesout on branch-2 | Major |

| Mit Desai | Mit Desai | | | Incorrect check for unknown datanode in Balancer | Major | balancer & mover | Benoy Antony | Benoy Antony | | | ProportionalCapacityPreemptionPolicy cannot work because it's initialized before scheduler initialized | Critical | resourcemanager, scheduler | Wangda Tan | Wangda Tan | | | Add Xattr option in DistCp docs | Minor | distcp, documentation | Uma Maheswara Rao G | Yi Liu | | | The password keystore file is not picked by LDAP group mapping | Major | security | Brandon Li | Brandon Li | | | Shell.runCommand can deadlock | Critical | . | Jason Lowe | Gera Shegalov | | | HTTPFS - Implement ACLs support | Major | . | Alejandro Abdelnur | Mike Yoder | | | TestNMClient failed due more exit code values added and passed to AM | Major | client | Wangda Tan | Wangda Tan | | | Make moveFromLocal CLI testcases to be non-disruptive | Major | test | Dasha Boudnik | Dasha Boudnik | | | TestRMAdminCLI consistently fail on trunk and branch-2 | Major | . | Zhijie Shen | Kenji Kikushima | | | Skip checking xattr limits for non-user-visible namespaces | Major | namenode | Andrew Wang | Yi Liu | | | Invalidate excess corrupted blocks as long as minimum replication is satisfied | Major | namenode | J.Andreina | Juan Yu | | | FairScheduler: Incorrect threshold check for preemption | Major | . | Wei Yan | Wei Yan | | | SecurityUtil has unnecessary synchronization on collection used for only tests | Minor | security | Benoy Antony | Benoy Antony | | | TestBPOfferService.testBPInitErrorHandling is flaky | Major | . | Andrew Wang | Ming Ma | | | Have RetryInvocationHandler log failover attempt at INFO level | Major | . | Ming Ma | Ming Ma | | | Users authenticated with KERBEROS are recorded as being authenticated with SIMPLE | Major | security | Benoy Antony | Benoy Antony | | | test\native\mini\_dfs is skipped in hadoop-hdfs/pom.xml | Major | . | Binglin Chang | Binglin Chang | | | TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list | Major | . | Yongjun Zhang | Andrew Wang | | | KerberosAuthenticationHandler does not log the principal names correctly | Minor | security | Benoy Antony | Benoy Antony | | | RM may not send the app-finished signal after RM restart to some nodes where the application ran before RM restarts | Major | . | Arpit Gupta | Wangda Tan | | | LeveldbIterator should get closed in NMLeveldbStateStoreService#loadLocalizationState() within finally block | Major | nodemanager | Junping Du | Junping Du | | | Fix build native library on mac osx | Major | . | Kirill A. Korinskiy | Binglin Chang | | | Windows: Sort Job failed due to 'Invalid event: TA\COMMIT\PENDING at COMMIT\_PENDING' | Major | . | Yesha Vora | Zhijie Shen | | | ServiceAuthorizationManager is not threadsafe | Major | security | Benoy Antony | Benoy Antony | | | GraphiteSink should implement Closeable | Major | . | Ted Yu | Chen He | | | Fix Balancer documentation | Minor | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | add DN storage to a BlockInfo will not replace the different storage from same DN | Trivial | namenode | Amir Langer | Amir Langer | | | Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode | Major | namenode, snapshots | Jing Zhao | Jing Zhao | | | NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not | Major | nfs | Brandon Li | Aaron

Myers | | | Fix wrong option "dfsadmin -rollingUpgrade start" in the document | Minor | documentation | Akira Ajisaka | Akira Ajisaka | | | Cleanup some extra dependencies from hadoop-auth | Major | security | Robert Kanter | Robert Kanter | | | Cannot use more than 1 har filesystem | Critical | conf, fs | Daryn Sharp | Rushabh S Shah | | | Add missing DeprecationDeltas for NFS Kerberos configurations | Major | nfs | Stephen Chu | Stephen Chu | | | NameNode cannot save fsimage in certain circumstances when snapshots are in use | Critical | namenode, snapshots | Aaron T. Myers | Aaron T. Myers | | | A Bug in recoverLeaseInternal method of FSNameSystem class | Major | namenode | Hooman Peiro Sajjad | Chen He | | | Add support for accessing the NFS gateway from the AIX NFS client | Major | nfs | Aaron T. Myers | Aaron T. Myers | | | Add a configurable delay to reducer-preemption | Major | . | Maysam Yabandeh | Maysam Yabandeh | | | WebHdfs HA failover is broken on secure clusters | Blocker | webhdfs | Daryn Sharp | Daryn Sharp | | | HDFS quota update is wrong when file is appended | Major | namenode | George Wong | George Wong | | | When metrics system is restarted MBean names get incorrectly flagged as dupes | Major | metrics | Mostafa Elhemali | Mike Liddell | | | Remove background token renewer from webhdfs | Major | webhdfs | Daryn Sharp | Daryn Sharp | | | FairScheduler: Disable max-AM-share check by default | Major | fairscheduler | Robert Kanter | Robert Kanter | | | Remove clientNode in FileUnderConstructionFeature | Minor | namenode | Haohui Mai | Haohui Mai | | | Bug in TestBPOfferService can cause test failure | Major | test | Zhilei Xu | Zhilei Xu | | | Add a test to make sure NM will do application cleanup even if RM restarting happens before application completed | Major | resourcemanager | Wangda Tan | Wangda Tan | | | In FairScheduler.attemptScheduling, we don't count containers as assigned if they have 0 memory but non-zero cores | Major | scheduler | Sandy Ryza | Sandy Ryza | | | TestRMHA fails when run with a mix of Schedulers | Major | . | Anubhav Dhoot | Anubhav Dhoot | | | TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC | Major | test | Jinghui Wang | Jinghui Wang | | | Fix TestRM to work with both schedulers | Major | scheduler | Anubhav Dhoot | Karthik Kambatla | | | Fix a typo in message issued from explorer.js | Trivial | webhdfs | Yongjun Zhang | Yongjun Zhang | | | WebHdfs clients fail without retry because incorrect handling of StandbyException | Major | ha, webhdfs | Yongjun Zhang | Yongjun Zhang | | | Edit log corruption due to defered INode removal | Blocker | . | Kihwal Lee | Kihwal Lee | | | AMs block on the CapacityScheduler lock during allocate() | Critical | capacityscheduler | Jason Lowe | Jason Lowe | | | FsShell cp -p does not preserve directory attibutes | Major | fs | Stephen Chu | Akira Ajisaka | | | StartTime showing up as the epoch time in JHS UI after upgrade | Major |

| Kihwal Lee | Chen He | | | Add an option to the NameNode that prints the software and on-disk image versions | Minor | namenode | Charles Lamb | Charles Lamb | | | WebUI: Order of AppId in apps table should be consistent with ApplicationId.compareTo(). | Minor | resourcemanager, webapp | Wangda Tan | Wangda Tan | | | NFS should not validate the access premission only based on the user's primary group | Major | nfs | Premchandra Preetham Kukillaya | Harsh J | | | TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler | Trivial | resourcemanager | Robert Kanter | Robert Kanter | | | Scheduler queue filter failed to work because index of queue column changed | Major | resourcemanager, webapp | Wangda Tan | Wangda Tan | | | Renaming a file into a directory containing the same filename results in a confusing I/O error | Major | fs | Jason Lowe | Chang Li | | | TestRMWebServicesAppsModification dependent on yarn-default.xml | Major | . | Ray Chiang | Varun Vasudev | | | Refine XAttr permissions | Major | namenode | Yi Liu | Uma Maheswara Rao G | | | Issues in finalizing rolling upgrade when there is a layout version change | Blocker | . | Kihwal Lee | Kihwal Lee | | | Regression: DFS\NAMENODE\USER\NAME\KEY missing in trunk | Blocker | hdfs-client | Steve Loughran | Tsz Wo Nicholas Sze | | | hadoop.auth cookie is not properly constructed according to RFC2109 | Major | security | Alejandro Abdelnur | Juan Yu | | | while loop is executed tens of thousands of times in Hedged Read | Major | hdfs-client | LiuLei | Liang Xie | | | AM cannot create new containers after restart-NM token from previous attempt used | Major | . | Steve Loughran | Jian He | | | MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID | Minor | . | Juan Yu | Juan Yu | | | The short-circuit cache doesn't correctly time out replicas that haven't been used in a while | Critical | hdfs-client | Giuseppe Reina | Colin P. McCabe | | | ZKRMStateStore: On startup, show nicer messages if znodes already exist | Minor | resourcemanager | Robert Kanter | Robert Kanter | | | ClientRMService doesn't allow delegation token owner to cancel their own token in secure mode | Major | . | Varun Vasudev | Varun Vasudev | | | TestShortCircuitLocalRead tests sometimes timeout on slow machines | Minor | test | Charles Lamb | Charles Lamb | | | Shell.ExitCodeException to have more useful toString | Minor | util | Steve Loughran | Steve Loughran | | | S3 input stream NPEs in MapReduce job | Minor | fs/s3 | Benjamin Kim | Steve Loughran | | | BufferedFSInputStream NPEs on getPos() on a closed stream | Minor | fs | Steve Loughran | Steve Loughran | | | Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond | Trivial | . | Juan Yu | Juan Yu | | | FairScheduler.findLowestCommonAncestorQueue returns null when queues not identical | Major | scheduler | Krisztian Horvath | Krisztian Horvath | | | TestPipeApplication causing nightly build to fail | Major | test | Jason Lowe | Akira Ajisaka | | | enabling uber mode with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb | Minor | . | Siqi Li | Siqi Li | | | Fix dead link in site.xml | Major | documentation | Akira Ajisaka | Akira Ajisaka | |

FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map | Blocker | . | Kihwal Lee | Kihwal Lee | | | Rename and AddBlock may race and produce invalid edits | Blocker | . | Kihwal Lee | Kihwal Lee | | | TestPread#testHedgedReadLoopTooManyTimes fails intermittently. | Major | hdfs-client, test | Chris Nauroth | Liang Xie | | | Edit log corruption when pipeline recovery occurs for deleted file present in snapshot | Blocker | namenode, snapshots | Aaron T. Myers | Kihwal Lee | | | NFS registration should timeout instead of hanging when portmap/rpcbind is not available | Major | nfs | Brandon Li | Abhiraj Butala | | | Default map hprof profile options do not work | Blocker | . | Andrew Wang | Gera Shegalov | | | TestMetricsSystemImpl.testMultiThreadedPublish fails intermediately | Blocker | . | Haohui Mai | Akira Ajisaka | | | LocalContainerLauncher#renameMapOutputForReduce incorrectly assumes a single dir for mapOutIndex | Blocker | mr-am, mrv2 | Gera Shegalov | Gera Shegalov | | | 2.4 addBlock is 10 to 20 times slower compared to 0.23 | Blocker | . | Kihwal Lee | Daryn Sharp | | | Reintroduce dfs.http.port / dfs.https.port in branch-2 | Major | . | Yongjun Zhang | Yongjun Zhang | | | BlockPlacementPolicyDefault does not choose favored nodes correctly | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Document HDFS Multihoming Settings | Major | documentation | Arpit Agarwal | Arpit Agarwal | | | NFS: Files can be deleted from a read-only mount | Major | nfs | Abhiraj Butala | Srikanth Upputuri | | | TestPathData fails intermittently with "Mkdirs failed to create d1" | Major | fs | Yongjun Zhang | Yongjun Zhang | | | TestDFVariations.testMount fails intermittently | Major | . | Yongjun Zhang | Yongjun Zhang | | | getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist | Blocker | . | Charles Lamb | Charles Lamb | | | New NN webUI no longer displays decommissioned state for dead node | Major | . | Ming Ma | Ming Ma | | | Name node cannot start if the path of a file under construction contains ".snapshot" | Blocker | . | Kihwal Lee | Andrew Wang | | | Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit | Major | test | Vinayakumar B | Vinayakumar B | | | ResourceSchedulerWrapper broken due to AbstractYarnScheduler | Blocker | . | Wei Yan | Wei Yan | | | MR task should prevent report error to AM when process is shutting down | Major | task | Wangda Tan | Wangda Tan | | | Writables are not always configured | Major | . | Abraham Elmahrek | Abraham Elmahrek | | | Increase findbugs maxHeap size | Blocker | . | Andrew Wang | Andrew Wang | | | Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2 | Blocker | . | Juan Yu | Juan Yu | | | NativeS3FileSystem throw NullPointerException when the file is empty | Major | fs/s3 | shuisheng wei | Steve Loughran | | | S3n silent failure on copy, data loss on rename | Major | fs/s3 | Gian Merlino | Steve Loughran | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestDeleteBlockPool fails in branch-2 | Minor |

| Ted Yu | Ted Yu | | | calls to junit Assert::assertEquals invert arguments, causing misleading error messages, other minor improvements. | Minor | test | Chris Douglas | jay vyas | | | TestMRJobsWithProfiler#testProfiler timesout | Major | . | Mit Desai | Mit Desai | | | Add a unit test to TestAuditLogger for file permissions passed to logAuditEvent | Minor | test | Charles Lamb | Charles Lamb | | | TestOfflineEditsViewer#testStored fails on Windows due to CRLF line endings in editsStored.xml from git checkout | Minor | test | Chris Nauroth | Chris Nauroth | | | TestMiniMRChildTask fails on Windows | Minor | test | Chuan Liu | Chuan Liu | | | Prepare HDFS codebase for JUnit 4.11. | Minor | test | Chris Nauroth | Chris Nauroth | | | Prepare YARN codebase for JUnit 4.11. | Minor | . | Chris Nauroth | Chris Nauroth | | | Prepare MapReduce codebase for JUnit 4.11. | Minor | test | Chris Nauroth | Chris Nauroth | | | Fix typo and warning in TestLeafQueue | Trivial | . | Chen He | Chen He | | | Add vecsum test of libhdfs read access times | Minor | libhdfs, test | Colin P. McCabe | Colin P. McCabe | | | TestBookKeeperHACheckpoints#TestSBNCheckpoints fails on trunk | Major | . | Akira Ajisaka | Akira Ajisaka | | | Fix TestFairScheduler after YARN-2012 | Major | . | Ted Yu | Ashwin Shankar | | | Add tests on getApplicationRequest with filtering start time range | Minor | . | Junping Du | Junping Du | | | TestCacheDirectives#testExceedsCapacity fails occasionally | Minor | caching | Ted Yu | Colin P. McCabe | | | Reenable several HA ZooKeeper-related tests on Windows. | Trivial | ha, test | Chris Nauroth | Chris Nauroth | | | TestRMApplicationHistoryWriter sometimes fails in trunk | Minor | . | Ted Yu | Zhijie Shen | | | Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow | Trivial | nodemanager | Anubhav Dhoot | Anubhav Dhoot | | | shorten TestPread run time with a smaller retry timeout setting | Minor | test | Liang Xie | Liang Xie | | | TestFSDownload#testDownloadPublicWithStatCache fails in trunk | Minor | . | Ted Yu | Akira Ajisaka | | | Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java | Major | resourcemanager | Wenwu Peng | Wenwu Peng | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Cleanup unnecessary cast in HDFS code base | Major | test | Suresh Srinivas | Suresh Srinivas | | | CreateOpts.getOpt(..) should declare with generic type argument | Minor | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Fix compilation error in branch-2 after HADOOP-10426 | Major | build | Haohui Mai | Haohui Mai | | | Fix Boxing/unboxing to parse a primitive findbugs warnings | Major | . | Suresh Srinivas | Suresh Srinivas | | | FSNamesystem code cleanup | Minor | namenode | Suresh Srinivas | Suresh Srinivas | | | Format strings should use platform independent line separator | Minor |

| Suresh Srinivas | Suresh Srinivas | | | Create a tool to take fsimage and expose read-only WebHDFS API | Major | tools | Akira Ajisaka | Akira Ajisaka | | | Move the default processor from Ls to Web in OfflineImageViewer | Major | tools | Akira Ajisaka | Akira Ajisaka | | | NM Recovery. Auxiliary service support. | Major | nodemanager | Jason Lowe | Jason Lowe | | | Move the address in WebImageViewer | Major | tools | Akira Ajisaka | Akira Ajisaka | | | Update jackson to 1.9.13 | Minor | build | Steve Loughran | Akira Ajisaka | | | Support GETFILESTATUS operation in WebImageViewer | Major | tools | Akira Ajisaka | Akira Ajisaka | | | Proxy superuser configuration should use true client IP for address checks | Major | namenode, webhdfs | Daryn Sharp | Daryn Sharp | | | Remove unused parameter from ProxyUsers.authorize() | Minor | security | Benoy Antony | Benoy Antony | | | Move junit up to v 4.11 | Minor | build | Steve Loughran | Chris Nauroth | | | Cleanup javadoc warnings in HDFS code | Major | . | Suresh Srinivas | Suresh Srinivas | | | Fix warnings - type arguments can be inferred and redudant local variable | Major | . | Suresh Srinivas | Suresh Srinivas | | | Webhdfs PUT operations may not work via a http proxy | Major | webhdfs | Daryn Sharp | Daryn Sharp | | | Remove unnecessary conditions and null check | Major | . | Suresh Srinivas | Suresh Srinivas | | | Support GETACLSTATUS operation in WebImageViewer | Major | tools | Akira Ajisaka | Akira Ajisaka | | | Update OfflineImageViewer document | Minor | documentation | Akira Ajisaka | Akira Ajisaka | | | Port DistCp2 document to trunk | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Audit log should use true client IP for proxied webhdfs operations | Major | namenode, webhdfs | Daryn Sharp | Daryn Sharp | | | Port Hadoop Archives document to trunk | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Convert Hadoop Streaming document to APT | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Convert MapReduce Tutorial document to APT | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Reduce the visibility of constants in ProxyUsers | Major | security | Benoy Antony | Benoy Antony | | | Enable proxyuser specification to support list of users in addition to list of groups. | Major | security | Benoy Antony | Benoy Antony | | | WebImageViewer returns 404 if LISTSTATUS to an empty directory | Major | tools | Akira Ajisaka | Akira Ajisaka | | | Rename the daemon name to timelineserver | Major | . | Zhijie Shen | Zhijie Shen | | | Command "hdfs dfs -rm -r" can't remove empty directory | Major | hdfs-client | Yongjun Zhang | Yongjun Zhang | | | Pause deletion of blocks when the namenode starts up | Major | namenode | Suresh Srinivas | Jing Zhao | | | Distinguish between nodemanager shutdown for decommission vs shutdown for restart | Major | nodemanager | Jason Lowe | Jason Lowe | | | Kerberos authentication for the timeline server | Major | . | Zhijie Shen | Zhijie Shen | | | Merge some of the common lib code in schedulers | Major | resourcemanager | Jian He | Jian He | | | Delegation token stuff for the timeline sever | Major |

| Zhijie Shen | Zhijie Shen | | | Secured timeline client | Major | . | Zhijie Shen | Zhijie Shen | | | Add entity-level access control of the timeline data for owners only | Major | . | Zhijie Shen | Zhijie Shen | | | Extend access control for admin acls | Major | . | Zhijie Shen | Zhijie Shen | | | Enforce more restricted permissions for the directory of Leveldb store | Major | . | Zhijie Shen | Zhijie Shen | | | Refactor proxyservers out of ProxyUsers | Major | security | Benoy Antony | Benoy Antony | | | Support pluggable mechanism to specify proxy user settings | Major | security | Benoy Antony | Benoy Antony | | | Document yarn.resourcemanager.zk-auth and its scope | Critical | resourcemanager | Karthik Kambatla | Robert Kanter | | | Recover localized resource cache state upon nodemanager restart | Major | nodemanager | Jason Lowe | Jason Lowe | | | Replace RegisterNodeManagerRequest#ContainerStatus with a new NMContainerStatus | Major | . | Jian He | Jian He | | | Make schedulers services | Major | scheduler | Sandy Ryza | Tsuyoshi Ozawa | | | Clean up dead code in FSDirectory | Major | namenode | Haohui Mai | Haohui Mai | | | Type mismatch in contains() check of TimelineWebServices#injectOwnerInfo() | Major | . | Ted Yu | Ted Yu | | | Close of Reader in TimelineAuthenticationFilterInitializer#initFilter() should be enclosed in finally block | Minor | . | Ted Yu | Chen He | | | TimelineAuthenticator#hasDelegationToken may throw NPE | Major | . | Zhijie Shen | Zhijie Shen | | | Common work to re-populatecontainers state into scheduler | Major | . | Bikas Saha | Jian He | | | Decouple recording edit logs from FSDirectory | Major | . | Haohui Mai | Haohui Mai | | | Expose kill app functionality as part of RM web services | Major | . | Varun Vasudev | Varun Vasudev | | | Move mkdirs() to FSNamesystem | Major | namenode | Haohui Mai | Haohui Mai | | | Recover DeletionService state upon nodemanager restart | Major | nodemanager | Jason Lowe | Jason Lowe | | | Move waitForReady() from FSDirectory to FSNamesystem | Major | namenode | Haohui Mai | Haohui Mai | | | Create multiplexer, a requirement for the fair queue | Major | . | Chris Li | Chris Li | | | Move the reference of fsimage to FSNamesystem | Major | namenode | Haohui Mai | Haohui Mai | | | Fix new findbugs warnings in hadoop-minikdc | Major |

| Haohui Mai | Swarnim Kulkarni | | | Capture renamed files/directories in snapshot diff report | Major | namenode | Jing Zhao | Jing Zhao | | | Refactor AccessControlList to reuse utility functions and to improve performance | Minor | security | Benoy Antony | Benoy Antony | | | Refactor rename() in FSDirectory | Minor | namenode | Haohui Mai | Haohui Mai | | | Preemption of AM containers shouldn't count towards AM failures | Major | resourcemanager | Vinod Kumar Vavilapalli | Jian He | | | Refactor Proxyusers to use AccessControlList | Major | security | Benoy Antony | Benoy Antony | | | Recover missing container information | Major | resourcemanager | Jian He | Jian He | | | ApplicationMasterService to allow Register of an app that was running before restart | Major | resourcemanager | Bikas Saha | Anubhav Dhoot | | | Support IP ranges (CIDR) in proxyuser.hosts | Major | security | Benoy Antony | Benoy Antony | | | Allow overriding the default ACL for service authorization | Major | security | Benoy Antony | Benoy Antony | | | ContainerId creation after work preserving restart is broken | Major | resourcemanager | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Implement getnewapplication and submitapp as part of RM web service | Blocker | . | Varun Vasudev | Varun Vasudev | | | Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy | Major | resourcemanager | Sunil Govindan | Sunil Govindan | | | Container preemption interpreted as task failures and eventually job failures | Major | applicationmaster, mr-am, mrv2 | Mayank Bansal | Mayank Bansal | | | Write contract tests for S3Native; fix places where it breaks | Minor | fs/s3 | Steve Loughran | Steve Loughran | | | Define Semantics of FileSystem more rigorously | Major | fs | Steve Loughran | Steve Loughran | | | Write contract tests for FTP filesystem, fix places where it breaks | Minor | fs/s3 | Steve Loughran | Steve Loughran | | | Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM | Major | . | Vinayakumar B | Rakesh R | | | Remove the format limitation point from BKJM documentation as HDFS-3810 closed | Major | ha | Uma Maheswara Rao G | Rakesh R | | | Update Bookkeeper dependency to 4.2.3 | Minor | . | Robert Rati | Rakesh R | | | AM should implement Resync with the ApplicationMasterService instead of shutting down | Major | resourcemanager | Bikas Saha | Rohith Sharma K S | | | Implement web services to create, renew and cancel delegation tokens | Blocker | resourcemanager | Varun Vasudev | Varun Vasudev | | | Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins | Major | resourcemanager | Sunil Govindan | Sunil Govindan | | | Tool documentenation is broken | Minor | documentation | Allen Wittenauer | Akira Ajisaka | | | Fix dead link in ToolRunner documentation | Minor | documentation | Akira Ajisaka | Akira Ajisaka | | | Allow RM web services users to authenticate using delegation tokens | Blocker | . | Varun Vasudev | Varun Vasudev | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Convert Forrest docs to APT | Major | documentation | Eli Collins