Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.7.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Phase out the old web UI in HDFS | Minor | namenode | Fengdong Yu | Haohui Mai | | | Restrict uppercase key names from being created with JCEKS | Major | security | Andrew Wang | Andrew Wang | | | Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient | Major | hdfs-client, namenode | Vinayakumar B | Vinayakumar B | | | Make hadoop trunk build on Java7+ only | Blocker | build | Steve Loughran | Steve Loughran | | | Remove mapreduce.task.tmp.dir from mapred-default.xml | Major | . | Sandy Ryza | James Carman | | | Prevent cross site scripting attack on JMXJSONServlet | Critical | . | Haohui Mai | Haohui Mai | | | Bump the version of HTrace to 3.1.0-incubating | Major | tracing | Masatake Iwasaki | Masatake Iwasaki | | | Deletion failure can leak inodes permanently | Critical | . | Kihwal Lee | Jing Zhao | | | Bump up curator version to 2.7.1 | Major | . | Karthik Kambatla | Arun Suresh | | | Remove httpclient dependency from hadoop-yarn-server-web-proxy | Major | . | Akira Ajisaka | Brahma Reddy Battula | | | Should not upload partial logs for MR jobs or other "short-running' applications | Blocker | nodemanager, resourcemanager | Xuan Gong | Xuan Gong | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Fair Scheduler: Display dynamic fair share for queues on the scheduler page | Major | fairscheduler | Ashwin Shankar | Ashwin Shankar | | | Expose DataNode network errors as a metric | Minor | datanode | Charles Lamb | Charles Lamb | | | Admin command to track file and locations from block id | Major | . | Kihwal Lee | Chen He | | | Provide volume management functionality for DataNode | Major | datanode | Wang Xu | Wang Xu | | | Add hadoop --loglevel option to change log level | Minor | scripts | Eli Collins | Akira Ajisaka | | | hadoop fs -find feature | Major | . | Marco Nicosia | Jonathan Allen | | | nntop: top-like tool for name node users | Major |

| Maysam Yabandeh | Maysam Yabandeh | | | KMS support for whitelist key ACLs | Major | kms, security | Arun Suresh | Arun Suresh | | | Add web UI for NFS gateway | Major | nfs | Brandon Li | Brandon Li | | | Add metrics to NFS gateway | Major | nfs | Brandon Li | Brandon Li | | | Support Windows Azure Storage - Blob as a file system in Hadoop | Major | tools | Mostafa Elhemali | Chris Nauroth | | | Metrics system for Windows Azure Storage Filesystem | Major | tools | Mike Liddell | Mike Liddell | | | Timeline server needs to recover the timeline DT when restarting | Blocker | timelineserver | Zhijie Shen | Zhijie Shen | | | Add support for FairScheduler to the ReservationSystem | Major | fairscheduler | Subru Krishnan | Anubhav Dhoot | | | Add support for moving apps between queues in RM web services | Major | resourcemanager | Varun Vasudev | Varun Vasudev | | | HDFS truncate | Major | datanode, namenode | Lei Chang | Plamen Jeliazkov | | | Expose truncate API via FileSystem and shell command | Major | fs | Konstantin Shvachko | Milan Desai | | | Add support for variable length block | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Jing Zhao | | | DFSIO for truncate | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko | | | Expose truncate API via FileContext | Major | fs | Yi Liu | Yi Liu | | | Enable Quota Support for Storage Types | Major | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao | | | Add truncate operation to SLive | Major | benchmarks, test | Konstantin Shvachko | Plamen Jeliazkov | | | Add CPU and memory limit options to the default container executor for Windows containers | Major | nodemanager | Chuan Liu | Chuan Liu | | | Support HDFS superuser in NFSv3 gateway | Major | nfs | Stephen Chu | Brandon Li | | | Plugin interface to enable delegation of HDFS authorization assertions | Major | security | Alejandro Abdelnur | Arun Suresh | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add javadoc to InterfaceAudience and InterfaceStability | Major | documentation | Suresh Srinivas | Brandon Li | | | Remove the dependency of jsp in trunk | Major | . | Haohui Mai | Haohui Mai | | | TestRMWebServicesAppsModification should run against both CS and FS | Minor | . | zhihai xu | zhihai xu | | | Document the "hadoop trace" command. | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Improve error message in Shell#runCommand on OutOfMemoryError | Major | . | Yongjun Zhang | Yongjun Zhang | | | Introduce a string constant for "Failed to obtain user group info..." | Trivial | . | Yongjun Zhang | Yongjun Zhang | | | Decommission nodes on -refreshNodes instead of next NM-RM heartbeat | Major | resourcemanager | zhihai xu | zhihai xu | | | Bad use of Preconditions in startFileInternal() | Major | namenode | Konstantin Shvachko | Dawson Choong | | | Code improvement for FSN#checkUnreadableBySuperuser | Minor | namenode | Yi Liu | Yi Liu | | | small refinement to the use of isInAnEZ in FSNamesystem | Trivial | . | Yi Liu | Yi Liu | | | HDFS Peercache enabled check should not lock on object | Minor | hdfs-client | Gopal V | Andrew Wang | | | Add the time of last HA state transition to NN's /jmx page | Minor | namenode | Charles Lamb | Charles Lamb | | | Tracing span description of IPC client is too long | Minor | . | Masatake Iwasaki | Masatake Iwasaki | | | Bump DataNode OOM log from WARN to ERROR | Trivial | datanode | Stephen Chu | Stephen Chu | | | Remove dead code in ServletUtil | Minor | . | Haohui Mai | Li Lu | | | Add a command that allows sysadmins to manually trigger full block reports from a DN | Major | datanode | Colin P. McCabe | Colin P. McCabe | | | Improve permission denied message when FSPermissionChecker#checkOwner fails | Trivial | . | Stephen Chu | Harsh J | | | Use netty 4 in WebImageViewer | Major |

| Haohui Mai | Haohui Mai | | | Separate block metrics for files with replication count 1 | Major | namenode | Andrew Wang | Zhe Zhang | | | SocketTimeoutException in BlockSender.sendChunks could have a better error message | Minor | datanode | Todd Lipcon | Yongjun Zhang | | | Provide an iterator-based listing API for FileSystem | Major | . | Kihwal Lee | Kihwal Lee | | | Remove the usage of sun.security.x509.\* in testing code | Minor | security | Kai Zheng | pascal oliva | | | Use DirectoryListing.hasMore() directly in nfs | Minor | nfs | Haohui Mai | Li Lu | | | FSNamesystem.checkFileProgress should log file path | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Redundant checkOperation() in FSN.analyzeFileState() | Major | namenode | Konstantin Shvachko | Milan Desai | | | Improve log message in Storage.tryLock() | Major | datanode, namenode | Konstantin Shvachko | Konstantin Shvachko | | | MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails. | Major | test | Konstantin Shvachko | Byron Wong | | | Unused member DFSInputStream.buffersize | Major | hdfs-client | Konstantin Shvachko | Milan Desai | | | Remove hdfs.server.blockmanagement.MutableBlockCollection | Minor | . | Li Lu | Li Lu | | | Decouple the management of block id and gen stamps from FSNamesystem | Major | . | Haohui Mai | Haohui Mai | | | Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement | Major | . | Haohui Mai | Haohui Mai | | | Log aggregated resource allocation in rm-appsummary.log | Minor | resourcemanager | Koji Noguchi | Eric Payne | | | Log the cause of SASL connection failures | Minor | security | Stephen Chu | Stephen Chu | | | Replace check "port number \< 1024" with shared isPrivilegedPort method | Trivial | datanode, security | Yongjun Zhang | Yongjun Zhang | | | Use netty to implement DatanodeWebHdfsMethods | Major | datanode, webhdfs | Haohui Mai | Haohui Mai | | | Remove o.a.h.hdfs.server.datanode.web.resources | Major | . | Haohui Mai | Li Lu | | | Document YARN metrics | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit | Major | namenode | Gera Shegalov | Gera Shegalov | | | Fix DockerContainerExecutor.apt.vm formatting | Major | documentation | Abin Shahab | Abin Shahab | | | Allow dead nodes to finish decommissioning if all files are fully replicated | Minor | . | Andrew Wang | Andrew Wang | | | ClusterMetrics to include AM launch and register delays | Major | resourcemanager | zhihai xu | zhihai xu | | | WritableComparator#compare keeps reference to byte array | Major | performance | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | MergeQueue should release reference to the current item from key and value at the end of the iteration to save memory. | Major | mrv2 | zhihai xu | zhihai xu | | | FairScheduler: queue names shouldn't allow periods | Major | . | Wei Yan | Wei Yan | | | Add Datanode network counts to datanode jmx page | Minor | datanode | Charles Lamb | Charles Lamb | | | Improve error messages for DataNode hot swap drive feature | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Improve error messages for some KeyShell commands | Minor |

| Andrew Wang | Andrew Wang | | | [optionally] update jmx cache to drop old metrics | Major | . | Maysam Yabandeh | Maysam Yabandeh | | | A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream | Major | hdfs-client | Liang Xie | Lars Hofhansl | | | Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values | Major | . | Akira Ajisaka | Tsuyoshi Ozawa | | | Provide an option to use a dedicated reduce-side shuffle log | Major | mrv2 | Gera Shegalov | Gera Shegalov | | | Add description to the nfs ports in core-site.xml used by nfs test to avoid confusion | Minor | nfs, test | Yongjun Zhang | Yongjun Zhang | | | Failed Container Executor does not provide a clear error message | Minor | nodemanager | Dustin Cote | Dustin Cote | | | Improve yarn container command | Major | . | Jian He | Naganarasimha G R | | | Reduce memory footprint for AclEntries in NameNode | Major | namenode | Vinayakumar B | Vinayakumar B | | | Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystem | Major | . | Li Lu | Li Lu | | | Adding a document about NativeLibraryChecker | Major | documentation | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | 'getfacl' command and 'getAclStatus' output should be in sync | Major | namenode | Vinayakumar B | Vinayakumar B | | | Scheduler should consider max-allocation-\* in conjunction with the largest node | Major | scheduler | Karthik Kambatla | Robert Kanter | | | Simplify FSNamesystem#getBlockLocationsUpdateTimes | Major | . | Haohui Mai | Haohui Mai | | | Change the class name for logs in RMCommunicator.java | Minor | mr-am | Devaraj K | Sahil Takiar | | | Change nntop JMX format to be a JSON blob | Major | namenode | Andrew Wang | Andrew Wang | | | Change message to mandate, not suggest JS requirement on UI | Minor | webapp | Harsh J | Dustin Cote | | | Provide navigation in the site documentation linking to the Hadoop Compatible File Systems. | Major | documentation | Chris Nauroth | Chris Nauroth | | | Bubble up final exception in failures during creation of output collectors | Minor | task | Harsh J | Varun Saxena | | | HDFS inotify: add defaultBlockSize to CreateEvent | Major | namenode | Colin P. McCabe | Colin P. McCabe | | | make the rpath of libhadoop.so configurable | Major | . | Colin P. McCabe | Colin P. McCabe | | | Move ChunkedArrayList into hadoop-common | Major | . | Colin P. McCabe | Colin P. McCabe | | | Add IOUtils#listDirectory | Major | . | Colin P. McCabe | Colin P. McCabe | | | hadoop-azure: page blob support | Major | tools | Mike Liddell | Eric Hanson | | | hadoop-azure: automatically expand page blobs when they become full | Major | fs | Eric Hanson | Eric Hanson | | | Improve the concurrent access on FsVolumeList | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | ChunkedArrayList: fix removal via iterator and implement get | Major | . | Colin P. McCabe | Colin P. McCabe | | | Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel | Major | . | Colin P. McCabe | Colin

McCabe | | | Check CryptoCodec is AES-CTR for Crypto input/output stream | Minor | . | Yi Liu | Yi Liu | | | Add site documentation for Azure Storage FileSystem integration. | Major | documentation | Chris Nauroth | Chris Nauroth | | | Remove the support of unmanaged connectors in HttpServer2 | Major | . | Haohui Mai | Haohui Mai | | | Fix spacing for a few keys in DFSConfigKeys.java | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Fix new findbugs warnings in hadoop-yarn-common | Major | . | Varun Saxena | Li Lu | | | Make FSDirectory#addINode take existing INodes as its parameter | Major | . | Haohui Mai | Jing Zhao | | | Java Configuration file and .xml files should be automatically cross-compared | Minor | . | Ray Chiang | Ray Chiang | | | Fix new findbugs warnings in rest of the hadoop-yarn components | Major | . | Varun Saxena | Li Lu | | | Fix new findbugs warnings in hadoop-yarn-nodemanager | Major | . | Varun Saxena | Varun Saxena | | | Fix findbugs warnings in FileBasedIPList | Minor | . | Akira Ajisaka | Tsuyoshi Ozawa | | | Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice | Major | . | Varun Saxena | Varun Saxena | | | Document override log4j.properties in MR job | Major | documentation | Junping Du | Junping Du | | | KMS and Credential CLI should request confirmation for deletion by default | Minor | security | Charles Lamb | Charles Lamb | | | Metrics 2 ganglia provider to include hostname in unresolved address problems | Minor | metrics | Steve Loughran | Varun Saxena | | | NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map | Minor | nfs | Hari Sekhon | Yongjun Zhang | | | Replace use of Guava's Stopwatch with Hadoop's StopWatch | Major | . | Gary Steelman | Tsuyoshi Ozawa | | | Refine fs operations in FileSystemRMStateStore and few fixes | Major | resourcemanager | Yi Liu | Yi Liu | | | Improve log reporting during block report rpc failure | Minor | datanode | Charles Lamb | Charles Lamb | | | HDFS inotify should have the ability to determine what txid it has read up to | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe | | | Reinstate support for launching Hadoop processes on Windows using Cygwin. | Major | bin | Chris Nauroth | Chris Nauroth | | | Modify the NN loadGenerator to optionally run as a MapReduce job | Major | test | Akshay Radia | Akshay Radia | | | JMX metrics aren't accessible when NN is busy | Major | . | Ming Ma | Ming Ma | | | Move the get/setStoragePolicy commands out from dfsadmin | Major | hdfs-client | Tsz Wo Nicholas Sze | Jing Zhao | | | Create unit test to automatically compare YarnConfiguration and yarn-default.xml | Minor | . | Ray Chiang | Ray Chiang | | | Add documentation for hdfs debug commands | Minor | documentation | Colin P. McCabe | Vijay Bhat | | | Remove dependency on old version of Guava in TestDFSClientCache#testEviction | Minor | test | Sangjin Lee | Sangjin Lee | | | Refine hdfs admin classes to reuse common code | Major | tools | Yi Liu | Jing Zhao | | | Don't create a new DominantResourceCalculator on every FairScheduler.allocate call | Trivial |

| Sandy Ryza | Karthik Kambatla | | | Add metric for container launch duration | Major | nodemanager | zhihai xu | zhihai xu | | | Document the configuration of deploying MR over distributed cache with enabling wired encryption at the same time | Major | distributed-cache, documentation | Junping Du | Junping Du | | | Fsck should work with fully qualified file paths. | Minor | tools | Jitendra Nath Pandey | Tsz Wo Nicholas Sze | | | ClassCastException while using a key created by keytool to create encryption zone. | Minor | . | Yi Yao | Charles Lamb | | | HardLink.java should use the jdk7 createLink method | Major | . | Colin P. McCabe | Akira Ajisaka | | | [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java | Trivial | . | Akira Ajisaka | Kengo Seki | | | Metrics should disallow names with invalid characters | Minor | metrics | Todd Lipcon | Ray Chiang | | | Set custom endpoint for S3A | Major | fs/s3 | Thomas Demoor | Thomas Demoor | | | hdfs classpath command should support same options as hadoop classpath. | Minor | scripts | Chris Nauroth | Varun Saxena | | | Enable using a proxy server to connect to S3a. | Major | fs/s3 | Thomas Demoor | Thomas Demoor | | | print NFS Client in the NFS log | Trivial | nfs | Brandon Li | Brandon Li | | | Rewrite the BlockScanner to use O(1) memory and use multiple threads | Major | . | Colin P. McCabe | Colin P. McCabe | | | improve hadoop-maven-plugins | Minor | build | Herv Boutemy | Herv Boutemy | | | History server leveldb recovery store | Major | jobhistoryserver | Jason Lowe | Jason Lowe | | | Make NodeManager memory configurable in MiniYARNCluster | Minor | test | Robert Metzger | Robert Metzger | | | Enable Java assertions when running tests | Major | build | Yoram Kulbak | Tsz Wo Nicholas Sze | | | Combine usages and percent stats in NameNode UI | Minor | namenode | Vinayakumar B | Vinayakumar B | | | Limit Returning Attributes for LDAP search | Major | security | Jason Hubbard | Jason Hubbard | | | Remove unused member DFSClient#spanReceiverHost | Trivial | hdfs-client | Konstantin Shvachko | Colin P. McCabe | | | Remove DRFA.MaxBackupIndex config from log4j.properties | Minor | . | Akira Ajisaka | Akira Ajisaka | | | Hadoop-azure: Change few methods scope to public | Minor | tools | Shashank Khandelwal | Shashank Khandelwal | | | Update document of Rumen | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki | | | ApplicationHistoryServer doesn't process -D arguments | Major | . | Chang Li | Chang Li | | | Update document of GridMix | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Switch BlockManager logging to use slf4j | Minor | namenode | Andrew Wang | Andrew Wang | | | RM should create

recursively | Major | resourcemanager | Chun Chen | Chun Chen | | | hadoop-azure: Create test jar | Major | tools | Shashank Khandelwal | Shashank Khandelwal | | | add configuration for mapreduce speculative execution in MR2 | Major | mrv2 | zhihai xu | zhihai xu | | | Application summary should include the application type | Major | resourcemanager | Jason Lowe | Rohith Sharma K S | | | Introducing a tool to detect flaky tests of hadoop jenkins test job | Major | build, tools | Yongjun Zhang | Yongjun Zhang | | | Expose Container resource information from NodeManager for monitoring | Major | . | Anubhav Dhoot | Anubhav Dhoot | | | SLS: Add how-to-use instructions | Major | . | Wei Yan | Wei Yan | | | Use Job#getInstance instead of deprecated constructors | Minor | . | Akira Ajisaka | Akira Ajisaka | | | add verification for containerLaunchDuration in TestNodeManagerMetrics. | Trivial | test | zhihai xu | zhihai xu | | | Remove unused configuration keys for tracing | Trivial | . | Masatake Iwasaki | Masatake Iwasaki | | | Make YARN CLI show a single completed container even if the app is running | Major | client | Zhijie Shen | Naganarasimha G R | | | Speed up history server startup time | Major | . | Siqi Li | Siqi Li | | | moving the source code of hadoop-tools docs to the directory under hadoop-tools | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Add congestion signaling capability to DataNode write protocol | Major | datanode | Haohui Mai | Haohui Mai | | | Capacity Scheduler: add a maximum-allocation-mb setting per queue | Major | capacityscheduler | Thomas Graves | Thomas Graves | | | Configuration variable expansion regex expensive for long values | Major | conf | Dmitriy V. Ryaboy | Gera Shegalov | | | Fix the order of the parameters in DFSConfigKeys | Trivial | . | Akira Ajisaka | Brahma Reddy Battula | | | Configuration for making delegation token failures to timeline server not-fatal | Major | . | Jonathan Eagles | Jonathan Eagles | | | Clean incomplete multi-part uploads in S3A tests | Minor | fs/s3 | Thomas Demoor | Thomas Demoor | | | Remove dead code in BackupImage.java | Minor | . | Xiaoyu Yao | Xiaoyu Yao | | | Code cleanup of BlockInfo and rename BlockInfo to BlockInfoContiguous | Minor | namenode | Jing Zhao | Jing Zhao | | | Make YARN authorization pluggable | Major | . | Jian He | Jian He | | | Convert site documentation from apt to markdown | Major | documentation | Allen Wittenauer | Masatake Iwasaki | | | Balancer should run for a configurable # of iterations | Minor | balancer & mover | Brian Bockelman | Xiaoyu Yao | | | Documentation for truncate | Major | documentation | Steve Loughran | Konstantin Shvachko | | | fuse\_dfs should permit FILE: on the front of KRB5CCNAME | Major | . | Colin P. McCabe | Colin P. McCabe | | | Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover. | Major | balancer & mover, datanode | yunjiong zhao | yunjiong zhao | | | Specification of HADOOP\CONF\DIR via the environment in hadoop\_config.cmd | Minor | scripts | Ian Jackson | Kiran Kumar M R | | | cleanup unnecssary code logic in LocatedBlock | Minor | . | Yi Liu | Yi Liu | | | Support favouredNodes for the append for new blocks | Major | . | Vinayakumar B | Vinayakumar B | | | Update use of Iterator to Iterable | Minor |

| Ray Chiang | Ray Chiang | | | Improve help message for hadoop/yarn command | Trivial | scripts | Jagadesh Kiran N | Brahma Reddy Battula | | | Rename Job Tracker terminology in ShuffleSchedulerImpl | Major | applicationmaster | Devaraj K | Devaraj K | | | mapred command should print the reason on killing already completed jobs | Minor | mrv2 | Nishan Shetty | Devaraj K | | | Refactor the exception handling in ConverterUtils#to\*Id | Minor | resourcemanager | Bibin A Chundatt | Bibin A Chundatt | | | FSDataInputStream should support "unbuffer" | Major | . | Colin P. McCabe | Colin P. McCabe | | | Clean up RM web proxy code | Major | webapp | Steve Loughran | Steve Loughran | | | Update use of Iterator to Iterable in AbstractMetricsContext.java | Minor | metrics | Ray Chiang | Ray Chiang | | | Configuration.getSocketAddr()/getEnum() should use getTrimmed() | Minor | conf | Steve Loughran | Tsuyoshi Ozawa | | | Correct log messages in ResourceTrackerService | Major | . | Devaraj K | Varun Saxena | | | Update use of Iterator to Iterable | Minor | . | Ray Chiang | Ray Chiang | | | The host:port settings of the daemons should be trimmed before use | Major | . | Tianyin Xu | Anu Engineer | | | Do not create optional fields in DFSInputStream unless they are needed | Minor | hdfs-client | Colin P. McCabe | Colin P. McCabe | | | Convert site documentation from apt to markdown | Major | documentation | Allen Wittenauer | Masatake Iwasaki | | | Cleanup switch statement in ApplicationMasterLauncher#handle() | Minor | . | Ray Chiang | Ray Chiang | | | Fix JobCounter's format to use grouping separator | Minor | client | Ryu Kobayashi | Ryu Kobayashi | | | NetUtils.createSocketAddr should trim the input URI | Minor | net | Akira Ajisaka | Rakesh R | | | Removed unused private methods in o.a.h.mapreduce.Job.java | Minor | . | Devaraj K | Naganarasimha G R | | | Correct a log message in AuxServices | Minor | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Improve a log message in AppSchedulingInfo by adding application id | Major | resourcemanager | Devaraj K | | | | Track and display failed DataNode storage locations in NameNode. | Major | datanode, namenode | Chris Nauroth | Chris Nauroth | | | Add audit log for setQuota operation | Major | namenode | Rakesh R | Rakesh R | | | Show warning if not all favored nodes were chosen by namenode | Minor | . | Kihwal Lee | Kihwal Lee | | | Update use of Iterator to Iterable in DataXceiverServer and SnapshotDiffInfo | Minor | . | Ray Chiang | Ray Chiang | | | Client#getTimeout should use IPC\CLIENT\PING\DEFAULT when IPC\CLIENT\PING\KEY is not configured. | Minor | ipc | zhihai xu | zhihai xu | | | Document hdfs balancer -exclude/-include option in HDFSCommands.html | Trivial | documentation | Xiaoyu Yao | Xiaoyu Yao | | | Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes | Minor | . | Akira Ajisaka | Kengo Seki | | | Improve description for "dfs.namenode.num.extra.edits.retained" and "dfs.namenode.num.checkpoints.retained" properties on

| Minor | documentation | Wellington Chevreuil | Wellington Chevreuil | | | cleanup TestLogAggregationService based on the change in YARN-90 | Minor | test | zhihai xu | zhihai xu | | | Clarify application states on the web UI | Major | . | Jian He | Jian He | | | Additional metrics in HDFS to be accessed via jmx. | Major | datanode, namenode | Anu Engineer | Anu Engineer | | | Reduce log spew in S3AFileSystem | Trivial | fs/s3 | Lei (Eddy) Xu | Lei (Eddy) Xu | | | cleanup RMAuthenticationFilter#AUTH\HANDLER\PROPERTY. | Trivial | resourcemanager | zhihai xu | zhihai xu | | | TestWorkPreservingRMRestart should use ParametrizedSchedulerTestBase | Minor | . | Karthik Kambatla | Karthik Kambatla | | | Add -help to yarn logs and nodes CLI command | Minor | client | Jagadesh Kiran N | Jagadesh Kiran N | | | Cleanup Find.java to remove SupressWarnings annotations | Minor | . | Akira Ajisaka | Akira Ajisaka | | | fsck is confusing when dfs.namenode.replication.min \> 1 && missing replicas && NN restart | Major | namenode | Allen Wittenauer | Rui Gao | | | Add support for load balancing across a group of KMS for HA | Major | kms | Arun Suresh | Arun Suresh | | | Show 'Last Modified' in Namenode's 'Browse Filesystem' | Major | namenode | Vinayakumar B | Vinayakumar B | | | Add javadoc for TaskCompletionEvent.Status | Minor | documentation | Sandy Ryza | Chris Palmer | | | Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile | Major | . | Vinayakumar B | Vinayakumar B | | | DFSClient write packet size may \> 64kB | Minor | hdfs-client | Tsz Wo Nicholas Sze | Takuya Fukudome | | | Retry in FileSystemRMStateStore when FS's operations fail due to IOException. | Major | resourcemanager | zhihai xu | zhihai xu | | | Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml | Minor | documentation | Frank Lanitz | Kai Sasaki | | | Surface application outstanding resource requests table in RM web UI | Major | yarn | Jian He | Jian He | | | Add "hadoop.user.group.metrics.percentiles.intervals" to hdfs-default.xml | Minor | documentation, namenode | Akira Ajisaka | Akira Ajisaka | | | Add BlockOpResponseProto's message to DFSClient's exception message | Minor | balancer & mover, datanode, hdfs-client | Ming Ma | Takanobu Asanuma | | | DFSck should resolve the path to support cross-FS symlinks | Major | tools | Gera Shegalov | Gera Shegalov | | | Externalize io.compression.codecs property | Minor | . | Kai Zheng | Kai Zheng | | | Ability to limit running map and reduce tasks | Major | mr-am, mrv2 | Jason Lowe | Jason Lowe | | | Misleading error messages in FSImage.java | Major | namenode | Arpit Agarwal | Brahma Reddy Battula | | | Surface container locality info in RM web UI | Major | . | Jian He | Jian He | | | Allow users to get the MR job information for distcp | Major | distcp | Jing Zhao | Jing Zhao | | | Convert branch-2 .apt.vm files of YARN to markdown | Major | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Use jackson instead jetty json in hdfs-client | Major | . | Haohui Mai | Akira Ajisaka | | | Utilize Snapshot diff report for distcp | Major | distcp, snapshots | Jing Zhao | Jing Zhao | | | Refactor JobSubmitter#copyAndConfigureFiles into it's own class | Minor |

| Chris Trezzo | Chris Trezzo | | | DatanodeID hashCode should not be mutable | Major | namenode | Daryn Sharp | Daryn Sharp | | | Set DomainSocketWatcher thread name explicitly | Major | net | Liang Xie | Liang Xie | | | Add a "kill application" button to Resource Manager's Web UI | Minor | resourcemanager | Ryu Kobayashi | Ryu Kobayashi | | | Upgrade azure sdk version from 0.6.0 to 2.0.0 | Major | tools | Shashank Khandelwal | Shashank Khandelwal | | | Refactor and improve decommissioning logic into DecommissionManager | Major | . | Andrew Wang | Andrew Wang | | | Change TestAppendSnapshotTruncate to fail-fast | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | HDFS Rolling upgrade document should mention the versions available | Minor | documentation | Akira Ajisaka | J.Andreina | | | Documentation of Capacity Scheduler Queue mapping based on user or group | Major | capacityscheduler, documentation | Naganarasimha G R | Gururaj Shetty | | | Speed up FileOutputCommitter#commitJob for many output files | Major | mrv2 | Jason Lowe | Siqi Li | | | Add incremental blockreport latency to DN metrics | Minor | datanode | Ming Ma | Ming Ma | | | PB encoding of block reports is very inefficient | Critical | datanode, namenode | Daryn Sharp | Daryn Sharp | | | Convert remaining branch-2 .apt.vm files to markdown | Major | documentation | Colin P. McCabe | Masatake Iwasaki | | | Make ContainerLauncherImpl.INITIAL\POOL\SIZE configurable to better control to launch/kill containers | Major | mrv2 | zhihai xu | zhihai xu | | | The document about timeline service and generic service needs to be updated | Critical | timelineserver | Zhijie Shen | Naganarasimha G R | | | Add more trace log4j messages to SpanReceiverHost | Minor | tracing | Colin P. McCabe | Colin P. McCabe | | | Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry | Minor | test | zhihai xu | zhihai xu | | | Improve web UI to facilitate scheduling analysis and debugging | Major | . | Jian He | Rohith Sharma K S | | | Update documentation for enabling a new feature in rolling upgrade | Minor | documentation | Tsz Wo Nicholas Sze | J.Andreina | | | Remove duplicated logs in BlockManager | Minor | . | Yi Liu | Yi Liu | | | Mark the end of individual log in aggregated log | Major | . | Ted Yu | Varun Saxena | | | Use file to replace data dirs in test to simulate a disk failure. | Minor | test | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Update NFS user guide for mount option "sync" to minimize or avoid reordered writes | Major | documentation, nfs | Brandon Li | Brandon Li | | | Use org.junit package instead of junit.framework in TestCombineFileInputFormat | Minor | test | Akira Ajisaka | Akira Ajisaka | | | Allow AuthenticationFilters to load secret from signature secret files | Minor | security | Kai Zheng | Kai Zheng | | | Support CreateFlags with append() to support hsync() for appending streams | Major | hdfs-client | Vinayakumar B | Vinayakumar B | | | Update "hadoop jar" documentation to warn against using it for launching yarn jars | Blocker | . | Allen Wittenauer | Masatake Iwasaki | | | Redundant checkFileProgress() in PART II of getAdditionalBlock() | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Update

for Ubuntu | Minor | documentation | Gabor Liptak | Gabor Liptak | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | HttpServer2 should load jsp DTD from local jars instead of going remote | Blocker | . | Dapeng Sun | Dapeng Sun | | | Remove link to 'Legacy UI' in Namenode UI | Minor | . | Vinayakumar B | Vinayakumar B | | | Cleanup javac warnings in FSNamesystem | Trivial | namenode | Charles Lamb | Charles Lamb | | | HttpServer2 should not load JspServlet | Major | . | Haohui Mai | Haohui Mai | | | DelegateToFileSystem should implement getFsStatus(final Path f). | Major | fs | zhihai xu | zhihai xu | | | Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH | Trivial | . | Yongjun Zhang | Yongjun Zhang | | | Remove ulimit from test-patch.sh | Major | . | Andrew Wang | Andrew Wang | | | Should be able to omit package name of SpanReceiver on "hadoop trace -add" | Minor | . | Masatake Iwasaki | Masatake Iwasaki | | | Fix findbugs "unchecked conversion" warning in DFSClient#getPathTraceScope | Trivial | . | Colin P. McCabe | Colin P. McCabe | | | Fix typos in hdfs-default.xml | Major | . | Konstantin Shvachko | Dawson Choong | | | Remove explicit dependency on netty 3.2 in BKJournal | Minor | build | Haohui Mai | Haohui Mai | | | Fix findbugs warning about NP\DEREFERENCE\OF\READLINE\VALUE in SpanReceiverHost | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Populate hostname in httpfs audit log | Trivial | . | Zoran Dimitrijevic | Zoran Dimitrijevic | | | CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level | Minor | namenode | Xiaoyu Yao | Xiaoyu Yao | | | "RM Home" link in NM should point to one of the RMs in an HA setup | Major | resourcemanager | Karthik Kambatla | Karthik Kambatla | | | NFS: Fix javadoc warning in RpcProgram.java | Trivial | documentation | Abhiraj Butala | Abhiraj Butala | | | Comment format error in ShortCircuitRegistry javadoc | Trivial | datanode | debugging | David Luo | | | Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC | Major | test | Jinghui Wang | Jinghui Wang | | | processIncrementalBlockReport performance degradation | Critical | namenode | Daryn Sharp | Eric Payne | | | TestMissingBlocksAlert should use MXBeans instead of old web UI | Minor | . | Zhe Zhang | Zhe Zhang | | | DataNode#transferBlock should report blocks that don't exist using reportBadBlock | Major | datanode, namenode | Yongjun Zhang | Yongjun Zhang | | | FairSchedulerConfiguration should allow extra spaces between value and unit | Minor | fairscheduler | Sangjin Lee | Wei Yan | | | documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Fix OutOfMemoryError caused by metrics system in Azure File System | Major | metrics | shanyu zhao | shanyu zhao | | | Snapshot read can reveal future bytes for appended files. | Major | hdfs-client | Konstantin Shvachko | Tao Luo | | | DFSTestUtil.readFileBuffer opens extra FSDataInputStream | Trivial | . | Plamen Jeliazkov | Plamen Jeliazkov | | | Add an hdfs debug command to validate blocks, call recoverlease,

| Major | hdfs-client | Colin P. McCabe | Colin P. McCabe | | | Update BUILDING.txt to remove the workaround for tools.jar | Minor | . | Haohui Mai | Li Lu | | | Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN | Major | test | Robert Kanter | Robert Kanter | | | Add java 8 profile for hadoop-annotations | Major | . | Haohui Mai | Li Lu | | | Use Time.monotonicNow() in Shell.java instead of Time.now() | Minor | . | Vinayakumar B | Vinayakumar B | | | Remove no longer supported activation properties for packaging from pom | Trivial | build | Masatake Iwasaki | Masatake Iwasaki | | | TestSecurityUtil fails when run with JDK8 because of empty principal names | Minor | security, test | Stephen Chu | Stephen Chu | | | AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call | Critical | fs/s3 | David S. Wang | Juan Yu | | | Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client | Major | . | Arun Suresh | Arun Suresh | | | BlockInfo should take replication as an short in the constructor | Minor | . | Haohui Mai | Li Lu | | | NameNode - KMS communication fails after a long period of inactivity | Major | . | Arun Suresh | Arun Suresh | | | TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation. | Minor | datanode, namenode, test | Chris Nauroth | Konstantin Shvachko | | | Fix UGI#reloginFromKeytab on Java 8 | Major | security | Tobi Vollebregt | Stephen Chu | | | Fix typo in RpcUtil log message | Trivial | net | Charles Lamb | Charles Lamb | | | Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor | Minor | nfs | Brandon Li | Brandon Li | | | diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection | Trivial | nodemanager | zhihai xu | zhihai xu | | | Time strings are formated in different timezone | Major | webapp | Peng Zhang | Akira Ajisaka | | | Named user ACL cannot stop the user from accessing the FS entity. | Major | namenode | Chunjun Xiao | Vinayakumar B | | | Clients may get stuck waiting when using ByteArrayManager | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit | Major | namenode | Yongjun Zhang | Haohui Mai | | | Application recovery throw InvalidStateTransitonException: Invalid event: ATTEMPT\_KILLED at ACCEPTED | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | LineRecordReader can return the same decompressor to CodecPool multiple times | Major | . | Sergey Murylev | Sergey Murylev | | | ConcurrentModificationException in ContainerLogAppender | Critical | . | Mohammad Kamrul Islam | Mohammad Kamrul Islam | | | NM fail to start with NPE during container recovery | Major | nodemanager | zhihai xu | zhihai xu | | | In Fair Scheduler, reservation fulfillments shouldn't ignore max share | Major | . | Siqi Li | Siqi Li | | | RMStateStore should process the pending events before close | Major | resourcemanager | Varun Saxena | Varun Saxena | | | Too many connections are opened for proxy server when applicationMaster UI is accessed. | Critical |

| Rohith Sharma K S | Rohith Sharma K S | | | Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache | Minor | . | Kihwal Lee | Keith Pak | | | Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() | Minor | . | Ted Yu | Vinayakumar B | | | ZKDelegationTokenSecretManager never shuts down listenerThreadPool | Major | security | Gregory Chanan | Arun Suresh | | | RM web UI: app page will crash if app is failed before any attempt has been created | Major | webapp | Zhijie Shen | Wangda Tan | | | NFS ID/Group lookup requires SSSD enumeration on the server | Major | nfs | Yongjun Zhang | Yongjun Zhang | | | mapred hsadmin fails on a secure cluster | Blocker | jobhistoryserver | Jason Lowe | Jason Lowe | | | AM JVM does not exit if MRClientService gracefull shutdown fails | Major | applicationmaster, resourcemanager | Nishan Shetty | Rohith Sharma K S | | | System class pattern package.Foo should match package.Foo$Bar, too | Blocker | . | Gera Shegalov | Gera Shegalov | | | Fix unit tests to not use uppercase key names | Major | security | Andrew Wang | Andrew Wang | | | SimpleHttpProxyHandler puts incorrect "Connection: Close" header | Major | . | Haohui Mai | Haohui Mai | | | Update examples in document of Timeline Server | Trivial | documentation, timelineserver | Masatake Iwasaki | Masatake Iwasaki | | | Hadoop Archives should support globs resolving to files | Blocker | tools | Gera Shegalov | Gera Shegalov | | | Allow decommissioning of dead DataNodes | Major | . | Zhe Zhang | Zhe Zhang | | | Remove stale block invalidation work when DN re-registers with different UUID | Major | namenode | Zhe Zhang | Zhe Zhang | | | Application recovery continuously fails with "Application with id already present. Cannot duplicate" | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | FairScheduler: Set current capacity in addition to capacity | Major | . | zhihai xu | zhihai xu | | | Inaccurate javadoc of BlockUCState#COMPLETE state | Trivial | namenode | Yongjun Zhang | Yongjun Zhang | | | RMAuthenticationHandler is no longer useful | Major | resourcemanager | Zhijie Shen | haosdent | | | NN UI fails to distinguish datanodes on the same host | Minor | . | Benoy Antony | Benoy Antony | | | key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT | Major | security | Dian Fu | Dian Fu | | | JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer. | Major | . | Jian He | MinJi Kim | | | KMS startup scripts must not display the keystore / truststore passwords | Major | kms | Arun Suresh | Arun Suresh | | | CapacitySchedulerPage shows HTML tags for a queue's Active Users | Major | capacityscheduler | Jason Lowe | Jason Lowe | | | Allow block reports to be processed during checkpointing on standby name node | Critical | . | Kihwal Lee | Kihwal Lee | | | convertToBlockUnderConstruction should preserve BlockCollection | Major | . | Haohui Mai | Haohui Mai | | | SchedulerNode#toString should print all resource detail instead of only

| Trivial | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | Fix deadlock in DomainSocketWatcher when the notification pipe is full | Major | . | yunjiong zhao | yunjiong zhao | | | TestDbClasses timeouts are too aggressive | Minor | test | Jason Lowe | Varun Saxena | | | AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted | Blocker | . | Jason Lowe | Varun Saxena | | | Potential NullPointerException in MRClientProtocol interface implementation. | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | KeyAuthorizationKeyProvider access checks need to be done atomically | Major | . | Dian Fu | Dian Fu | | | RMStateStore can explicitly handle store/update events when fenced | Major | . | Jian He | Varun Saxena | | | When ACL's are enabled, if RM switches then application can not be viewed from web. | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup | Major | . | Arun Suresh | Arun Suresh | | | KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL | Major | kms, security | Dian Fu | Dian Fu | | | Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps | Blocker | resourcemanager | Naganarasimha G R | Naganarasimha G R | | | KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject | Major | security | Dian Fu | Dian Fu | | | Remove unused variable from CMake error message for finding openssl | Minor | . | Dian Fu | Dian Fu | | | Fix typo in message of ReplicaNotFoundException | Trivial | . | Masatake Iwasaki | Masatake Iwasaki | | | When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. | Minor | . | Arun Suresh | Arun Suresh | | | Fix PROCFS\USE\SMAPS\BASED\RSS\_ENABLED property in YarnConfiguration | Minor | . | Ray Chiang | Ray Chiang | | | CapacityScheduler should trim sub queue names when parse configuration | Major | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan | | | Overflow is not properly handled in caclulating final iv for AES CTR | Blocker | security | Haifeng Chen | Haifeng Chen | | | Minor typo in the EncryptedShuffle document about ssl-client.xml | Trivial | documentation | wyp | wyp | | | Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid | Major | documentation | Jason Keller | Akira Ajisaka | | | ThrottledInputStream doesn't perform effective throttling | Major | . | Ted Yu | Ted Yu | | | Add JAVA\LIBRARY\PATH to KMS startup options | Major | kms, security | Dian Fu | Arun Suresh | | | Simplify UGI#reloginFromKeytab for Java 7+ | Major | . | Haohui Mai | Li Lu | | | PublicLocalizer may fail until directory is initialized by LocalizeRunner | Critical | nodemanager | Anubhav Dhoot | Anubhav Dhoot | | | Hadoop maven surefire-plugin uses must set heap size | Major | build | Steve Loughran | Steve Loughran | | | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor |

| Andrew Purtell | Andrew Purtell | | | HDFS tests OOM on Java7+ | Major | build, test | Steve Loughran | Steve Loughran | | | Fix SSLFactory truststore reloader thread leak in KMSClientProvider | Major | kms | Arun Suresh | Arun Suresh | | | TestMiniKdc failure: login options not compatible with IBM JDK | Major | test | Gao Zhong Liang | Gao Zhong Liang | | | FSLeafQueue can throw ConcurrentModificationException | Major | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. | Minor | fs | Chris Nauroth | Varun Saxena | | | Add ACL indicator to the "Permission Denied" exception. | Minor | namenode | Vinayakumar B | Vinayakumar B | | | Fix findbugs warning in hdfs-nfs project | Major | nfs | Brandon Li | Brandon Li | | | Remove deprecated o.a.h.metrics.file.FileContext | Minor | . | Haohui Mai | Li Lu | | | Replace \\n by %n in format hadoop-common format strings | Major | . | Li Lu | Li Lu | | | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor | . | Andrew Purtell | Andrew Purtell | | | Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | Fix new findbugs warnings in hadoop-hdfs | Major | . | Haohui Mai | Haohui Mai | | | mapreduce.job.classloader.system.classes semantics should be order-independent | Major | . | Yitong Zhou | Yitong Zhou | | | Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui | Major | datanode, namenode | Yongjun Zhang | Yongjun Zhang | | | Order of arguments for Preconditions.checkNotNull() is wrong in SchedulerApplicationAttempt ctor | Minor | . | Ted Yu | Devaraj K | | | Jersey Tests failing with port in use | Major | test | Steve Loughran | Varun Saxena | | | Remove redundant non-null checks in FSNamesystem#getBlockLocations | Major | . | Haohui Mai | Haohui Mai | | | TestTextCommand fails on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | Update the NameNode's Group Cache in the background when possible | Minor | . | Chris Li | Chris Li | | | hadoop-aws documentation missing. | Major | documentation | Chris Nauroth | Chris Nauroth | | | TeraOutputFormat may overwrite an existing output directory | Major | examples | Gera Shegalov | Gera Shegalov | | | yarn status command for non-existent application/application attempt/container is too verbose | Minor | client | Sunil Govindan | Sunil Govindan | | | Fix findbugs warnings in hadoop-nfs project | Major | nfs | Brandon Li | Brandon Li | | | NetgroupCache is not thread-safe | Major | security | Benoy Antony | Benoy Antony | | | Reducers do not validate checksum of map outputs when fetching directly to disk | Major | mrv2 | Eric Payne | Eric Payne | | | POMs mention "The Apache Software License" rather than "Apache License" | Trivial | . | Herv Boutemy | Herv Boutemy | | | Large postponedMisreplicatedBlocks has impact on blockReport latency | Major | namenode | Ming Ma | Ming Ma | | | Checking of closed in DFSInputStream#pread() should be protected by synchronization | Minor | . | Ted Yu | Ted Yu | | | Remove unused CryptoCodec in

| Minor | security | Yi Liu | Yi Liu | | | copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. | Major | fs | Chris Nauroth | Chris Nauroth | | | FSLeafQueue#assignContainer - document the reason for using both write and read locks | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Use latest maven-site-plugin and replace link to svn with link to git | Trivial | site | Herv Boutemy | Herv Boutemy | | | InputStream is not closed in AzureNativeFileSystemStore#retrieve() | Minor | tools | Ted Yu | Chen He | | | Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close() | Minor | tools | Ted Yu | Chen He | | | Add hadoop configuration to disable Azure Filesystem metrics collection | Major | fs | shanyu zhao | shanyu zhao | | | DelegationTokenRenewer thread pool never expands | Major | resourcemanager | Jason Lowe | Jason Lowe | | | Move jenkins to Java 7 | Major | . | Haohui Mai | Steve Loughran | | | Clean up temporary files after fsimage transfer failures | Major | . | Kihwal Lee | Kihwal Lee | | | FileContext.getFileContext can stack overflow if default fs misconfigured | Major | . | Jason Lowe | Gera Shegalov | | | Remove obsolete reference to Cygwin in BUILDING.txt | Major | documentation | Arpit Agarwal | Arpit Agarwal | | | Allow renaming of encryption zone roots | Minor | namenode | Charles Lamb | Charles Lamb | | | log message for InvalidMagicNumberException may be incorrect | Major | security | Yi Liu | Yi Liu | | | RM prematurely cancels tokens for jobs that submit jobs (oozie) | Blocker | resourcemanager | Daryn Sharp | Jian He | | | clean up redundant maven-site-plugin configuration | Major | . | Herv Boutemy | Herv Boutemy | | | change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration | Major | datanode, test | Liang Xie | Liang Xie | | | need close the DataInputStream after open it in TestMapReduce.java | Minor | test | zhihai xu | zhihai xu | | | Typos in html pages: SecureMode and EncryptedShuffle | Minor | . | Wei Yan | Wei Yan | | | containersKilled metrics is not updated when the container is killed during localization | Major | nodemanager | zhihai xu | zhihai xu | | | Incorrect version check in RMStateStore | Major | . | Jian He | Rohith Sharma K S | | | TestNMClient get failed intermittently | Major | . | Junping Du | Junping Du | | | FSLeafQueue app lists are accessed without required locks | Blocker | . | Karthik Kambatla | Karthik Kambatla | | | Hive build failure on hadoop-2.7 due to HADOOP-11356 | Major | . | Jason Dere | | | | FileBasedIPList#readLines() can leak file descriptors | Minor | . | Ted Yu | Tsuyoshi Ozawa | | | ACLs removed by removeDefaultAcl() will be back after NameNode restart/failover | Critical | namenode | Vinayakumar B | Vinayakumar B | | | NPE thrown when RM restart after queue is

There after RM can not recovery application's and remain in standby | Critical | resourcemanager, scheduler | Nishan Shetty | Rohith Sharma K S | | | De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode | Major | namenode | Vinayakumar B | Vinayakumar B | | | Graph#save() may leak file descriptors | Minor | . | Ted Yu | Ted Yu | | | Potentially unclosed SequenceFile.Writer in DistCpV1#setup() | Minor | . | Ted Yu | Varun Saxena | | | Several fixes (missing acl check, error log msg ...) and some refinement in AdminService | Major | resourcemanager | Yi Liu | Yi Liu | | | ZKRMStateStore crashes due to session expiry | Blocker | resourcemanager | Karthik Kambatla | Karthik Kambatla | | | ByteBufferReadable API doc is inconsistent with the implementations. | Minor | documentation | Yi Liu | Yi Liu | | | ClientRMService#getQueueInfo doesn't check app ACLs | Major | . | Jian He | Varun Saxena | | | NFS gateway parseStaticMap NumberFormatException | Major | nfs | Hari Sekhon | Yongjun Zhang | | | TestRMRestart.testDecomissionedNMsMetricsOnRMRestart intermittently fails on trunk | Blocker | . | Zhijie Shen | Rohith Sharma K S | | | NPE possible in ClientRMService#getQueueInfo | Major | resourcemanager | Varun Saxena | Varun Saxena | | | ConcurrentModificationException in CapacityScheduler's LeafQueue | Major | capacityscheduler, resourcemanager, scheduler | Jason Tufo | Rohith Sharma K S | | | S3AOutputStream should use shared thread pool to avoid OutOfMemoryError | Major | fs/s3 | Ted Yu | Ted Yu | | | TestLazyPersistFiles#testDnRestartWithSavedReplicas is flaky on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | RMStateStore seems to unnecessarily and wrongly store sequence number separately | Blocker | resourcemanager | Zhijie Shen | Varun Saxena | | | Negative user-to-group cache entries are never cleared for never-again-accessed users | Major | . | Colin P. McCabe | Varun Saxena | | | Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping | Minor | . | Vinayakumar B | Vinayakumar B | | | Fix findbug in TransferFsImage.java | Minor | namenode | Vinayakumar B | Vinayakumar B | | | Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split | Critical | . | Ankit Kamboj | Ankit Kamboj | | | ResourceManager crashes with NPE while getting queue info | Critical | . | Jason Tufo | Varun Saxena | | | TestAggregatedTransferRate fails on non-US systems | Critical | . | Jens Rabe | Jens Rabe | | | Fix description of yarn.scheduler.maximum-allocation-vcores in yarn-default.xml (or code) | Minor | client, documentation, scheduler | Adam Kawa | Vijay Bhat | | | TestSocketIOWithTimeout needs change for PowerPC platform | Major | test | Ayappan | Ayappan | | | Fix recent findbug issue in AbstractYarnScheduler | Minor | . | Yi Liu | Yi Liu | | | TestFetchImage should write fetched-image-dir under target. | Major | . | Konstantin Shvachko | Liang Xie | | | YARNDelegationTokenIdentifier doesn't set proto.builder now | Major | . | Zhijie Shen | Varun Saxena | | | NM keeps sending already-sent completed containers to RM until containers are removed from context | Major | nodemanager | Chengbing Liu | Chengbing Liu | | | Remove some uses of obsolete guava APIs from the hadoop codebase | Major |

| Sangjin Lee | Sangjin Lee | | | Some yarn-site index linked pages are difficult to discover because are not in the side bar | Minor | documentation | Remus Rusanu | Masatake Iwasaki | | | GraphiteSink does not reconnect to Graphite after 'broken pipe' | Major | metrics | Kamil Gorlo | Kamil Gorlo | | | NameNode should prune dead storages from storageMap | Major | namenode | Arpit Agarwal | Arpit Agarwal | | | Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation | Major | . | Anubhav Dhoot | Anubhav Dhoot | | | Datanode sometimes does not shutdown on receiving upgrade shutdown command | Major | . | Kihwal Lee | Eric Payne | | | PacketReceiver populates the packetLen field in PacketHeader incorrectly | Minor | datanode | Jonathan Mace | Jonathan Mace | | | SecondaryNameNode need twice memory when calling reloadFromImageFile | Major | namenode | yunjiong zhao | yunjiong zhao | | | maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications. | Critical | resourcemanager | Wangda Tan | Craig Welch | | | Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java | Minor | applicationmaster | Leitao Guo | Leitao Guo | | | Update the document for hadoop fs -stat | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Timeline DT secret manager should not reuse the RM's configs. | Major | . | Zhijie Shen | Zhijie Shen | | | Remove longReadLock | Major | . | Kihwal Lee | Kihwal Lee | | | DatanodeID generates excessive garbage | Major | namenode | Daryn Sharp | Daryn Sharp | | | The size of header buffer of HttpServer is too small when HTTPS is enabled | Major | security | Benoy Antony | Benoy Antony | | | TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout | Critical | scheduler | Wangda Tan | Jian He | | | Remove TestCorruptFilesJsp from branch-2. | Minor | test | Chris Nauroth | Chris Nauroth | | | MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. | Major | test | Chris Nauroth | Chris Nauroth | | | Missing null check in INodeFile#getBlocks() | Minor | . | Ted Yu | Byron Wong | | | Remove jline from hadoop-yarn-server-common | Major | . | Ferdinand Xu | Ferdinand Xu | | | Potential null pointer dereference in Jets3tFileSystemStore#retrieveBlock() | Minor | fs/s3 | Ted Yu | Ted Yu | | | Remove invalid char from sample conf in doc of FairScheduler | Trivial | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Fix the check condition for reserved path | Minor | . | Yi Liu | Yi Liu | | | yarn classpath command should support same options as hadoop classpath. | Minor | scripts | Chris Nauroth | Varun Saxena | | | Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder | Major | . | Carlo Curino | Carlo Curino | | | Update archival storage user doc for list/set/get block storage policies | Minor | documentation | Yi Liu | Yi Liu | | | Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances | Major | . | Colin P. McCabe | Lei (Eddy) Xu | | | Fix removal of dynamically added DN volumes | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Some site docs have inconsistent appearance | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki | |

BloomFilter#not() omits the last bit, resulting in an incorrect filter | Minor | util | Tim Luo | Eric Payne | | | Corrupt block reporting delayed until datablock scanner thread detects it | Major | . | Rushabh S Shah | Rushabh S Shah | | | mapred classpath CLI does not display the complete classpath | Minor | scripts | Ramya Sunil | Varun Saxena | | | Configuration#updatingResource/finalParameters are not thread-safe | Major | conf | Josh Rosen | Varun Saxena | | | LogCLIHelpers lacks of a blank space before string 'does not exist' | Minor | log-aggregation | sam liu | | | | InputStream is left unclosed in ApplicationClassLoader | Major | . | Ted Yu | Ted Yu | | | Upgrade should generate a unique storage ID for each volume | Critical | . | Lars Francke | Arpit Agarwal | | | Remove duplicated description about proxy-user in site documents | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Checkpoint upload may interfere with a concurrent saveNamespace | Critical | namenode | Todd Lipcon | Ming Ma | | | Fix some typos in kms-acls.xml description | Trivial | kms | Charles Lamb | Charles Lamb | | | BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly. | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Non thread safe access to systemCredentials in NodeHeartbeatResponse processing | Major | . | Anubhav Dhoot | Anubhav Dhoot | | | Hadoop RPC Authentication problem with different user locale | Minor | . | Talat UYARER | Talat UYARER | | | Use correct UGI when KMSClientProvider is called by a proxy user | Major | . | Arun Suresh | Arun Suresh | | | minor typo in HttpFS doc | Trivial | documentation | Charles Lamb | Charles Lamb | | | LocalizerRunner should give DIE action when all resources are localized | Major | nodemanager | Chengbing Liu | Chengbing Liu | | | Cleanup DistCpV1 not to use deprecated methods and fix javadocs | Minor | tools/distcp | Tsuyoshi Ozawa | Varun Saxena | | | Allow reuse of NN connections via webhdfs | Major | webhdfs | Eric Payne | Eric Payne | | | LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error | Major | nodemanager | Jason Lowe | Eric Payne | | | Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition | Minor | . | Ted Yu | Ted Yu | | | RPC Client operations cannot be interrupted | Minor | ipc | Steve Loughran | Steve Loughran | | | change parsing sequence in GenericOptionsParser to parse -D parameters first | Major | . | Xuan Gong | Xuan Gong | | | MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found | Minor | test | Steve Loughran | Steve Loughran | | | CrossOriginFilter needs more log statements | Major | . | Mit Desai | Mit Desai | | | Remove obsolete entries from hdfs-default.xml | Major | . | Ray Chiang | Ray Chiang | | | Add entry for "preemptable" status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging | Major | . | Eric Payne | Eric Payne | | | KMS should skip default.key.acl and whitelist.key.acl when loading key acl | Minor | kms | Dian Fu | Dian Fu | | | "mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters | Blocker |

| Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | AMRMClientImpl does not update AMRM token properly | Blocker | client | Jason Lowe | Jason Lowe | | | deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. | Critical | namenode | Konstantin Shvachko | Jing Zhao | | | MR AM does not survive RM restart if RM activated a new AMRM secret key | Blocker | mr-am | Jason Lowe | Jason Lowe | | | various typos and message formatting fixes in nfs daemon and doc | Trivial | nfs | Charles Lamb | Charles Lamb | | | Scheduler should also update maximumAllocation when updateNodeResource. | Major | . | zhihai xu | zhihai xu | | | Grep example job is not working on a fully-distributed cluster | Major | examples | Akira Ajisaka | Akira Ajisaka | | | Webapp http://hostname:port/metrics link is not working | Critical | . | Jian He | Akira Ajisaka | | | The background replication queue initialization may not let others run | Critical | rolling upgrades | Kihwal Lee | Kihwal Lee | | | FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere | Major | nodemanager | Steve Loughran | Varun Saxena | | | Avoid using sys\_errlist on Solaris, which lacks support for it | Major | . | Malcolm Kavalsky | Malcolm Kavalsky | | | StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB | Major | tools | Duo Xu | Duo Xu | | | Support connection limiting in IPC server | Major | . | Sanjay Radia | Kihwal Lee | | | Difference in default connection timeout for S3A FS | Minor | fs/s3 | Harsh J | Daisuke Kobayashi | | | Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread | Minor | . | Ted Yu | Ted Yu | | | Release audit warning for "Sorting icons.psd" | Major | . | Chang Li | Steve Loughran | | | GangliaContext does not work with multicast ganglia setup | Minor | metrics | Andrew Otto | Andrew Johnson | | | yarn client tool can not list app\_attempt's container info correctly | Major | client | Gordon Wang | Naganarasimha G R | | | FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Fix findbugs warnings in hadoop-archives | Minor | tools | Masatake Iwasaki | Masatake Iwasaki | | | The HDFS BlockScanner may run fast during the first hour | Major | datanode | Tsz Wo Nicholas Sze | Colin P. McCabe | | | Edit log corruption due to delayed block removal again | Major | namenode | Yongjun Zhang | Yongjun Zhang | | | Fix error message of tokens' activation delay configuration | Minor | . | Yi Liu | Yi Liu | | | Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck | Major | build | Steve Loughran | Tsuyoshi Ozawa | | | Fix findbugs warnings in hadoop-rumen | Minor | tools/rumen | Akira Ajisaka | Masatake Iwasaki | | | checknative should display a nicer error message when openssl support is not compiled in | Major | build, native | Colin P. McCabe | Anu Engineer | | | Class cast exception in NameNode#main | Blocker | namenode | Arpit Agarwal | Yi Liu | | | hadoop-common native compilation fails on Windows due to missing support for \\attribute\\

| Major | native | Chris Nauroth | Chris Nauroth | | | BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes | Major | . | Lei (Eddy) Xu | Lei (Eddy) Xu | | | flaky test detection tool failed to handle special control characters in test result | Major | tools | Yongjun Zhang | Yongjun Zhang | | | Fix dead links to the javadocs in mapreduce project | Minor | documentation | Akira Ajisaka | Akira Ajisaka | | | race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results | Major | metrics | Shinichi Yamashita | Sangjin Lee | | | Fix findbug warnings in httpfs | Major | . | Rakesh R | Rakesh R | | | In Fair Scheduler, fix canceling of reservations for exceeding max share | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot | | | Redundant call to requireJob() while displaying the conf page | Minor | jobhistoryserver | Rohit Agarwal | Rohit Agarwal | | | org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunk | Major | test | Yongjun Zhang | zhihai xu | | | Typo in message for invalid application id | Trivial | resourcemanager | Bibin A Chundatt | Bibin A Chundatt | | | ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo | Major | . | Jian He | Tsuyoshi Ozawa | | | Fix locking on HDFS read statistics and add a method for clearing them. | Major | . | Colin P. McCabe | Colin P. McCabe | | | Memory leak in Bzip2Compressor and Bzip2Decompressor | Major | io, native | Ian Rogers | Anu Engineer | | | Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream | Minor | . | Yi Liu | Yi Liu | | | LinuxContainerExecutor does not handle file arguments to deleteAsUser | Blocker | . | Jason Lowe | Eric Payne | | | RM Apps REST API can return NPE or entries missing id and other fields | Major | webapp | Kendall Thrapp | Jason Lowe | | | FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla | | | DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs | Major | . | Milan Desai | Milan Desai | | | reset timer for liveness monitors after RM recovery | Major | resourcemanager | Jun Gong | Jun Gong | | | Refactor the exception handling code for TimelineClientImpl's retryOn method | Minor | . | Li Lu | Li Lu | | | Restore method signature for LocatedBlock#getLocations() | Major | . | Ted Yu | Ted Yu | | | Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe | | | Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContext | Major | . | Arun Suresh | Arun Suresh | | | Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one

| Major | datanode | Chris Nauroth | Vinayakumar B | | | Use getTrimmedStrings when reading serialization keys | Minor | io | Harsh J | Ryan P | | | DeletionService can silently ignore deletion task failures | Major | nodemanager | Jason Lowe | Varun Saxena | | | Implement workaround for linux kernel panic when removing cgroup | Major | nodemanager | Nathan Roberts | Nathan Roberts | | | NetworkTopology#add calls NetworkTopology#toString without holding the netlock | Minor | net | Liang Xie | Liang Xie | | | Job History Link in RM UI is redirecting to the URL which contains Job Id twice | Major | webapp | Devaraj K | Devaraj K | | | Fix Multithreaded correctness Warnings in BackupImage.java | Major | . | Rakesh R | Konstantin Shvachko | | | Non-atomic operation on nodeUpdateQueue in RMNodeImpl | Major | resourcemanager | Chengbing Liu | Chengbing Liu | | | Nodemanager dies when localizer runner tries to write to a full disk | Major | nodemanager | Jason Lowe | Varun Saxena | | | On Failover tracking url wrong in application cli for KILLED application | Minor | client, resourcemanager | Bibin A Chundatt | Rohith Sharma K S | | | Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading | Minor | documentation | Hitesh Shah | Brahma Reddy Battula | | | Documentation error regarding "container-allocation.expiry-interval-ms" | Trivial | documentation | German Florez-Larrahondo | Brahma Reddy Battula | | | DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out. | Major | datanode, namenode | Rushabh S Shah | Rushabh S Shah | | | Stringifier is left unclosed in Chain#getChainElementConf() | Minor | . | Ted Yu | Ted Yu | | | TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root | Trivial | test | Xiaoyu Yao | Xiaoyu Yao | | | RM generates new AMRM tokens every heartbeat between rolling and activation | Critical | resourcemanager | Jason Lowe | Jason Lowe | | | Log object should be initialized with its own class | Trivial | nodemanager | Rohith Sharma K S | Rohith Sharma K S | | | Fix typo in ClusterSetup.html#Hadoop\_Startup | Major | documentation | Christian Winkler | Christian Winkler | | | rmadmin command usage prints incorrect command name | Minor | resourcemanager | Bibin A Chundatt | Bibin A Chundatt | | | Linux native container executor segfaults if default banned user detected | Major | nodemanager | Jason Lowe | Olaf Flebbe | | | KerberosAuthenticator can connect to a non-secure cluster | Critical | security | Robert Kanter | Yongjun Zhang | | | Re-add rapid rescan of possibly corrupt block feature to the block scanner | Blocker | . | Rushabh S Shah | Colin P. McCabe | | | Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2 | Major | datanode, test | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Run TestDockerContainerExecutorWithMocks on Linux only | Minor | nodemanager, test | Ming Ma | Ming Ma | | | Some testcases from TestLogAggregationService fails in trunk | Major | . | Xuan Gong | Xuan Gong | | | Fix new findbug warnings in hadoop-mapreduce-client-core | Major | . | Jason Lowe | Varun Saxena | | | Checkpointing failure caused by shared KerberosAuthenticator | Critical | security | Chengbing Liu | Chengbing Liu | | | HAServiceProtocol's health state is incorrectly transitioned to SERVICE\NOT\RESPONDING | Major | . | Ming Ma | Ming Ma | | | WebHDFS cannot open a file if its path contains "%" | Critical | namenode | Brahma Reddy Battula | Gerson Carlos | | | RPC Server Reader thread can't shutdown if RPCCallQueue is full | Major |

| Ming Ma | Ming Ma | | | TestClientProtocolProviderImpls passes on failure conditions | Major | . | Devaraj K | Devaraj K | | | ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider" | Minor | security | Brahma Reddy Battula | Brahma Reddy Battula | | | NullPointerException if MapOutputBuffer.flush invoked twice | Major | mrv2 | Jason Lowe | Tsuyoshi Ozawa | | | Fix typos in description about delay scheduling | Trivial | documentation, scheduler | Akira Ajisaka | Akira Ajisaka | | | Add default implementation for AbstractFileSystem#truncate | Major | fs | Yi Liu | Yi Liu | | | Queue size metric for metric sinks isn't actually maintained | Minor | metrics | Mostafa Elhemali | Akira Ajisaka | | | Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL\_SAVING | Major | resourcemanager | J.Andreina | Rohith Sharma K S | | | Post-2.6 namenode may not start up with an image containing inodes created with an old release. | Blocker | . | Kihwal Lee | Rushabh S Shah | | | RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node | Blocker | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. | Critical | net | Liang Xie | Chris Nauroth | | | AppLogAggregatorImpl fails to log error cause | Major | . | Rushabh S Shah | Rushabh S Shah | | | TestDFSHAAdminMiniCluster#testFencer testcase is failing frequently | Major | ha, test | Rakesh R | Rakesh R | | | Connection timeouts to nodemanagers are retried at multiple levels | Blocker | . | Jason Lowe | Jason Lowe | | | secondary filter matches entites which do not have the key being filtered for. | Major | timelineserver | Prakash Ramachandran | Zhijie Shen | | | Active NN and standby NN have different live nodes | Major | datanode | Ming Ma | Ming Ma | | | Document that io.native.lib.available only controls native bz2 and zlib compression codecs | Major | documentation, native | Eli Collins | Akira Ajisaka | | | libhdfs htable.c: fix htable resizing, add unit test | Major | native | Colin P. McCabe | Colin P. McCabe | | | NameNode recovery prompt should be printed on console | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | FTPFileSystem should override getDefaultPort | Major | fs | Gera Shegalov | Brahma Reddy Battula | | | xlator should be closed upon exit from DFSAdmin#genericRefresh() | Minor | . | Ted Yu | Tsuyoshi Ozawa | | | Fix the starting index and end condition of the loop in FileDiffList.findEarlierSnapshotBlocks() | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | JavaDoc does not generate correctly for MultithreadedMapRunner | Minor | documentation | Shane Butler | Chris Palmer | | | fix zkfc hung issue due to not catching exception in a corner case | Major | ha | Liang Xie | Liang Xie | | | Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.name | Minor | documentation | Ted Yu | Ted Yu | | | WebAppProxy does not support a final tracking url which has query fragments and params | Major | . | Hitesh Shah | Jian He | | | WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true | Major | tools | shanyu zhao | shanyu zhao | | | Remove updatePosition argument

DFSInputStream#getBlockAt() | Minor | . | Ted Yu | Colin P. McCabe | | | TestClientToAMTokens#testClientTokenRace is not running against all Schedulers even when using ParameterizedSchedulerTestBase | Major | . | Anubhav Dhoot | Anubhav Dhoot | | | hadoop windows native build will fail in 32 bit machine | Major | build, native | Vinayakumar B | Kiran Kumar M R | | | Unresolved symbols error while compiling HDFS on Windows 7/32 bit | Critical | build, native | Venkatasubramaniam Ramakrishnan | Kiran Kumar M R | | | RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options | Major | nodemanager, resourcemanager | Konstantin Shvachko | Konstantin Shvachko | | | Initialize checkDisk when DirectoryScanner not able to get files list for scanning | Major | . | J.Andreina | J.Andreina | | | TestHDFSCLI create files in hdfs project root dir | Trivial | test | Tsz Wo Nicholas Sze | | | | Description of webhdfs' principal/keytab should switch places each other | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula | | | Update ServiceLevelAuth.md for YARN | Minor | documentation | Akira Ajisaka | Brahma Reddy Battula | | | Add RMStateStore to StateMachine visualization list | Minor | scripts | Chengbing Liu | Chengbing Liu | | | Improve diagnostics information for HttpPutFailedException | Major | namenode | Chengbing Liu | Chengbing Liu | | | node label expression not getting set in ApplicationSubmissionContext | Minor | . | Rohit Agarwal | Rohit Agarwal | | | [JDK8] Cannot build on Windows: error: unexpected end tag: \</ul\> | Major | build | Alec Taylor | Chris Nauroth | | | FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FS | Minor | fs | Gera Shegalov | Gera Shegalov | | | NameNodeEditLogRoller can keep printing "Swallowing exception" message | Critical | . | Jing Zhao | Jing Zhao | | | Fix typo in Task Attempt API's URL | Minor | . | Ryu Kobayashi | Ryu Kobayashi | | | RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content | Major | . | Charles Lamb | Charles Lamb | | | Revert the format change of du output introduced by HADOOP-6857 | Major | . | Akira Ajisaka | Byron Wong | | | Inconsistency in the return information while performing rolling upgrade | Major | . | J.Andreina | J.Andreina | | | hdfs.dll does not export functions of the public libhdfs API | Major | build, libhdfs | Chris Nauroth | Chris Nauroth | | | YarnClientImpl should check FAILED and KILLED state in submitApplication | Major | . | Chang Li | Chang Li | | | Merge Block.BLOCK\FILE\PREFIX and DataStorage.BLOCK\FILE\PREFIX into one constant | Major | datanode | Konstantin Shvachko | Dongming Liang | | | FairScheduler: Changing queueMaxRunningApps interferes with pending jobs | Critical |

| Siqi Li | Siqi Li | | | Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client | Critical | resourcemanager | zhihai xu | zhihai xu | | | MRAppMaster doesn't shutdown file systems | Major | applicationmaster | Noah Watkins | Brahma Reddy Battula | | | oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static | Critical | io | Sean Busbey | Sean Busbey | | | Datanode should not trust the generation stamp provided by client | Critical | datanode | vitthal (Suhas) Gogate | Tsz Wo Nicholas Sze | | | Timeline renew delegation token fails when RM user's TGT is expired | Critical | . | Jonathan Eagles | Zhijie Shen | | | OffsetParam should return the default value instead of throwing NPE when the value is unspecified | Blocker | webhdfs | Eric Payne | Eric Payne | | | CapacityScheduler: Preemption happening on non-preemptable queues | Major | . | Eric Payne | Eric Payne | | | yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private | Major | . | Hitesh Shah | Hitesh Shah | | | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor | documentation | Andrew Purtell | Akira Ajisaka | | | Fix toUpperCase/toLowerCase to use Locale.ENGLISH | Blocker | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | MiniKDC cannot change ORG\NAME or ORG\DOMAIN | Major | security, test | Duo Zhang | Duo Zhang | | | TimelineClient kerberos authentication failure uses wrong login context. | Major | . | Jonathan Eagles | Daryn Sharp | | | ber-jira: S3a stabilisation phase I | Blocker | fs/s3 | Steve Loughran | Steve Loughran | | | Configurable timeout between YARNRunner terminate the application and forcefully kill. | Major | client | Jason Lowe | Eric Payne | | | Fix typo in nnbench#displayUsage | Trivial | test | Liang Xie | Liang Xie | | | DelegateToFileSystem erroneously uses default FS's port in constructor | Major | fs | Gera Shegalov | Brahma Reddy Battula | | | DataNode does not release the volume lock when adding a volume fails. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Fix documentation nits found in markdown conversion | Trivial | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. | Major | tools | Duo Xu | Duo Xu | | | Remove the tests for legacy Web UI in branch-2 | Blocker | test | Akira Ajisaka | Brahma Reddy Battula | | | Exclude jline dependency from YARN | Blocker | build | Zhijie Shen | Zhijie Shen | | | DirectoryScanner should not register a deleting block with memory of DataNode | Critical | datanode | Shinichi Yamashita | Shinichi Yamashita | | | DataNode#checkDiskError should also remove Storage when error is found. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Timelineserver applies the ACL rules after applying the limit on the number of records | Major | . | Prakash Ramachandran | Chang Li | | | NameNode implementation of ClientProtocol.truncate(..) is not idempotent | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | CHANGES.txt has two "Release 0.21.1" sections | Major | documentation | Konstantin Shvachko | Allen Wittenauer | | | Fix dead links to doc of hadoop-tools | Minor | documentation | Masatake Iwasaki | Jean-Pierre Matsumoto | | | The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error | Major | . | Colin P. McCabe | Colin P. McCabe | | | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor |

| Andrew Purtell | Akira Ajisaka | | | TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes | Minor | test | Yi Liu | Plamen Jeliazkov | | | OpensslSecureRandom.c pthreads\thread\id should support FreeBSD and Solaris in addition to Linux | Major | native | Dmitry Sivachenko | Kiran Kumar M R | | | [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted | Major | . | Arun Suresh | Arun Suresh | | | NN Web UI fails to navigate to paths that contain # | Minor | namenode | Kanaka Kumar Avvaru | Kanaka Kumar Avvaru | | | Job can post multiple history files if attempt loses connection to the RM | Major | mr-am | Chang Li | Chang Li | | | Mark the PB OIV tool as experimental | Major | . | Haohui Mai | Lei (Eddy) Xu | | | The WebHdfs system on DN does not honor the length parameter | Blocker | . | Haohui Mai | Haohui Mai | | | Append cannot handle the last block with length greater than the preferred block size | Blocker | . | Jing Zhao | Jing Zhao | | | inotify unable fetch pre-upgrade edit log segments once upgrade starts | Major | . | Zhe Zhang | Zhe Zhang | | | Edit log corruption can happen if append fails with a quota violation | Blocker | namenode | Kihwal Lee | Jing Zhao | | | HttpServer2 creates multiple authentication filters | Major | security | Benoy Antony | Benoy Antony | | | Unable to open webhdfs paths with "+" | Blocker | webhdfs | Jason Lowe | Haohui Mai | | | Fix link to cgroups doc in site.xml | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Speed up the shutdown of datanode during rolling upgrade | Major | . | Kihwal Lee | Kihwal Lee | | | Race condition in FileOutputCommitter v2 for user-specified task output subdirs | Critical | . | Siqi Li | Gera Shegalov | | | commitBlockSynchronization() does not remove locations | Blocker | namenode | Konstantin Shvachko | Yi Liu | | | Missing NullPointer check in AppSchedulingInfo causes RM to die | Blocker | resourcemanager | Giovanni Matteo Fumarola | Brahma Reddy Battula | | | Truncate should verify quota before making changes | Critical | namenode | Jing Zhao | Jing Zhao | | | Use Time.monotonicNow() wherever applicable instead of Time.now() | Major | . | Vinayakumar B | Vinayakumar B | | | TestLogAggregationService.verifyContainerLogs fails after YARN-2777 | Minor | . | Naganarasimha G R | Naganarasimha G R | | | NFS: support regexp grouping in nfs.exports.allowed.hosts | Major | nfs | Brandon Li | Brandon Li | | | FileSystem memory leak in DelegationTokenRenewer | Critical | resourcemanager | zhihai xu | zhihai xu | | | TestHftpFileSystem#testSeek fails in branch-2 | Blocker | . | Akira Ajisaka | Brahma Reddy Battula | | | Getting application(s) goes wrong when app finishes before starting the attempt | Critical | timelineserver | Zhijie Shen | Zhijie Shen | | | NullPointerException in BlockSender | Blocker | datanode | Tsz Wo Nicholas Sze | Brahma Reddy Battula | | | The full block report should prune zombie storages even if they're not empty | Critical |

| Lei (Eddy) Xu | Colin P. McCabe | | | Improve logging for DatanodeRegistration. | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov | | | Correct credential commands info in CommandsManual.html#credential | Major | documentation, security | Brahma Reddy Battula | Varun Saxena | | | ClientServiceDelegate should not retry upon AuthenticationException | Major | . | Jonathan Eagles | Jonathan Eagles | | | Trigger full block report after hot swapping disk | Major | . | Lei (Eddy) Xu | Lei (Eddy) Xu | | | NFS couldn't take percentile intervals | Major | nfs | Brandon Li | Brandon Li | | | Potential resource leak in JavaKeyStoreProvider due to unclosed stream | Minor | security | Ted Yu | Tsuyoshi Ozawa | | | Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Fix expected tracing spans in TestTracing along with HDFS-7054 | Critical | test | Masatake Iwasaki | Masatake Iwasaki | | | The secrets of auth cookies should not be specified in configuration in clear text | Critical | . | Haohui Mai | Li Lu | | | X86 build of libwinutils is broken | Critical | build, native | Remus Rusanu | Kiran Kumar M R | | | Clean up Windows native code compilation warnings related to Windows Secure Container Executor. | Major | native | Chris Nauroth | Remus Rusanu | | | favoring decommissioning node for replication can cause a block to stay underreplicated for long periods | Major | namenode | Nathan Roberts | Nathan Roberts | | | Fix findbugs warnings in org.apache.hadoop.security.authentication | Minor | . | Li Lu | Li Lu | | | RM fails to start in non-secure mode due to authentication filter failure | Blocker | . | Sangjin Lee | Haohui Mai | | | Separate ECN flags from the Status in the DataTransferPipelineAck | Blocker | . | Haohui Mai | Anu Engineer | | | ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters | Blocker | nodemanager | Junping Du | Junping Du | | | OpensslSecureRandom.c pthread\threadid\np usage signature is wrong on 32-bit Mac | Critical | native | Colin P. McCabe | Kiran Kumar M R | | | Use snapshot path as source when using snapshot diff report in DistCp | Major | distcp | Sushmitha Sreenivasan | Jing Zhao | | | NFS gateway should shutdown when it can't start UDP or TCP server | Major | nfs | Brandon Li | Brandon Li | | | RpcProgramNfs3 : wrong parsing of dfs.blocksize | Trivial | nfs | Remi Catherinot | Remi Catherinot | | | Read timeout when retrying a fetch error can be fatal to a reducer | Blocker | . | Jason Lowe | Jason Lowe | | | After swapping a volume, BlockReceiver reports ReplicaNotFoundException | Critical | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | jdiff is broken in Hadoop 2 | Blocker | . | Li Lu | Li Lu | | | FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time | Major |

| zhouyingchao | zhouyingchao | | | Reserved RBW space is not released if client terminates while writing block | Major | datanode | Arpit Agarwal | Arpit Agarwal | | | Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated | Major | . | Ming Ma | Ming Ma | | | HttpServer2 should destroy SignerSecretProvider when it stops | Blocker | . | Rohith Sharma K S | Rohith Sharma K S | | | Fix intermittent test failures in TestTracing | Minor | test | Masatake Iwasaki | Masatake Iwasaki | | | The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer | Blocker | security | Yi Liu | Daryn Sharp | | | AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments | Blocker | security | Venkat Ranganathan | Bowen Zhang | | | Regression with hdfs oiv tool | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestDirectoryCollection fails when the umask is unusual | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | TestUTF8 fails when run against java 8 | Minor | test | Ted Yu | Stephen Chu | | | TestBookKeeperHACheckpoints fails in trunk build | Minor | . | Ted Yu | Akira Ajisaka | | | TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 & 8 | Minor | . | Ted Yu | Wangda Tan | | | Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic | Major | test | Xiaoyu Yao | Xiaoyu Yao | | | Tests for encryption/decryption with IV calculation overflow | Major | security, test | Yi Liu | Yi Liu | | | Remove redundant tests in TestOsSecureRandom | Major | . | Ted Yu | Masanori Oyama | | | Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 | Major | test | sam liu | sam liu | | | TestRMAdminCLI#testHelp fails for transitionToActive command | Minor | . | Ted Yu | Junping Du | | | TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails | Major | test | Ted Yu | Ming Ma | | | Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2 | Major | fs | Liang Xie | Liang Xie | | | TestLocalResourcesTrackerImpl.testLocalResourceCache often failed | Major | nodemanager | Hong Shen | Xuan Gong | | | TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use | Major | . | Xiaoyu Yao | Xiaoyu Yao | | | TableMapping related tests failed due to 'successful' resolving of invalid test hostname | Minor | . | Kai Zheng | Kai Zheng | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Initial cache manager structure and context | Major | . | Chris Trezzo | Chris Trezzo | | | Add tracing to DFSInputStream | Major | datanode, namenode | Colin P. McCabe | Colin P. McCabe | | | In-memory backing store for cache manager | Major | . | Chris Trezzo | Chris Trezzo | | | Populate EDEK cache when creating encryption zone | Major | encryption, performance | Yi Liu | Yi Liu | | | Add documentation for hot swaping DataNode drives | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Avoid calling checkDisk when an HDFS volume is removed during a

| Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Additional user documentation for HDFS encryption. | Minor | documentation | Andrew Wang | Andrew Wang | | | Cleaner service for cache manager | Major | . | Chris Trezzo | Chris Trezzo | | | show namespace and namenode ID on NN dfshealth page | Major | . | Siqi Li | Siqi Li | | | TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks | Major | resourcemanager | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Make adding a new data directory to the DataNode an atomic operation and improve error handling | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Node Manager uploader service for cache manager | Major | . | Chris Trezzo | Chris Trezzo | | | Shared Cache uploader service on the Node Manager | Major | . | Chris Trezzo | Chris Trezzo | | | ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers | Major | timelineserver | Robert Kanter | Robert Kanter | | | Make ReservationSystem and its dependent classes independent of Scheduler type | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot | | | Some unit tests should use NameNodeProtocols instead of FSNameSystem | Major | test | Haohui Mai | Haohui Mai | | | Move FSNameSystem.resolvePath() to FSDirectory | Major | . | Haohui Mai | Haohui Mai | | | Allow enabling/disabling timeline server per framework | Major | . | Jonathan Eagles | Mit Desai | | | Delegate permission checks to FSDirectory | Major | . | Haohui Mai | Haohui Mai | | | Move RetryCache to NameNodeRpcServer | Major | . | Haohui Mai | Haohui Mai | | | LeveldbTimelineStore does not handle db exceptions properly | Major | . | Jason Lowe | Varun Saxena | | | Remove ApplicationAttemptState and ApplicationState class in RMStateStore class | Major | . | Jian He | Tsuyoshi Ozawa | | | Client service for cache manager | Major | . | Chris Trezzo | Chris Trezzo | | | Consolidate snapshot related operations in a single class | Major | . | Haohui Mai | Haohui Mai | | | Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context | Major | hdfs-client | stack | stack | | | Mover can give first priority to local DN if it has target storage type available in local DN | Major | balancer & mover | Uma Maheswara Rao G | Vinayakumar B | | | Timeline server should validate the numeric configuration values | Major | timelineserver | Karam Singh | Vasanth kumar RJ | | | Add leveldb-based implementation for RMStateStore | Major | resourcemanager | Jason Lowe | Jason Lowe | | | Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class | Major | . | Haohui Mai | Haohui Mai | | | Consolidate the implementation of rename() into a single class | Major | . | Haohui Mai | Haohui Mai | | | Consolidate implementation of mkdirs() into a single class | Major | . | Haohui Mai | Haohui Mai | | | Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled | Major | resourcemanager | Wangda Tan | Rohith Sharma K S | | | Moving verify\* functions to corresponding classes | Major |

| Li Lu | Li Lu | | | Disable preemption at Queue level | Major | resourcemanager | Mayank Bansal | Eric Payne | | | Avoid resolving path in FSPermissionChecker | Major | namenode | Jing Zhao | Jing Zhao | | | Consolidate cache-related implementation in FSNamesystem into a single class | Major | . | Haohui Mai | Haohui Mai | | | Consolidate ACL-related operations to a single class | Major | namenode | Haohui Mai | Haohui Mai | | | InMemorySCMStore properties are inconsistent | Major | . | Ray Chiang | Ray Chiang | | | Consolidate XAttr-related implementation into a single class | Major | . | Haohui Mai | Haohui Mai | | | Bumping the findbugs version to 3.0.0 | Major | build | Haohui Mai | Haohui Mai | | | Fix warnings from findbugs 3.0 in hadoop-streaming | Major | . | Li Lu | Li Lu | | | Fix new findbugs warnings in hadoop-mapreduce-client, non-core directories | Major | . | Li Lu | Li Lu | | | Fix new findbugs warnings in mapreduce-examples | Major | . | Li Lu | Li Lu | | | Simplify the logic in INodesInPath | Major | namenode | Jing Zhao | Jing Zhao | | | Fix new findbugs warnings in hadoop-auth\* | Major | . | Li Lu | Li Lu | | | Fix new findbugs warnings in hadoop-kms | Major | . | Li Lu | Li Lu | | | Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI | Major | client | Wangda Tan | Wangda Tan | | | Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack | Major | . | Li Lu | Li Lu | | | Fix various findbugs warnings in hadoop-common | Major | . | Haohui Mai | Haohui Mai | | | Clean up byte to string encoding issues in hadoop-common | Major | . | Haohui Mai | Haohui Mai | | | Avoid resolving path multiple times | Major | . | Jing Zhao | Jing Zhao | | | Consolidate implementation of setting inode attributes into a single class | Major | . | Haohui Mai | Haohui Mai | | | Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics | Minor | . | Ted Yu | Varun Saxena | | | RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM | Minor | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | Admin service for cache manager | Major | . | Chris Trezzo | Chris Trezzo | | | Consolidate symlink-related implementation into a single class | Major | . | Haohui Mai | Haohui Mai | | | InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance | Minor | . | Chris Trezzo | Chris Trezzo | | | Web UI for cache manager | Major | . | Chris Trezzo | Chris Trezzo | | | Avoid path resolution when getting FileStatus for audit logs | Major | . | Haohui Mai | Haohui Mai | | | Add FairReservationSystem for FairScheduler | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot | | | Findbugs warnings in hadoop extras | Major | . | Varun Saxena | Varun Saxena | | | CapacityScheduler should be notified when labels on nodes changed | Major |

| Wangda Tan | Wangda Tan | | | NodeLabel operations in RMAdmin CLI get missing in help command. | Minor | api, client, resourcemanager | Junping Du | Varun Saxena | | | Fix new findbug warnings hadoop-yarn | Major | . | Zhijie Shen | | | | Add a node-labels page in RM web UI | Major | resourcemanager | Wangda Tan | Wangda Tan | | | Abstract out scheduler independent PlanFollower components | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot | | | Implement PlanFollower for FairScheduler | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot | | | Add ability to restrict service access using IP addresses and hostnames | Major | security | Benoy Antony | Benoy Antony | | | Break the dependency between libnative\mini\dfs and libhdfs | Major | libhdfs | Zhanwei Wang | Zhanwei Wang | | | Replaces labels on a host should update all NM's labels on that host | Major | . | Wangda Tan | Wangda Tan | | | Fix findbugs warnings in hadoop-gridmix | Major | . | Varun Saxena | Varun Saxena | | | Snapshot support for truncate | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov | | | Make work-preserving-recovery the default mechanism for RM recovery | Major | resourcemanager | Jian He | Jian He | | | Option "--forceactive" not works as described in usage of "yarn rmadmin -transitionToActive" | Minor | documentation, resourcemanager | Wangda Tan | Masatake Iwasaki | | | BlockListAsLongs should take lists of Replicas rather than concrete classes | Minor | datanode | David Powell | Joe Pallas | | | Shared cache client side changes | Major | . | Chris Trezzo | Chris Trezzo | | | Add trace spans for DFSClient metadata operations | Major | datanode, namenode | Colin P. McCabe | Colin P. McCabe | | | Metrics for container's actual memory usage | Major | nodemanager | Karthik Kambatla | Karthik Kambatla | | | Consolidate the implementation of delete() into a single class | Major | . | Haohui Mai | Haohui Mai | | | Expose interfaces required by FsDatasetSpi implementations | Minor | datanode | David Powell | Joe Pallas | | | Capacity Scheduler preemption policy should only consider capacity without labels temporarily | Major | capacityscheduler | Wangda Tan | Mayank Bansal | | | Small fix and few refinements for FSN#truncate | Major | datanode, namenode | Yi Liu | Yi Liu | | | Disallow truncation of Lazy persist files | Major | datanode, namenode | Yi Liu | Yi Liu | | | Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace | Major | . | Yi Liu | Yi Liu | | | Test case to ensure lazy persist files cannot be truncated | Major | test | Arpit Agarwal | Yi Liu | | | Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature | Major | client, resourcemanager | Wangda Tan | Wangda Tan | | | We should check the new length of truncate can't be a negative

| Major | datanode, namenode | Yi Liu | Yi Liu | | | Fix TestFileTruncate to avoid bug of HDFS-7611 | Major | test | Konstantin Shvachko | Konstantin Shvachko | | | Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan | | | NM dies because of the failure of resource localization | Major | nodemanager | Wang Hao | Varun Saxena | | | Better syntax for replaceLabelsOnNode in RMAdmin CLI | Major | api, client, resourcemanager | Jian He | Rohith Sharma K S | | | DistributedFileSystem#truncate should resolve symlinks | Major | datanode, namenode | Yi Liu | Yi Liu | | | Increment SLF4J version to 1.7.10 | Major | build | Steve Loughran | Tim Robertson | | | Add delimited format support to PB OIV tool | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Fix ReplicaInputStream constructor to take InputStreams | Major | datanode | Joe Pallas | Joe Pallas | | | Bump the maven plugin versions too -moving the numbers into properties | Major | build | Steve Loughran | Akira Ajisaka | | | Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan | | | Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues | Major | capacityscheduler | Wangda Tan | Wangda Tan | | | NodeLabelsManager implementation to retrieve label to node mapping | Major | resourcemanager | Varun Saxena | Varun Saxena | | | Resource usage should be published to the timeline server as well | Major | timelineserver | Zhijie Shen | Naganarasimha G R | | | AMRMClientAsync missing blacklist addition and removal functionality | Major | . | Bikas Saha | Bartosz ugowski | | | Expose truncate API for Web HDFS | Major | datanode, namenode | Yi Liu | Yi Liu | | | Uniform the XXXXNotFound messages from ClientRMService and ApplicationHistoryClientService | Major | . | Zhijie Shen | Zhijie Shen | | | Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY | Major | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan | | | Quota by Storage Type API, tools and ClientNameNode Protocol changes | Major | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao | | | Add more tests for truncate | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | RM uses conf instead of token service address to renew timeline delegation tokens | Major | timelineserver | Jonathan Eagles | Jonathan Eagles | | | Tests for truncate CLI | Major | test | Konstantin Shvachko | Dasha Boudnik | | | Add CLI client to the registry to list, view and manipulate entries | Major | client | Steve Loughran | Akshay Radia | | | registry config options: document and move to core-default | Major | api, resourcemanager | Steve Loughran | Steve Loughran | | | Document truncate for

| Minor | documentation | Yi Liu | Konstantin Shvachko | | | Quota By Storage Type namenode implemenation | Major | namenode | Xiaoyu Yao | Xiaoyu Yao | | | Recover NonAggregatingLogHandler state upon nodemanager restart | Major | nodemanager | Jason Lowe | Jason Lowe | | | Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-label | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan | | | Document work-preserving RM restart | Major | resourcemanager | Jian He | Jian He | | | Adding additional unit tests for Quota By Storage Type | Major | test | Xiaoyu Yao | Xiaoyu Yao | | | BKJM doesn't take advantage of speculative reads | Major | ha | Ivan Kelly | Rakesh R | | | Use consistent naming for NN-internal quota related types and functions | Minor | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao | | | Fix up source codes to be compiled with Guava 17.0 | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | BKJM: Separate write and ack quorum | Major | ha | Ivan Kelly | Rakesh R | | | S3AInputStream.close() downloads the remaining bytes of the object from S3 | Major | fs/s3 | Dan Hecht | Dan Hecht | | | Update S3A Documentation | Major | fs/s3 | Thomas Demoor | Thomas Demoor | | | Make connection timeout configurable in s3a | Minor | fs/s3 | Thomas Demoor | Thomas Demoor | | | RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan | | | Utility to benchmark ZKRMStateStore#loadState for ResourceManager-HA | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Expose truncate API for HDFS httpfs | Major | datanode, namenode | Yi Liu | Yi Liu | | | Add API/Implementation to YarnClient to retrieve label-to-node mapping | Major | client | Varun Saxena | Varun Saxena | | | Fix usage string of storageType parameter for "dfsadmin -setSpaceQuota/clrSpaceQuota" | Minor | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao | | | Test truncate with DataNodes restarting | Major | test | Konstantin Shvachko | Yi Liu | | | s3a file block size set to 0 in getFileStatus | Blocker | fs/s3 | Dan Hecht | Brahma Reddy Battula | | | Refactor: move StorageType from hadoop-hdfs to hadoop-common | Minor | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao | | | Fix new findbugs warnings in hadoop-maven-plugins | Major | . | Haohui Mai | Li Lu | | | Provide storage tier information for a directory via fsck | Major | balancer & mover | Benoy Antony | Benoy Antony | | | A truncated file is corrupted after rollback from a rolling upgrade | Blocker | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Log WARN message for the blocks which are not in Block ID based layout | Major | datanode | Rakesh R | Rakesh R | | | CapacityScheduler deadlock when computing absolute max avail capacity (fix for trunk/branch-2) | Blocker | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan | | | Memory-based S3AOutputstream | Major | fs/s3 | Thomas Demoor | Thomas Demoor | | | Metrics for container's actual CPU usage | Major | nodemanager | Anubhav Dhoot | Anubhav Dhoot | | | Add a test randomly mixing append, truncate and snapshot | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Create yarn cluster CLI to enable list node labels collection | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan | | | Separate class Packet from DFSOutputStream | Major | hdfs-client | Li Bo | Li Bo | | | Synchronize RM and Generic History Service Web-UIs | Major |

| Zhijie Shen | Xuan Gong | | | Regression: s3a auth setup broken | Blocker | fs/s3 | Adam Budde | Adam Budde | | | outstanding\resource\requests table should not be shown in AHS | Major | resourcemanager | Xuan Gong | Xuan Gong | | | ContainerReport should have nodeHttpAddress | Major | . | Zhijie Shen | Xuan Gong | | | Make CryptoOutputStream behave like DFSOutputStream wrt synchronization | Critical | fs | Sean Busbey | Sean Busbey | | | Cannot recover block after truncate and delete snapshot | Blocker | datanode, namenode | Tsz Wo Nicholas Sze | Plamen Jeliazkov | | | Sort by Application id, AppAttempt & ContainerID doesn't work in ATS / RM web ui | Minor | timelineserver | Jeff Zhang | Naganarasimha G R | | | Expose truncate API for libhdfs | Major | datanode, namenode | Yi Liu | Yi Liu | | | Add tracing to DFSClient#setQuotaByStorageType | Major | hdfs-client | Rakesh R | Rakesh R | | | TestDataNodeVolumeFailureReporting NPE on Windows | Major | test | Xiaoyu Yao | Xiaoyu Yao | | | TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows | Major | test | Xiaoyu Yao | Xiaoyu Yao | | | Fix TestFsDatasetImpl#testAddVolumes failure on Windows | Major | test | Xiaoyu Yao | Xiaoyu Yao | | | Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux | Major | test | Xiaoyu Yao | Xiaoyu Yao | | | Make DFSOutputStream tracing more fine-grained | Major | datanode, namenode | Colin P. McCabe | Colin P. McCabe | | | Missing data in localityTable and ResourceRequests table in RM WebUI | Major | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong | | | GetContentSummary API and its namenode implementation for Storage Type Quota/Usage | Major | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao | | | Document quota support for storage types | Major | documentation | Xiaoyu Yao | Xiaoyu Yao | | | TestBalancer#testBalancerWithPinnedBlocks failed on Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao | | | Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage | Minor | namenode | Xiaoyu Yao | Xiaoyu Yao | | | Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao | | | jdiff failing on java 7 and java 8, "Null.java" not found | Major | build | Steve Loughran | Tsuyoshi Ozawa | | | RMAppAttempt headroom data is missing in RM Web UI | Blocker | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong | | | PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. | Minor | tools | Xiaoyu Yao | Xiaoyu Yao | | | Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Review issues with UnderReplicatedBlocks | Minor | namenode | Steve Loughran | Uma Maheswara Rao G | | | Add documentation for CGroups | Major | documentation, nodemanager | Varun Vasudev | Varun Vasudev | | | Dropping dependency on io.netty from hadoop-nfs' pom.xml | Minor | nfs | Ted Yu | Ted Yu | | | Replace method-local TransferManager object with S3AFileSystem#transfers | Major | fs/s3 | Ted Yu | Ted Yu | | | Workaround for Curator's ChildReaper requiring Guava 15+ | Major | . | Robert Kanter | Robert Kanter | | | Remove httpclient dependency from hadoop-mapreduce-client | Major | .