Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.7.4.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | fsck should also report decommissioning replicas. | Major | namenode | Jitendra Nath Pandey | Xiaoyu Yao | | | Upgrade Tomcat to 6.0.48 | Blocker | kms | John Zhuge | John Zhuge | | | Add ability to secure log servlet using proxy users | Major | . | Jeffrey E Rodriguez | Yuanbo Liu | | | Remove S3A ref from META-INF service discovery, rely on existing core-default entry | Critical | fs/s3 | Steve Loughran | Steve Loughran | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Allow long-running Balancer to login with keytab | Major | balancer & mover, security | Xiao Chen | Xiao Chen | | | Specifying node labels when submitting MR jobs | Major | job submission | Jian Fang | Naganarasimha G R | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Refactor FSDirStatAndListingOp | Major | . | Haohui Mai | Haohui Mai | | | Implement a space balanced block placement policy | Minor | namenode | Liu Shaohui | Liu Shaohui | | | Abort the balancer if an upgrade is in progress | Major | balancer & mover | Andrew Wang | Andrew Wang | | | Clarify automatic sync in FSEditLog#logEdit | Minor | . | Andrew Wang | Andrew Wang | | | Utility to Dynamic port allocation | Major | test, util | Brahma Reddy Battula | Brahma Reddy Battula | | | NameNode Metrics : Add FSNameSystem lock Queue Length | Major | namenode | Anu Engineer | Anu Engineer | | | Adding informative message to sticky bit permission denied exception | Minor | security | Thejas M Nair | Xiaoyu Yao | | | Tracking methods that hold FSNamesytemLock for too long | Major | namenode | Jing Zhao | Mingliang Liu | | | Refactor IBR code to a new class | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Support excluding weak Ciphers in HttpServer2 through ssl-server.xml | Critical | security | Vijay Singh | Vijay Singh | | | Change DN to send block receipt IBRs in batches | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | getBlocks occupies FSLock and takes too long to complete | Major | balancer & mover, namenode | He Tianyi | He Tianyi | | | Support different values of dfs.datanode.du.reserved per storage type | Major | datanode | Pan Yuxuan | Brahma Reddy Battula | | | Appropriate use of generics in FairCallQueue | Major | ipc | Konstantin Shvachko | Jonathan Hung | | | Optimize RMAppAttempt#pullJustFinishedContainers | Major |

| sandflee | sandflee | | | Make the threshold of reporting FSNamesystem lock contention configurable | Major | logging, namenode | Zhe Zhang | Erik Krogen | | | Doc about upgrading to a version of HDFS with snapshots may be confusing | Minor | documentation | Mingliang Liu | Mingliang Liu | | | VolumeScanner to report why a block is found bad | Major | datanode, hdfs | Yongjun Zhang | Rushabh S Shah | | | TestYarnCLI#testGetContainers should format according to CONTAINER\_PATTERN | Minor | client, test | Jonathan Hung | Jonathan Hung | | | Add Logging for Long-held NN Read Locks | Major | logging, namenode | Erik Krogen | Erik Krogen | | | scheduler spends too much time looking at empty priorities | Major | capacity scheduler, fairscheduler, resourcemanager | Nathan Roberts | Jason Lowe | | | YarnClientImpl.submitApplication swallows exceptions | Minor | client | Steve Loughran | Varun Saxena | | | add MR support to redact job conf properties | Major | mrv2 | Haibo Chen | Haibo Chen | | | Tighten the authorization of datanode RPC | Major | datanode, security | Kihwal Lee | Kihwal Lee | | | RPC Metrics : Add the ability track and log slow RPCs | Major | ipc, metrics | Anu Engineer | Anu Engineer | | | Make MutableRates metrics thread-local write, aggregate-on-read | Major | metrics | Erik Krogen | Erik Krogen | | | Improve BlockManager#processMisReplicatesAsync log | Major | namenode | Xiaoyu Yao | Chen Liang | | | Expose "NumOpenConnectionsPerUser" as a metric | Major | . | Brahma Reddy Battula | Brahma Reddy Battula | | | NameNode WebUI should display DataNode usage histogram | Major | namenode, ui | Zhe Zhang | Kai Sasaki | | | Print a user friendly error message when plugins are not found | Minor | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms | Major | namenode | Andrew Wang | Andrew Wang | | | Implement listStatusIterator, listLocatedStatus for ViewFs | Minor | viewfs | Erik Krogen | Erik Krogen | | | Clarify the behavior of HDFS Mover in documentation | Major | documentation | Xiaobing Zhou | Xiaobing Zhou | | | Add a nanosecond API to Time/Timer/FakeTimer | Minor | util | Erik Krogen | Erik Krogen | | | Lazy construct the IIP pathname | Major | . | Daryn Sharp | Daryn Sharp | | | Optimize BlockIterator when iterating starts in the middle. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike | Major | balancer & mover | yunjiong zhao | Konstantin Shvachko | | | Allow the directoryScanner to be rate-limited | Major | datanode | Nathan Roberts | Daniel Templeton | | | Allow custom SSL configuration to be supplied in WebApps | Major | webapp, yarn | Sanjay M Pujare | Sanjay M Pujare | | | Print requested node partition in assignContainer logs | Major | . | Jonathan Hung | Jonathan Hung | | | Add metrics for connections dropped | Major | . | Eric Badger | Eric Badger | | | Document the configuration key for FSNamesystem lock fairness | Minor | documentation, namenode | Zhe Zhang | Erik Krogen | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Configuration.getClasses() never returns the default value. | Major | conf | Amar Kamat | Uma Maheswara Rao G | | | The SLS simulator is not running the preemption policy for CapacityScheduler | Minor | . | Carlo Curino | Carlo Curino | | | git should ignore .DS\_Store files on Mac OS X | Major |

| Abin Shahab | Abin Shahab | | | Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path | Major | . | Xuan Gong | Xuan Gong | | | IBR delete ack should not be delayed | Major | namenode | Daryn Sharp | Daryn Sharp | | | PseudoAuthenticationHandler fails with httpcomponents v4.4 | Major | . | Eugene Koifman | Eugene Koifman | | | Modify NNThroughputBenchmark to be able to operate on a remote NameNode | Major | . | Colin P. McCabe | Charles Lamb | | | FSImage may be left unclosed in BootstrapStandby#doRun() | Minor | ha | Ted Yu | Sanghyun Yun | | | RM Web UI queue filter doesn't work | Blocker | . | Wangda Tan | Wangda Tan | | | NetworkTopology#add calls NetworkTopology#toString always | Major | . | igo Goiri | igo Goiri | | | Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. | Major | . | J.Andreina | J.Andreina | | | NameNode does not check for inode type before traversing down a path | Trivial | namenode | Harsh J | Xiao Chen | | | container-executor overuses PATH\_MAX | Major | nodemanager | Allen Wittenauer | Sidharta Seethana | | | NPE in AppSchedulingInfo#isRequestLabelChanged | Major | resourcemanager, scheduler | Brahma Reddy Battula | Brahma Reddy Battula | | | Maintain wrapped SASL ordering for postponed IPC responses | Critical | ipc | Daryn Sharp | Daryn Sharp | | | TestRPC.testRPCInterruptedSimple fails intermittently | Major | test | Steve Loughran | Kihwal Lee | | | SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReport | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | SLS webapp doesn't load | Major | scheduler-load-simulator | Karthik Kambatla | Karthik Kambatla | | | Increase the timeout of TestZKFailoverController | Major | test | Rajat Jain | Steve Loughran | | | Fix data race accessing writeLockHeldTimeStamp in FSNamesystem | Major | namenode | Mingliang Liu | Mingliang Liu | | | Exception on RM scheduler page loading with labels | Minor | . | Bibin A Chundatt | Mohammad Shahid Khan | | | Fix rumen and scheduler load simulator handle killed tasks properly | Major | . | Ming Ma | Ming Ma | | | TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler | Major | test | Karthik Kambatla | Bibin A Chundatt | | | YARN WebApp ignores the configuration passed to it for keystore settings | Major | . | Sergey Shelukhin | Sergey Shelukhin | | | TestJMXGet:testNameNode() fails | Minor | test | Andras Bokor | Gergely Novk | | | Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator | Critical | . | Xuan Gong | Xuan Gong | | | HDFS should not expose path info that user has no permission to see. | Major | fs, security | Kevin Cox | Yuanbo Liu | | | RM leaks containers if running container disappears from node update | Critical | resourcemanager | Jason Lowe | Jason Lowe | | | Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | Using -diff option with DistCp may get "Comparison method violates its general contract" exception | Major |

| Yongjun Zhang | Yongjun Zhang | | | TestBalancer failing intermittently because of not reseting UserGroupInformation completely | Major | test | Yiqun Lin | Yiqun Lin | | | VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks | Major | datanode | Wei-Chiu Chuang | Yiqun Lin | | | ResourceManager can leak delegation tokens when they are shared across apps | Critical | resourcemanager | Jason Lowe | Jason Lowe | | | Fix a race condition in MetricsSourceAdapter.updateJmxCache | Major | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Balancer doesn't work with IPFailoverProxyProvider | Major | balancer & mover, ha | Zhe Zhang | Zhe Zhang | | | Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes | Major | util | zhengbing li | Kai Sasaki | | | Conflicting default ports in DelegateToFileSystem | Major | fs | Kevin Hogeland | Kai Sasaki | | | Increase timeout on TestDFSIO tests | Major | . | Eric Badger | Eric Badger | | | FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException | Major | . | Yiqun Lin | Yiqun Lin | | | fix some container-executor portability issues | Blocker | nodemanager, security | Allen Wittenauer | Allen Wittenauer | | | Single shuffle to memory must not exceed Integer#MAX\_VALUE | Major | mrv2 | Haibo Chen | Haibo Chen | | | Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. | Major | . | J.Andreina | J.Andreina | | | TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently | Major | . | Eric Badger | Eric Badger | | | Increase timeout of TestAmFilter.testFilter | Minor | . | Eric Badger | Eric Badger | | | In Balancer, the target task should be removed when its size \< 0. | Minor | balancer & mover | Yiqun Lin | Yiqun Lin | | | NPE when applying AvailableSpaceBlockPlacementPolicy | Major | namenode | Guangbin Zhu | Guangbin Zhu | | | Some recovered apps are put into default queue when RM HA | Major | . | Jun Gong | Jun Gong | | | metaSave should print blocks, not LightWeightHashSet | Major | namenode | Konstantin Shvachko | Yuanbo Liu | | | BlockManager.processReport() should print blockReportId in each log message. | Major | logging, namenode | Konstantin Shvachko | Yuanbo Liu | | | Schedule a block for scanning if its metadata file is corrupt | Major | datanode | Rushabh S Shah | Rushabh S Shah | | | RM does not audit log kill request for active applications | Major | resourcemanager | Jason Lowe | Vrushali C | | | Garbage snapshot records lingering forever | Critical | . | Kihwal Lee | Kihwal Lee | | | o.a.h.hdfs.tools.DebugAdmin usage message is misleading | Minor | hdfs-client | Mingliang Liu | Mingliang Liu | | | ReconfigurableBase can log sensitive information | Major | security | Sean Mackrory | Sean Mackrory | | | ReloadingX509TrustManager should keep reloading in case of exception | Critical | security | Mingliang Liu | Mingliang Liu | | | Open files can leak permanently due to inconsistent lease update | Critical | . | Kihwal Lee | Kihwal Lee | | | Shuffle server listen queue is too small | Major | mrv2 | Jason Lowe | Jason Lowe | | | Trash does not descent into child directories to check for permissions | Critical | fs, security | Eric Yang | Weiwei Yang | | |

fails intermittently in jenkins | Minor | test | Anu Engineer | Masatake Iwasaki | | | HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections | Major | . | Min Shen | Min Shen | | | TestRecovery.testSpeculative failed with NPE | Major | mrv2 | Haibo Chen | Haibo Chen | | | TestRecovery occasionally fails | Major | mrv2, test | Jason Lowe | Haibo Chen | | | getNumEncryptionZones causes NPE in branch-2.7 | Major | encryption, namenode | Zhe Zhang | Vinitha Reddy Gankidi | | | UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket | Major | security | Alejandro Abdelnur | Xiao Chen | | | DFS reserved space is erroneously counted towards non-DFS used. | Major | datanode | Chris Nauroth | Brahma Reddy Battula | | | Fix source-level compatibility after HADOOP-11252 | Blocker | . | Akira Ajisaka | Tsuyoshi Ozawa | | | Fix typo in a log messages of AbstractDelegationTokenSecretManager | Trivial | . | Mehran Hassani | Mehran Hassani | | | TestEncryptionZonesWithKMS#testReadWrite fails intermittently | Major | . | Xiao Chen | Xiao Chen | | | Update space quota when a UC block is completed rather than committed. | Major | hdfs, namenode | Erik Krogen | Erik Krogen | | | Add jetty6 acceptor startup issue workaround to branch-2 | Major | . | Wei-Chiu Chuang | Min Shen | | | In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name | Minor | security | huangyitian | Surendra Singh Lilhore | | | Correct the distcp counters name while displaying counters | Minor | distcp | Archana T | Surendra Singh Lilhore | | | Remove outdated Fault Injection Framework documentaion | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula | | | Throttle FsNameSystem lock warnings | Major | logging, namenode | Arpit Agarwal | Hanisha Koneru | | | Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart | Minor | test | Xiaobing Zhou | Xiaobing Zhou | | | Add utility to find set of available ephemeral ports to ServerSocketUtil | Major | . | Brahma Reddy Battula | Masatake Iwasaki | | | Prevent IPC reader thread death | Critical | ipc | Daryn Sharp | Daryn Sharp | | | RMContainerAllocator sends container diagnostics event after corresponding completion event | Major | mrv2 | Haibo Chen | Haibo Chen | | | TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException | Major | hdfs-client | Rushabh S Shah | Rushabh S Shah | | | Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications | Major | encryption | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Export hdfsTruncateFile symbol in libhdfs | Blocker | libhdfs | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md | Major | documentation | Mingliang Liu | Mingliang Liu | | | Make Decommission less expensive when lot of blocks present. | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula | | | BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order | Critical | namenode | Konstantin Shvachko | Vinitha Reddy Gankidi | | | Fix TestDataNodeVolumeFailure on 2.\* branches. | Major |

| Konstantin Shvachko | Vinitha Reddy Gankidi | | | Volume Scanner marks a block as "suspect" even if the exception is network-related | Major | hdfs | Rushabh S Shah | Rushabh S Shah | | | truncate will fail when we use viewfilesystem | Major | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Enforce timeout in balancer | Major | balancer & mover | Kihwal Lee | Kihwal Lee | | | Unnecessary superuser check in versionRequest() | Major | namenode, security | Kihwal Lee | Kihwal Lee | | | TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode | Major | . | Eric Badger | Eric Badger | | | Print the directory paths when ViewFs denies the rename operation on internal dirs | Major | viewfs | Tianyin Xu | Rakesh R | | | Findbugs warning in resourcemanager in branch-2.7 and branch-2.6 | Minor | resourcemanager | Varun Saxena | Akira Ajisaka | | | Cluster metrics have wrong Total Memory when there is reserved memory on CS | Major | capacityscheduler, resourcemanager | Thomas Graves | Brahma Reddy Battula | | | datanodesSoftwareVersions map may counting wrong when rolling upgrade | Major | . | Phil Yang | Erik Krogen | | | Logging the username when deny the setOwner operation | Minor | namenode | Tianyin Xu | Rakesh R | | | Aggregated Logs root directory is created with wrong group if nonexistent | Major | log-aggregation, nodemanager, security | Haibo Chen | Haibo Chen | | | NPE when getting node status of a decommissioned node after an RM restart | Major | . | Robert Kanter | Robert Kanter | | | MutableStat mean loses accuracy if add(long, long) is used | Minor | metrics | Erik Krogen | Erik Krogen | | | Spurious DNS Queries from hdfs shell | Trivial | hdfs-client | Anu Engineer | Andres Perez | | | NamenodeFsck should check if the output writer is still writable. | Major | namenode | Konstantin Shvachko | Erik Krogen | | | Concurrent append and read operations lead to checksum error | Major | datanode, httpfs | Wei-Chiu Chuang | Wei-Chiu Chuang | | | NPE while processing localizer heartbeat | Major | nodemanager | Jason Lowe | Varun Saxena | | | Enhance Dispatcher logic on deciding when to give up a source DataNode | Major | balancer & mover | Zhe Zhang | Mark Wagner | | | Wrong HttpFS test command in doc | Minor | documentation, httpfs | John Zhuge | John Zhuge | | | ZKRMStateStore can prevent the transition to standby in branch-2.7 if the ZK node is unreachable | Critical | resourcemanager | Daniel Templeton | Daniel Templeton | | | Intermittent deadlock in NameNode when failover happens. | Blocker | namenode | Abhishek Modi | Akira Ajisaka | | | FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations | Major | . | Vinayakumar B | Vinayakumar B | | | HDFS-11056 failed to close meta file | Blocker | datanode | Wei-Chiu Chuang | Wei-Chiu Chuang | | | VolumeScanner reports write-in-progress replicas as corrupt incorrectly | Major | datanode | Wei-Chiu Chuang | Wei-Chiu Chuang | | | ClassCastException when we use Bzipcodec for Fsimage compression | Critical |

| Brahma Reddy Battula | Brahma Reddy Battula | | | Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max | Major | . | Wangda Tan | Wangda Tan | | | RM unable to start in secure setup | Blocker | . | Ajith S | Ajith S | | | Fix outdated tracing documentation | Minor | documentation, tracing | Masatake Iwasaki | Elek, Marton | | | Allow WebHDFS to reuse HTTP connections to NN | Major | hdfs | Zheng Shao | Zheng Shao | | | JobImpl fails to handle preemption events on state COMMITTING | Major | . | Li Lu | Prabhu Joseph | | | Bump up release year to 2017 | Blocker | . | Junping Du | Junping Du | | | NameNode terminated after full GC thinking QJM is unresponsive. | Major | namenode, qjm | Konstantin Shvachko | Vinitha Reddy Gankidi | | | Improve delegation token validity checking | Major | . | Akira Ajisaka | Akira Ajisaka | | | Potential deadlock in NN when failing over | Critical | namenode | Erik Krogen | Erik Krogen | | | Synchronization issue in delegation token cancel functionality | Major | . | Hrishikesh Gadre | Hrishikesh Gadre | | | Balancer hung due to no available mover threads | Major | balancer & mover | yunjiong zhao | yunjiong zhao | | | Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator | Major | . | Jonathan Hung | Jonathan Hung | | | Race in UGI.reloginFromKeytab | Major | security | Duo Zhang | Duo Zhang | | | DFSInputStream may infinite loop requesting block locations | Critical | hdfs-client | Daryn Sharp | Daryn Sharp | | | Workaround guice3x-undecoded pathInfo in YARN WebApp | Major | . | Abraham Elmahrek | Yuanbo Liu | | | OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions | Major | yarn | Haibo Chen | Haibo Chen | | | Decommissioning stuck because of failing recovery | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | | | ViewFs should use underlying FileSystem's server side defaults | Major | fs, viewfs | Lohit Vijayarenu | Erik Krogen | | | DomainSocketWatcher::add()/delete() should not self interrupt while looping await() | Critical | hdfs-client | Mingliang Liu | Mingliang Liu | | | CredentialProviderFactory$getProviders is not thread-safe | Major | security | Vihang Karajgaonkar | Vihang Karajgaonkar | | | FilterFs and ChRootedFs are too aggressive about enforcing "authorityNeeded" | Major | viewfs | Erik Krogen | Erik Krogen | | | Client close() should not fail fast if the last block is being decommissioned | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang | | | DefaultMetricsSystem leaks the source name when a source unregisters | Blocker | metrics | Jason Lowe | Junping Du | | | MR Job Submission Fails if MR framework application path not on defaultFS | Minor | mrv2 | Erik Krogen | Erik Krogen | | | HDFS write crashed with block size greater than 2 GB | Critical | hdfs-client | Xiaobing Zhou | Xiaobing Zhou | | | VersionInfo should be marked as public API | Critical | common | Thejas M Nair | Akira Ajisaka | | | Initialize FakeTimer with a less trivial value | Major | test | Andrew Wang | Andrew Wang | | | Skip rm.transitionToActive call to RM if RM is already

| Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | FSNamesystemLock metrics can be inaccurate due to millisecond precision | Major | hdfs | Erik Krogen | Erik Krogen | | | StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully | Critical | ha, namenode | Zhe Zhang | Erik Krogen | | | Some blocks can be permanently lost if nodes are decommissioned while dead | Blocker | namenode | Kihwal Lee | Kihwal Lee | | | Blocks can be committed with wrong size | Critical | hdfs-client | Daryn Sharp | Jing Zhao | | | Newly added NN storage directory won't get initialized and cause space exhaustion | Critical | . | Kihwal Lee | Kihwal Lee | | | License error in TestLoadBalancingKMSClientProvider.java | Major | . | hu xiaodong | hu xiaodong | | | License error in GridmixTestUtils.java | Major | . | lixinglong | lixinglong | | | Fix findbugs warning in branch-2.7 | Major | . | Akira Ajisaka | Chen Liang | | | Upgrade Jsch jar to latest version to fix vulnerability in old versions | Critical | . | Vinayakumar B | Vinayakumar B | | | Backport HDFS-11258 and HDFS-11272 to branch-2.7 | Critical | . | Akira Ajisaka | Akira Ajisaka | | | Fix ASF Licence warnings in branch-2.7 | Major | . | Yiqun Lin | Yiqun Lin | | | ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread | Major | capacityscheduler, resourcemanager | Min Shen | Min Shen | | | reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered | Critical | datanode | Vinayakumar B | Vinayakumar B | | | Memory leak when reading a compressed file using the native library | Major | common, io | Eli Acherkan | Eli Acherkan | | | Use MoveFileEx to allow renaming a file when the destination exists | Major | native | Lukas Majercak | Lukas Majercak | | | JournalNode startup failure exception should be logged in log file | Major | journal-node | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Document Metrics to track usage of memory for writes | Major | documentation | Brahma Reddy Battula | Yiqun Lin | | | AmIpFilter drops query parameters on redirect | Major | . | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | FSCK shows overall health status as corrupt even one replica is corrupt | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Fix NPE in LazyPersistFileScrubber | Major | . | igo Goiri | igo Goiri | | | Completed files lost after power failure | Critical | . | Dave Latham | Vinayakumar B | | | Fix TestDFSShell.testMoveWithTargetPortEmpty failure. | Major | test | Konstantin Shvachko | Brahma Reddy Battula | | | Long running balancer may fail due to expired DataEncryptionKey | Major | balancer & mover | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates | Major | hdfs-client, rolling upgrades | Vinayakumar B | Vinayakumar B | | | Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures | Major | build | Akira Ajisaka | Akira Ajisaka | | | ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression | Major |

| Bibin A Chundatt | Bibin A Chundatt | | | Positional read will fail if replicas moved to different DNs after stream is opened | Critical | hdfs-client | Vinayakumar B | Vinayakumar B | | | Revert the incompatible fsck reporting output in HDFS-7933 from branch-2.7 | Blocker | namenode | Zhe Zhang | Zhe Zhang | | | Parent spans are not initialized to NullScope for every DFSPacket | Major | tracing | Karan Mehta | Masatake Iwasaki | | | Fix findbugs warnings in SLSCapacityScheduler.java | Major | . | Akira Ajisaka | Akira Ajisaka | | | OIV tests should not write outside 'target' directory. | Major | . | Konstantin Shvachko | Yiqun Lin | | | launchTime may be negative | Major | jobhistoryserver, mrv2 | Allen Wittenauer | zhihai xu | | | Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe | Major | security | Benoy Antony | Benoy Antony | | | StringIndexOutOfBoundsException breaks org.apache.hadoop.util.Shell on 2.7.x with Java 9 | Minor | common | Uwe Schindler | Akira Ajisaka | | | Concurrent task limits should only be applied when necessary | Major | mrv2 | Jason Lowe | Nathan Roberts | | | AM attempt fail to register before RM processes launch event | Critical | resourcemanager | Jason Lowe | Bibin A Chundatt | | | User limit per partition is not honored in branch-2.7 \>= | Major | . | Jonathan Hung | Jonathan Hung | | | Update CHANGES.txt to reflect all the changes in branch-2.7 | Blocker | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Fix inconsistent replica size after a data pipeline failure | Critical | datanode | Wei-Chiu Chuang | Erik Krogen | | | NameNode exits due to setting BlockPlacementPolicy loglevel to Debug | Major | block placement | Jiandan Yang | Jiandan Yang | | | Improve balancer usability after HDFS-8818 | Blocker | . | Kihwal Lee | Kihwal Lee | | | Branch-2.7 .gitignore is out of date | Blocker | build, precommit | Sean Busbey | Sean Busbey | | | Non-dfsUsed will be doubled on dead node re-registration | Blocker | . | Brahma Reddy Battula | Brahma Reddy Battula | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Allow reseting KerberosName in unit tests | Minor | . | Xiao Chen | Xiao Chen | | | TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup | Minor | nodemanager | Daniel Templeton | Daniel Templeton | | | TestRMDelegationTokens fails intermittently | Major | test | Rohith Sharma K S | Jason Lowe | | | TestActiveStandbyElector fails occasionally in trunk | Minor | . | Ted Yu | Eric Badger | | | TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts | Minor |

| Xiao Chen | Xiao Chen | | | Some tests using MiniDFSCluster errored complaining port in use | Minor | test | Kai Zheng | Masatake Iwasaki | | | TestFSNameSystemMBean should wait until JMX cache is cleared | Major | test | Akira Ajisaka | Erik Krogen | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add a metric for number of encryption zones | Major | encryption | Rakesh R | Rakesh R | | | Do not use small blocks for balancing the cluster | Major | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | NNThroughputBenchmark replication test NPE with -namenode option | Major | benchmarks | Xiaoyu Yao | Mingliang Liu | | | TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently | Major | test | Varun Saxena | Varun Saxena | | | getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory | Critical | erasure-coding | Sushmitha Sreenivasan | Jing Zhao | | | NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block | Major | test | Masatake Iwasaki | Masatake Iwasaki | | | TestRMAppTransitions.testAppRunningKill and testAppKilledKilled fail on trunk | Major | resourcemanager, test | Takashi Ohnishi | Takashi Ohnishi | | | Replace -namenode option with -fs for NNThroughputBenchmark | Major | test | Konstantin Shvachko | Mingliang Liu | | | Add jitter to CachingGetSpaceUsed's thread | Major | . | Elliott Clark | Elliott Clark | | | Optimize conversion from path string to components | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Optimize conversion of byte arrays back to path string | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Optimize creating a full path from an inode | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Fix path related byte array conversion bugs | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Optimize UTF8 string/byte conversions | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Optimize FSPermissionChecker's internal path usage | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Internally optimize path component resolution | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Cache path in InodesInPath | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Move lock logging logic from FSNamesystem into FSNamesystemLock | Major | namenode | Erik Krogen | Erik Krogen | | | Directly resolve paths into INodesInPath | Major | hdfs | Daryn Sharp | Daryn Sharp | | | RPC Server signals backoff to clients when all request queues are full | Major | . | Ming Ma | Ming Ma | | | Allowed deferred sending of call responses | Major | ipc | Daryn Sharp | Daryn Sharp | | | Add MutableRate metrics for FSNamesystemLock operations | Major | namenode | Erik Krogen | Erik Krogen | | | document object store use with fs shell and distcp | Major | documentation, fs, fs/s3 | Steve Loughran | Steve Loughran | | | Allow Balancer to run faster | Major | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | RM container allocation delayed incase of app submitted to Nodelabel partition | Major | scheduler | Bibin A Chundatt | Bibin A Chundatt | | JIRA | Summary | Priority | Component | Reporter