Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.8.2.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add ability to secure log servlet using proxy users | Major | . | Jeffrey E Rodriguez | Yuanbo Liu | | | Set default ADLS access token provider type to ClientCredential | Major | fs/adl | John Zhuge | John Zhuge | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | DirectoryScanner shouldn't abort the scan if one directory had an error | Major | datanode | Rakesh R | Rakesh R | | | Upgrade Domains in HDFS | Major | . | Ming Ma | Ming Ma | | | Make class Token$PrivateToken private | Minor | . | John Zhuge | John Zhuge | | | Stop bundling HTML source code in javadoc JARs | Major | build | Andrew Wang | Andrew Wang | | | Cleanup DiskChecker interface | Major | util | Arpit Agarwal | Arpit Agarwal | | | Include file lengths in Mismatch in length error for distcp | Minor | . | Ted Yu | Ted Yu | | | NameNode WebUI should display DataNode usage histogram | Major | namenode, ui | Zhe Zhang | Kai Sasaki | | | Add process name to kms process | Minor | kms, scripts | Rushabh S Shah | Rushabh S Shah | | | Add process name to httpfs process | Minor | httpfs, scripts | John Zhuge | Weiwei Yang | | | Print a user friendly error message when plugins are not found | Minor | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms | Major | namenode | Andrew Wang | Andrew Wang | | | Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands | Major | federation | Brahma Reddy Battula | Brahma Reddy Battula | | | Implement listStatusIterator, listLocatedStatus for ViewFs | Minor | viewfs | Erik Krogen | Erik Krogen | | | Delay construction of PreCondition.check failure message in Configuration#set | Major | . | Jonathan Eagles | Jonathan Eagles | | | Configuration#get return value optimization | Major | . | Jonathan Eagles | Jonathan Eagles | | | Improve performance for createAndGetApplicationReport | Major | . | yunjiong zhao | yunjiong zhao | | | Refine the behaviour of getFileChecksum when length = 0 | Minor | . | Kai Zheng | Sammi Chen | | | Clarify the behavior of HDFS Mover in documentation | Major | documentation | Xiaobing Zhou | Xiaobing Zhou | | | Client should always ask namenode for kms provider path. | Major | kms | Rushabh S Shah | Rushabh S Shah | | | Add a nanosecond API to Time/Timer/FakeTimer | Minor | util | Erik Krogen | Erik Krogen | | | BPServiceActor thread name is too long | Minor | datanode | Tsz Wo Nicholas Sze | Xiaobing Zhou | | | Lazy construct the IIP pathname | Major | . | Daryn Sharp | Daryn Sharp | | | Optimize BlockIterator when iterating starts in the middle. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Add option for balancer to disperse getBlocks calls to avoid NameNode's

spike | Major | balancer & mover | yunjiong zhao | Konstantin Shvachko | | | Allow custom SSL configuration to be supplied in WebApps | Major | webapp, yarn | Sanjay M Pujare | Sanjay M Pujare | | | Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Print requested node partition in assignContainer logs | Major | . | Jonathan Hung | Jonathan Hung | | | DU#refresh should print the path of the directory when an exception is caught | Minor | . | Chen Liang | Chen Liang | | | Add metrics for connections dropped | Major | . | Eric Badger | Eric Badger | | | ipc.Client.Connection#sendRpcRequest should log request name | Trivial | ipc | John Zhuge | John Zhuge | | | Document the configuration key for FSNamesystem lock fairness | Minor | documentation, namenode | Zhe Zhang | Erik Krogen | | | LevelDBCacheTimelineStore should reuse ObjectMapper instances | Major | timelineserver | Zoltan Haindrich | Zoltan Haindrich | | | Specifically configure zookeeper-related log levels in KMS log4j | Major | kms | Xiao Chen | Xiao Chen | | | NameNode consumes a lot of memory for snapshot diff report generation | Major | hdfs, snapshots | Manoj Govindassamy | Manoj Govindassamy | | | Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption | Major | . | Misha Dmitriev | Misha Dmitriev | | | Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml | Minor | documentation, hdfs | Weiwei Yang | Weiwei Yang | | | Improve exception checking in FileContext related JUnit tests | Major | fs, test | Andras Bokor | Andras Bokor | | | DN dataset lock should be fair | Critical | datanode | Daryn Sharp | Daryn Sharp | | | UGI getShortUserName does not need to search the Subject | Major | common | Daryn Sharp | Daryn Sharp | | | Improve performance of yarn api record toString and fromString | Major | . | Jonathan Eagles | Jonathan Eagles | | | Support user-specific minimum user limit percentage in Capacity Scheduler | Major | capacityscheduler | Eric Payne | Eric Payne | | | Queue path is recomputed from scratch on every allocation | Minor | capacityscheduler | Jason Lowe | Eric Payne | | | NN File Browser UI: Navigate to a path when enter is pressed | Trivial | ui | Ravi Prakash | Ravi Prakash | | | Credential provider should handle property key deprecation | Critical | security | John Zhuge | John Zhuge | | | Backport MAPREDUCE-6870 to branch-2 while preserving compatibility | Major |

| Zhe Zhang | Peter Bacsko | | | NMLeveldbStateStore should be more tolerant of unknown keys | Major | nodemanager | Jason Lowe | Ajith S | | | Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager | Major | nodemanager | Vinod Kumar Vavilapalli | Shane Kumpf | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestYarnVersionInfo failing if generated properties doesn't include an SVN URL | Minor | api | Steve Loughran | Steve Loughran | | | The SLS simulator is not running the preemption policy for CapacityScheduler | Minor | . | Carlo Curino | Carlo Curino | | | git should ignore .DS\_Store files on Mac OS X | Major | . | Abin Shahab | Abin Shahab | | | Fix rumen and scheduler load simulator handle killed tasks properly | Major | . | Ming Ma | Ming Ma | | | container-executor fails to remove directory tree when chmod required | Major | nodemanager | Colin P. McCabe | Colin P. McCabe | | | container-executor should not follow symlinks in recursive\unlink\children | Blocker | . | Bibin A Chundatt | Colin P. McCabe | | | TestFairScheduler#testContinuousScheduling fails intermittently | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla | | | TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler | Major | test | Karthik Kambatla | Bibin A Chundatt | | | YARN WebApp ignores the configuration passed to it for keystore settings | Major | . | Sergey Shelukhin | Sergey Shelukhin | | | Failed to Update HDFS Delegation Token for long running application in HA mode | Major | fs, ha, security | Liangliang Gu | Liangliang Gu | | | Some recovered apps are put into default queue when RM HA | Major | . | Jun Gong | Jun Gong | | | KMS should reload whitelist and default key ACLs when hot-reloading | Major | kms | Xiao Chen | Xiao Chen | | | Trash does not descent into child directories to check for permissions | Critical | fs, security | Eric Yang | Weiwei Yang | | | Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHang | Major | test | Rohith Sharma K S | Varun Saxena | | | FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations | Major | . | Vinayakumar B | Vinayakumar B | | | FsPermission string constructor does not recognize sticky bit | Major | . | Atul Sikaria | Atul Sikaria | | | RM unable to start in secure setup | Blocker | . | Ajith S | Ajith S | | | TimelineServer fails to start when some LevelDb state files are missing. | Critical | . | Ravi Prakash | Ravi Prakash | | | TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error | Major | fs/adl, test | John Zhuge | John Zhuge | | | Path globbing does not match newlines | Major | . | Eric Badger | Eric Badger | | | TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails in trunk | Minor | . | Yiqun Lin | Yiqun Lin | | | Synchronization issue in delegation token cancel functionality | Major | . | Hrishikesh Gadre | Hrishikesh Gadre | | | Balancer hung due to no available mover threads | Major | balancer & mover | yunjiong zhao | yunjiong zhao | | | Application recovery has failed when node label feature is turned off during RM recovery | Minor | scheduler | Ying Zhang | Ying Zhang | | | Yarn client implicitly invoke ATS client which accesses HDFS | Major | . | Yesha Vora | Li Lu | | | Race in UGI.reloginFromKeytab | Major | security | Duo Zhang | Duo Zhang | | |

NativeS3FileSystemContractBaseTest#testDirWithDifferentMarkersWorks | Minor | fs/s3, test | Akira Ajisaka | Yiqun Lin | | | Add a regression test for sticky bit support of OIV ReverseXML processor | Major | tools | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Numeric usernames do no work with WebHDFS FS (write access) | Major | webhdfs | Pierre Villard | Pierre Villard | | | 'storagepolicies -getStoragePolicy' command should accept URI based path. | Major | shell | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpc | Major | . | Eric Badger | Eric Badger | | | S3A can no longer handle unencoded + in URIs | Minor | fs/s3 | Sean Mackrory | Sean Mackrory | | | Fix dead link in MapReduce tutorial document | Minor | documentation | Akira Ajisaka | Victor Nee | | | Variable in byte printed directly in mapreduce client | Major | client | Nemo Chen | Kai Sasaki | | | NMTokenSecretManagerInRM.createAndGetNMToken is not thread safe | Major | yarn | Haibo Chen | Haibo Chen | | | start-build-env.sh: invalid docker image name | Major | build | Gerg Psztor | Gerg Psztor | | | Add escaping to error message in KMS web UI | Minor | security | Aaron T. Myers | Aaron T. Myers | | | Specify charset when create String in CredentialsTestJob | Minor | . | Akira Ajisaka | Kai Sasaki | | | Intra-queue preemption occurs even when preemption is turned off for a specific queue. | Major | capacity scheduler, scheduler preemption | Eric Payne | Eric Payne | | | OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions | Major | yarn | Haibo Chen | Haibo Chen | | | TestResources test timeouts are too aggressive | Major | test | Jason Lowe | Eric Badger | | | Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum | Minor | . | Eric Badger | Eric Badger | | | Decommissioning stuck because of failing recovery | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | | | RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode | Major | ha | Nanda kumar | Nanda kumar | | | ContainerKillEvent lost when container is still recovering and application finishes | Critical | nodemanager | sandflee | sandflee | | | TestLocalCacheDirectoryManager test timeout is too aggressive | Major | test | Jason Lowe | Miklos Szegedi | | | Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files | Major | fs/adl, test | Vishwajeet Dusane | Vishwajeet Dusane | | | S3A multipart commit failing, "UnsupportedOperationException at

| Critical | fs/s3 | Steve Loughran | Steve Loughran | | | No FileSystem for scheme: adl | Major | fs/adl | John Zhuge | John Zhuge | | | HttpFS doc errors | Trivial | documentation, httpfs, test | Yuanbo Liu | Yuanbo Liu | | | ViewFs should use underlying FileSystem's server side defaults | Major | fs, viewfs | Lohit Vijayarenu | Erik Krogen | | | DomainSocketWatcher::add()/delete() should not self interrupt while looping await() | Critical | hdfs-client | Mingliang Liu | Mingliang Liu | | | CredentialProviderFactory$getProviders is not thread-safe | Major | security | Vihang Karajgaonkar | Vihang Karajgaonkar | | | FilterFs and ChRootedFs are too aggressive about enforcing "authorityNeeded" | Major | viewfs | Erik Krogen | Erik Krogen | | | Fix getNumMapTasks() documentation in JobConf | Minor | documentation | Joe Mszros | Joe Mszros | | | License check for jdiff output files should be ignored | Major | build | Akira Ajisaka | Akira Ajisaka | | | OIV's ReverseXML processor cannot reconstruct some snapshot details | Major | tools | Colin P. McCabe | Akira Ajisaka | | | Client close() should not fail fast if the last block is being decommissioned | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang | | | TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition | Major | test | Robert Kanter | Robert Kanter | | | Memory leak in timeline server | Critical | timelineserver | Wataru Yukawa | Jonathan Eagles | | | FileContextMainOperationsBaseTest should clean up test root path | Minor | fs, test | Mingliang Liu | Mingliang Liu | | | Header injections are possible in application proxy servlet | Major | resourcemanager, security | Naganarasimha G R | Naganarasimha G R | | | MR Job Submission Fails if MR framework application path not on defaultFS | Minor | mrv2 | Erik Krogen | Erik Krogen | | | [S3A DOC] Correct the format for "Seoul" example | Minor | documentation, fs/s3 | Brahma Reddy Battula | Brahma Reddy Battula | | | Shuffle Handler keep-alive connections are closed from the server side | Major | . | Jonathan Eagles | Jonathan Eagles | | | Closing a file has a wasteful preconditions in NameNode | Major | namenode | Eric Badger | Eric Badger | | | LeveldbRMStateStore can parse invalid keys when recovering reservations | Major | resourcemanager | Jason Lowe | Jason Lowe | | | Fix markdown itemization in hadoop-aws documents | Minor | documentation, fs/s3 | Akira Ajisaka | Akira Ajisaka | | | TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low | Major | test | Jason Lowe | Eric Badger | | | RM startup failure due to wrong order in nodelabel editlog | Critical | . | Bibin A Chundatt | Bibin A Chundatt | | | Invalid local resource request can raise NPE and make NM exit | Major | nodemanager | Tao Yang | Tao Yang | | | Move ClientProtocol HA proxies into hadoop-hdfs-client | Blocker | hdfs-client | Andrew Wang | Huafeng Wang | | | TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently | Major | test | Jason Lowe | Jason Lowe | | | Revert HDFS-11431 hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider. | Major |

| Andrew Wang | Andrew Wang | | | Fix some release build issues | Blocker | build | Andrew Wang | Andrew Wang | | | HDFS write crashed with block size greater than 2 GB | Critical | hdfs-client | Xiaobing Zhou | Xiaobing Zhou | | | Exceptions during aggregated log writes are mishandled | Critical | log-aggregation | Akira Ajisaka | Akira Ajisaka | | | VersionInfo should be marked as public API | Critical | common | Thejas M Nair | Akira Ajisaka | | | Initialize FakeTimer with a less trivial value | Major | test | Andrew Wang | Andrew Wang | | | TestRMAdminCLI has very low test timeouts | Major | test | Jason Lowe | Eric Badger | | | Mover should move the file blocks to default storage once policy is unset | Major | balancer & mover | Surendra Singh Lilhore | Surendra Singh Lilhore | | | TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest | Major | test | Jason Lowe | Jason Lowe | | | FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close() | Critical | nodemanager | Daryn Sharp | Haibo Chen | | | TestCapacityScheduler.testAMLimitUsage fails intermittently | Major | . | Eric Badger | Eric Badger | | | Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart | Major | . | Eric Badger | Eric Badger | | | Add python2.7-dev to Dockerfile | Major | . | Allen Wittenauer | Allen Wittenauer | | | Skip rm.transitionToActive call to RM if RM is already active. | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | FSNamesystemLock metrics can be inaccurate due to millisecond precision | Major | hdfs | Erik Krogen | Erik Krogen | | | Remove non-existent setfattr command option from FileSystemShell.md | Minor | documentation | Doris Gu | Doris Gu | | | Python example in the rack awareness document doesn't work due to bad indentation | Minor | documentation | Kengo Seki | Kengo Seki | | | New exception thrown by DFSClient#isHDFSEncryptionEnabled broke hacky hive code | Major | . | Yongjun Zhang | Yongjun Zhang | | | Add a proper scheme to the datanode links in NN web UI | Major | . | Kihwal Lee | Kihwal Lee | | | Support multi-line value for ssl.server.exclude.cipher.list | Major | . | John Zhuge | John Zhuge | | | AMs only intended to run one attempt can be run more than once | Major | resourcemanager | Jason Lowe | Jason Lowe | | | CryptoOutputStream throws IOException on flush() if stream is closed | Major | . | Pierre Lacave | Pierre Lacave | | | StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully | Critical | ha, namenode | Zhe Zhang | Erik Krogen | | | fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 | Blocker | yarn | Haibo Chen | Haibo Chen | | | TestIPC.testIpcWithReaderQueuing fails intermittently | Major | . | Eric Badger | Eric Badger | | | TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently | Major | . | Eric Badger | Jason Lowe | | | Some blocks can be permanently lost if nodes are decommissioned while dead | Blocker | namenode | Kihwal Lee | Kihwal Lee | | | Blocks can be committed with wrong size | Critical | hdfs-client | Daryn Sharp | Jing Zhao | | | Newly added NN storage directory won't get initialized and cause space exhaustion | Critical | . | Kihwal Lee | Kihwal Lee | | | License error in TestLoadBalancingKMSClientProvider.java | Major | . | hu xiaodong | hu xiaodong | | | NetworkTopology calls expensive toString() when logging | Major | . | igo Goiri | igo Goiri | | | TestLocalFileSystem tests have very low timeouts | Major | . | Eric Badger | Eric Badger | | | TestSymlinkLocalFS timeouts are too low | Major | . | Eric Badger | Eric Badger | | | "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler | Blocker | rpc-server | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Remove indefinite caching of key provider uri in DFSClient | Major | hdfs-client | Rushabh S Shah | Rushabh S Shah | | | License error in GridmixTestUtils.java | Major | . | lixinglong | lixinglong | | | Upgrade Jsch jar to latest version to fix vulnerability in old versions | Critical |

| Vinayakumar B | Vinayakumar B | | | Increase Common test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | License error In org.apache.hadoop.metrics2.util.Servers | Major | . | hu xiaodong | hu xiaodong | | | Increase YARN test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | Increase MapReduce test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | Fix performance regression due to incorrect use of DataChecksum | Major | native, performance | LiXin Ge | LiXin Ge | | | Increase HDFS test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | Underconstruction blocks can be considered missing | Major | . | Nathan Roberts | Nathan Roberts | | | ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread | Major | capacityscheduler, resourcemanager | Min Shen | Min Shen | | | reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered | Critical | datanode | Vinayakumar B | Vinayakumar B | | | Memory leak when reading a compressed file using the native library | Major | common, io | Eli Acherkan | Eli Acherkan | | | TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently | Major | . | Eric Badger | Nathan Roberts | | | History server getApplicationReport NPE when fetching report for pre-2.8 job | Blocker | timelineserver | Jason Lowe | Jason Lowe | | | NPE in RMAppsBlock | Major | resourcemanager | Jason Lowe | Jason Lowe | | | HDFS architecture documentation describes outdated placement policy | Minor | . | dud | Chen Liang | | | HostsFileReader#getHostDetails is very expensive on large clusters | Major | util | Jason Lowe | Jason Lowe | | | Remove unused ContainerLocalization classes | Minor | nodemanager | ZhangBing Lin | ZhangBing Lin | | | TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once | Minor | test | Jason Lowe | Jason Lowe | | | JournalNode startup failure exception should be logged in log file | Major | journal-node | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Document Metrics to track usage of memory for writes | Major | documentation | Brahma Reddy Battula | Yiqun Lin | | | AmIpFilter drops query parameters on redirect | Major | . | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct | Minor | common, documentation | ZhangBing Lin | ZhangBing Lin | | | Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used | Major | common | Surendra Singh Lilhore | Surendra Singh Lilhore | | | GetContentSummary uses excessive amounts of memory | Blocker | namenode | Nathan Roberts | Wei-Chiu Chuang | | | ppc64le on Linux doesn't trigger \\linux get\_executable codepath | Major | nodemanager | Sonia Garudi | Ayappan | | | FSCK shows overall health status as corrupt even one replica is corrupt | Critical |

| Brahma Reddy Battula | Brahma Reddy Battula | | | TestRMFailover fails rarely due to port conflict | Major | test | Robert Kanter | Robert Kanter | | | A faulty node can cause a lease leak and NPE on accessing data | Critical | . | Kihwal Lee | Kihwal Lee | | | Non-public resource localization on a bad disk causes subsequent containers failure | Major | . | Kuhu Shukla | Kuhu Shukla | | | Fix NPE in LazyPersistFileScrubber | Major | . | igo Goiri | igo Goiri | | | hadoop-aws doc header warning #5 line wrapped | Trivial | documentation, fs/s3 | John Zhuge | John Zhuge | | | Completed files lost after power failure | Critical | . | Dave Latham | Vinayakumar B | | | RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception | Critical | . | Jonathan Eagles | Jonathan Eagles | | | Fix TestDFSShell.testMoveWithTargetPortEmpty failure. | Major | test | Konstantin Shvachko | Brahma Reddy Battula | | | Long running balancer may fail due to expired DataEncryptionKey | Major | balancer & mover | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates | Major | hdfs-client, rolling upgrades | Vinayakumar B | Vinayakumar B | | | Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures | Major | build | Akira Ajisaka | Akira Ajisaka | | | TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor | Major | . | Eric Badger | Eric Badger | | | BPServiceActor thread name is not correctly set | Major | hdfs | Chen Liang | Chen Liang | | | Positional read will fail if replicas moved to different DNs after stream is opened | Critical | hdfs-client | Vinayakumar B | Vinayakumar B | | | DN should not delete the block On "Too many open files" Exception | Critical | datanode | Brahma Reddy Battula | Brahma Reddy Battula | | | NNBench should Throw IOException when rename and delete fails | Major | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Fix typo in the top page in branch-2.8 | Trivial | common, documentation | Akira Ajisaka | Wenxin He | | | Internal lease recovery may not be retried for a long time | Major | namenode | Kihwal Lee | Kihwal Lee | | | WritableRpcEngine.Invocation#toString NPE on null parameters | Minor | ipc | John Zhuge | John Zhuge | | | WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename | Major | fs/azure | Duo Xu | Duo Xu | | | RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels. | Blocker | . | Eric Payne | Sunil Govindan | | | TestJMXGet fails occasionally | Major | . | Arpit Agarwal | Arpit Agarwal | | | Fix findbugs warnings in SLSCapacityScheduler.java | Major | . | Akira Ajisaka | Akira Ajisaka | | | Replace MRv1 specific terms in HostsFileReader | Minor | documentation | Akira Ajisaka | hu xiaodong | | | HDFS Architecture documentation incorrectly describes writing to a local temporary file. | Minor | documentation | Chris Nauroth | Nanda kumar | | | OIV tests should not write outside 'target' directory. | Major |

| Konstantin Shvachko | Yiqun Lin | | | Fix dead link in the Javadoc of FairSchedulerEventLog.java | Minor | documentation | Akira Ajisaka | Weiwei Yang | | | Size of args cannot be less than zero in TraceAdmin#run as its linkedlist | Trivial | common, tracing | Weisen Han | Weisen Han | | | Successfully closed files can stay under-replicated. | Critical | . | Kihwal Lee | Kihwal Lee | | | KerberosAuthenticationHandler should authenticate with SPN in AP-REQ | Major | security | Daryn Sharp | Daryn Sharp | | | CSQueueMetrics needs to update the current metrics for default partition only | Major | capacity scheduler | Naganarasimha G R | Manikandan R | | | KMS JMX endpoint throws ClassNotFoundException | Critical | kms | Andrew Wang | John Zhuge | | | TestAppSchedulingInfo.testPriorityAccounting fails consistently | Major | . | Eric Badger | Naganarasimha G R | | | Fix meaningless operations in TestDFSIO in some situation. | Major | tools/rumen | LiXin Ge | LiXin Ge | | | LocalJobRunner fails when run on a node from multiple users | Blocker | client | Jason Lowe | Jason Lowe | | | Hide Jetty Server version header in HTTP responses | Major | security | Vinayakumar B | Surendra Singh Lilhore | | | Fix ambiguous NN retry log message | Major | webhdfs | Eric Badger | Eric Badger | | | TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently | Major | . | Eric Badger | Eric Badger | | | Nodemanager container crash after ext3 folder limit | Critical | . | Bibin A Chundatt | Bibin A Chundatt | | | LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException | Major | . | Rushabh S Shah | Rushabh S Shah | | | DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2 | Major | mrv1, mrv2 | ramtin | Gergely Novk | | | Queue AM limit is not honored in CS always | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | [Docs] A small mistake in the example of TimelineClient | Trivial | docs | Jinjiang Ling | Jinjiang Ling | | | Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe | Major | security | Benoy Antony | Benoy Antony | | | Fix typo in ResourceManagerHA.md | Trivial | documentation | Akira Ajisaka | Yeliang Cang | | | mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time | Minor | jobhistoryserver | Shinichi Yamashita | Shinichi Yamashita | | | TimelineWriter does not fully consume the POST response | Major | timelineclient | Jason Lowe | Jason Lowe | | | Datanode UI should display hostname based on JMX bean instead of window.location.hostname | Major | hdfs | Jeffrey E Rodriguez | Jeffrey E Rodriguez | | | FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs | Minor | test | Andras Bokor | Andras Bokor | | | Concurrent task limits should only be applied when necessary | Major | mrv2 | Jason Lowe | Nathan Roberts | | | RollingLevelDBTimelineStore backwards incompatible after fst upgrade | Blocker |

| Jonathan Eagles | Jonathan Eagles | | | NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code | Major | nodemanager | Jason Lowe | Jason Lowe | | | AM attempt fail to register before RM processes launch event | Critical | resourcemanager | Jason Lowe | Bibin A Chundatt | | | Remove BPOfferService lock contention to get block pool id | Critical | datanode | Daryn Sharp | Daryn Sharp | | | TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE | Minor | . | Wei-Chiu Chuang | Wei-Chiu Chuang | | | MapReduceTrackingUriPlugin can not return the right URI of history server with HTTPS | Major | jobhistoryserver | Lantao Jin | Lantao Jin | | | Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protection | Major | namenode | Mukul Kumar Singh | Mukul Kumar Singh | | | Null LocalResource visibility or resource type can crash the nodemanager | Major | . | Jinjiang Ling | Jinjiang Ling | | | Fix inconsistent replica size after a data pipeline failure | Critical | datanode | Wei-Chiu Chuang | Erik Krogen | | | NameNode exits due to setting BlockPlacementPolicy loglevel to Debug | Major | block placement | Jiandan Yang | Jiandan Yang | | | Improve balancer usability after HDFS-8818 | Blocker | . | Kihwal Lee | Kihwal Lee | | | Non-dfsUsed will be doubled on dead node re-registration | Blocker | . | Brahma Reddy Battula | Brahma Reddy Battula | | | TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout | Major | test | Akira Ajisaka | Akira Ajisaka | | | Unexpected jackson-core-2.2.3 dependency introduced | Blocker | timelineserver | Jason Lowe | Jonathan Eagles | | | Preemption calculation is not accurate when reserved containers are present in queue. | Major | capacity scheduler | Sunil Govindan | Wangda Tan | | | FileStatus.compareTo binary compatible issue | Blocker | . | Sergey Shelukhin | Akira Ajisaka | | | Ensure apps could run given NodeLabels are disabled post RM switchover/restart | Major | resourcemanager | Sunil Govindan | Sunil Govindan | | | Nodemanager can fail to fully delete application local directories when applications are killed | Critical | nodemanager | Jason Lowe | Jason Lowe | | | MR job should only set tracking url if history was successfully written | Major | . | Eric Badger | Eric Badger | | | If UI is not secured, we allow user to kill other users' job even yarn cluster is secured. | Critical | . | Sumana Sathish | Junping Du | | | Disable setting tcp socket send/receive buffers for write pipelines | Major | datanode, hdfs | Daryn Sharp | Daryn Sharp | | | Do fsyncDirectory(..) outside of FSDataset lock | Critical | datanode | Vinayakumar B | Vinayakumar B | | | LeaseManager operations are inefficient in 2.8. | Blocker | namenode | Rushabh S Shah | Rushabh S Shah | | | Log app attempt during InvalidStateTransition | Major | . | Jonathan Eagles | Jonathan Eagles | | | TestAMRMProxy#testAMRMProxyTokenRenewal is flakey | Major | . | Robert Kanter | Robert Kanter | | | InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time | Critical | resourcemanager | Jian Fang | Jonathan Eagles | | | Fix tests faking kerberos to explicitly set ugi auth type | Major | yarn | Daryn Sharp | Daryn Sharp | | | AuthenticatedURL will reuse bad/expired session cookies | Critical | common | Daryn Sharp | Daryn Sharp | | | AM heartbeat stuck when responseId overflows MAX\_INT | Blocker | . | Botong Huang | Botong Huang | | | DirectoryScanner will throw IllegalStateException when Multiple BP's are present | Blocker |

| Brahma Reddy Battula | Brahma Reddy Battula | | | Race Between update pipeline and DN Re-Registration | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula | | | RM SchedulingMonitor gives no indication why the spawned thread crashed. | Critical | yarn | Eric Payne | Eric Payne | | | NM failed to perform log aggregation due to absent container | Blocker | log-aggregation | Jason Lowe | Jason Lowe | | | Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin | Critical | capacity scheduler, scheduler preemption, yarn | Eric Payne | Eric Payne | | | [branch-2.8.2] Fix the Compile Error after HDFS-12299 | Blocker | hdfs | Jiandan Yang | Jiandan Yang | | | TestAMRMProxy is failing with invalid request | Major | . | Jason Lowe | Jason Lowe | | | yarn application -list -appTypes \<appType\> is not working | Blocker | . | Jian He | Jian He | | | TestTaskAttempt fails in trunk | Major | test | Tsuyoshi Ozawa | Haibo Chen | | | Log aggregation deletes/renames while file is open | Critical | nodemanager | Daryn Sharp | Jason Lowe | | | Fix incompatible API change on FsServerDefaults to HADOOP-14104 | Blocker | . | Junping Du | Junping Du | | | Incorrect ReservationId.compareTo() implementation | Minor | reservation system | Oleg Danilov | Oleg Danilov | | | Hadoop 2.8.2 release build process get stuck due to java issue | Blocker | build | Junping Du | Junping Du | | | RM intermittently crashed with NPE while handling APP\ATTEMPT\REMOVED event when async-scheduling enabled in CapacityScheduler | Major | resourcemanager | Karam Singh | sandflee | | | DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor | Blocker | nodemanager | Miklos Szegedi | Miklos Szegedi | | | Remove unused container variable in DockerLinuxContainerRuntime | Minor | nodemanager | Shane Kumpf | Shane Kumpf | | | Fix the default docker binary path | Blocker | nodemanager | Shane Kumpf | Shane Kumpf | | | container-executor fails to remove entries from a directory that is not writable or executable | Critical | . | Jason Lowe | Jason Lowe | | | Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature | Blocker | documentation | Junping Du | Shane Kumpf | | | CLONE - Fix source-level compatibility after HADOOP-11252 | Blocker | . | Junping Du | Junping Du | | | NM print inappropriate error log when node-labels is enabled | Minor | . | Yang Wang | Yang Wang | | | Fix CapacityScheduler NPE issue when a container preempted while the node is being removed | Blocker | . | Wangda Tan | Wangda Tan | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestDirectoryScanner.testThrottle() is still a little flakey | Major | balancer & mover, test | Daniel Templeton | Daniel Templeton | | | TestShellBasedIdMapping.testStaticMapUpdate doesn't work on OS X | Major | test | Allen Wittenauer | Kai Sasaki | | | TestContinuousScheduling#testSortedNodes fails intermittently | Minor | . | sandflee | Yufei Gu | | | Flaky test

| Major | mrv2 | Peter Bacsko | Peter Bacsko | | | TestFSNameSystemMBean should wait until JMX cache is cleared | Major | test | Akira Ajisaka | Erik Krogen | | | TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently | Minor | . | sandflee | Jason Lowe | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Reduce fair call queue priority inversion | Major | ipc | Daryn Sharp | Daryn Sharp | | | Allow ipc layer exceptions to selectively close connections | Major | ipc | Daryn Sharp | Daryn Sharp | | | Reduce fair call queue lock contention | Major | ipc | Daryn Sharp | Daryn Sharp | | | Remove URI parameter in AWSCredentialProvider constructors | Major | fs/s3 | Mingliang Liu | Mingliang Liu | | | Azure Data Lake doc is missing required config entry | Major | fs/adl | Atul Sikaria | Atul Sikaria | | | Fix ADLS doc for credential provider | Major | documentation, fs/adl | John Zhuge | John Zhuge | | | TestAdlFileSystemContractLive fails to clean up | Minor | fs/adl, test | John Zhuge | John Zhuge | | | Rename ADLS credential properties | Minor | fs/adl | John Zhuge | John Zhuge | | | Explicitly exclude S3A root dir ITests from parallel runs | Minor | fs/s3, test | Steve Loughran | Steve Loughran | | | Add ADLS sensitive config keys to default list | Minor | fs, fs/adl, security | John Zhuge | John Zhuge | | | Rename ADLS CONTRACT\ENABLE\KEY | Minor | fs/adl | Mingliang Liu | Mingliang Liu | | | Provide configuration support for upgrade domain | Major | . | Ming Ma | Ming Ma | | | Display upgrade domain information in fsck | Major | . | Ming Ma | Ming Ma | | | Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes | Minor | . | Chris Trezzo | Chris Trezzo | | | Reduce fair call queue backoff's impact on clients | Major | ipc | Daryn Sharp | Daryn Sharp | | | Improve performance of AssignmentInformation datastructures | Major | . | Daryn Sharp | Daryn Sharp | | | Avoid locking overhead for NO\_LABEL lookups | Major | resourcemanager | Daryn Sharp | Daryn Sharp | | | Eliminate double-copy of child queues in canAssignToThisQueue | Major | resourcemanager | Daryn Sharp | Daryn Sharp | | | Add cross-user preemption within CapacityScheduler's leaf-queue | Major | capacity scheduler | Vinod Kumar Vavilapalli | Sunil Govindan | | | CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls | Major | capacityscheduler | Nathan Roberts | Nathan Roberts | | | container-executor fails for docker when command length \> 4096 B | Major | yarn | Eric Badger | Eric Badger | | | Change hosts JSON file format | Major | . | Ming Ma | Ming Ma | | | Avoid unnecessary getBlockCollection calls in BlockManager | Major | namenode | Jing Zhao | Jing Zhao | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Revert HADOOP-13606 swift FS to add a service load metadata file | Major | . | John Zhuge | John Zhuge | | | Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully | Minor | ha, namenode | Erik Krogen |