Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.3.2.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate keys | Minor | capacityscheduler | Tao Yang | Tao Yang | | | Remove DataOutputByteBuffer | Minor | common | BELUGA BEHR | BELUGA BEHR | | | Fair scheduler: queue deletion without RM restart | Major | fairscheduler | Gergo Repas | Gergo Repas | | | Upgrade common-lang version to 3.7 in hadoop-common-project and hadoop-tools | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | EC: No error message for unsetting EC policy of the directory inherits the erasure coding policy from an ancestor directory | Minor | erasure-coding | Souryakanta Dwivedy | Ayush Saxena | | | Remove s3a user:secret authentication | Major | fs/s3, security | Steve Loughran | Steve Loughran | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Flexible Visual Studio support | Major | build | Allen Wittenauer | Allen Wittenauer | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | NUMA awareness support for launching containers | Major | nodemanager, yarn | Olasoji | Devaraj K | | | Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts | Major | datanode, distcp, erasure-coding, federation, hdfs | Dennis Huo | Dennis Huo | | | Percentage based Reserved Space Calculation for DataNode | Major | datanode, hdfs | Lukas Majercak | Lukas Majercak | | | HDFS Block Placement - Ignore Locality for First Block Replica | Minor | block placement, hdfs-client | BELUGA BEHR | BELUGA BEHR | | | Add IsActiveServlet to be used for Load Balancers | Major | common | Lukas Majercak | Lukas Majercak | | | Support Node Attribute functionality | Major | api, client, RM | Wangda Tan | Naganarasimha G R | | | Storage Policy Satisfier in HDFS | Major | datanode, namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Support Windows Azure Storage - Blob file system in Hadoop | Blocker | fs/azure | Esfandiar Manii | Da Zhou | | | Readiness check for remote service belonging to the same user | Major | yarn-native-services | Eric Yang | Eric Yang | | | Implement an async pure c++ HDFS client | Major | hdfs-client | Owen O'Malley | James Clampffer | | | Stabilise FileSystem builder-based create API | Major | fs | Steve Loughran | Lei (Eddy) Xu | | | Plugin interface to support more complex usernames in Hadoop | Major | security | Eric Yang | Bolke de Bruin | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Support authorizeUserAccessToQueue in RMWebServices | Major | . | Wangda Tan | Wangda Tan | | | Fix typos in hadoop-aws markdown docs | Minor | . | Gabor Bota | Gabor Bota | | | Remove jdk1.7 profile from hadoop-annotations module | Minor | . | Akira Ajisaka | fang zhenyi | | | Remove redundant logging related to tags from Configuration | Major | . | Ajay Kumar | Ajay Kumar | | | The vmemLimit parameter

ContainersMonitorImpl#isProcessTreeOverLimit is confusing | Trivial | nodemanager | Sen Zhao | Sen Zhao | | | Improve AclException message "Invalid ACL: only directories may have a default ACL." | Minor | . | Wei-Chiu Chuang | Gabor Bota | | | Update ADLS connector to use the current SDK version (2.2.7) | Major | fs/adl | Atul Sikaria | Atul Sikaria | | | Include LocalizedResource size information in the NM download log for localization | Minor | . | Kuhu Shukla | Kuhu Shukla | | | Ability to configure auxiliary services from HDFS-based JAR files | Major | nodemanager | john lilley | Xuan Gong | | | Record file path when FSDirAclOp throws AclException | Minor | . | Wei-Chiu Chuang | Gabor Bota | | | Add ability to specify user environment variables individually | Major | . | Jim Brennan | Jim Brennan | | | NetworkTopology should be configurable when enable DFSNetworkTopology | Major | . | Tao Jie | Tao Jie | | | Add test case for read block operation when it is moved | Major | . | Ajay Kumar | Ajay Kumar | | | Add BIND\_HOST configuration for JournalNode's HTTP and RPC Servers | Major | hdfs, journal-node | Lukas Majercak | Lukas Majercak | | | Upgrade the version of commons-lang3 to 3.7 | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Remove method AllocationConfiguration#getQueueAcl and related unit tests | Minor | fairscheduler | Yufei Gu | Sen Zhao | | | Cleanup RackResolver.java | Minor | yarn | BELUGA BEHR | BELUGA BEHR | | | Improve log in DirectoryCollection constructor | Major | nodemanager | Yufei Gu | Yufei Gu | | | Add erasure coding metrics into ReadStatistics | Major | erasure-coding | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Improve log message when launch cmd is ran for stopped yarn service | Major | yarn-native-services | Yesha Vora | Eric Yang | | | Add config to allow FileInputFormat to ignore directories when recursive=false | Major | . | Sergey Shelukhin | Sergey Shelukhin | | | Improve debug messages in MetricsConfig.java | Minor | common | BELUGA BEHR | BELUGA BEHR | | | Improve anti-affinity section description in YARN Service API doc | Major | docs, documentation | Charan Hebri | Gour Saha | | | Log kinit output in credential renewal thread | Minor | security | Wei-Chiu Chuang | Gabor Bota | | | Add support for Node Labels in opportunistic scheduling. | Major | . | Abhishek Modi | Abhishek Modi | | | Documentation should clarify

impact from reserved disk capacity | Minor | documentation | Alexander Fahlke | Gabor Bota | | | Use assertEquals instead of assertTrue(a == b) in TestMapReduceJobControlWithMocks | Minor | test | Akira Ajisaka | Abhishek Modi | | | renameSnapshot a Non-Existent snapshot to itself should throw error | Minor | hdfs | Sailesh Patel | Kitti Nanasi | | | [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI | Major | yarn-ui-v2 | Sumana Sathish | Sunil Govindan | | | [UI2] Per-application tracking URL is no longer available in YARN UI2 | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan | | | Make HTTP timeout configurable in ADLS Connector | Major | fs/adl | Atul Sikaria | Atul Sikaria | | | Skip stacktrace of few exception from ClientRMService | Minor | . | Bibin A Chundatt | Bilwa S T | | | hadoop-aliyun & hadoop-azure modules to mark hadoop-common as provided | Major | build, fs/azure, fs/oss | Steve Loughran | Steve Loughran | | | FairScheduler: Add steady-fair-shares to the REST API documentation | Major | documentation, fairscheduler | Karthik Kambatla | Ray Chiang | | | Log kms url and token service at debug level. | Minor | . | Wei-Chiu Chuang | Gabor Bota | | | Improve logging for JournalNode in federated cluster | Major | federation, hdfs | Hanisha Koneru | Hanisha Koneru | | | Few REST api's in RMWebServices are missing static user check | Critical | webapp, yarn | Sunil Govindan | Sunil Govindan | | | Skip compiling old hamlet package when the Java version is 10 or upper | Major | webapp | Akira Ajisaka | Dinesh Chitlangia | | | WebHdfs getFileStatus doesn't return ecPolicy | Major | . | Ajay Kumar | Ajay Kumar | | | Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong | Critical | ipc, net | Greg Senia | Ajay Kumar | | | Abstract new method assertCapability for StreamCapabilities testing | Minor | test | Xiao Chen | Zsolt Venczel | | | Add Security-Related HTTP Response Header in WEBUIs. | Major | . | Kanwaljeet Sachdev | Kanwaljeet Sachdev | | | Add dfsAdmin command to query if "upgrade" is finalized | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Make NetworkTopology#netLock fair | Major | net | Nanda kumar | Nanda kumar | | | Reduce the HttpServer2 thread count on DataNodes | Major | datanode | Erik Krogen | Erik Krogen | | | Reduce unnecessary byte-to-string transform operation in INodesInPath#toString | Minor | . | Yiqun Lin | Gabor Bota | | | Add Capacity Scheduler performance metrics | Critical | capacityscheduler, metrics | Weiwei Yang | Weiwei Yang | | | Make unjar in RunJar overrideable | Trivial | . | Johan Gustavsson | Johan Gustavsson | | | Update Archival Storage doc for Provided Storage | Major | documentation | Takanobu Asanuma | Takanobu Asanuma | | | Increase default timeout of ZK session to avoid frequent NameNode failover | Critical | common | Karthik Palanisamy | Karthik Palanisamy | | | Upgrade common-langs version to 3.7 in hadoop-mapreduce-project | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Load balance YARN services using RegistryDNS multiple A records | Major | yarn-native-services | Eric Yang | Eric Yang | | | Log HDFS file name when client fails to connect | Trivial | . | Wei-Chiu Chuang | Gabor Bota | | | [KMS] Add missing configuration properties into kms-default.xml | Minor | kms | Wei-Chiu Chuang | Chetna Chaudhari | | | Add checkOperation(WRITE) checks in FSNamesystem | Major | ha, namenode | Erik Krogen | Chao Sun | | | BlockPlacementPolicyDefault.chooseTargetInOrder Not Checking Return Value for NULL | Minor | namenode | BELUGA BEHR | Zsolt Venczel | | | Improve the description of machine-list property in Federation docs | Major | documentation, federation | Takanobu Asanuma | Takanobu Asanuma | | | Add MapReduce counters about EC bytes read | Major | . | Xiao Chen | Xiao Chen | | | Provide specialized exception when block length cannot be obtained | Major |

| Ted Yu | Gabor Bota | | | clean up Shell from JDK7 workarounds | Minor | common | Steve Loughran | Zsolt Venczel | | | Add more test coverage for contentSummary for snapshottable path | Major | namenode, test | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Preempt opportunistic containers when root container cgroup goes over memory limit | Major | nodemanager | Haibo Chen | Haibo Chen | | | Fix typos in YARN Federation documentation page | Trivial | . | Bibin A Chundatt | Giovanni Matteo Fumarola | | | Performance severe drop when running RawErasureCoderBenchmark with NativeRSRawErasureCoder | Major | . | Sammi Chen | Sammi Chen | | | Change log level when there is an IOException when the allocation file is loaded | Minor | fairscheduler | Haibo Chen | Szilard Nemeth | | | AllocationFileLoaderService. getAllocationFile() should be declared as VisibleForTest | Trivial | fairscheduler | Haibo Chen | Szilard Nemeth | | | Make dfs.client.failover.random.order a per nameservice configuration | Major | federation | Ekanth Sethuramalingam | Ekanth Sethuramalingam | | | Upgrade commons-lang version to 3.7 in hadoop-yarn-project | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Miscellaneous QueueManager code clean up | Minor | fairscheduler | Haibo Chen | Szilard Nemeth | | | Improve data locality documentation for Capacity Scheduler | Major | . | Weiwei Yang | Weiwei Yang | | | Add metrics for edit log tailing | Major | metrics | Chao Sun | Chao Sun | | | Improve backward compatibility for HDFS-13176 (WebHdfs file path gets truncated when having semicolon (;) inside) | Major | . | Zsolt Venczel | Zsolt Venczel | | | Add overall metrics for FSNamesystemLock | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | | | Upgrade common-lang version to 3.7 in hadoop-hdfs-project | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Fix log level inconsistency in CombineFileInputFormat.java | Minor | client | BELUGA BEHR | Vidura Bhathiya Mudalige | | | Typo in YarnConfiguration javadoc: "Miniumum request grant-able.." | Trivial | . | Szilard Nemeth | Szilard Nemeth | | | Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl | Minor | client, yarn | Yufei Gu | Szilard Nemeth | | | Strange characters and missing spaces in FairScheduler documentation | Major | . | Szilard Nemeth | Szilard Nemeth | | | Typo in CSQueueUtils local variable names: queueGuranteedResource | Trivial | resourcemanager | Szilard Nemeth | Szilard Nemeth | | | Typos in test names in TestTaskAttempt: "testAppDiognostic" | Minor | . | Szilard Nemeth | Szilard Nemeth | | | Avoid use of Java8 streams in Configuration.addTags | Major | performance | Todd Lipcon | Todd Lipcon | | | StorageInfoDefragmenter floods log when compacting StorageInfo TreeSet | Minor | . | Yiqun Lin | Bharat Viswanadham | | | Change default RegistryDNS port | Major |

| Billie Rinaldi | Billie Rinaldi | | | Support strict memory control on individual container with elastic control memory mechanism | Major | nodemanager | Haibo Chen | Haibo Chen | | | Replace/improve Hadoop's byte[] comparator | Major | common | Vikas Vishwakarma | Vikas Vishwakarma | | | Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit | Major | performance | Todd Lipcon | Todd Lipcon | | | Improve JIT performance for Configuration parsing | Minor | conf, performance | Todd Lipcon | Todd Lipcon | | | [PROVIDED Storage] HA for InMemoryAliasMap | Major | . | Virajith Jalaparti | Virajith Jalaparti | | | Fix TestNameNodePrunesMissingStorages test failures on Windows | Major | hdfs, namenode, test | Lukas Majercak | Lukas Majercak | | | BlockReaderRemote.read() logging improvement | Minor | hdfs-client | Gergo Repas | Gergo Repas | | | ATS v2 should handle HBase connection issue properly | Major | ATSv2 | Yesha Vora | Billie Rinaldi | | | Docs around dfs.image.transfer.timeout are misleading | Major | documentation | Kitti Nanasi | Kitti Nanasi | | | KMSClientProvider should log KMS DT acquisition at INFO level | Minor | kms | Kitti Nanasi | Kitti Nanasi | | | Set default jetty log level to INFO in KMS | Major | . | Kitti Nanasi | Kitti Nanasi | | | fix some typos in the .sh comments | Trivial | bin | Steve Loughran | Steve Loughran | | | Use path strings consistently for webservice endpoints in RMWebServices | Major | . | Szilard Nemeth | Szilard Nemeth | | | Use commons-text instead of commons-lang in some classes to fix deprecation warnings | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | DataChecksum calculate checksum is contented on hashtable synchronization | Major | common | Prasanth Jayachandran | Prasanth Jayachandran | | | Single parameter Resource / LightWeightResource constructor looks confusing | Major | api | Szilard Nemeth | Szilard Nemeth | | | Change App Name Placement Rule to use App Name instead of App Id for configuration | Major | yarn | Zian Chen | Zian Chen | | | Improve error message when creating encryption zone while KMS is unreachable | Minor | encryption, hdfs, kms | Kitti Nanasi | Kitti Nanasi | | | Reduce complexity of RMWebServices' getApps method | Major | restapi | Szilard Nemeth | Szilard Nemeth | | | DiskValidator is not used in LocalDirAllocator | Major | . | Haibo Chen | Szilard Nemeth | | | Stack trace should not be printed out when running hadoop key commands | Minor | common | Kitti Nanasi | Kitti Nanasi | | | Fix wrong log statement in AbstractService | Minor | util | Szilard Nemeth | Szilard Nemeth | | | Clean up lock-try order in fair scheduler | Major | fairscheduler | Daniel Templeton | Szilard Nemeth | | | Add toString Method to AclFeature Class | Minor | . | Shweta | Shweta | | | Retry KMS calls when SSLHandshakeException occurs | Major | common, kms | Kitti Nanasi | Kitti Nanasi | | | Improve exception when tfile fails to load LzoCodec | Major | . | Gera Shegalov | Gera Shegalov | | | make DEFAULT\MAX\CORRUPT\FILEBLOCKS\RETURNED configurable | Minor | hdfs | Lantao Jin | Lantao Jin | | | Log more details for FairCallQueue | Minor | . | Ryan Wu | Ryan Wu | | | Log full stack trace if DiskBalancer exits with an unhandled exception | Minor | diskbalancer | Stephen O'Donnell | Gabor Bota | | | getContainer and getContainers ResourceManager REST API methods are not documented | Major | resourcemanager | Szilard Nemeth | Antal Blint Steinbach | | | Add diagnostic message for unschedulable containers | Major | resourcemanager | Szilard Nemeth | Szilard Nemeth | | | Several typos in Log Aggregation related classes | Minor |

| Szilard Nemeth | Szilard Nemeth | | | Improve ATSv2 client logging in RM and NM publisher | Major | . | Rohith Sharma K S | Abhishek Modi | | | fix logging for split-dns multihome | Major | . | Ajay Kumar | Ajay Kumar | | | Enable fair scheduler to refresh maximum allocation for multiple resource types | Major | fairscheduler | Yufei Gu | Szilard Nemeth | | | Allow verbosity of InMemoryLevelDBAliasMapServer to be configurable | Trivial | . | Virajith Jalaparti | Virajith Jalaparti | | | Disk Balancer should not fail if volume usage is greater than capacity | Minor | diskbalancer | Stephen O'Donnell | Stephen O'Donnell | | | Fix Typos - Node Not Chosen | Trivial | namenode | BELUGA BEHR | BELUGA BEHR | | | Print ExecutionType in Container report CLI | Minor | . | Bilwa S T | Bilwa S T | | | Expose HighestPriorityLowRedundancy blocks statistics | Major | hdfs | Kitti Nanasi | Kitti Nanasi | | | Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md | Minor | yarn | Antal Blint Steinbach | Antal Blint Steinbach | | | Make QJM HTTP URL connection timeout configurable | Minor | qjm | Chao Sun | Chao Sun | | | RM should not consider an application as COMPLETED when log aggregation is not in a terminal state | Major | log-aggregation | Robert Kanter | Szilard Nemeth | | | Remove super user privilege requirement for NameNode.getServiceStatus | Minor | namenode | Chao Sun | Chao Sun | | | Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint | Major | resourcemanager | Anna Savarin | Weiwei Yang | | | Exit NameNode if dangling child inode is detected when saving FsImage | Major | hdfs, namenode | Siyao Meng | Siyao Meng | | | Expose SecurityEnabled boolean field in JMX for other services besides NameNode | Minor | . | Ray Burgemeestre | Adam Antal | | | Audit log all EC policy names during addErasureCodingPolicies | Major | erasure-coding | liaoyuxiangqin | liaoyuxiangqin | | | Remove redundant condition judgement in DirectoryScanner#scan | Minor | datanode | liaoyuxiangqin | liaoyuxiangqin | | | speedup libhdfs++ build (enable parallel build) | Minor | . | Pradeep Ambati | Allen Wittenauer | | | Create a new touch command to allow modifying atime and mtime | Minor | tools | Brian Burton | Hrishikesh Gadre | | | YARN NM: OOM error while reading back the state store on recovery | Critical | yarn | Kanwaljeet Sachdev | Pradeep Ambati | | | Support to display pending scheduling requests in RM app attempt page | Major | webapp | Tao Yang | Tao Yang | | | RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache | Major | hdfs | Fei Hui | Fei Hui | | | RBF: Illegal Router Admin command leads to printing usage for all commands | Major | . | Ayush Saxena | Ayush Saxena | | | Make block increment deletion number configurable | Major | . | Yiqun Lin | Ryan Wu | |

TestRMEmbeddedElector#testCallbackSynchronization is flakey | Major | test | Robert Kanter | Robert Kanter | | | Add debug logs in dfsclient around decrypting EDEK | Major | hdfs-client | Kitti Nanasi | Kitti Nanasi | | | RBF: Choose to enable the default nameservice to read/write files | Major | federation, hdfs | yanghuafeng | yanghuafeng | | | Fix the inconsistent default refresh interval on Caching documentation | Trivial | documentation | BELUGA BEHR | Hrishikesh Gadre | | | Allow linux container runtimes to be pluggable | Minor | nodemanager | Craig Condit | Craig Condit | | | Registering MutableQuantiles via Metric annotation | Major | metrics | Sushil Ks | Sushil Ks | | | Add an ability to disable CacheReplicationMonitor | Minor | caching | BELUGA BEHR | Hrishikesh Gadre | | | Improve the description of the setting dfs.image.compress | Minor | documentation | Yiqun Lin | Ryan Wu | | | Upgrade to Apache Yetus 0.8.0 | Major | build, documentation, test | Allen Wittenauer | Allen Wittenauer | | | Router-based HDFS federation phase 2 | Major | . | igo Goiri | igo Goiri | | | Add JMX, conf and stacks menus to the datanode page | Minor | datanode | fengchuang | fengchuang | | | move httpcomponents version in pom.xml | Minor | build | Brandon Scheller | Brandon Scheller | | | OIV tool should better handle control characters present in file or directory names | Critical | hdfs, tools | Zsolt Venczel | Zsolt Venczel | | | YARN NM: Implement Iterable Abstraction for LocalResourceTracker state | Critical | yarn | Pradeep Ambati | Pradeep Ambati | | | Reduce log output from container status calls | Major | . | Shane Kumpf | Craig Condit | | | Refactoring TaskAttemptInfo to separate Map and Reduce tasks | Minor | . | Oleksandr Shevchenko | Oleksandr Shevchenko | | | ber-JIRA: S3Guard Phase III: Hadoop 3.2 features | Major | fs/s3 | Steve Loughran | | | | Log if ipc backoff is enabled in CallQueueManager | Minor | . | Yiqun Lin | Ryan Wu | | | Create utility to limit frequency of log statements | Major | common, util | Erik Krogen | Erik Krogen | | | Improve TestDataNodeMultipleRegistrations#testDNWithInvalidStorageWithHA wait | Minor | . | Ayush Saxena | Ayush Saxena | | | systemClock should be used in RMAppImpl instead of System.currentTimeMills() to be consistent | Major | . | Szilard Nemeth | Szilard Nemeth | | | Allow updating application tracking url after registration | Major | . | Jonathan Hung | Jonathan Hung | | | Post enabled Erasure Coding Policies on NameNode UI | Major | namenode | Kai Sasaki | Kitti Nanasi | | | Support getting PreemptionMessage when using AMRMClientAsync | Major | yarn | Krishna Kishore | Zian Chen | | | iNotify should include information to identify a file as either replicated or erasure coded | Minor | . | Hrishikesh Gadre | Hrishikesh Gadre | | | HDFS Block Placement Policy - Client Local Rack | Minor | documentation | BELUGA BEHR | Ayush Saxena | | | Enable the use of queue based maximum container allocation limit and implement it in FairScheduler | Critical | fairscheduler, scheduler | Antal Blint Steinbach | Antal Blint Steinbach | | | Support additional key/value propereties in JMX bean registration | Major | common | Elek, Marton | Elek, Marton | | | Provide ability for NN to re-replicate based on topology changes. | Major |

| ellen johansen | Hrishikesh Gadre | | | WASB: Add asterisk wildcard support for PageBlobDirSet | Major | fs/azure | Da Zhou | Da Zhou | | | revert HADOOP-12751 | Minor | security | Steve Loughran | Steve Loughran | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | [UI2] New YARN UI webapp does not respect current pathname for REST api | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan | | | TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9 | Major | . | Miklos Szegedi | Miklos Szegedi | | | TestWebHdfsTimeouts fails | Major | webhdfs | Andrew Wang | Chao Sun | | | Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration | Major | common | Miklos Szegedi | Miklos Szegedi | | | Hedged reads thread pool creation not synchronized | Major | hdfs-client | John Zhuge | John Zhuge | | | Yarn service should expose failuresValidityInterval to users and use it for launching containers | Major | . | Chandni Singh | Chandni Singh | | | Add the exception message for failed launches running under LCE | Major | . | Shane Kumpf | Shane Kumpf | | | Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes | Major | . | William Watson | Haibo Chen | | | Bump Hadoop's Jackson 2 dependency 2.9.x | Major | . | Sean Mackrory | Sean Mackrory | | | YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess | Major | . | Miklos Szegedi | Tao Yang | | | Snapshotted encryption zone information should be immutable | Major | encryption | LiXin Ge | LiXin Ge | | | LDAP Group Mapping over SSL can not specify trust store | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Fix default local maven repository path in create-release script | Minor | scripts | Elek, Marton | Elek, Marton | | | Improve NetworkTopology chooseRandom's loop | Major | . | Xiao Chen | Xiao Chen | | | TestCommonConfigurationFields is broken by HADOOP-15312 | Major | test | Konstantin Shvachko | LiXin Ge | | | Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing | Major | . | Shane Kumpf | Shane Kumpf | | | Findbugs warning: Resource#getResources may expose internal representation | Major | api | Weiwei Yang | Weiwei Yang | | | [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM | Major | yarn-ui-v2 | Sunil Govindan | Sreenath Somarajapuram | | | Hadoop scripts may errantly believe a daemon is still running, preventing it from starting | Major | scripts | Aaron T. Myers | Robert Kanter | | | Negative legacy block ID will confuse Erasure Coding to be considered as striped block | Major | erasure-coding | Lei (Eddy) Xu | Lei (Eddy) Xu | | | [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan | | | WebHdfs file path gets truncated when having semicolon (;) inside | Major | webhdfs | Zsolt Venczel | Zsolt Venczel | | | [UI2] All YARN related configurations are paged together in conf page | Major | yarn-ui-v2 | Zoltan Haindrich | Gergely Novk | | | Crypto command should give proper exception when trying to set key on existing EZ directory | Major | hdfs, kms | Harshakiran Reddy | Ranith Sardar | | | Add a helper shutdown routine in HadoopExecutor to ensure clean shutdown | Minor |

| Shashikant Banerjee | Shashikant Banerjee | | | Parent directory permission incorrect during public localization | Critical | . | Bibin A Chundatt | Bilwa S T | | | Specify minimum GCC version to avoid TLS support error in Build of hadoop-hdfs-native-client | Major | build, documentation, native | LiXin Ge | LiXin Ge | | | Fix the typo in HttpAuthentication.md | Minor | common | fang zhenyi | fang zhenyi | | | Add links of the new features of 3.1.0 to the top page | Major | documentation | Takanobu Asanuma | Takanobu Asanuma | | | Refresh action on Grid view page should not be redirected to graph view | Major | yarn-ui-v2 | Yesha Vora | Gergely Novk | | | License header is displayed in ArchivalStorage/MemoryStorage html pages | Minor | documentation | Akira Ajisaka | Akira Ajisaka | | | Abstract ReencryptionHandler recursive logic in separate class. | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Provide meaningful RPC server name for RpcMetrics | Major | common | Elek, Marton | Elek, Marton | | | Configuration.getPropsWithPrefix no longer does variable substitution | Major | . | Jim Brennan | Jim Brennan | | | Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior | Critical | yarn-native-services | Billie Rinaldi | Billie Rinaldi | | | Doc link broken for yarn-service from overview page. | Blocker | yarn-native-services | Rohith Sharma K S | Rohith Sharma K S | | | Nodemanager fails with NumberFormatException: For input string: "" | Critical | . | Yesha Vora | Chandni Singh | | | Update mapreduce.job.tags description for making use for ATSv2 purpose. | Major | . | Charan Hebri | Charan Hebri | | | TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | Resource leak when async scheduling is enabled | Critical | . | Weiwei Yang | Tao Yang | | | SetReplication OutOfMemoryError | Major | . | Philipp Schuegerl | Vinayakumar B | | | Fix the section titles of transparent encryption document | Minor | documentation | Akira Ajisaka | Akira Ajisaka | | | Potential null dereference in DFSck#doWork() | Minor | . | Ted Yu | skrho | | | Fix javadoc in FsDatasetAsyncDiskService#removeVolume | Minor | hdfs | Shashikant Banerjee | Shashikant Banerjee | | | JVM can crash with SIGSEGV when exiting due to custom leveldb logger | Major | nodemanager, resourcemanager | Jason Lowe | Jason Lowe | | | TestClientRMService#testGetApplications sporadically fails | Major | test | Jason Lowe | Jason Lowe | | | Fix javadoc of package-info.java | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Make IrqHandler.bind() public | Minor | util | Steve Loughran | Ajay Kumar | | | Fix missing titles in PlacementConstraints document | Minor | documentation | Akira Ajisaka | Weiwei Yang | | | Guaranteed containers always stay in SCHEDULED on NM after restart | Major | . | Yang Wang | Yang Wang | | | MiniHadoopClusterManager doesn't respect lack of format option | Minor | . | Erik Krogen | Erik Krogen | | | Fix javadoc in FsVolumeList#removeVolume | Minor |

| Shashikant Banerjee | Shashikant Banerjee | | | yarn service application stops when AM is killed with SIGTERM | Major | yarn-native-services | Yesha Vora | Billie Rinaldi | | | Pipe mapreduce job fails with Permission denied for jobTokenPassword | Critical | . | Yesha Vora | Akira Ajisaka | | | ShortCircuitCache#fetchOrCreate never retries | Major | . | Wei-Chiu Chuang | Gabor Bota | | | Increase the default value of yarn.timeline-service.app-collector.linger-period.ms | Major | . | Rohith Sharma K S | Charan Hebri | | | Avoid usage of ${project.version} in parent poms | Major | build | Elek, Marton | Elek, Marton | | | Remove Method DirectoryCollection#verifyDirUsingMkdir | Major | nodemanager | Yufei Gu | Yufei Gu | | | YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list' | Blocker | federation | Yiran Wu | Yiran Wu | | | Incorrect queue name logging in AbstractContainerAllocator | Trivial | capacityscheduler | Weiwei Yang | Weiwei Yang | | | Fix a potential NPE in AbstractSchedulerPlanFollower | Major | . | lujie | lujie | | | Add application launch time to Resource Manager REST API | Major | . | Abdullah Yousufi | Kanwaljeet Sachdev | | | Wrong condition in AmIpFilter#getProxyAddresses() to update the proxy IP list | Major | . | Oleksandr Shevchenko | Oleksandr Shevchenko | | | OIV ReverseXML Processor fails with escaped characters | Critical | hdfs | Erik Krogen | Erik Krogen | | | Add missing css file in hadoop-aws, hadoop-aliyun, hadoop-azure and hadoop-azure-datalake modules | Major | documentation | Yiqun Lin | Yiqun Lin | | | [UI2] AM Node link from attempt page should not redirect to new tab | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan | | | yarn rmadmin -getGroups doesn't return updated groups for user | Major | . | Sumana Sathish | Sunil Govindan | | | Fix javadoc in FsDatasetImpl#checkAndUpdate | Minor | datanode | Shashikant Banerjee | Shashikant Banerjee | | | Fix javadoc in FsVolumeList#handleVolumeFailures | Minor | documentation | Shashikant Banerjee | Shashikant Banerjee | | | Some java source files are executable | Minor | . | Akira Ajisaka | Shashikant Banerjee | | | [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | [UI2] Proxy- Clicking on nodes under Nodes HeatMap gives 401 error | Critical | . | Sumana Sathish | Sunil Govindan | | | [UI2] Nodes page column headers are half truncated | Major | . | Sunil Govindan | Sunil Govindan | | | [UI2] Post selecting grid view in Attempt page, attempt info page should also be opened with grid view | Major | yarn-ui-v2 | Yesha Vora | Gergely Novk | | | NullPointerException while launching ApplicationMaster | Major | . | lujie | lujie | | | Prevent race condition during class initialization | Minor | fs | Pavel Avgustinov | Pavel Avgustinov | | | Aggregate usage statistics from datanodes | Major |

| Ajay Kumar | Ajay Kumar | | | RequestHedgingProxyProvider calls multiple configured NNs all the time | Major | hdfs-client | Jinglun | Jinglun | | | [UI2] Avoid duplicating Components link under Services/\<ServiceName\>/Components | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora | | | MiniDFSCluster to support being built on randomized base directory | Major | test | Xiao Liang | Xiao Liang | | | Balancer:Set default value of minBlockSize to 10mb | Major | balancer & mover | Bharat Viswanadham | Bharat Viswanadham | | | Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens | Critical | . | Xiao Chen | Xiao Chen | | | Test cases of TestWriteToReplica failed in windows | Major | . | Xiao Liang | Xiao Liang | | | Document how to use classpath isolation for aux-services in YARN | Major | . | Xuan Gong | Xuan Gong | | | yarn.webapp.api-service.enable should be highlighted in the quickstart | Trivial | documentation | Davide Vergari | Billie Rinaldi | | | Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap | Critical | yarn | Sumana Sathish | Suma Shivaprasad | | | Prevent double logout of UGI's LoginContext | Major | security | Daryn Sharp | Daryn Sharp | | | RM Nodes UI data table index for sorting column need to be corrected post Application tags display | Major | resourcemanager, webapp | Weiwei Yang | Weiwei Yang | | | AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator | Critical | . | Suma Shivaprasad | Suma Shivaprasad | | | Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled | Major | . | Yesha Vora | Xuan Gong | | | Application State is not updated to ATS if AM launching is delayed. | Critical | . | Sumana Sathish | Rohith Sharma K S | | | Add unit tests for inter queue preemption for dominant resource calculator | Critical | yarn | Sumana Sathish | Zian Chen | | | Add log statement for Docker client configuration file at INFO level | Minor | yarn-native-services | Yesha Vora | Yesha Vora | | | Yarn registry dns log finds BufferUnderflowException on port ping | Major | yarn-native-services | Yesha Vora | Eric Yang | | | mapred job -history prints duplicate counter in human output | Major | client | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps | Major | webapp | Sunil Govindan | Sunil Govindan | | | AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs | Major | yarn | Suma Shivaprasad | Suma Shivaprasad | | | Add unit tests for queue priority with dominant resource calculator | Critical | . | Sumana Sathish | Zian Chen | | | YARN precommit build failing in TestPlacementConstraintTransformations | Critical | . | Billie Rinaldi | Shane Kumpf | | | Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows | Major | . | Xiao Liang | Xiao Liang | | | [UI2] Individual Node page does not contain breadcrumb trail | Critical | yarn-ui-v2 | Sumana Sathish | Zian Chen | | | YARN Service dependency follow up work | Critical | client, resourcemanager | Gour Saha | Billie Rinaldi | | | Optimize TokenCache#obtainTokensForNamenodesInternal | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | hadoop-nfs dependencies for mockito and junit are not test scope | Major | nfs | Jason Lowe | Jason Lowe | | | Fix checkstyle warnings in TestFileSystemApplicationHistoryStore | Minor | . | Yiqun Lin | Yiqun Lin | | | Fix potential NPE when gets RMApp from RM context | Critical | . | Tao Yang | Tao Yang | | | conftest is not documented | Minor | documentation | Kengo Seki | Kengo Seki | | | NPE in DeletionService | Critical |

| Chandni Singh | Eric Badger | | | TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently | Major | hdfs | Gabor Bota | Gabor Bota | | | Upgrade to ADLS SDK that exposes current timeout | Major | . | Sean Mackrory | Sean Mackrory | | | RmAuthenticationFilterInitializer /TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator | Major | . | Suma Shivaprasad | Suma Shivaprasad | | | Remove privileged operation warnings during container launch for the ContainerRuntimes | Major | . | Yesha Vora | Shane Kumpf | | | ClassNotFoundException when auxiliary service is loaded from HDFS | Blocker | . | Charan Hebri | Zian Chen | | | Support static and archive unmodified local resources in service AM | Critical | . | Wangda Tan | Suma Shivaprasad | | | UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty | Major | yarn | Jiandan Yang | Tao Yang | | | [UI2] Clicking on Application link at the header goes to Diagnostics Tab instead of AppAttempt Tab | Major | yarn-ui-v2 | Sumana Sathish | Yesha Vora | | | RMContainer lost queue name when RM HA happens | Major | resourcemanager | Hu Ziqian | Hu Ziqian | | | Improve ATS response for DS\_CONTAINER when container launch fails | Major | timelineserver | Charan Hebri | Chandni Singh | | | [UI2 GPU] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers | Major | . | Sumana Sathish | Sunil Govindan | | | Avoid taking FSN lock while doing group member lookup for FSD permission check | Major | namenode | Xiaoyu Yao | Xiaoyu Yao | | | TestHdfsHelper does not generate jceks path properly for relative path in Windows | Major | . | Xiao Liang | Xiao Liang | | | Race conditions in closing FadvisedChunkedFile | Minor | . | Miklos Szegedi | Miklos Szegedi | | | WASB: PageBlobInputStream.skip breaks HBASE replication | Major | fs/azure | Thomas Marquardt | Thomas Marquardt | | | Support NM promotion/demotion of running containers. | Major | . | Arun Suresh | Miklos Szegedi | | | DRAINING state of queues is not recovered after RM restart | Major | capacityscheduler | Tao Yang | Tao Yang | | | Fair scheduler: reservable queue is configured both as parent and leaf queue | Major | fairscheduler | Gergo Repas | Gergo Repas | | | TestContainerSchedulerQueuing.testStartMultipleContainers failed | Major | . | Miklos Szegedi | Jim Brennan | | | Service AM should retrieve new IP for docker container relaunched by NM | Critical | yarn-native-services | Eric Yang | Billie Rinaldi | | | [UI2] Improve labeling of certain tables | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora | | | Fix wrong number of table columns in Resource Model doc | Major | . | Weiwei Yang | Weiwei Yang | | | DFSStripedInputStream NPE when reportCheckSumFailure | Major | . | Xiao Chen | Xiao Chen | | | [UI2] Clicking on application from cluster view should redirect to application attempt page | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora | | | [UI2] Service page header links are broken | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora | | | Invalid kerberos principal file name cause NPE in native service | Critical | yarn-native-services | Sunil Govindan | Gour Saha | | | DistributedScheduling is not working in HA | Blocker |

| Bibin A Chundatt | Bibin A Chundatt | | | Correct units in adl.http.timeout | Major | fs/adl | Sean Mackrory | Sean Mackrory | | | Fix NPE in DefaultUpgradeComponentsFinder | Major | yarn | Suma Shivaprasad | Suma Shivaprasad | | | Add ability to specify nodemanager environment variables individually | Major | yarn | Jim Brennan | Jim Brennan | | | DN UI logs link is broken when https is enabled | Minor | datanode | Namit Maheshwari | Shashikant Banerjee | | | LocalDistributedCacheManager leaves classloaders open, which leaks FDs | Major | . | Adam Szita | Adam Szita | | | Document better the per-node per-app file limit in YARN log aggregation | Major | . | Xuan Gong | Xuan Gong | | | In YARN Services UI, "User Name for service" should be completely removed in secure clusters | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan | | | YARN Native Service: Respect YARN\CONTAINER\RUNTIME\DOCKER\LOCAL\RESOURCE\MOUNTS specified in service spec | Critical | yarn-native-services | Wangda Tan | Chandni Singh | | | Update YarnServiceApi documentation and yarn service UI code to remove references to unique\component\support | Major | yarn-native-services, yarn-ui-v2 | Suma Shivaprasad | Suma Shivaprasad | | | Fsync fails on directories on Windows | Critical | datanode, hdfs | Lukas Majercak | Lukas Majercak | | | Javadoc for BlockPlacementPolicyDefault is inaccurate | Trivial | . | Yiqun Lin | Zsolt Venczel | | | Job hangs when a job requests a resource that its queue does not have | Major | fairscheduler | Szilard Nemeth | Szilard Nemeth | | | Preemption does not happen due to natural\termination\factor when DRF is used | Major | . | kyungwan nam | kyungwan nam | | | Rename properties introduced for \<tags\> | Major | conf | Nanda kumar | Zsolt Venczel | | | Avoid fsync storm triggered by DiskChecker and handle disk full situation | Blocker | . | Kihwal Lee | Arpit Agarwal | | | SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception | Critical | . | Yesha Vora | Eric Yang | | | Incorrect min/max allocation property name in resource types doc | Critical | documentation | Weiwei Yang | Weiwei Yang | | | Log aggregation does not warn if HDFS quota in target directory is exceeded | Major | log-aggregation | Gergo Repas | Gergo Repas | | | Optimize ByteString conversions in PBHelper | Major | . | Andrew Wang | Andrew Wang | | | DFSStripedInputStream should only allocate new buffers when reading | Major | . | Xiao Chen | Xiao Chen | | | Incorrect ATS Url used for Wire encrypted cluster | Blocker | yarn-ui-v2 | Yesha Vora | Sunil Govindan | | | Fix TestFsDatasetImpl test failures on Windows | Major | . | Xiao Liang | Xiao Liang | | | Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats | Major | . | Robert Kanter | Robert Kanter | | | Fix potential connection leak in SchedConfCLI and YarnWebServiceUtils | Major | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Missing nm.stop() in TestNodeManagerResync to fix testKillContainersOnResync | Major | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Incorrect and missing AfterClass in HBase-tests to fix NPE failures | Major |

| Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows | Major | log-aggregation | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full" | Blocker | . | Rohith Sharma K S | Jason Lowe | | | Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient | Major | . | Andrew Wang | Andrew Wang | | | Diagnostic message should improve when yarn service fails to launch due to ATS unavailability | Major | yarn-native-services | Yesha Vora | Billie Rinaldi | | | Yarn Service: NPE when service is saved first and then started. | Critical | . | Chandni Singh | Chandni Singh | | | Fix TestDataNodeFaultInjector test failures on Windows | Major | test | Xiao Liang | Xiao Liang | | | Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997 | Critical | kms | Gabor Bota | Gabor Bota | | | Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative | Critical | yarn | Sumana Sathish | Wangda Tan | | | Incorrect debug message in KMSACL#hasAccess | Trivial | . | Wei-Chiu Chuang | Yuen-Kuei Hsueh | | | TimelineService V1.5 doesn't come up after HADOOP-15406 | Critical | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Service AM should localize static/archive resource types to container working directory instead of 'resources' | Critical | yarn-native-services | Suma Shivaprasad | Suma Shivaprasad | | | Javadoc build failed due to "bad use of '\>'" | Critical | build, docs | Takanobu Asanuma | Takanobu Asanuma | | | Number of remaining retries are updated twice after a container failure in NM | Critical | . | Chandni Singh | Chandni Singh | | | Fix incorrect username when deny the setOwner operation | Minor | namenode | luhuachao | Zsolt Venczel | | | Javadoc build failed in hadoop-yarn-server-nodemanager | Critical | build, docs | Takanobu Asanuma | Takanobu Asanuma | | | yarn app start cli should print applicationId | Critical | . | Yesha Vora | Rohith Sharma K S | | | NPE in service AM related to placement policy | Critical | yarn-native-services | Billie Rinaldi | Gour Saha | | | Fix NPE in SingleConstraintAppPlacementAllocator when placement constraint in SchedulingRequest is null | Major | scheduler | Gour Saha | Weiwei Yang | | | Multiple declaration of maven-enforcer-plugin found in pom.xml | Minor | . | Nanda kumar | Nanda kumar | | | DFSAdmin doesn't display specialized help for triggerBlockReport | Major | tools | Takanobu Asanuma | Takanobu Asanuma | | | Tracking URL in the app state does not get redirected to MR ApplicationMaster for Running applications | Critical | yarn | Sumana Sathish | Sunil Govindan | | | Yarn service app fails due to issues with Renew Token | Major | yarn-native-services | Yesha Vora | Gour Saha | | | Fix the missing time stamp in exception message in Class NoOverCommitPolicy | Minor | reservation system | Yufei Gu | Dinesh Chitlangia | | | Cross-Site Scripting vulnerability in HttpServer2 | Major |

| Haibo Yan | Haibo Yan | | | Race Condition When Stopping DelegationTokenRenewer causes RM crash during failover | Critical | resourcemanager | BELUGA BEHR | BELUGA BEHR | | | Distributed shell app master should not release containers when shutdown if keep-container is true | Critical | distributed-shell | Charan Hebri | Suma Shivaprasad | | | TestCGroupElasticMemoryController fails surefire build | Major | . | Jason Lowe | Miklos Szegedi | | | More YARN pages need to honor yarn.resourcemanager.display.per-user-apps | Major | webapp | Vinod Kumar Vavilapalli | Sunil Govindan | | | MapReduce JHS should honor yarn.webapp.filter-entity-list-by-user | Major | . | Vinod Kumar Vavilapalli | Sunil Govindan | | | [UI2] After version field became mandatory, form-based submission of new YARN service doesn't work | Critical | yarn-ui-v2 | Gergely Novk | Gergely Novk | | | Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume | Critical | datanode | liaoyuxiangqin | Zsolt Venczel | | | Fix API incompatible changes in FairScheduler's AllocationFileLoaderService | Major | fairscheduler | Gergo Repas | Gergo Repas | | | cgroup file leak in NM | Major | nodemanager | Hu Ziqian | Hu Ziqian | | | TestCGroupElasticMemoryController.testNormalExit() hangs on Linux | Major | nodemanager | Haibo Chen | Miklos Szegedi | | | Revisit the record type used by Registry DNS for upstream resolution | Major | yarn-native-services | Shane Kumpf | Shane Kumpf | | | "guarded" is misspelled as "gaurded" in FSPermissionChecker.java | Trivial | documentation | Jianchao Jia | Jianchao Jia | | | Click on an individual container continuously spins and doesn't load the page | Blocker | . | Charan Hebri | Sunil Govindan | | | Fix TestHistoryViewerPrinter on windows due to a mismatch line separator | Minor | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | FsUrlConnection does not handle paths with spaces | Major | fs | Joseph Fourny | Zsolt Venczel | | | [oiv] ls will fail in secure cluster | Major | . | Brahma Reddy Battula | Wei-Chiu Chuang | | | App log can not be viewed from Logs tab in secure cluster | Critical | yarn-ui-v2 | Yesha Vora | Sunil Govindan | | | libhdfs++ SaslProtocol hanging while accessing invalid lock | Major | . | Mitchell Tracy | Mitchell Tracy | | | Exclude containermanager.linux test classes on Windows | Major | . | Giovanni Matteo Fumarola | Jason Lowe | | | Creating a file with block size smaller than EC policy's cell size should fail | Major | erasure-coding | Xiao Chen | Xiao Chen | | | Refactor ConfiguredFailoverProxyProvider to make inheritance easier | Minor | hdfs-client | Chao Sun | Chao Sun | | | can't renew HDFS tokens with only the hdfs client jar | Critical | . | Thomas Graves | Arpit Agarwal | | | Typo: Marking all "datandoes" as stale | Trivial | namenode | Wei-Chiu Chuang | Nanda kumar | | | FairScheduler.allocConf should be declared as volatile | Major | fairscheduler | Haibo Chen | Szilard Nemeth | | | Flow activity page is failing with "Timeline server failed with an error" | Major | yarn-ui-v2 | Yesha Vora | Sunil Govindan | | | RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773 | Major | . | Rohith Sharma K S | igo Goiri | | | [UI2] User cannot submit a new service as submit button is always disabled | Major |

| Suma Shivaprasad | Suma Shivaprasad | | | NFS: flavor AUTH\_SYS should use VerifierNone | Major | nfs | Wei-Chiu Chuang | Gabor Bota | | | TestFileOutputCommitter fails on Windows | Minor | test | Zuoming Zhang | Zuoming Zhang | | | Add config parameter to allow JHS to alway scan user dir irrespective of modTime | Critical | . | Wangda Tan | Thomas Marquardt | | | loop until TIMEOUT before sending kill -9 | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down | Blocker | . | Rohith Sharma K S | Rohith Sharma K S | | | Registry DNS lookup fails to return for CNAMEs | Major | yarn-native-services | Shane Kumpf | Shane Kumpf | | | Upgrade jquery-ui to 1.12.1 in YARN | Major | webapp | Sunil Govindan | Sunil Govindan | | | Speed up TestDFSAdminWithHA | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | | | Fix Typo in javadoc for ScanInfoPerBlockPool#addAll | Minor | . | Shashikant Banerjee | Shashikant Banerjee | | | TestNameNodeMetrics fails on Windows | Minor | test | Zuoming Zhang | Zuoming Zhang | | | TestEditLogRace fails on Windows | Minor | test | Zuoming Zhang | Zuoming Zhang | | | hdfs mover -p /path times out after 20 min | Major | balancer & mover | Istvan Fajth | Istvan Fajth | | | Upgrade Maven and Maven Wagon versions | Major | build | Sean Mackrory | Sean Mackrory | | | Shell command timeout given is in seconds whereas it is taken as millisec while scheduling | Major | . | Bilwa S T | Bilwa S T | | | Build oom-listener fails on older versions | Major | . | Miklos Szegedi | Miklos Szegedi | | | Investigate AllocationFileLoaderService.reloadListener locking issue | Critical | fairscheduler | Haibo Chen | Szilard Nemeth | | | Cannot create encryption zone after KMS auth token expires | Critical | encryption, kms, namenode | Xiao Chen | Xiao Chen | | | Upgrade to commons-configuration 2.1 regresses task CPU consumption | Major | metrics | Todd Lipcon | Todd Lipcon | | | NodeResourceMonitor crashes on bad swapFree value | Major | . | Jim Brennan | Jim Brennan | | | Make FrameworkUploader symlink ignore improvement | Major | . | Gergo Repas | Gergo Repas | | | Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator | Major | nodemanager | Yufei Gu | Yufei Gu | | | Yarn 3.0 seems runs slower than Yarn 2.6 | Major | yarn | Hsin-Liang Huang | Shane Kumpf | | | Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers | Major | webapp | Tao Yang | Tao Yang | | | Compilation is broken with -Pyarn-ui | Major | webapp | Sunil Govindan | Sunil Govindan | | | Avoid static initialization of ObjectMappers | Minor | performance | Todd Lipcon | Todd Lipcon | | | TestContainer.testKillOnNew flaky on trunk | Major | nodemanager | Szilard Nemeth | Szilard Nemeth | | | RM metrics rest API throws GSSException in kerberized environment | Blocker | . | Kshitij Badani | Sunil Govindan | | | Async scheduling thread could be interrupted when there are no NodeManagers in cluster | Blocker | capacity scheduler | Charan Hebri | Sunil Govindan | | | GPU does not get released even though the application gets

| Critical | yarn | Sumana Sathish | Sunil Govindan | | | [UI2] new ui is not accessible with out internet connection | Blocker | . | Bibin A Chundatt | Bibin A Chundatt | | | The native ISA-L library loading failure should be made warning rather than an error message | Minor | erasure-coding | Nilotpal Nandi | Shashikant Banerjee | | | ActiveStandbyElectorBasedElectorService is failing with NPE | Major | . | Yesha Vora | Chandni Singh | | | Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption | Major | . | Wangda Tan | Zian Chen | | | Add basic ACL check for all ATS v2 REST APIs | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | [UI2] URL needs to be trimmed to handle index.html redirection while accessing via knox | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan | | | Multiple NM heartbeat thread created when a slow NM resync with RM | Major | nodemanager | Botong Huang | Botong Huang | | | Randomize local dirs | Minor | . | Jim Brennan | Jim Brennan | | | [PROVIDED Storage] Fix failing integration tests in ITestProvidedImplementation | Major | . | Virajith Jalaparti | Virajith Jalaparti | | | Suppress build error if there are no docs after excluding private annotations | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Remove HTrace hooks from DFSClient to reduce CPU usage | Major | performance | Todd Lipcon | Todd Lipcon | | | Incorrect message when block is not found | Major | datanode | Wei-Chiu Chuang | Gabor Bota | | | TimelineWebServices.getEntity should throw ForbiddenException instead of 404 when ACL checks fail | Major | . | Sumana Sathish | Suma Shivaprasad | | | diskbalancer does not work if one of the blockpools are empty on a Federated cluster | Major | diskbalancer | Namit Maheshwari | Bharat Viswanadham | | | Improve Capacity Scheduler logs to debug invalid states | Major | capacity scheduler | Wangda Tan | Wangda Tan | | | Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints | Major | resourcemanager, restapi | Grant Sohn | Szilard Nemeth | | | Fix NPE when the same client simultaneously contact for the first time Yarn Router | Critical | router | rangjiaheng | rangjiaheng | | | Multiple FileContexts created with the same configuration object should be allowed to have different umask | Critical | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | ATSv2 HBase tests are failing with ClassNotFoundException | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | NPE when request file descriptors when SC read | Minor | hdfs-client | Gang Xie | Zsolt Venczel | | | NPE in DataNode due to uninitialized DiskBalancer | Major | datanode, diskbalancer | Xiao Chen | Xiao Chen | | | yarn.resourcemanager.fail-fast is used inconsistently | Major | resourcemanager | Daniel Templeton | Yuanbo Liu | | | HDFS Native Client Fails Compilation on Ubuntu 18.04 | Minor | . | Jack Bearden | Jack Bearden | | | Containers being launched as app tears down can leave containers in NEW state | Major | nodemanager | Jason Lowe | Jason Lowe | | | ATSv2 entities are not published to HBase from second attempt onwards | Major |

| Yesha Vora | Rohith Sharma K S | | | TestServiceCLI#testEnableFastLaunch fail when umask is 077 | Major | . | K G Bakthavachalam | K G Bakthavachalam | | | Exclude commons-lang3 from hadoop-client-minicluster | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh | Major | security, test | Siyao Meng | Siyao Meng | | | Intermittent failure in TestReencryptionWithKMS | Major | encryption, test | Surendra Singh Lilhore | Xiao Chen | | | GenericTestUtils can exceed maxSleepTime | Trivial | . | Sean Mackrory | Adam Antal | | | Fix broken links to RBF documentation | Minor | documentation | jwhitter | Gabor Bota | | | test-container-executor test\is\empty() is broken | Major | . | Jim Brennan | Jim Brennan | | | Should throw exception when incorrect block size is set | Major | . | Yongjun Zhang | Shweta | | | container-executor can crash with SIGPIPE after nodemanager restart | Major | . | Jim Brennan | Jim Brennan | | | when moving app, activeUsers is increased, even though app does not have outstanding request | Major | . | kyungwan nam | | | | When AM releases a container, RM removes allocation tags before it is released by NM | Major | capacity scheduler | Weiwei Yang | Weiwei Yang | | | Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize | Major | . | Wei-Chiu Chuang | Siyao Meng | | | Fix valgrind leak check on container executor | Major | . | Billie Rinaldi | Billie Rinaldi | | | DataNode WebHDFS endpoint throws NPE | Minor | datanode, webhdfs | Wei-Chiu Chuang | Siyao Meng | | | Hadoop Docker Image Pip Install Fails | Critical | . | Jack Bearden | Jack Bearden | | | TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails | Major | . | Kihwal Lee | Weiwei Yang | | | FSParentQueue: Comparison method violates its general contract | Minor | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | Distributed cache conflicts breaks backwards compatability | Blocker | mrv2 | Jason Lowe | Jason Lowe | | | Final states in ContainerAllocation might be modified externally causing unexpected allocation results | Major | capacity scheduler | Tony Xintong Song | Tony Xintong Song | | | Fair scheduler misuses Resources operations | Major | fairscheduler | Daniel Templeton | Szilard Nemeth | | | Yarn service conflict between restart policy and NM configuration | Critical | yarn | Chandni Singh | Suma Shivaprasad | | | Support bind propagation options for mounts in docker runtime | Major | . | Billie Rinaldi | Billie Rinaldi | | | [DS] AM registration fails when hadoop authorization is enabled | Blocker | . | Bibin A Chundatt | Bibin A Chundatt | | | AllocationRespose proto setNMToken initBuilder not done | Major | . | Bibin A Chundatt | Bilwa S T | | | TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events | Major | capacityscheduler | Haibo Chen | Weiwei Yang | | | RM startup failure on recovery after user deletion | Blocker | resourcemanager | yimeng | Bibin A Chundatt | | | Fix the broken anchor in SLS site-doc | Minor | documentation | Weiwei Yang | Weiwei Yang | | | DefaultImpersonationProvider fails to parse proxy user config if username has . in it | Major |

| Ajay Kumar | Ajay Kumar | | | CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps | Critical | capacity scheduler, capacityscheduler | Karam Singh | Manikandan R | | | Avoid publishing reserved container to ATS from RM | Critical | yarn-native-services | Yesha Vora | Suma Shivaprasad | | | mkdir should print the parent directory in the error message when parent directories do not exist | Major | . | Zoltan Haindrich | Shweta | | | UserGroupInformation TGT renewer throws NPE | Blocker | security | Wei-Chiu Chuang | Gabor Bota | | | Improve diagnostic message when artifact is not set properly | Major | . | Yesha Vora | Gour Saha | | | Fix javadoc for FSDirMkdirOp#createParentDirectories | Minor | documentation | Lokesh Jain | Lokesh Jain | | | Validate service principal format prior to launching yarn service | Major | security, yarn | Eric Yang | Eric Yang | | | Allow SQLFederationStateStore to submit the same app in the same subcluster | Major | federation | igo Goiri | Giovanni Matteo Fumarola | | | On NodeManager container gets cleaned up before its pid file is created | Critical | . | Sumana Sathish | Chandni Singh | | | Update federation documentation of Nodemanager configurations | Minor | . | Bibin A Chundatt | Bibin A Chundatt | | | [ATSv2] NPE while checking for entity acl in non-secure cluster | Major | timelinereader, timelineserver | Akhil PB | Rohith Sharma K S | | | NM recovery level db not cleaned up properly on container finish | Critical | . | Bibin A Chundatt | Bibin A Chundatt | | | LocalFs#listLocatedStatus does not filter out hidden .crc files | Minor | fs | Erik Krogen | Erik Krogen | | | TestDominantResourceFairnessPolicy.testModWhileSorting is flaky | Minor | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | App local logs could leaked if log aggregation fails to initialize for the app | Critical | . | Bibin A Chundatt | Bibin A Chundatt | | | New AM attempt could not retrieve previous attempt component data | Critical | . | Yesha Vora | Gour Saha | | | fuse dfs - uid persists when switching between ticket caches | Minor | fuse-dfs | Alex Volskiy | Istvan Fajth | | | Potential thread leak in ActivitiesManager | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | Application fails with InvalidResourceRequestException | Critical | . | Yesha Vora | Zian Chen | | | Opportunistic scheduling does not work post RM failover | Blocker | . | Bibin A Chundatt | Bibin A Chundatt | | | [UI2] Container diagnostic information is missing from container page | Major | yarn-ui-v2 | Akhil PB | Akhil PB | | | Nodemanager logs failed to download file with INFO level | Major | yarn | Eric Yang | Eric Yang | | | RegistryDNS hang when remote lookup does not reply | Critical | yarn | Eric Yang | Eric Yang | | | Yarn Service Upgrade: Typo in Error message | Major | . | Chandni Singh | Chandni Singh | | | Add RM web service endpoint to get user information | Major | resourcemanager | Akhil PB | Akhil PB | | | [UI2] Display current logged in user | Major |

| Akhil PB | Akhil PB | | | [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser | Major | . | Akhil S Naik | Akhil PB | | | [UI2] IP address in component page shows N/A | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora | | | NodeManager metrics may return wrong negative values when NM restart | Major | . | Yang Wang | Szilard Nemeth | | | [UI2] Latest run application should be listed first in the RM UI | Major | yarn-ui-v2 | Sumana Sathish | Akhil PB | | | [UI2] No information available per application appAttempt about 'Total Outstanding Resource Requests' | Major | yarn-ui-v2 | Sumana Sathish | Akhil PB | | | [UI2] YARN Services UI new submission failures are not debuggable | Major | yarn-ui-v2 | Akhil PB | Akhil PB | | | [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu. | Major | yarn-ui-v2 | Sumana Sathish | Akhil PB | | | Fix FSN read/write lock metrics name | Trivial | documentation, metrics | Chao Sun | Chao Sun | | | Container cleanup fails while trying to delete Cgroups | Critical | . | Yesha Vora | Suma Shivaprasad | | | Container launch exception in AM log should be printed in ERROR level | Major | . | Yesha Vora | Yesha Vora | | | NodeManager is giving 403 GSS exception post upgrade to 3.1 in secure mode | Major | timelineservice | Sunil Govindan | Sunil Govindan | | | TestEditLogTailer#testTriggersLogRollsForAllStandbyNN fails due to missing synchronization between rollEditsRpcExecutor and tailerThread shutdown | Minor | ha | Hrishikesh Gadre | Hrishikesh Gadre | | | EC: Display erasure coding policy for sub-directories is not working | Major | erasure-coding | Souryakanta Dwivedy | Ayush Saxena | | | EC: "removePolicy" is not working for built-in/system Erasure Code policies | Minor | documentation, erasure-coding | Souryakanta Dwivedy | Ayush Saxena | | | Update DataTables version in yarn-common in line with JQuery 3 upgrade | Major | yarn | Akhil PB | Akhil PB | | | Race condition in NM container launched after done | Major | . | Yang Wang | Pradeep Ambati | | | NPE in AllocationTagsManager when a container is removed more than once | Major | resourcemanager | Weiwei Yang | Weiwei Yang | | | Avoid committing allocation proposal to unavailable nodes in async scheduling | Major | capacityscheduler | Tao Yang | Tao Yang | | | Fix potential NPE in InMemoryLevelDBAliasMapServer | Major | . | Virajith Jalaparti | Virajith Jalaparti | | | FSPermissionChecker may throws AIOOE when check inode permission | Major | namenode | He Xiaoqiao | He Xiaoqiao | | | KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x | Major | kms | Wei-Chiu Chuang | Wei-Chiu Chuang | | | NameNode UI : "Utilities -\> Browse the file system -\> open a file -\> Head the file" is not working | Major | ui | Nanda kumar | Nanda kumar | | | fsck -list-corruptfileblocks has infinite loop if user is not privileged. | Major | tools | Wei-Chiu Chuang | Yuen-Kuei Hsueh | | | DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction | Major | namenode | Wei-Chiu Chuang | chencan | | | Fix few annotation typos in YarnConfiguration | Trivial |

| Sen Zhao | Sen Zhao | | | TestDirectoryScanner#testDirectoryScannerInFederatedCluster is flaky | Minor | hdfs | Daniel Templeton | Daniel Templeton | | | container-executor should not write cgroup tasks files for docker containers | Major | . | Jim Brennan | Jim Brennan | | | sleeper service fails to launch with "Authentication Required" | Critical | yarn | Sumana Sathish | Billie Rinaldi | | | Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh | Major | . | Siyao Meng | Siyao Meng | | | Cleanup symlinks when container restarted by NM to solve issue "find: File system loop detected;" for tar ball artifacts. | Critical | . | Rohith Sharma K S | Chandni Singh | | | Race between close/recoverLease leads to missing block | Major | . | zhouyingchao | Jinglun | | | Enhance KMS client retry behavior | Critical | kms | Kitti Nanasi | Kitti Nanasi | | | Fix NM Collector Service Port issue in YarnConfiguration | Major | ATSv2 | Prabha Manepalli | Prabha Manepalli | | | Statistic for list\located\status is incremented incorrectly by listStatusIterator | Minor | hdfs-client | Todd Lipcon | Antal Mihalyi | | | Update README and website to reflect HADOOP-8662 | Trivial | documentation | Eli Collins | Andras Bokor | | | Test failure TestSSLHttpServer.testExcludedCiphers with TLS\ECDHE\RSA\WITH\AES\128\CBC\_SHA256 cipher suite | Major | common | Gabor Bota | Szilard Nemeth | | | Restore previous state in container-executor after failure | Major | . | Jim Brennan | Jim Brennan | | | [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked | Major | . | Rohith Sharma K S | Wangda Tan | | | Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled | Trivial | erasure-coding | Souryakanta Dwivedy | Ayush Saxena | | | The OpenSolaris taxonomy link is dead in InterfaceClassification.md | Major | documentation | Daniel Templeton | Rui Gao | | | NPE in localizer hearbeat processing if a container is killed while localizing | Major | . | lujie | lujie | | | Journal Nodes should allow to format non-empty directories with "-force" option | Major | journal-node | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Threads in SLS quit without logging exception | Major | scheduler-load-simulator | Xianghao Lu | Xianghao Lu | | | Add metrics tags for ShuffleClientMetrics | Major | . | Akira Ajisaka | Zoltan Siegl | | | Typo correction for yarn configuration in OpportunisticContainers(federation) docs | Major | documentation, federation | Y. SREENIVASULU REDDY | Y. SREENIVASULU REDDY | | | Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service | Major | . | Yesha Vora | Suma Shivaprasad | | | fs.TrashPolicyDefault: Can't create trash directory | Major | common | Fei Hui | Fei Hui | | | RBF: Add check to have single valid argument to safemode command | Major | federation | Soumyapn | Ayush Saxena | | | Enable debug log for LeaseRenewer in TestDistributedFileSystem | Major | hdfs | Shweta | Shweta | | | ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints | Major | encryption | Xiao Chen | Zsolt Venczel | | | Fix a typo in CS init error message when resource calculator is not correctly set | Minor |

| Weiwei Yang | Abhishek Modi | | | Typo in the definition of "stable" in the interface classification | Minor | . | Daniel Templeton | Daniel Templeton | | | FsDatasetImpl should log DiskOutOfSpaceException | Major | hdfs | Fei Hui | Fei Hui | | | KMS log4j is not initialized properly at startup | Major | kms | Kitti Nanasi | Kitti Nanasi | | | Typo in compatibility doc: SHOUD -\> SHOULD | Trivial | . | Daniel Templeton | Laszlo Kollar | | | Handle possible NPEs due to deleted blocks in race condition | Major | namenode | Vinayakumar B | Vinayakumar B | | | Fix DistributedShell unit tests | Major | distributed-shell, timelineservice | Eric Yang | Abhishek Modi | | | RBF: Add validation for max arguments for Router admin ls, clrQuota, setQuota, rm and nameservice commands | Major | . | Ayush Saxena | Ayush Saxena | | | EC: "hdfs ec -getPolicy" is not retrieving policy details when the special REPLICATION policy set on the directory | Minor | erasure-coding | Souryakanta Dwivedy | Ayush Saxena | | | ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns | Major | ipc | Steve Loughran | Kihwal Lee | | | RBF: Add check to order command | Major | federation | Soumyapn | Ranith Sardar | | | KMS performance regression due to too many open file descriptors after Jetty migration | Blocker | kms | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate | Major | . | Anthony Hsu | Anthony Hsu | | | RBF: Handle mount table znode with null value | Major | federation, hdfs | yanghuafeng | yanghuafeng | | | Container-executor permission check errors cause the NM to be marked unhealthy | Critical | . | Shane Kumpf | Craig Condit | | | RBF: Router logs are not capturing few of the dfsrouteradmin commands | Major | . | Soumyapn | Ayush Saxena | | | 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available | Major | datanode | usharani | Ranith Sardar | | | EC: Fix Intermittent Failure in TestDFSStripedOutputStreamWithFailureWithRandomECPolicy | Major | erasure-coding | Ayush Saxena | Ayush Saxena | | | CS preemption monitor always fails since one under-served queue was deleted | Major | capacityscheduler, scheduler preemption | Tao Yang | Tao Yang | | | Fix dead lock during async editlog rolling if edit queue is full | Major | namenode | zhangwei | Daryn Sharp | | | TestTaskAttemptContainerRequest should reset UserGroupInformation | Minor | test | Oleksandr Shevchenko | Oleksandr Shevchenko | | | TestMRAppMetrics should shutdown DefaultMetricsSystem after completion | Minor | test | Oleksandr Shevchenko | Oleksandr Shevchenko | | | Safe blocks counter is not decremented correctly if the block is striped | Major | hdfs | Kitti Nanasi | Kitti Nanasi | | | Javadoc error in node attributes | Major | . | Sunil Govindan | Sunil Govindan | | | sun.misc.Cleaner has moved to a new location in OpenJDK 9 | Major | . | Chris Hegarty | Akira Ajisaka | | | ATSv2 REST APIs should honor filter-entity-list-by-user in non-secure cluster when ACls are enabled | Major |

| Rohith Sharma K S | Rohith Sharma K S | | | Node status updater thread could be lost after it is restarted | Critical | nodemanager | Tao Yang | Tao Yang | | | Fix DN UI logs link broken when https is enabled after HDFS-13902 | Minor | datanode | Jianfei Jiang | Jianfei Jiang | | | History Server task attempts REST API returns invalid data | Major | jobhistoryserver | Oleksandr Shevchenko | Oleksandr Shevchenko | | | WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status | Major | hdfs, webhdfs | Siyao Meng | Siyao Meng | | | Correct the log when Invalid emptier Interval configured | Major | trash | Harshakiran Reddy | Ayush Saxena | | | Annotation javax.annotation.Generated has moved | Minor | api | Andrew Purtell | Andrew Purtell | | | CapacityScheduler does not enforce max resource allocation check at queue level | Major | capacity scheduler, capacityscheduler, resourcemanager | Tarun Parimi | Tarun Parimi | | | Javadoc warnings within the nodemanager package | Trivial | . | Shane Kumpf | Craig Condit | | | Fix exception message in Resource.throwExceptionWhenArrayOutOfBound | Minor | . | Szilard Nemeth | Gergely Pollak | | | Documentation: Improper formatting in Disk Balancer for Settings | Minor | . | Ayush Saxena | Ayush Saxena | | | Fix the fmt\_bytes function in the dfs-dust.js | Minor | hdfs, ui | yanghuafeng | yanghuafeng | | | ber-jira: S3a phase V: Hadoop 3.2 features | Major | . | Steve Loughran | Steve Loughran | | | [UI2] YARN UI2 is not accessible when config.env file failed to load | Critical | yarn-ui-v2 | Akhil PB | Akhil PB | | | [UI2] YARN UI2 breaks if getUserInfo REST API is not available in older versions. | Critical | . | Akhil PB | Akhil PB | | | Fix broken list items in PlacementConstraints documentation | Minor | documentation | Masahiro Tanaka | Masahiro Tanaka | | | Arrays.fill() wrong index in BlockSender.readChecksum() exception handling | Major | datanode | Tao Zhang | Tao Zhang | | | Container cgroups are leaked when using docker | Major | . | Jim Brennan | Jim Brennan | | | StringUtils#createStartupShutdownMessage throws NPE when args is null | Major | . | Lokesh Jain | Dinesh Chitlangia | | | org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently | Major | mrv2 | Robert Joseph Evans | Jason Lowe | | | MRAppBenchmark.benchmark1() fails with NullPointerException | Minor | test | Oleksandr Shevchenko | Oleksandr Shevchenko | | | ThrottledContainerAllocator in MRAppBenchmark should implement RMHeartbeatHandler | Minor | test | Oleksandr Shevchenko | Oleksandr Shevchenko | | | HttpFSFileSystem.getFileStatus() doesn't return "snapshot enabled" bit | Major | httpfs | Siyao Meng | Siyao Meng | | | Improve BlockPlacementPolicyDefault's consider load logic | Major | . | Henrique Barros | Shweta | | | WebHDFS: GETSNAPSHOTDIFF API NPE when param "snapshotname" is given but "oldsnapshotname" is not. | Major | hdfs, webhdfs | Siyao Meng | Pranay Singh | | | CapacityScheduler fails to unreserve when cluster resource contains empty resource type | Critical | capacityscheduler | Tao Yang | Tao Yang | | | TestDataNodeMultipleRegistrations is flaky | Major | . | igo Goiri | Ayush Saxena | | | triggerActiveLogRoll stuck on dead name node, when ConnectTimeoutException happens. | Critical | ha | Rong Tang | Rong Tang | | | Remove the 'Path

should be specified as a URI' warnings on startup | Major | conf | Arpit Agarwal | Ayush Saxena | | | DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk | Major | nodemanager | Jason Lowe | Eric Badger | | | Disk Balancer : Make execute command documentation better. | Major | diskbalancer, documentation | Harshakiran Reddy | Ranith Sardar | | | Trash : Negative Value For Deletion Interval Leads To Abnormal Behaviour. | Major | . | Ayush Saxena | Ayush Saxena | | | [UI2] Few duplicated or inconsistent information displayed in UI2 | Major | yarn-ui-v2 | Akhil PB | Akhil PB | | | [UI2] Container logs on Application / Service pages on UI2 are not available many case, improve error messages in such cases. | Major | yarn-ui-v2 | Akhil PB | Akhil PB | | | JobResourceUploader creates LocalFileSystem when it's not necessary | Major | job submission | Peter Cseh | Peter Cseh | | | Typos in Docker docs: contains =\> containers | Minor | nodemanager | Daniel Templeton | Zoltan Siegl | | | RM fails to recover finished unmanaged AM | Critical | . | Rakesh Shah | Bibin A Chundatt | | | yarn-registry.md has wrong word ong-lived, it should be long-lived | Trivial | documentation | leiqiang | leiqiang | | | Misplaced the TestRMWebServicesFairScheduler.java file. | Major | fairscheduler, test | Y. SREENIVASULU REDDY | Y. SREENIVASULU REDDY | | | Typo in Secure Mode documentation | Trivial | documentation | Thomas Levine | Thomas Levine | | | App Nodelabel missed after RM restart for finished apps | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | RBW Blocks which are having less GS should be added to Corrupt | Minor | . | Brahma Reddy Battula | Brahma Reddy Battula | | | resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues | Critical | capacityscheduler | Tao Yang | Tao Yang | | | [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise ClassCastExceptions | Minor | test | Andrew Purtell | Andrew Purtell | | | Add a missing "break" in BaseTestHttpFSWith | Minor | httpfs, test | Siyao Meng | Siyao Meng | | | Cluster metrics can fail with IndexOutOfBoundsException | Minor | router | Akshay Agarwal | Akshay Agarwal | | | Memory leak when CapacityScheduler allocates from reserved container with non-default label | Critical | capacityscheduler | Tao Yang | Tao Yang | | | Maven 3.3.3 unable to parse pom file | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Add missing cleanupSSLConfig() call for TestTimelineClient test | Minor | test, timelineclient | Aki Tanaka | Aki Tanaka | | | Reuse Object Mapper in KMSJSONReader | Major | kms | Jonathan Eagles | Jonathan Eagles | | | TestNMProxy unit test is failing | Major | yarn | Eric Yang | Eric Yang | | | Fix incorrect option used in description of InMemoryAliasMap | Minor | documentation | Yiqun Lin | Yiqun Lin | | | [UI2] YARN service delete option disappears after stopping application | Critical | yarn-ui-v2 | Yesha Vora | Akhil PB | | | [UI2] Improve error pages in new YARN UI | Major | yarn-ui-v2 | Akhil PB | Akhil PB | | | Remove Ozone related sources from the 3.2 branch | Major | . | Elek, Marton | Elek, Marton | | | ZStandardDecompressor native code sets an integer field as a long | Blocker |

| Jason Lowe | Jason Lowe | | | Fix findbugs warnings in YarnServiceUtils | Minor | . | Akira Ajisaka | Vidura Bhathiya Mudalige | | | RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice | Major | . | Ayush Saxena | Ayush Saxena | | | [UI2] Maintain constant horizontal application info bar for Application Attempt page | Major | yarn-ui-v2 | Yesha Vora | Akhil PB | | | updateNodeResource does not support units for memory | Minor | . | igo Goiri | Manikandan R | | | Adding replicas to volume map makes DataNode start slowly | Major | . | Yiqun Lin | Surendra Singh Lilhore | | | Add null check for add-replica pool to avoid lock acquiring | Major | . | Yiqun Lin | Surendra Singh Lilhore | | | Fix deprecated maven-surefire-plugin configuration in hadoop-kms module | Minor | kms | Akira Ajisaka | Vidura Bhathiya Mudalige | | | [UI2] Application Attempts tab is not shown correctly when there are no attempts | Major | . | Charan Hebri | Akhil PB | | | hadoop.registry.rm.enabled is not used | Major | . | igo Goiri | igo Goiri | | | TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out | Minor | namenode, test | John Zhuge | Ayush Saxena | | | ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads | Major | erasure-coding | Xiao Chen | Hrishikesh Gadre | | | Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API | Major | webhdfs | Weiwei Yang | Weiwei Yang | | | [UI2] Remove application tab from YARN Queue Page | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora | | | [UI2] Lost nodes representation missing from Nodemanagers Chart | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora | | | executorLock is misleading in ContainerLaunch | Trivial | yarn | Chandni Singh | Chandni Singh | | | TestDataNodeVolumeFailure is Flaky | Major | . | Ayush Saxena | Ayush Saxena | | | RBF: Remove FSCK from Router Web UI | Major | . | Fei Hui | Fei Hui | | | SLS tool fix node addition | Critical | . | Bibin A Chundatt | Bibin A Chundatt | | | YARN Service Client might not work correctly with RM REST API for Kerberos authentication | Blocker | . | Eric Yang | Eric Yang | | | Remove ozonefs class name definition from core-default.xml | Blocker | fs | Elek, Marton | Elek, Marton | | | Kerberos principal is needed when submitting a submarine job | Critical | . | Zac Zhou | Zac Zhou | | | JobSplitWriter prints unnecessary warnings if EC(RS10,4) is used | Major | client, mrv2 | Peter Bacsko | Peter Bacsko | | | YARN UI2 doc changes to update security status (verified under security environment) | Blocker | . | Sunil Govindan | Sunil Govindan | | | Yarn Service: discrepancy between hashcode and equals of ConfigFile | Minor | . | Chandni Singh | Chandni Singh | | | start-build-env.sh creates an invalid /etc/sudoers.d/hadoop-build-${USER\_ID} file entry | Minor | build | Jon Boone | Jon Boone | | | TestBlockReaderLocal#testStatisticsForErasureCodingRead is flaky | Major | erasure-coding, test | Wei-Chiu Chuang | Xiao Chen | | | Move DelegationTokenIssuer to the right path | Blocker | security | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Copy of

is not deleted if test fails, causes other test failures | Major | yarn | Antal Blint Steinbach | Antal Blint Steinbach | | | ZStandardDecompressor.c mistakes a class for an instance | Blocker | . | Ben Lau | Jason Lowe | | | RBF: Documentation should reflect right scripts for v3.0 and above | Major | . | CR Hota | CR Hota | | | RBF: Web UI update to bootstrap-3.3.7 | Major | . | igo Goiri | igo Goiri | | | TestLayoutVersion#testNameNodeFeatureMinimumCompatibleLayoutVersions fails | Major | test | Takanobu Asanuma | Takanobu Asanuma | | | Incompatible layout when generating FSImage | Major | . | igo Goiri | igo Goiri | | | CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0 | Critical | tools/distcp | Ted Yu | Ted Yu | | | Renamed HADOOP\SECURITY\GROUP\SHELL\COMMAND\_TIMEOUT keys break compatibility | Blocker | . | Wei-Chiu Chuang | Wei-Chiu Chuang | | | zstd compressor can fail with a small output buffer | Major | . | Jason Lowe | Jason Lowe | | | Add service upgrade cancel and express examples to the service upgrade doc | Minor | . | Chandni Singh | Chandni Singh | | | Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances | Major | kms | Wei-Chiu Chuang | Xiao Chen | | | Compilation fails with dependency convergence error for hbase.profile=2.0 | Blocker | . | Rohith Sharma K S | Rohith Sharma K S | | | CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. | Major | . | Sumana Sathish | Wangda Tan | | | Fix fair scheduler race condition in app submit and queue cleanup | Blocker | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | Configuration: Included properties are not cached if resource is a stream | Critical | . | Eric Payne | Eric Payne | | | MapReduce example wordmedian should handle generic options | Major | . | Fei Hui | Fei Hui | | | KMS client uses wrong UGI after HADOOP-14445 | Blocker | kms | Wei-Chiu Chuang | Wei-Chiu Chuang | | | JSON License is included in the transitive dependency of aliyun-sdk-oss 3.0.0 | Blocker | . | Akira Ajisaka | Akira Ajisaka | | | TestSecureLogins#testValidKerberosName fails | Major | security | Akira Ajisaka | Akira Ajisaka | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestQueue fails on Java9 | Major | test | Takanobu Asanuma | Takanobu Asanuma | | | TestKMS should close providers | Major | kms, test | Xiao Chen | Xiao Chen | | | Add a test for DfsAdmin refreshSuperUserGroupsConfiguration | Minor | namenode | Mukul Kumar Singh | Mukul Kumar Singh | | | Remove the usage of org.mockito.internal.util.reflection.Whitebox | Major | test | Akira Ajisaka | Ewan Higgs | | | Fix TestFsck test failures on Windows | Major | hdfs | Xiao Liang | Xiao Liang | | | TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster | Minor | . | Anbang Hu | Anbang Hu | | | TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestResolveHdfsSymlink#testFcResolveAfs fails on Windows | Minor | . | Anbang Hu | Anbang Hu | |

TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir | Minor | . | Anbang Hu | Anbang Hu | | | TestDFSAdmin#testListOpenFiles fails on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestDebugAdmin#testComputeMetaCommand fails on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestBlockScanner does not close TestContext properly | Minor | . | Anbang Hu | Anbang Hu | | | TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestDatanodeHttpXFrame does not shut down cluster | Minor | . | Anbang Hu | Anbang Hu | | | TestDatanodeRegistration#testForcedRegistration does not shut down cluster | Minor | . | Anbang Hu | Anbang Hu | | | TestNestedEncryptionZones does not shut down cluster | Minor | . | Anbang Hu | Anbang Hu | | | Insufficient system resources exist to complete the requested service for some tests on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestNameNodePrunesMissingStorages#testNameNodePrunesUnreportedStorages does not shut down cluster properly | Minor | . | Anbang Hu | Anbang Hu | | | TestBlockReaderLocalLegacy#testBlockReaderLocalLegacyWithAppend fails on Windows | Minor | test | Anbang Hu | Anbang Hu | | | TestQuorumJournalManager fails on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestAuditLoggerWithCommands fails on Windows | Minor | test | Anbang Hu | Anbang Hu | | | Randomize the test directory path for TestHDFSFileSystemContract | Minor | . | Anbang Hu | Anbang Hu | | | TestErasureCodingExerciseAPIs fails on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestDFSShell#testSetrepLow fails on Windows | Minor | . | Anbang Hu | Anbang Hu | | | Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA | Minor | . | Anbang Hu | Anbang Hu | | | Some tests in TestDiskBalancerCommand fail on Windows due to MiniDFSCluster path conflict and improper path usage | Minor | . | Anbang Hu | Anbang Hu | | | TestDFSAdmin#testCheckNumOfBlocksInReportCommand should use a separate MiniDFSCluster path | Minor | . | Anbang Hu | Anbang Hu | | | TestReencryptionHandler fails on Windows | Minor | . | Anbang Hu | Anbang Hu | | | Fix TestGetConf#testGetJournalNodes on Windows due to a mismatch line separator | Major | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Fix TestJavaSerialization for Windows due a mismatch line separator | Minor | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Fix TestNativeCollectorOnlyHandler.testOnCall on Windows because of the path format | Minor | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Randomize baseDir for MiniDFSCluster in TestBlockScanner | Minor | . | Anbang Hu | Anbang Hu | | | Randomize baseDir for MiniDFSCluster in TestReconstructStripedFile and TestReconstructStripedFileWithRandomECPolicy | Minor | . | Anbang Hu | Anbang Hu | | | Randomize baseDir for MiniDFSCluster in TestDFSStripedInputStream and TestDFSStripedInputStreamWithRandomECPolicy | Minor | . | Anbang Hu | Anbang Hu | | | Add tests for various org.apache.hadoop.util classes | Minor | test, util | Arash Nabili | Arash Nabili | | | Some Node Manager tests fail on Windows due to improper path/file separator | Minor | . | Anbang Hu | Anbang Hu | | | TestAMSimulator failing with NPE | Minor |

| Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | TestBasicDiskValidator fails with NoSuchFileException | Minor | . | igo Goiri | Giovanni Matteo Fumarola | | | TestDFSAdminWithHA times out on Windows | Minor | . | Anbang Hu | Lukas Majercak | | | Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows | Major | test | Xiao Liang | Xiao Liang | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Daemon thread in Namenode to find blocks placed in other storage than what the policy specifies | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN | Major | datanode, namenode | Uma Maheswara Rao G | Rakesh R | | | [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN | Major | datanode | Rakesh R | Rakesh R | | | [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Provide unique trackID to track the block movement sends to coordinator | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Add satisfyStoragePolicy API in HdfsAdmin | Major | hdfs-client | Uma Maheswara Rao G | Yuanbo Liu | | | [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on | Major | datanode, namenode | Wei Zhou | Wei Zhou | | | [SPS] Make storage policy satisfier daemon work on/off dynamically | Major | datanode, namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Handling of block movement failure at the coordinator datanode | Major | datanode | Rakesh R | Rakesh R | | | [SPS]: Handle partial block location movements | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Erasure coded files should be considered for satisfying storage policy | Major | namenode | Rakesh R | Rakesh R | | | [SPS]: Make SPS movement monitor timeouts configurable | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Local DN should be given preference as source node, when target available in same node | Critical | namenode | Yuanbo Liu | Uma Maheswara Rao G | | | [SPS]: Provide persistence when satisfying storage

| Major | datanode, namenode | Yuanbo Liu | Yuanbo Liu | | | [SPS]: Daemon thread of SPS should start only in Active NN | Major | datanode, namenode | Wei Zhou | Wei Zhou | | | [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues | Major | datanode, namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Check Mover file ID lease also to determine whether Mover is running | Major | datanode, namenode | Wei Zhou | Wei Zhou | | | [SPS]: Remove xAttrs when movements done or SPS disabled | Major | datanode, namenode | Yuanbo Liu | Yuanbo Liu | | | [SPS]: Fix timeout issue in unit tests caused by longger NN down time | Major | datanode, namenode | Wei Zhou | Rakesh R | | | [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks | Major | datanode, namenode | Uma Maheswara Rao G | Rakesh R | | | [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log. | Blocker | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called | Major | datanode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS] : Empty files should be ignored in StoragePolicySatisfier. | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode. | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS] Correct the log in BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck | Minor | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS]: Add CLI command for satisfy storage policy operations | Major | datanode, namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS]: Double checks to ensure that SPS/Mover are not running together | Major | datanode, namenode | Wei Zhou | Rakesh R | | | [SPS]: Document the SPS feature | Major | documentation | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS] :

TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS]: Fix checkstyle warnings | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time | Minor | datanode, namenode | Rakesh R | Rakesh R | | | libhdfs++: PROTOC\IS\COMPATIBLE check fails if protobuf library is built from source | Major | hdfs-client | Anatoli Shein | Anatoli Shein | | | [SPS]: Fix review comments of StoragePolicySatisfier feature | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Optimize extended attributes for tracking SPS movements | Major | datanode, namenode | Uma Maheswara Rao G | Surendra Singh Lilhore | | | [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir | Major | datanode, namenode | Rakesh R | Surendra Singh Lilhore | | | CLI Proto Modifications to support Node Attributes | Major | api, capacityscheduler, client | Naganarasimha G R | Naganarasimha G R | | | [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS] : Block movement analysis should be done in read lock. | Major | datanode, namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | libhdfs++: Prevent Requests from holding dangling pointer to RpcEngine | Critical | hdfs-client | James Clampffer | James Clampffer | | | [SPS]: Provide an option to track the status of in progress requests | Major | datanode, namenode | Uma Maheswara Rao G | Surendra Singh Lilhore | | | [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Improve storage policy satisfier configurations | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS]: Move SPS classes to a separate package | Trivial | nn | Uma Maheswara Rao G | Rakesh R | | | [SPS]: Reduce the locking and cleanup the Namesystem access | Major | datanode, namenode | Rakesh R | Rakesh R | | | [SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations. | Major | datanode, namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Support CLI for Node Attributes Mapping | Major | api, capacityscheduler, client | Naganarasimha G R | Naganarasimha G R | | | [SPS]: Implement a mechanism to scan the files for external SPS | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS]: Implement a mechanism to do file block movements for external SPS | Major | . | Rakesh R | Rakesh R | | | [SPS]: Revisit configurations to make SPS service modes internal/external/none | Blocker | . | Rakesh R | Rakesh R | | | [SPS]: Provide External Context implementation. | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G | | | [SPS] : Create start/stop script to start external SPS process. | Blocker | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS]: Fix review comments of external storage policy satisfier | Major | . | Rakesh R | Rakesh R | | | PB changes to carry node-attributes in NM heartbeat | Major | . | Weiwei Yang | Weiwei Yang | | | Update PB for prefix support of node attributes | Blocker | . | Weiwei Yang | Naganarasimha G R | | | Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers | Blocker | nodemanager | Weiwei Yang | Weiwei Yang | | | [SPS]: Fix the branch review comments(Part1) | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier | Major |

| Rakesh R | Rakesh R | | | Attribute Manager to store and provide node attributes in RM | Major | api, capacityscheduler, client | Naganarasimha G R | Naganarasimha G R | | | Validate Node Attributes from NM | Major | nodemanager, RM | Weiwei Yang | Weiwei Yang | | | NodeAttributeManager add/get API is not working properly | Critical | resourcemanager | Weiwei Yang | Weiwei Yang | | | [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls | Major | . | Rakesh R | Rakesh R | | | Node attributes reporting from NM to RM | Major | nodemanager | Weiwei Yang | Weiwei Yang | | | AliyunOSS: move files under a directory in parallel when rename a directory | Major | fs/oss | wujinhu | wujinhu | | | Support NOT\_SELF and ALL namespace types for allocation tag | Major | resourcemanager | Weiwei Yang | Weiwei Yang | | | RBF: Improve the use of setQuota command | Major | . | liuhongtong | liuhongtong | | | Refactor FSNodeLabelStore code for Node Attributes store support | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | Add file system based scheduler configuration store | Major | yarn | Jiandan Yang | Jiandan Yang | | | RBF: TestConnectionManager#testCleanup() test case need correction | Minor | . | Dibyendu Karmakar | Dibyendu Karmakar | | | Support configuration based Node Attribute provider | Major | nodemanager | Weiwei Yang | Weiwei Yang | | | Expose Node Attributes info via RM nodes REST API | Major | resourcemanager | Weiwei Yang | Weiwei Yang | | | CLI Integration with NodeAttributesManagerImpl | Major | . | Naganarasimha G R | Naganarasimha G R | | | S3GuardTool.prune to handle UnsupportedOperationException | Trivial | fs/s3 | Steve Loughran | Gabor Bota | | | RBF: Support NamenodeProtocol in the Router | Major | . | igo Goiri | igo Goiri | | | Support application tags when defining application namespaces for placement constraints | Major | . | Weiwei Yang | Weiwei Yang | | | Update TimelineServerV2 doc as per YARN-7919 | Major | . | Rohith Sharma K S | Haibo Chen | | | Fix TestRMWebServicesNodes test failure | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | [Atsv2] Retrospect storing entities into sub application table from client perspective | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | RBF: TestRouterWebHDFSContractCreate failed | Major | test | Takanobu Asanuma | Takanobu Asanuma | | | Node Attribute store for storing and recovering attributes | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | S3GuardTool prune to prune specific bucket entries | Minor | fs/s3 | Steve Loughran | Gabor Bota | | | Give an informative message when incorrect format is used in ATSv2 filter attributes | Major | ATSv2 | Charan Hebri | Rohith Sharma K S | | | Support auto-spawning of admin configured services during bootstrap of rm/apiserver | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | RBF: Fix java doc for StateStoreFileSystemImpl | Minor | hdfs | Yiran Wu | Yiran Wu | | | Add support for Node Labels on Auto Created Leaf Queue Template | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad | | | RBF: mv/rm fail after the directory exceeded the quota limit | Major | . | Weiwei Wu | Yiqun Lin | | | Docker Stop grace period should be configurable | Major | yarn | Eric Badger | Eric Badger | | | Support API interface to query cluster attributes and attribute to nodes | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | RBF: Support federation with no subclusters | Minor |

| igo Goiri | igo Goiri | | | RBF: Improve timeout RPC call mechanism | Minor | . | igo Goiri | igo Goiri | | | Remove double semi colons on imports that make Clover fall over. | Minor | . | Ewan Higgs | Ewan Higgs | | | Support ContainerRelaunch for Docker containers | Major | . | Shane Kumpf | Shane Kumpf | | | Transitive dependencies for component are not resolved | Major | . | Rohith Sharma K S | Billie Rinaldi | | | RBF: Improve error message returned from subcluster | Minor | . | Wei Yan | igo Goiri | | | RBF: Remove LinkedList From StateStoreFileImpl.java | Trivial | federation | BELUGA BEHR | BELUGA BEHR | | | RBF: Wrong date information in list file(-ls) result | Minor | . | Dibyendu Karmakar | Dibyendu Karmakar | | | Add security check for privileged docker container | Major | security | Eric Yang | Eric Yang | | | [JDK10] Update maven plugin tools to fix compile error in hadoop-maven-plugins module | Major | build | Akira Ajisaka | Takanobu Asanuma | | | [atsv2 read acls] Include domain table creation as part of schema creator | Major | . | Vrushali C | Vrushali C | | | Add default service AM Xmx | Major | . | Jian He | Jian He | | | Yarn Service Upgrade: Add support for initiating service upgrade | Major | . | Chandni Singh | Chandni Singh | | | AliyunOSS: provide one asynchronous multi-part based uploading mechanism | Major | fs/oss | Genmao Yu | Genmao Yu | | | Support placement policy in yarn native services | Major | yarn-native-services | Billie Rinaldi | Gour Saha | | | Add unit test to validate queue priority preemption works under node partition. | Minor | . | Charan Hebri | Zian Chen | | | Create default readiness check for service components | Major | yarn-native-services | Billie Rinaldi | Billie Rinaldi | | | RBF: Improve the error loggings for printing the stack trace | Major | . | Yiqun Lin | Yiqun Lin | | | Support auto-spawning of admin configured services during bootstrap of RM | Major | . | Rohith Sharma K S | Rohith Sharma K S | | | Allow user supplied Docker client configurations with YARN native services | Major | . | Shane Kumpf | Shane Kumpf | | | Support specifying node resources in SLS | Major | . | Abhishek Modi | Abhishek Modi | | | RBF: Add more router-related information to the UI | Minor | . | Wei Yan | Wei Yan | | | [UI2] Improve unit tests for new YARN UI | Minor | yarn-ui-v2 | Akhil PB | Akhil PB | | | RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table | Major | . | Dibyendu Karmakar | Dibyendu Karmakar | | | Add API to fetch node to attribute mapping | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | [Router] Federation: routing getAppState REST invocations transparently to multiple RMs | Major | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Parallelize node addition in SLS | Major |

| Abhishek Modi | Abhishek Modi | | | Simplify PlacementConstraints API by removing allocationTagToIntraApp | Minor | resourcemanager | Weiwei Yang | Weiwei Yang | | | Docker ".cmd" files should not be put in hadoop.tmp.dir | Critical | . | Eric Badger | Eric Badger | | | RBF: Disabled Nameservice store API | Major | . | igo Goiri | igo Goiri | | | Documentation changes for auto creation of Leaf Queues with node label | Major | . | Suma Shivaprasad | Suma Shivaprasad | | | S3Guard: expose capability query in MetadataStore and add tests of authoritative mode | Major | fs/s3 | Steve Loughran | Gabor Bota | | | RBF: Fix setSafeMode in the Router | Major | . | igo Goiri | igo Goiri | | | RBF: Disable Nameservices from the federation | Major | . | igo Goiri | igo Goiri | | | Remove multibyte characters in DataNodeUsageReportUtil | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Yarn Service Upgrade: add support to upgrade a component instance | Major | . | Chandni Singh | Chandni Singh | | | RBF: Improve the interfaces to modify and view mount tables | Minor | . | Wei Yan | Gang Li | | | Component health threshold monitor | Major | . | Gour Saha | Gour Saha | | | RBF: Show disabled name services in the UI | Minor | . | igo Goiri | igo Goiri | | | LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash. | Major | fs/s3, test | Lei (Eddy) Xu | Gabor Bota | | | ATS v2 returns invalid YARN\CONTAINER\ALLOCATED\HOST\HTTP\_ADDRESS from NM | Critical | ATSv2 | Yesha Vora | Rohith Sharma K S | | | Add chart in SLS to illustrate the throughput of the scheduler | Major | scheduler-load-simulator | Weiwei Yang | Tao Yang | | | Yarn Service Upgrade: Add a flag to disable upgrade | Major | . | Chandni Singh | Chandni Singh | | | Update YARN-Services-Examples.md to be in sync with the latest code | Major | . | Gour Saha | Gour Saha | | | RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries | Minor | . | Ekanth Sethuramalingam | Ekanth Sethuramalingam | | | RBF: Fix dead links in RBF document | Major | documentation | Akira Ajisaka | Chetna Chaudhari | | | [SPS]: Collects successfully moved block details via IBR | Major | . | Rakesh R | Rakesh R | | | Fix constraint cardinality check in the presence of multiple target allocation tags | Critical | . | Weiwei Yang | Weiwei Yang | | | S3ABlockOutputStream.flush() be no-op when stream closed | Trivial | fs/s3 | Steve Loughran | Gabor Bota | | | Docker does not support hostnames greater than 64 characters | Critical | yarn-native-services | Yesha Vora | Shane Kumpf | | | Pending backlog for async allocation threads should be configurable | Major | . | Weiwei Yang | Tao Yang | | | Distributed shell AM may re-launch containers if RM work preserving restart happens | Major | applications, resourcemanager | Chun Chen | Shane Kumpf | | | RBF: Reject requests when a Router is overloaded | Major |

| igo Goiri | igo Goiri | | | libhdfs++: Get minidfscluster tests running under valgrind | Major | hdfs-client | James Clampffer | Anatoli Shein | | | Update placement constraints doc with application namespaces and inter-app constraints | Major | documentation | Weiwei Yang | Weiwei Yang | | | Exception when reinitializing a container using LinuxContainerExecutor | Blocker | . | Chandni Singh | Chandni Singh | | | Yarn RM Epoch should wrap around | Major | . | Young Chen | Young Chen | | | Improve status response when yarn application is destroyed | Major | yarn-native-services | Yesha Vora | Gour Saha | | | RBF: Add unit test TestStateStoreDisabledNameservice | Major | . | Yiqun Lin | Yiqun Lin | | | ITestS3GuardToolDynamo should only run with -Ddynamo | Major | . | Aaron Fabbri | Aaron Fabbri | | | [UI2] Support kill application from new YARN UI | Major | . | Wangda Tan | Gergely Novk | | | HTTPS Ats v2 api call fails with "bad HTTP parsed" | Critical | ATSv2 | Yesha Vora | Charan Hebri | | | Docker container launch use popen have risk of shell expansion | Blocker | yarn-native-services | Eric Yang | Eric Yang | | | s3guard: implement time-based (TTL) expiry for LocalMetadataStore | Minor | fs/s3 | Aaron Fabbri | Gabor Bota | | | s3guard ITestS3GuardToolLocal failures in diff tests | Minor | . | Aaron Fabbri | Gabor Bota | | | Docker container launch fails due to .cmd file creation failure | Blocker | . | Eric Badger | Jason Lowe | | | TestRollingFileSystemSinkWithLocal fails on Windows | Major | test | Xiao Liang | Xiao Liang | | | RBF: Fix synchronization of router quota and nameservice quota | Major | . | liuhongtong | Yiqun Lin | | | Flex down should remove instance with largest component instance ID first | Critical | yarn-native-services | Gour Saha | Gour Saha | | | Support ENTRY\_POINT for docker container | Blocker | yarn | Eric Yang | Eric Yang | | | Revisit NodeAttribute class structure | Major | resourcemanager | Naganarasimha G R | Naganarasimha G R | | | Incorrect HTTP status code returned by ATSv2 for non-whitelisted users | Critical | ATSv2 | Charan Hebri | Rohith Sharma K S | | | Race condition when container events are published for KILLED applications | Major | ATSv2 | Charan Hebri | Rohith Sharma K S | | | Yarn Service Upgrade: Add support to upgrade a component | Major | . | Chandni Singh | Chandni Singh | | | get\docker\command refactoring | Minor | . | Jason Lowe | Eric Badger | | | [atsv2 read acls] Add TimelineWriter#writeDomain | Major | . | Vrushali C | Rohith Sharma K S | | | [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor | Major | . | Botong Huang | Botong Huang | | | Sending a kill does not immediately kill docker containers | Major | . | Eric Badger | Eric Badger | | | Add no-new-privileges flag to docker run | Major | . | Eric Badger | Eric Badger | | | Remove unused environment variables from the Docker runtime | Trivial |

| Shane Kumpf | Eric Badger | | | Set OOM control for memory cgroups | Major | nodemanager | Karthik Kambatla | Miklos Szegedi | | | hadoop-yarn-services-api should be part of hadoop-yarn-services | Blocker | yarn-native-services | Eric Yang | Chandni Singh | | | Add default volume mount list | Major | yarn | Eric Badger | Eric Badger | | | TestRawLocalFileSystemContract fails on Windows | Minor | test | Anbang Hu | Anbang Hu | | | Node attribute manager logs are flooding RM logs | Major | . | Weiwei Yang | Weiwei Yang | | | TestHadoopArchiveLogs (#testGenerateScript, #testPrepareWorkingDir) fails on Windows | Minor | . | Anbang Hu | Anbang Hu | | | TestTrash should use proper test path to avoid failing on Windows | Minor | . | Anbang Hu | Anbang Hu | | | Docker client configuration can still be set incorrectly | Major | . | Shane Kumpf | Shane Kumpf | | | S3Guard testPruneCommandCLI can fail | Major | fs/s3 | Steve Loughran | Gabor Bota | | | AbstractS3GuardToolTestBase.testDiffCommand fails when using dynamo | Major | fs/s3 | Gabor Bota | Gabor Bota | | | Fine-grained locking while consuming journal stream. | Major | namenode | Konstantin Shvachko | Konstantin Shvachko | | | stdout.txt, stderr.txt logs of a launched docker container is coming with primary group of submit user instead of hadoop | Critical | yarn-native-services | Sunil Govindan | Eric Yang | | | Remove YARN registry entries when a service is killed by the RM | Critical | yarn-native-services | Shane Kumpf | Billie Rinaldi | | | RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN\_VALUE | Critical | federation | CR Hota | CR Hota | | | Using docker image from a non-privileged registry, the launch\_command is not honored | Critical | . | Wangda Tan | Eric Yang | | | Namenode#createFile should be /.reserved/raw/ aware. | Critical | encryption | Rushabh S Shah | Rushabh S Shah | | | RMNodeResourceUpdateEvent update from scheduler can lead to race condition | Major | graceful, resourcemanager, scheduler | Brook Zhou | Wilfred Spiegelenburg | | | ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster | Major | . | Jeff Zhang | Bharat Viswanadham | | | NoClassDefFoundError for TimelineCollectorManager when starting MiniYARNCluster | Major | . | Jeff Zhang | Rohith Sharma K S | | | Add additional test cases to cover some corner cases for FileUtil#symlink | Major | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Add test cases to cover FileUtil#readLink | Minor | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks | Minor | fs/azure | Esfandiar Manii | Esfandiar Manii | | | Make the aggregation interval in AppLevelTimelineCollector configurable | Minor | timelineserver | Haibo Chen | Abhishek Modi | | | ContainerLaunch#testInvalidEnvVariableSubstitutionType is not supported in Windows | Minor | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Enable stopped system services to be started during RM start | Critical | . | Billie Rinaldi | Billie Rinaldi | | | Revisit liveliness checks for Docker containers | Blocker | . | Shane Kumpf | Shane Kumpf | | | Clean up ContainerLaunch and ContainerExecutor pre-HADOOP-15528 | Minor | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | [PROVIDED Phase 2] Multipart Uploader API | Major | . | Ewan Higgs | Ewan Higgs | | | Make WASB listStatus messages consistent | Trivial | fs/azure | Esfandiar Manii | Esfandiar Manii | | | Remove the Local Dynamo DB test option | Major | fs/s3 | Steve Loughran | Gabor Bota | | | Add builder interface to FileContext | Major | fs | Lei (Eddy) Xu | Lei (Eddy) Xu | |

TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows | Minor | test | Xiao Liang | Xiao Liang | | | s3guard diff assert failure if source path not found | Minor | fs/s3 | Steve Loughran | Gabor Bota | | | Merge fileCache and dirCache into one single cache in LocalMetadataStore | Minor | . | Gabor Bota | Gabor Bota | | | Add CLI interface to query node attributes | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters | Minor | amrmproxy, federation | Botong Huang | Botong Huang | | | Dshell docker container gets marked as lost after NM restart | Major | yarn-native-services | Yesha Vora | Shane Kumpf | | | Priviledged container app launch is failing intermittently | Major | yarn-native-services | Yesha Vora | Eric Yang | | | [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path | Major | . | Rakesh R | Rakesh R | | | s3guard set-capacity command to fail on read/write of 0 | Minor | fs/s3 | Steve Loughran | Gabor Bota | | | RBF: If a directory exceeds quota limit then quota usage is not refreshed for other mount entries | Major | . | Dibyendu Karmakar | Dibyendu Karmakar | | | Fair scheduler configuration should allow resource types in the minResources and maxResources properties | Critical | fairscheduler | Daniel Templeton | Szilard Nemeth | | | RBF: setQuota and getQuotaUsage should check the dfs.federation.router.quota.enable | Major | federation, hdfs | yanghuafeng | yanghuafeng | | | [AMRMProxy] Stateful FederationInterceptor for pending requests | Major | . | Botong Huang | Botong Huang | | | RBF: Fix RBF configuration links | Minor | documentation | Takanobu Asanuma | Takanobu Asanuma | | | S3Guard DDB retryBackoff to be more informative on limits exceeded | Major | fs/s3 | Steve Loughran | Gabor Bota | | | RBF: Admin cannot enforce Router enter SafeMode | Major | . | Wei Yan | Chao Sun | | | RBF: Add Web UI configurations and descriptions to RBF document | Minor | documentation | Takanobu Asanuma | Takanobu Asanuma | | | Improve use of ResourceNotFoundException in resource types code | Minor | nodemanager, resourcemanager | Daniel Templeton | Szilard Nemeth | | | RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Yarn Service Upgrade: Add documentation | Critical | . | Chandni Singh | Chandni Singh | | | [SPS]: Cleanup work for HDFS-10285 | Major | . | Rakesh R | Rakesh R | | | RBF: Router admin clrQuota is not synchronized with nameservice | Major | . | Dibyendu Karmakar | Dibyendu Karmakar | | | Resource leak caused by a reserved container being released more than once under async scheduling | Major | capacity scheduler | Weiwei Yang | Tao Yang | | | Add ITestDynamoDBMetadataStore | Minor | fs/s3, test | Sean Mackrory | Gabor Bota | | | Allow dot in attribute values | Minor | . | Bibin A Chundatt | Bibin A Chundatt | | | Add support for Node Labels in SLS | Major | . | Abhishek Modi | Abhishek Modi | | | DockerClient still touches hadoop.tmp.dir | Minor |

| Jason Lowe | Craig Condit | | | Normalize unit of resource objects in RM to avoid unit conversion in critical path | Critical | nodemanager, resourcemanager | Wangda Tan | Manikandan R | | | FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append. | Blocker | fs/s3, test | Steve Loughran | Steve Loughran | | | Update documentation and yarn-default related to the Docker runtime | Minor | . | Shane Kumpf | Craig Condit | | | Cleanup ENTRYPOINT documentation | Minor | . | Craig Condit | Craig Condit | | | Mark the log-aggregation-controller APIs as public | Major | . | Xuan Gong | Zian Chen | | | Create HomePolicyManager that sends all the requests to the home subcluster | Minor | . | Giovanni Matteo Fumarola | igo Goiri | | | Improve S3Guard documentation on Authoritative Mode implementation | Minor | fs/s3 | Aaron Fabbri | Gabor Bota | | | ABFS: tune imports & javadocs; stabilise tests | Major | fs/azure | Steve Loughran | Thomas Marquardt | | | Stabilize S3A Assumed Role support | Blocker | fs/s3 | Steve Loughran | Steve Loughran | | | Add version attribute to site doc examples and quickstart | Major | site | Gour Saha | Eric Yang | | | Logging improvements for better debuggability | Major | . | Suma Shivaprasad | Suma Shivaprasad | | | Document best practice for user management | Major | documentation, yarn | Eric Yang | Eric Yang | | | ABFS: Code changes for bug fix and new tests | Major | fs/azure | Da Zhou | Da Zhou | | | [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite() and #getFileInfo() function | Minor | . | Rakesh R | Rakesh R | | | S3A Multipart Uploader to work with S3Guard and encryption | Blocker | fs/s3 | Steve Loughran | Ewan Higgs | | | [Submarine] Initial implementation: Training job submission and job history retrieval | Major | . | Wangda Tan | Wangda Tan | | | ITestS3GuardToolLocal.testDiffCommand fails if bucket has per-bucket binding to DDB | Blocker | fs/s3 | Steve Loughran | Steve Loughran | | | re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes | Major | . | Xuan Gong | Zian Chen | | | Move logging APIs over to slf4j in hadoop-tools - Part2 | Major | . | Giovanni Matteo Fumarola | Ian Pickering | | | ABFS: Improve HTTPS Performance | Major | fs/azure | Thomas Marquardt | Vishwajeet Dusane | | | Update aws-sdk version to 1.11.375 | Blocker | build, fs/s3 | Steve Loughran | Steve Loughran | | | Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support) | Minor | fs/s3 | Rajesh Balamohan | Gabor Bota | | | Add GenericTestUtils.DelayAnswer that accept slf4j logger API | Major | . | Wenxin He | Wenxin He | | | ABFS: Add support for OAuth | Major | . | Da Zhou | Da Zhou | | | RBF: Router ID in RouterRpcClient is always null | Major |

| Takanobu Asanuma | Takanobu Asanuma | | | Improve error message for invalid value in fields attribute | Minor | ATSv2 | Charan Hebri | Abhishek Modi | | | Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision | Major | capacity scheduler | Sunil Govindan | Sunil Govindan | | | [AMRMProxy] Add sub-cluster timeout in LocalityMulticastAMRMProxyPolicy | Major | amrmproxy, federation | Botong Huang | Botong Huang | | | [AMRMProxy] More robust responseId resync after an YarnRM master slave switch | Major | amrmproxy | Botong Huang | Botong Huang | | | ABFS: Add support for ACL | Major | . | Da Zhou | Da Zhou | | | Support all types of placement constraint support for Capacity Scheduler | Critical | capacity scheduler | Weiwei Yang | Weiwei Yang | | | ABFS: InputStream wrapped in FSDataInputStream twice | Major | . | Sean Mackrory | Sean Mackrory | | | ABFS: Add support for StreamCapabilities. Fix javadoc and checkstyle | Major | fs/azure | Thomas Marquardt | Thomas Marquardt | | | Refactor NameNode failover proxy providers | Major | ha, hdfs-client | Konstantin Shvachko | Konstantin Shvachko | | | Modify placement constraints to support node attributes | Major | . | Sunil Govindan | Sunil Govindan | | | Refactor the UAM heartbeat thread in preparation for YARN-8696 | Major | . | Botong Huang | Botong Huang | | | Fix some of testContainerManager failures in Windows | Major | . | Botong Huang | Botong Huang | | | Relax NE node-attribute check when attribute doesn't exist on a node | Major | . | Sunil Govindan | Sunil Govindan | | | LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource | Major | . | Botong Huang | Botong Huang | | | ABFS: extensible support for custom oauth | Major | fs/azure | Thomas Marquardt | Da Zhou | | | RBF: Configurable value in xml for async connection request queue size. | Major | federation | CR Hota | CR Hota | | | Add support for tmpfs mounts with the Docker runtime | Major | . | Shane Kumpf | Craig Condit | | | FileSystemMultipartUploader should verify that UploadHandle has non-0 length | Major | fs/s3 | Ewan Higgs | Ewan Higgs | | | ABFS: Simplify configuration | Major | fs/azure | Thomas Marquardt | Da Zhou | | | Node attributes documentation | Major | documentation | Weiwei Yang | Naganarasimha G R | | | ABFS: Reduce test run time via parallelization and grouping | Major | fs/azure | Thomas Marquardt | Da Zhou | | | Fix jenkins issues for Node Attributes branch | Major | . | Sunil Govindan | Sunil Govindan | | | Clear node attribute path after each test run | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | ABFS - Implement client-side throttling | Major | . | Sneha Varma | Thomas Marquardt | | | Move logging to slf4j in HDFS package | Major | . | Giovanni Matteo Fumarola | Ian Pickering | | | ABFS: Add backward compatibility to handle Unsupported Operation for storage account with no namespace feature | Major | . | Da Zhou | Da Zhou | | | Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants | Minor | . | Gabor Bota | Gabor Bota | | | Add Yarnclient#yarnclusterMetrics API implementation in router | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | TestDistributedShell fails on Windows | Major | . | Botong Huang | Botong Huang | | | [Submarine] Failed to reset Hadoop home environment when submitting a submarine job | Major | . | Zac Zhou | Zac Zhou | | | [Documentation] RBF: Mount points across multiple subclusters | Minor | . | igo Goiri | igo Goiri | | | Add ABFS configuration to ConfigRedactor | Major |

| Sean Mackrory | Sean Mackrory | | | ABFS: Check variable names during initialization of AbfsClientThrottlingIntercept | Minor | . | Sneha Varma | Sneha Varma | | | ABFS: Allow OAuth credentials to not be tied to accounts | Major | . | Sean Mackrory | Sean Mackrory | | | add option to tag DDB table(s) created | Minor | fs/s3 | Steve Loughran | Gabor Bota | | | Make S3guard client resilient to DDB throttle events and network failures | Blocker | fs/s3 | Steve Loughran | Steve Loughran | | | DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period | Major | . | Chandni Singh | Chandni Singh | | | ABFS: support path "abfs://mycluster/file/path" | Major | . | Da Zhou | Da Zhou | | | ABFS: remove dependency on common-codec Base64 | Major | . | Da Zhou | Da Zhou | | | Make allocation tags in the placement spec optional for node-attributes | Major | . | Weiwei Yang | Weiwei Yang | | | s3guard: testDynamoTableTagging should clear existing config | Minor | fs/s3 | Aaron Fabbri | Gabor Bota | | | [JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1 | Minor | build | Akira Ajisaka | Takanobu Asanuma | | | [JDK10] Migrate from com.sun.tools.doclets to the replacement | Major | build | Akira Ajisaka | Akira Ajisaka | | | AliyunOSS: update oss-sdk version to 3.0.0 | Major | fs/oss | wujinhu | wujinhu | | | [Submarine] Add Tensorboard component when --tensorboard is specified | Critical | . | Wangda Tan | Wangda Tan | | | When STOPSIGNAL is not present then docker inspect returns an extra line feed | Major | . | Chandni Singh | Chandni Singh | | | ABFS: Fix issues raised by Yetus | Major | fs/azure | Sean Mackrory | Sean Mackrory | | | S3 listing inconsistency can raise NPE in globber | Major | fs | Steve Loughran | Steve Loughran | | | [JDK10] Migrate from sun.net.util.IPAddressUtil to the replacement | Major | net, util | Akira Ajisaka | Akira Ajisaka | | | java doc comments in docker-util.h is confusing | Minor | . | Zian Chen | Zian Chen | | | [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor | Major | . | Botong Huang | Young Chen | | | [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job | Critical | . | Wangda Tan | Wangda Tan | | | Multipart Uploader APIs to be marked as private/unstable in 3.2.0 | Blocker | fs | Steve Loughran | Steve Loughran | | | HttpFS: Implement ALLOWSNAPSHOT, DISALLOWSNAPSHOT | Major | httpfs | Siyao Meng | Siyao Meng | | | [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async | Major | nodemanager | Botong Huang | Botong Huang | | | [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments | Critical | submarine | Wangda Tan | Wangda Tan | | | [JDK10] TestSFTPFileSystem.testGetModifyTime fails | Major | . | Akira Ajisaka | Akira Ajisaka | | | AliyunOSS: Support Assume Roles in AliyunOSS | Major | fs/oss | wujinhu | wujinhu | | | Update Docker examples to use image which exists | Minor |

| Craig Condit | Craig Condit | | | ABFS: Ranger Support | Major | fs/azure | Thomas Marquardt | Yuan Gao | | | ABFS: remove unused maven dependencies and add used undeclared dependencies | Major | build, fs/azure | Da Zhou | Da Zhou | | | RBF: Move ClientProtocol APIs to its own module | Major | . | igo Goiri | Chao Sun | | | Allow administrators to control available container runtimes and set defaults for all containers | Major | nodemanager | Miklos Szegedi | Craig Condit | | | Adding JMX Metrics for Timeline Collector and Reader | Major | ATSv2, timelineserver | Sushil Ks | Sushil Ks | | | [JDK10] Migrate from sun.net.dns.ResolverConfiguration to the replacement | Major | net, util | Akira Ajisaka | Akira Ajisaka | | | Updated documentation of Submarine with latest examples. | Critical | . | Wangda Tan | Wangda Tan | | | [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer | Major | . | Botong Huang | Botong Huang | | | [JDK10] Fix javadoc errors in hadoop-hdfs-client module | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | ABFS: Skip unsupported test cases when non namespace enabled in ITestAzureBlobFileSystemAuthorization | Minor | fs/azure, test | Yuan Gao | Yuan Gao | | | ABFS: Fixing skipUserGroupMetadata in AzureBlobFileSystemStore | Major | fs/azure | Da Zhou | Da Zhou | | | Improve the error message when a bind mount is not whitelisted | Major | . | Simon Prewo | Simon Prewo | | | typo in AzureBlobFileSystem.getIsNamespaceEnabeld | Minor | fs/azure | Steve Loughran | Abhishek Modi | | | Make HTTPS the default protocol for ABFS | Major | fs/azure | Da Zhou | Da Zhou | | | HttpFS: Implement GETSNAPSHOTDIFF | Major | httpfs | Siyao Meng | Siyao Meng | | | ABFS: better exception handling when making getAccessToken call | Major | fs/azure | Da Zhou | Da Zhou | | | multipart upload to HDFS to support 0 byte upload | Major | fs, hdfs | Steve Loughran | Ewan Higgs | | | [Submarine] Add documentation for submarine installation details | Major | documentation, submarine | Zac Zhou | Zac Zhou | | | NM gets backed up deleting docker containers | Major | nodemanager | Eric Badger | Chandni Singh | | | HttpFS: Implement GETSNAPSHOTTABLEDIRECTORYLIST | Major | httpfs | Siyao Meng | Siyao Meng | | | Serve aggregated logs of historical apps from timeline service | Critical | timelineserver | Varun Saxena | Rohith Sharma K S | | | DynamoDB table Update can fail S3A FS init | Major | fs/s3 | Steve Loughran | Steve Loughran | | | ITestS3AContractMultipartUploader#testMultipartUploadEmptyPart test error | Major | fs/s3 | Gabor Bota | Ewan Higgs | | | [Submarine] Add documentation for submarine installation script details | Critical | . | Xun Liu | Xun Liu | | | [Submarine] Job should not be submitted if "--input\_path" option is missing | Critical | . | Zhankun Tang | Zhankun Tang | | | Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys | Minor | conf | Steve Loughran | Steve Loughran | | | YARN service example is out-dated | Major | yarn-native-services | Eric Yang | Suma Shivaprasad | | | AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream | Critical |

| wujinhu | wujinhu | | | [libhdfs++] Disable libhdfs++ build on systems that do not support thread\_local | Major | . | Anatoli Shein | Anatoli Shein | | | libhdfs++: Fix compilation errors and warnings when compiling with Clang | Blocker | hdfs-client | Anatoli Shein | Anatoli Shein | | | Yarn Service Upgrade: Add GET APIs that returns instances matching query params | Critical | . | Chandni Singh | Chandni Singh | | | Yarn Service Upgrade: Support upgrade of service that use docker containers | Major | . | Chandni Singh | Chandni Singh | | | Yarn Service Upgrade: Support express upgrade of a service | Major | . | Chandni Singh | Chandni Singh | | | Yarn Service Upgrade: Support cancelling upgrade | Major | . | Chandni Singh | Chandni Singh | | | Add ingress port based sasl resolver | Major | security | Chen Liang | Chen Liang | | | Carriage Return character in launch command cause node manager to become unhealthy | Major | . | Eric Yang | Billie Rinaldi | | | [Submarine] Update submarine installation script document | Blocker | . | Xun Liu | Xun Liu | | | Nvidia-docker v2 support for YARN GPU feature | Critical | . | Zhankun Tang | Charo Zhang | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Refine PlacementRule interface and add a app-name queue mapping rule as an example | Major | . | Zian Chen | Zian Chen | | | Update BUILDING.txt for building native libraries | Critical | build, documentation, native | Takanobu Asanuma | Takanobu Asanuma | | | Revisit checkUserAccessToQueue RM REST API | Critical | . | Wangda Tan | Wangda Tan | | | libhdfs++: Use hdfs::IoService object rather than asio::io\_service | Critical | . | James Clampffer | James Clampffer | | | Docker command error during container relaunch | Critical | . | Billie Rinaldi | Jason Lowe | | | YARN native service should support component restart policy | Critical | . | Wangda Tan | Suma Shivaprasad | | | libhdfs++: Fix GCC7 build | Major | . | James Clampffer | James Clampffer | | | Upgrade jackson-databind to version 2.9.5 | Major | . | Lokesh Jain | Lokesh Jain | | | Remove unused variables from ContainerLocalizer | Trivial | . | Ray Chiang | Dedunu Dhananjaya | | | Move ResourceRequest.clone logic everywhere into a proper API | Minor | . | Botong Huang | Botong Huang | | | Upgrade jquery to version 3.3.1 | Major | . | Lokesh Jain | Lokesh Jain | | | Make GetApplicationsRequestPBImpl thread safe | Critical | . | Wangda Tan | Wangda Tan | | | YARN native service should return container if launch failed | Critical | . | Wangda Tan | Chandni Singh | | | sun.net.spi.nameservice.NameService has moved to a new location | Major | . | Akira Ajisaka | Akira Ajisaka | | | Update EC documentation about rack fault tolerance | Major | documentation, erasure-coding | Xiao Chen | Kitti Nanasi | | | Upgrade Apache Zookeeper version due to security concerns | Major | . | Boris Vulikh | Akira Ajisaka | | | Upgrade maven-shade-plugin from 2.4.3 to 3.2.0 | Major | . | Takanobu Asanuma | Takanobu Asanuma | | | Upgrade Eclipse Jetty version to 9.3.24 | Major | . | Boris Vulikh | Boris