Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.3.0.0-alpha4.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Switch HttpFS from Tomcat to Jetty | Blocker | httpfs | John Zhuge | John Zhuge | | | Add ability to secure log servlet using proxy users | Major | . | Jeffrey E Rodriguez | Yuanbo Liu | | | ADLS connector should not check in contract-test-options.xml | Major | fs/adl, test | John Zhuge | John Zhuge | | | Recursively deleting file protected by sticky bit should fail | Critical | fs | John Zhuge | John Zhuge | | | UGI.getCurrentUser() fails if user does not have a keytab associated | Major | security | Alejandro Abdelnur | Xiao Chen | | | Rename "erasurecode" CLI subcommand to "ec" | Blocker | erasure-coding | Andrew Wang | Manoj Govindassamy | | | Refactor EC CLI to be similar to storage policies CLI | Major | erasure-coding, shell | Andrew Wang | Andrew Wang | | | Rename "rs-default" to "rs" | Major | erasure-coding | Andrew Wang | Andrew Wang | | | Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage | Major | hdfs | Manoj Govindassamy | Manoj Govindassamy | | | Change setErasureCodingPolicy to take a required string EC policy name | Major | erasure-coding | Andrew Wang | Andrew Wang | | | Remove S3A ref from META-INF service discovery, rely on existing core-default entry | Critical | fs/s3 | Steve Loughran | Steve Loughran | | | Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors | Blocker | erasure-coding | Sammi Chen | Sammi Chen | | | Enforce set of enabled EC policies on the NameNode | Blocker | erasure-coding | Andrew Wang | Andrew Wang | | | Do not enable any erasure coding policies by default | Major | erasure-coding | Andrew Wang | Manoj Govindassamy | | | Update guava dependency to the latest version | Major | . | Rakesh R | Tsuyoshi Ozawa | | | Make DistCpOptions class immutable | Major | tools/distcp | Mingliang Liu | Mingliang Liu | | | fix jsvc/secure user var inconsistencies | Major | scripts | Allen Wittenauer | Allen Wittenauer | | | Set default ADLS access token provider type to ClientCredential | Major | fs/adl | John Zhuge | John Zhuge | | | Metric preemptCall is not used in new preemption | Blocker | fairscheduler | Yufei Gu | Yufei Gu | | | Update minimum version of Maven from 3.0 to 3.3 | Major | . | Akira Ajisaka | Akira Ajisaka | | | Remove xmlenc dependency | Minor | . | Chris Douglas | Chris Douglas | | | Erasure Coding codec should support fallback coder | Blocker | io | Wei-Chiu Chuang | Kai Sasaki | | | Retire SharedInstanceProfileCredentialsProvider in trunk. | Major | fs/s3 | Mingliang Liu | Mingliang Liu | | | Use compact identifiers for built-in ECPolicies in HdfsFileStatus | Blocker | erasure-coding | Andrew Wang | Andrew Wang | | | Remove deprecated methods from ResourceCalculatorProcessTree | Blocker |

| Karthik Kambatla | Miklos Szegedi | | | HDFS Snapshots should capture point-in-time copies of OPEN files | Major | hdfs | Manoj Govindassamy | Manoj Govindassamy | | | remove httpclient dependency | Blocker | build | Colin P. McCabe | Akira Ajisaka | | | Implement customizable and configurable erasure coders | Blocker | . | Kai Zheng | Tim Yao | | | ZKRMStateStore: Limit the number of znodes under a znode | Critical | resourcemanager | Karthik Kambatla | Varun Saxena | | | Rewind trunk from Guava 21.0 back to Guava 11.0.2 | Blocker | . | Andrew Wang | Andrew Wang | | | maven-project-info-reports-plugin can be removed | Major | . | Andras Bokor | Andras Bokor | | | Remove tomcat support from hadoop-functions.sh | Minor | scripts | Allen Wittenauer | John Zhuge | | | Remove findbugs report from docs profile | Minor | . | Andras Bokor | Andras Bokor | | | Upgrade Kerby version from 1.0.0-RC2 to 1.0.0 | Blocker | security | Jiajia Li | Jiajia Li | | | Remove Log4j classes from JobConf | Critical | conf | Sean Busbey | Sean Busbey | | | Change distcp to have -pb on by default | Minor | . | Dave Thompson | Mithun Radhakrishnan | | | Confusion/name conflict between NameNodeActivity#BlockReportNumOps and RpcDetailedActivity#BlockReportNumOps | Minor | metrics | Erik Krogen | Erik Krogen | | | DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries | Major | hdfs-client | Vinayakumar B | Vinayakumar B | | | Add support for work preserving NM restart when AMRMProxy is enabled | Major | amrmproxy, nodemanager | Subru Krishnan | Botong Huang | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Support for multi-cluster delegation tokens | Minor | security | Clay B. | Jian He | | | YARN Capacity Scheduler - Queue Priorities | Major | . | Wangda Tan | Wangda Tan | | | Maintain aggregated peer performance metrics on NameNode | Major | namenode | Xiaobing Zhou | Arpit Agarwal | | | Honour AclBit flag associated to file/folder permission for Azure datalake account | Major | fs/adl | Vishwajeet Dusane | Vishwajeet Dusane | | | Allow YARN containers to run with Java Security Manager | Minor | nodemanager, yarn | Greg Phillips | Greg Phillips | | | REDO operation of WASB#AtomicRename should create placeholder blob for destination folder | Critical | fs/azure | NITIN VERMA | NITIN VERMA | | | Add RM monitor validating metrics invariants | Major | . | Carlo Curino | Carlo Curino | | | Allow users to specify racks and nodes for strict locality for AMs | Major | client | Robert Kanter | Robert Kanter | | | Add datanode admin command to get the storage info. | Major | . | Surendra Singh Lilhore | Surendra Singh Lilhore | | | add an entry point that can start any Yarn service | Major | api | Steve Loughran | Steve Loughran | | | Add an admin command to list currently open files | Major | . | Kihwal Lee | Manoj Govindassamy | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Document -DskipShade property in

| Minor | build, documentation | Hanisha Koneru | Hanisha Koneru | | | Read ADLS credentials from Credential Provider | Critical | fs/adl | John Zhuge | John Zhuge | | | Update ADLS SDK to 2.1.4 | Major | fs/adl | John Zhuge | John Zhuge | | | Document KMS usage of CredentialProvider API | Minor | documentation, kms | John Zhuge | John Zhuge | | | NameNode WebUI should display DataNode usage histogram | Major | namenode, ui | Zhe Zhang | Kai Sasaki | | | Add peak memory usage counter for each task | Major | mrv2 | Yufei Gu | Miklos Szegedi | | | Skip FSync in Test util CreateEditsLog to speed up edit log generation | Minor | hdfs | Hanisha Koneru | Hanisha Koneru | | | Use doxia macro to generate in-page TOC of HDFS site documentation | Major | documentation | Masatake Iwasaki | Masatake Iwasaki | | | FairScheduler: Lower update interval for faster tests | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla | | | Document FairScheduler 'allowPreemptionFrom' queue property | Minor | fairscheduler | Yufei Gu | Yufei Gu | | | Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment | Major | . | Daniel Templeton | Udai Kiran Potluri | | | Use doxia macro to generate in-page TOC of MapReduce site documentation | Major | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Optimize NamenodeFsck#getReplicaInfo | Minor | namenode | Takanobu Asanuma | Takanobu Asanuma | | | Journal Nodes should refuse to format non-empty directories | Major | . | Arpit Agarwal | Yiqun Lin | | | Improve the unit tests relevant to DataNode volume failure testing | Major | . | Yiqun Lin | Yiqun Lin | | | Update the link to HTrace SpanReceivers | Minor | documentation | Akira Ajisaka | Yiqun Lin | | | Allow port range to be specified while starting webapp | Major | . | Varun Saxena | Varun Saxena | | | Change the default value for dfs.namenode.reconstruction.pending.timeout-sec from -1 to 300 | Minor | . | Akira Ajisaka | Yiqun Lin | | | Allow AM to specify a port range for starting its webapp | Major | applicationmaster | Varun Saxena | Varun Saxena | | | Update the links in PiEstimator document | Minor | documentation | Akira Ajisaka | Jung Yoo | | | Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled | Major | encryption, kms | Xiao Chen | Xiao Chen | | | DatanodeInfo getNetworkLocation and setNetworkLocation shoud use volatile instead of synchronized | Minor | performance | Chen Liang | Chen Liang | | | Add an UncaughtExceptionHandler for critical threads in RM | Major | resourcemanager | Yufei Gu | Yufei Gu | | | Use doxia macro to generate in-page TOC of YARN site documentation | Major | documentation | Masatake Iwasaki | Masatake Iwasaki | | | Print a user friendly error message when plugins are not found | Minor | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Log files pattern should be same for both running and finished container | Major | yarn | Sumana Sathish | Xuan Gong | | | Display the volume storage type in datanode UI | Minor | datanode, ui | Surendra Singh Lilhore | Surendra Singh Lilhore | | | The application attempt's diagnostic message should have a maximum size | Critical | resourcemanager | Daniel Templeton | Andras Piros | | | Remove unused getStartInstance and getFinalizeInstance in FSEditLogOp | Trivial |

| Andrew Wang | Alison Yu | | | Fix typo in error message of StoragePolicyAdmin tool | Trivial | . | Alison Yu | Alison Yu | | | Cluster capacity in SchedulingPolicy is updated only on allocation file reload | Major | fairscheduler | Karthik Kambatla | Yufei Gu | | | Deprecate FileSystem APIs that promote inefficient call patterns. | Major | fs | Chris Nauroth | Mingliang Liu | | | Remove Java6 specific code from GzipCodec.java | Minor | . | Akira Ajisaka | Elek, Marton | | | Add a finite shell command timeout to ShellBasedUnixGroupsMapping | Minor | security | Harsh J | Harsh J | | | Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete() | Major | namenode | X. Liang | Elek, Marton | | | Add log4j configuration to enable logging in hadoop-distcp's tests | Minor | test | Xiao Chen | Xiao Chen | | | Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms | Major | namenode | Andrew Wang | Andrew Wang | | | Improve application status log message when RM restarted when app is in NEW state | Major | . | Yesha Vora | Junping Du | | | Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands | Major | federation | Brahma Reddy Battula | Brahma Reddy Battula | | | DataNode Disk Outlier Detection | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Refactor out system default erasure coding policy | Major | erasure-coding | Andrew Wang | Andrew Wang | | | Azure: Add Authorization support to WASB | Major | fs/azure | Dushyanth | Sivaguru Sankaridurg | | | Log message when DN is not selected for block replication | Minor | . | Yiqun Lin | Yiqun Lin | | | Proper error msg to be printed when invalid operation type is given to WebHDFS operations | Minor | webhdfs | Archana T | Surendra Singh Lilhore | | | CLI MiniCluster: add an option to specify NameNode HTTP port | Minor | . | Takanobu Asanuma | Takanobu Asanuma | | | Last full block report received time for each DN should be easily discoverable | Major | ui | Arpit Agarwal | Surendra Singh Lilhore | | | Simplify file IO profiling configuration | Minor | . | Hanisha Koneru | Hanisha Koneru | | | RMCriticalThreadUncaughtExceptionHandler.rmContext should be final | Minor | resourcemanager | Daniel Templeton | Corey Barker | | | Implement getHomeDirectory() method in NativeAzureFileSystem | Critical | fs/azure | Namit Maheshwari | Santhosh G Nayak | | | NULL\UPDATE\REQUESTS is redundant in TestFairScheduler | Minor | . | Daniel Templeton | Yuanbo Liu | | | Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code | Major | erasure-coding | Andrew Wang | Manoj Govindassamy | | | Document how HDFS updates timestamps in the FS spec; compare with object stores | Minor | documentation, fs | Steve Loughran | Steve Loughran | | | Dump scheduler and queue state information into FairScheduler DEBUG log | Major | fairscheduler | Yufei Gu | Yufei Gu | | | Support Timeout when checking single disk | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Improve log message to include hostname when the NameNode is in safemode | Minor |

| Kuhu Shukla | Kuhu Shukla | | | Expose slow disks via DataNode JMX | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Implement listStatusIterator, listLocatedStatus for ViewFs | Minor | viewfs | Erik Krogen | Erik Krogen | | | Add logs for slow BlockReceiver while writing data to disk | Major | datanode | Xiaobing Zhou | Xiaobing Zhou | | | Fix typo in javadoc for DistributedCache | Trivial | . | Attila Sasvari | Attila Sasvari | | | Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see | Minor | fairscheduler | Daniel Templeton | esmaeil mirzaee | | | Azure: Add Kerberos and Delegation token support to WASB client. | Major | fs/azure | Santhosh G Nayak | Santhosh G Nayak | | | Propagate DataNode's slow disks info to the NameNode via Heartbeat | Major | . | Hanisha Koneru | Hanisha Koneru | | | hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable | Major | resourcemanager | Daniel Templeton | Laura Adams | | | Move Configuration runtime check for hadoop-site.xml to initialization | Major | . | Jonathan Eagles | Jonathan Eagles | | | Remove unused PermissionStatus#applyUMask | Trivial | . | John Zhuge | Chen Liang | | | Spelling mistakes in the Java source | Trivial | . | hu xiaodong | hu xiaodong | | | Add counters for number of blocks in pending IBR | Major | hdfs | Xiaobing Zhou | Xiaobing Zhou | | | Refactor ClientRMService to unify error handling across apis | Minor | resourcemanager | Kai Sasaki | Kai Sasaki | | | Remove unused argument in ClientRMService | Trivial | . | Kai Sasaki | Kai Sasaki | | | Delay construction of PreCondition.check failure message in Configuration#set | Major | . | Jonathan Eagles | Jonathan Eagles | | | Configuration#get return value optimization | Major | . | Jonathan Eagles | Jonathan Eagles | | | Improve performance for createAndGetApplicationReport | Major | . | yunjiong zhao | yunjiong zhao | | | Add builder-based create API to FileSystem | Major | . | Sammi Chen | Sammi Chen | | | Remove unnecessary TODO comment from AppLogAggregatorImpl.java | Minor | . | Akira Ajisaka | victor bertschinger | | | Refine the behaviour of getFileChecksum when length = 0 | Minor | . | Kai Zheng | Sammi Chen | | | Correct spelling of 'separate' and variants | Minor | . | Doris Gu | Doris Gu | | | Document replication factor for EC files. | Major | documentation, erasure-coding | Wei-Chiu Chuang | Yiqun Lin | | | Handle SlowDiskReport from DataNode at the NameNode | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Improve slow mirror/disk warnings in BlockReceiver | Major | datanode | Arpit Agarwal | Arpit Agarwal | | | Expose slow disks via NameNode JMX | Major | namenode | Hanisha Koneru | Hanisha Koneru | | | Improve -setrep for Erasure Coded files | Major | shell | Wei-Chiu Chuang | Yiqun Lin | | | All web UIs should include a robots.txt file | Minor |

| Lars Francke | Lars Francke | | | Fix compilation of TestKafkaMetrics | Major | tools | Andrew Wang | Andrew Wang | | | Clarify the behavior of HDFS Mover in documentation | Major | documentation | Xiaobing Zhou | Xiaobing Zhou | | | FSAppAttempt has several variables that should be final | Major | fairscheduler | Daniel Templeton | Ameet Zaveri | | | Improve Logging for SSLHostnameVerifier | Major | security | Xiaoyu Yao | Chen Liang | | | Client should always ask namenode for kms provider path. | Major | kms | Rushabh S Shah | Rushabh S Shah | | | Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches | Major | . | Chris Trezzo | Chris Trezzo | | | Add a nanosecond API to Time/Timer/FakeTimer | Minor | util | Erik Krogen | Erik Krogen | | | Move system erasure coding policies into hadoop-hdfs-client | Major | erasure-coding | Andrew Wang | Andrew Wang | | | Upgrade to Apache Yetus 0.4.0 | Major | build, documentation, test | Allen Wittenauer | Allen Wittenauer | | | Export UsedCapacity and AbsoluteUsedCapacity to JMX | Major | capacityscheduler, metrics, yarn | Benson Qiu | Benson Qiu | | | BPServiceActor thread name is too long | Minor | datanode | Tsz Wo Nicholas Sze | Xiaobing Zhou | | | Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets | Major | security | Robert Kanter | Robert Kanter | | | DataXceiver thread should log the actual error when getting InvalidMagicNumberException | Minor | datanode | Chen Liang | Chen Liang | | | Lazy construct the IIP pathname | Major | . | Daryn Sharp | Daryn Sharp | | | Azure: Simplify Ranger-WASB policy model | Major | fs/azure | Sivaguru Sankaridurg | Sivaguru Sankaridurg | | | Add a test example job that grows in memory usage over time | Major | test | Karthik Kambatla | Karthik Kambatla | | | Enable distcp to copy blocks in parallel | Major | tools/distcp | dhruba borthakur | Yongjun Zhang | | | Remove SchedulerRequestKeys when no more pending ResourceRequest | Major | . | Arun Suresh | Arun Suresh | | | Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals | Minor | erasure-coding | Andrew Wang | Andrew Wang | | | Optimize BlockIterator when iterating starts in the middle. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Expose hedged read metrics via libHDFS API | Major | libhdfs | Sailesh Mukil | Sailesh Mukil | | | Switch from Findbugs to Spotbugs | Major | build | Allen Wittenauer | Allen Wittenauer | | | Expose Queue Configurations per Node Label through YARN client api | Major | . | Benson Qiu | Benson Qiu | | | Add submit time to Application Summary log | Minor | resourcemanager | zhihai xu | zhihai xu | | | FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verify | Minor | fs | Steve Loughran | Steve Loughran | | | Enable KMS and HttpFS to exclude SSL ciphers | Minor | kms | John Zhuge | John Zhuge | | | Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike | Major | balancer & mover | yunjiong zhao | Konstantin Shvachko | | | Add PowerShell NodeFencer | Minor | ha | igo Goiri | igo Goiri | | | Remove unnecessary shading of commons-httpclient | Minor | . | Akira Ajisaka | Wei-Chiu Chuang | | | Remove unused setting from

| Minor | build | Akira Ajisaka | Chen Liang | | | Make some HttpServer2 SSL properties optional | Minor | kms | John Zhuge | John Zhuge | | | Change Datanode file IO profiling sampling to percentage | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Add new public encryption APIs required by Hive | Major | encryption | Andrew Wang | Lei (Eddy) Xu | | | Remove usages of MoreObjects.toStringHelper | Minor | metrics | Andrew Wang | Andrew Wang | | | Add an optional StorageID to writes | Major | . | Chris Douglas | Ewan Higgs | | | Correct spelling of 'succeed' and variants | Trivial | . | Dongtao Zhang | Dongtao Zhang | | | Implement FileSystem that reads from HTTP / HTTPS endpoints | Major | fs | Haohui Mai | Haohui Mai | | | Allow custom SSL configuration to be supplied in WebApps | Major | webapp, yarn | Sanjay M Pujare | Sanjay M Pujare | | | Improve Configuration XML Parsing Performance | Major | . | Jonathan Eagles | Jonathan Eagles | | | AuditLogger and TestAuditLogger are dead code | Minor | client | Daniel Templeton | Vrushali C | | | Document output of 'hdfs count -u' should contain PATHNAME | Minor | hdfs | Xiaobing Zhou | Xiaobing Zhou | | | Add Javadoc comment for jitter parameter on CachingGetSpaceUsed | Trivial | . | Erik Krogen | Erik Krogen | | | Query StreamCapabilities when creating balancer's lock file | Major | balancer & mover | Andrew Wang | Sammi Chen | | | Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus | Major | hdfs | Daryn Sharp | Daryn Sharp | | | Provide container sandbox policies for groups | Minor | nodemanager, yarn | Greg Phillips | Greg Phillips | | | Use java.lang.AssertionError instead of junit.framework.AssertionFailedError | Minor | . | Akira Ajisaka | Chen Liang | | | Add -v option for du command to show header line | Major | hdfs | Xiaobing Zhou | Xiaobing Zhou | | | Print requested node partition in assignContainer logs | Major | . | Jonathan Hung | Jonathan Hung | | | Allow to enable user defined erasure coding policy | Major | erasure-coding | Sammi Chen | Sammi Chen | | | DistCp - Introduce a configurable copy buffer size | Major | tools/distcp | Omkar Aradhya K S | Omkar Aradhya K S | | | FSAppAttempt demand can be updated atomically in updateDemand() | Major | . | Karthik Kambatla | Karthik Kambatla | | | Make WebHDFS' ACLs RegEx configurable | Major | webhdfs | Harsh J | Harsh J | | | DU#refresh should print the path of the directory when an exception is caught | Minor | . | Chen Liang | Chen Liang | | | Owner support for ranger-wasb integration | Major | fs, fs/azure | Varada Hemeswari | Varada Hemeswari | | | Switch leftover logs to slf4j format in BlockManager.java | Minor | namenode | Hui Xu | Chen Liang | | | Dispatcher no longer needs the raw types suppression | Minor | . | Daniel Templeton | Maya Wexler | | | Method length of ResourceManager#serviceInit() is too long | Minor | resourcemanager | Yufei Gu | Gergely Novk | | | Intern strings in BlockLocation and ExtendedBlock | Major |

| Misha Dmitriev | Misha Dmitriev | | | Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application | Minor | . | Akira Ajisaka | Akira Ajisaka | | | Add metrics for connections dropped | Major | . | Eric Badger | Eric Badger | | | Redundant 'final' modifier in try-with-resources statement | Minor | . | Wenxin He | Wenxin He | | | Azure has messed doc structure | Major | documentation, fs/azure | Mingliang Liu | Mingliang Liu | | | Add more diagnosis info for fsimage transfer failure. | Major | . | Yongjun Zhang | Yongjun Zhang | | | Log HDFS Mover exception message of exit to its own log | Minor | balancer & mover | LiXin Ge | LiXin Ge | | | ipc.Client.Connection#sendRpcRequest should log request name | Trivial | ipc | John Zhuge | John Zhuge | | | LdapGroupsMapping - support user and group search base | Major | common, security | Shwetha G S | Shwetha G S | | | RolloverSignerSecretProvider.LOG should be @VisibleForTesting | Minor | security | Daniel Templeton | Arun Shanmugam Kumar | | | Add metric for time taken by NameNode resource check | Major | . | Chen Liang | Chen Liang | | | Make RollingAverages a mutable metric | Major | common | Hanisha Koneru | Hanisha Koneru | | | Add create() contract test that verifies ancestor dir creation | Minor | fs | Aaron Fabbri | Sean Mackrory | | | OpensslAesCtrCryptoCodec.finalize() holds excessive amounts of memory | Major | . | Misha Dmitriev | Misha Dmitriev | | | Make CryptoCodec Closeable so it can be cleaned up proactively | Major | . | Xiao Chen | Xiao Chen | | | Add CRC32C performance test. | Minor | common | LiXin Ge | LiXin Ge | | | Document the configuration key for FSNamesystem lock fairness | Minor | documentation, namenode | Zhe Zhang | Erik Krogen | | | Add -E option in hdfs "count" command to show erasure policy summarization | Major | . | Sammi Chen | luhuichun | | | Maintain Short-Circuit Read Statistics | Major | hdfs-client | Hanisha Koneru | Hanisha Koneru | | | [Erasure coding] Warn log frequently print to screen in doEncode/doDecode functions | Major | erasure-coding, native | liaoyuxiangqin | liaoyuxiangqin | | | Replace commons-logging APIs with slf4j in FsDatasetImpl | Major | . | Akira Ajisaka | hu xiaodong | | | Add log info when connect to datanode socket address failed | Major | hdfs-client | chencan | chencan | | | Add log when Diskbalancer volume is transient storage type | Major | diskbalancer | steven-wugang | steven-wugang | | | Update azure-storage sdk to version

| Major | fs/azure | Mingliang Liu | Georgi Chalakov | | | LevelDBCacheTimelineStore should reuse ObjectMapper instances | Major | timelineserver | Zoltan Haindrich | Zoltan Haindrich | | | Specifically configure zookeeper-related log levels in KMS log4j | Major | kms | Xiao Chen | Xiao Chen | | | Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable | Major | erasure-coding | Sammi Chen | luhuichun | | | NameNode consumes a lot of memory for snapshot diff report generation | Major | hdfs, snapshots | Manoj Govindassamy | Manoj Govindassamy | | | allow custom release notes/changelog during create-release | Minor | build, scripts | Allen Wittenauer | Allen Wittenauer | | | NetworkTopology.DEFAULT\HOST\LEVEL is unused | Trivial | . | Daniel Templeton | Chen Liang | | | Display reserved resources in web UI per queue | Major | fairscheduler, webapp | Abdullah Yousufi | Abdullah Yousufi | | | Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API | Major | resourcemanager, restapi | Lantao Jin | Lantao Jin | | | [API] Refactor ResourceManager WebServices to make API explicit | Critical | resourcemanager | Subru Krishnan | Giovanni Matteo Fumarola | | | NMLeveldbStateStore should be more tolerant of unknown keys | Major | nodemanager | Jason Lowe | Ajith S | | | Improve the patch of HADOOP-13119 | Major | security | Yuanbo Liu | Yuanbo Liu | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or Windows | Major | test | Akira Ajisaka | Akira Ajisaka | | | Remove node label (removeFromClusterNodeLabels) document is missing | Major | documentation | Weiwei Yang | Ying Zhang | | | SharedCacheManager does not start up | Major | . | Chris Trezzo | Chris Trezzo | | | Invalid REST api response for getApps since queueUsagePercentage is coming as INF | Critical | . | Sunil Govindan | Sunil Govindan | | | Log portnumber in PrivilegedNfsGatewayStarter | Minor | nfs | Mukul Kumar Singh | Mukul Kumar Singh | | | Log map attempts as part of shuffle handler audit log | Major | . | Jonathan Eagles | Gerg Psztor | | | Remove erroneous source jar option from hadoop-client shade configuration | Minor | build | Joe Pallas | Joe Pallas | | | Change exception message in StorageLocationChecker | Minor | datanode | Arpit Agarwal | Arpit Agarwal | | | Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues | Major | fairscheduler | Ashwin Shankar | Yufei Gu | | | Add a test to verify Audit log entries for setfacl/getfacl commands over FS shell | Major | hdfs, test | Manoj Govindassamy | Manoj Govindassamy | | | Revert HDFS-8377 Support HTTP/2 in datanode | Major | datanode | Andrew Wang | Xiao Chen | | | KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser | Major | common, kms | Greg Senia | Xiaoyu Yao | | | Fix KMSClientProvider for non-secure proxyuser use case | Major | kms | Xiaoyu Yao | Xiaoyu Yao | | | Localizer leaves behind tarballs after container is complete | Major | . | Eric Badger | Eric Badger | | | KMS should load SSL configuration the same way as SSLFactory | Major | kms, security | John Zhuge | John Zhuge | | | Verify multiple DataNodes can be decommissioned/maintenance at the same time | Major | hdfs | Manoj Govindassamy | Manoj Govindassamy | | | Log updates for ZKRMStateStore | Trivial | . | Bibin A Chundatt | Daniel Sturman | | | shaded jars of hadoop-client modules are missing hadoop's root LICENSE and NOTICE files | Critical | . | John Zhuge | Elek, Marton | | | Remove HdfsClientConfigKeys.DFS\CLIENT\SLOW\IO\WARNING\THRESHOLD\KEY usage from DNConf | Major |

| Manoj Govindassamy | Manoj Govindassamy | | | Make FileStatus Serializable | Minor | fs | Chris Douglas | Chris Douglas | | | Aliyun OSS documentation missing from website | Major | documentation, fs/oss | Andrew Wang | Yiqun Lin | | | Need more diagnosis info when seeing Slow waitForAckedSeqno | Major | . | Yongjun Zhang | Xiao Chen | | | Socket reuse address option is not honored in PrivilegedNfsGatewayStarter | Major | nfs | Mukul Kumar Singh | Mukul Kumar Singh | | | Synchronization issue in delegation token cancel functionality | Major | . | Hrishikesh Gadre | Hrishikesh Gadre | | | Document missing metrics of erasure coding | Minor | documentation, erasure-coding | Yiqun Lin | Yiqun Lin | | | MR AppMaster does not honor ephemeral port range | Major | mr-am, mrv2 | Frank Nguyen | Frank Nguyen | | | Balancer hung due to no available mover threads | Major | balancer & mover | yunjiong zhao | yunjiong zhao | | | Require admin to access KMS instrumentation servlets | Minor | kms | John Zhuge | John Zhuge | | | Node manager REST API documentation is not up to date | Trivial | nodemanager, restapi | Miklos Szegedi | Miklos Szegedi | | | Improve log message on fail over | Major | . | Jian He | Jian He | | | Application recovery has failed when node label feature is turned off during RM recovery | Minor | scheduler | Ying Zhang | Ying Zhang | | | Yarn client implicitly invoke ATS client which accesses HDFS | Major | . | Yesha Vora | Li Lu | | | Race in UGI.reloginFromKeytab | Major | security | Duo Zhang | Duo Zhang | | | UpdateCallDuration is calculated only when debug logging is enabled | Major | fairscheduler | Yufei Gu | Yufei Gu | | | FairScheduler: preempted resources can become negative | Blocker | fairscheduler, resourcemanager | Miklos Szegedi | Miklos Szegedi | | | Add javadoc for Resources.isNone | Minor | scheduler | Karthik Kambatla | Andres Perez | | | Unnecessary INFO logs in AMRMClientAsyncImpl$CallbackHandlerThread.run | Trivial | . | Grant W | Grant W | | | SwiftRestClient includes pass length in exception if auth fails | Minor | security | Marcell Hegedus | Marcell Hegedus | | | Zookeper ACLs on NN HA enabled clusters to be handled consistently | Major | hdfs | Laszlo Puskas | Hanisha Koneru | | | help of stat is confusing | Trivial | documentation, fs | Xiaohe Lan | Attila Bukor | | | FairScheduler: Multiple calls to completedContainer are not safe | Major | fairscheduler | Lavkesh Lahngir | Shiwei Guo | | | Document the missing usages of OfflineImageViewer processors | Minor | documentation, tools | Yiqun Lin | Yiqun Lin | | | The config name of balance bandwidth is out of date | Minor | balancer & mover, documentation | Yiqun Lin | Yiqun Lin | | | Fix NativeS3FileSystemContractBaseTest#testDirWithDifferentMarkersWorks | Minor | fs/s3, test | Akira Ajisaka | Yiqun Lin | | | Add a regression test for sticky bit support of OIV ReverseXML processor | Major | tools | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Numeric usernames do no work with WebHDFS FS (write access) | Major | webhdfs | Pierre Villard | Pierre Villard | | | Update checkstyle and checkstyle plugin version to handle indentation of JDK8 Lambdas | Major |

| Xiaoyu Yao | Akira Ajisaka | | | Fix checkstyle warnings in NameNode#createNameNode | Trivial | namenode | Ethan Li | Ethan Li | | | FairScheduler: Can't create a DRF queue under a FAIR policy queue | Major | . | Arun Suresh | Yufei Gu | | | Yarn client should exit with an informative error message if an incompatible Jersey library is used at client | Major | . | Weiwei Yang | Weiwei Yang | | | ConcurrentModificationException on FSAppAttempt.containersToPreempt | Major | fairscheduler | Miklos Szegedi | Miklos Szegedi | | | Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOp | Major | namenode | Xiao Chen | Xiao Chen | | | Fix OOM issue with decommissioningNodesWatcher in the case of clusters with large number of nodes | Major | resourcemanager | Ajay Jadhav | Ajay Jadhav | | | DFSInputStream may infinite loop requesting block locations | Critical | hdfs-client | Daryn Sharp | Daryn Sharp | | | Typo in hadoop-aws index.md | Trivial | fs/s3 | John Zhuge | John Zhuge | | | 'storagepolicies -getStoragePolicy' command should accept URI based path. | Major | shell | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpc | Major | . | Eric Badger | Eric Badger | | | S3A Deadlock in multipart copy due to thread pool limits. | Critical | fs/s3 | Sean Mackrory | Sean Mackrory | | | User friendly name for ADLS user and group | Major | fs/adl | John Zhuge | Vishwajeet Dusane | | | YARNRunner#createApplicationSubmissionContext method is longer than 150 lines | Trivial | . | Chris Trezzo | Gergely Novk | | | FS: Node reservations can interfere with preemption | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla | | | Synchronization improvement for moveApplicationAcrossQueues and updateApplicationPriority | Major | . | Bibin A Chundatt | Bibin A Chundatt | | | TestFairScheduler.testReservationMetrics is flaky | Major | fairscheduler | Yufei Gu | Yufei Gu | | | S3A can no longer handle unencoded + in URIs | Minor | fs/s3 | Sean Mackrory | Sean Mackrory | | | FailoverOnNetworkExceptionRetry does not wait when failover on certain exception | Major | . | Jian He | Jian He | | | Document missing usages of OfflineEditsViewer processors | Minor | documentation, tools | Yiqun Lin | Yiqun Lin | | | Fix occasional BindException in TestNameNodeMetricsLogger | Major | test | Arpit Agarwal | Arpit Agarwal | | | S3A BlockOutputStreams doesn't delete temporary files in multipart uploads or handle part upload failures | Critical | fs/s3 | Seth Fitzsimmons | Steve Loughran | | | FSLeafQueue demand update needs to be atomic | Major | resourcemanager | Varun Saxena | Miklos Szegedi | | | Remove unused imports from GzipCodec.java | Minor | . | Akira Ajisaka | Yiqun Lin | | | Fix dead link in MapReduce tutorial document | Minor | documentation | Akira Ajisaka | Victor Nee | | | FairSchedulerTestBase helper methods should call scheduler.update to avoid flakiness | Major | . | Arun Suresh | Karthik Kambatla | | | Fix javac warnings in YARN that caused by deprecated FileSystem APIs | Minor | . | Yiqun Lin | Yiqun Lin | | | Workaround guice3x-undecoded pathInfo in YARN WebApp | Major |

| Abraham Elmahrek | Yuanbo Liu | | | KafkaSink jar files are created but not copied to target dist | Major | . | Babak Behzad | Babak Behzad | | | Socket re-use address option should be used in SimpleUdpServer | Major | nfs | Mukul Kumar Singh | Mukul Kumar Singh | | | Update EC commands in HDFSCommands.md | Minor | documentation, erasure-coding | Yiqun Lin | Yiqun Lin | | | Job#updateStatus() failed with NPE due to race condition | Major | . | Junping Du | Junping Du | | | Variable in byte printed directly in mapreduce client | Major | client | Nemo Chen | Kai Sasaki | | | io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java | Minor | . | Erik Steffl | Harsh J | | | NMTokenSecretManagerInRM.createAndGetNMToken is not thread safe | Major | yarn | Haibo Chen | Haibo Chen | | | Fix TestAMRMClient when using FairScheduler | Minor | . | Miklos Szegedi | Miklos Szegedi | | | Fix NPE in FsDatasetImpl#checkAndUpdate | Major | datanode | Xiaobing Zhou | Xiaobing Zhou | | | yarn rmadin -getGroups returns information from standby RM | Critical | yarn | Sumana Sathish | Jian He | | | WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA setting | Major | . | Sumana Sathish | Xuan Gong | | | user is not removed from UsersManagers when app is killed with pending container requests. | Major | . | Eric Payne | Eric Payne | | | start-build-env.sh: invalid docker image name | Major | build | Gerg Psztor | Gerg Psztor | | | Add escaping to error message in KMS web UI | Minor | security | Aaron T. Myers | Aaron T. Myers | | | Enhance documentation for yarn.resourcemanager.scheduler.class property | Trivial | documentation | Miklos Szegedi | Yufei Gu | | | Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0 | Major | . | Andrew Wang | Andrew Wang | | | Specify charset when create String in CredentialsTestJob | Minor | . | Akira Ajisaka | Kai Sasaki | | | S3A typo in pom.xml test exclusions | Major | fs/s3 | Aaron Fabbri | Aaron Fabbri | | | Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME\_WAIT state | Major | nfs | Mukul Kumar Singh | Mukul Kumar Singh | | | TestRecovery.testCrashed failed | Major | test | Gerg Psztor | Gerg Psztor | | | Move application across queues should handle delayed event processing | Major | capacity scheduler | Bibin A Chundatt | Bibin A Chundatt | | | hadoop-mapreduce-client-jobclient.jar sets a main class that isn't in the JAR | Minor | client | Daniel Templeton | Daniel Templeton | | | TestAppLogAggregatorImp.verifyFilesUploaded() should check # of filed uploaded with that of files expected | Major | . | Haibo Chen | Haibo Chen | | | Intra-queue preemption occurs even when preemption is turned off for a specific queue. | Major | capacity scheduler, scheduler preemption | Eric Payne | Eric Payne | | | Fix dead link in KMS document | Minor | documentation | Akira Ajisaka | Christina Vu | | | AM not launched when a single vcore is available on the cluster | Major | fairscheduler | Yufei Gu | Yufei Gu | | | OutputStreams in

can be left open upon exceptions | Major | yarn | Haibo Chen | Haibo Chen | | | ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled | Critical | . | Steven Rand | Steven Rand | | | TestResources test timeouts are too aggressive | Major | test | Jason Lowe | Eric Badger | | | DataNode reconfigure for disks doesn't remove the failed volumes | Major | . | Manoj Govindassamy | Manoj Govindassamy | | | Fix grammar error in ConfTest.java | Trivial | test | Andrey Dyatlov | Andrey Dyatlov | | | Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum | Minor | . | Eric Badger | Eric Badger | | | Decommissioning stuck because of failing recovery | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak | | | RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode | Major | ha | Nanda kumar | Nanda kumar | | | Fix confusing block recovery message | Minor | datanode | Wei-Chiu Chuang | Yiqun Lin | | | Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator | Major | capacityscheduler | Jonathan Hung | Jonathan Hung | | | FileSystemContractBaseTest is not cleaning up test directory clearly | Major | fs | Mingliang Liu | Mingliang Liu | | | Fix flakiness in TestFairScheduler#testDumpState | Major | fairscheduler | Yufei Gu | Yufei Gu | | | Fix a spelling mistake in CapacityScheduler | Trivial | capacity scheduler | Jin Yibo | Jin Yibo | | | Edit file should not be processed by the same type processor in OfflineEditsViewer | Major | tools | Yiqun Lin | Yiqun Lin | | | ATS client should better handle Socket closed case | Major | timelineclient | Sumana Sathish | Li Lu | | | Make RegistrySecurity use short user names for ZK ACLs | Major | . | Billie Rinaldi | Billie Rinaldi | | | ContainerKillEvent lost when container is still recovering and application finishes | Critical | nodemanager | sandflee | sandflee | | | reuseAddress option should be used for child channels in Portmap and SimpleTcpServer | Major | nfs | Mukul Kumar Singh | Mukul Kumar Singh | | | Duplicate hadoop-minikdc dependency in hadoop-common module | Minor | build | Akira Ajisaka | Xiaobing Zhou | | | move declaration of okhttp version from hdfs-client to hadoop-project POM | Minor | build | Steve Loughran | Xiaobing Zhou | | | Admin command line should print message to stderr in failure case | Minor | . | Kai Sasaki | Kai Sasaki | | | TestLocalCacheDirectoryManager test timeout is too aggressive | Major | test | Jason Lowe | Miklos Szegedi | | | Clean up OrderingPolicy javadoc | Minor | resourcemanager | Daniel Templeton | Daniel Templeton | | | typo in s3a rename(self, subdir) error message | Minor | . | Steve Loughran | Steve Loughran | | | Order of namenodes in ConfiguredFailoverProxyProvider is undefined | Major | ha, hdfs-client | Rafal Wojdyla | igo Goiri | | | S3A multipart commit failing, "UnsupportedOperationException at java.util.Collections$UnmodifiableList.sort" | Critical | fs/s3 | Steve Loughran | Steve Loughran | | | Update ZooKeeper dependency to 3.4.9 and Curator dependency to 2.12.0 | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Fix

| Major | test | Akira Ajisaka | Akira Ajisaka | | | HttpFS doc errors | Trivial | documentation, httpfs, test | Yuanbo Liu | Yuanbo Liu | | | ViewFs should use underlying FileSystem's server side defaults | Major | fs, viewfs | Lohit Vijayarenu | Erik Krogen | | | DomainSocketWatcher::add()/delete() should not self interrupt while looping await() | Critical | hdfs-client | Mingliang Liu | Mingliang Liu | | | CredentialProviderFactory$getProviders is not thread-safe | Major | security | Vihang Karajgaonkar | Vihang Karajgaonkar | | | FilterFs and ChRootedFs are too aggressive about enforcing "authorityNeeded" | Major | viewfs | Erik Krogen | Erik Krogen | | | Prevent FS state dump logger from cramming other log files | Major | fairscheduler | Yufei Gu | Yufei Gu | | | TestRMFailover#testAutomaticFailover always passes even when it should fail | Major | . | Yufei Gu | Yufei Gu | | | Fix getNumMapTasks() documentation in JobConf | Minor | documentation | Joe Mszros | Joe Mszros | | | License check for jdiff output files should be ignored | Major | build | Akira Ajisaka | Akira Ajisaka | | | Fix typos in class OfflineImageReconstructor | Trivial | . | Yiqun Lin | Yiqun Lin | | | OIV's ReverseXML processor cannot reconstruct some snapshot details | Major | tools | Colin P. McCabe | Akira Ajisaka | | | Client close() should not fail fast if the last block is being decommissioned | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang | | | TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition | Major | test | Robert Kanter | Robert Kanter | | | Memory leak in timeline server | Critical | timelineserver | Wataru Yukawa | Jonathan Eagles | | | AMs can't be scheduled on racks or nodes | Major | . | Robert Kanter | Robert Kanter | | | Typo in DataStorage exception message | Minor | datanode | Daniel Templeton | Anna Budai | | | RM configuration allows all failover methods to disabled when automatic failover is enabled | Critical | resourcemanager | Daniel Templeton | Daniel Templeton | | | Extend FileStatus#toString() to include details like Erasure Coding and Encryption | Major | fs | Manoj Govindassamy | Manoj Govindassamy | | | FileContextMainOperationsBaseTest should clean up test root path | Minor | fs, test | Mingliang Liu | Mingliang Liu | | | Fragments are not handled correctly by resource limit checking | Minor | . | Chris Trezzo | Chris Trezzo | | | MR Job Submission Fails if MR framework application path not on defaultFS | Minor | mrv2 | Erik Krogen | Erik Krogen | | | [S3A DOC] Correct the format for "Seoul" example | Minor | documentation, fs/s3 | Brahma Reddy Battula | Brahma Reddy Battula | | | Shuffle Handler keep-alive connections are closed from the server side | Major |

| Jonathan Eagles | Jonathan Eagles | | | exception thrown when accessing the job configuration web UI | Minor | webapps | Sangjin Lee | Haibo Chen | | | Closing a file has a wasteful preconditions in NameNode | Major | namenode | Eric Badger | Eric Badger | | | LeveldbRMStateStore can parse invalid keys when recovering reservations | Major | resourcemanager | Jason Lowe | Jason Lowe | | | ReservationAgents are not correctly configured | Major | capacity scheduler, resourcemanager | Sean Po | Manikandan R | | | Fix markdown itemization in hadoop-aws documents | Minor | documentation, fs/s3 | Akira Ajisaka | Akira Ajisaka | | | Correct spelling of 'occurred' and variants | Trivial | . | Yeliang Cang | Yeliang Cang | | | Azure: WasbRemoteCallHelper should use String equals for comparison. | Major | fs/azure | Santhosh G Nayak | Santhosh G Nayak | | | Azure: NativeAzureFileSystem should respect config for kerberosSupportEnabled flag | Major | fs/azure | Santhosh G Nayak | Santhosh G Nayak | | | TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low | Major | test | Jason Lowe | Eric Badger | | | Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines | Trivial | test | Chris Trezzo | Chris Trezzo | | | RM startup failure due to wrong order in nodelabel editlog | Critical | . | Bibin A Chundatt | Bibin A Chundatt | | | TaskAttemptImpl#createCommonContainerLaunchContext is longer than 150 lines | Trivial | . | Chris Trezzo | Chris Trezzo | | | Invalid local resource request can raise NPE and make NM exit | Major | nodemanager | Tao Yang | Tao Yang | | | Move ClientProtocol HA proxies into hadoop-hdfs-client | Blocker | hdfs-client | Andrew Wang | Huafeng Wang | | | TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently | Major | test | Jason Lowe | Jason Lowe | | | Continuous scheduling thread crashes while sorting nodes | Major | . | Yufei Gu | Yufei Gu | | | hadoop-hdfs-client jar is in the wrong directory in release tarball | Critical | build | Andrew Wang | Yuanbo Liu | | | Fragments specified for libjar paths are not handled correctly | Minor | . | Chris Trezzo | Chris Trezzo | | | TestThrottledAsyncChecker#testCancellation is flaky | Major | test | Arpit Agarwal | Arpit Agarwal | | | StorageDirectory should initialize a non-null default StorageDirType | Minor | hdfs | Hanisha Koneru | Hanisha Koneru | | | HDFS write crashed with block size greater than 2 GB | Critical | hdfs-client | Xiaobing Zhou | Xiaobing Zhou | | | TestNetworkedJob fails on trunk | Major | . | Robert Kanter | Peter Bacsko | | | Exceptions during aggregated log writes are mishandled | Critical | log-aggregation | Akira Ajisaka | Akira Ajisaka | | | Compiling trunk with -DskipShade fails | Major | build | Arpit Agarwal | Arun Suresh | | | Decommissioning an NM results in a -1 exit code | Minor | . | Miklos Szegedi | Miklos Szegedi | | | FSImage failover disables all erasure coding policies | Critical | erasure-coding, namenode | Wei-Chiu Chuang | Wei-Chiu Chuang | | | VersionInfo should be marked as public API | Critical | common | Thejas M Nair | Akira Ajisaka | | | Docker docs MR example is broken | Major | nodemanager | Daniel Templeton | Prashant Jha | | | Initialize FakeTimer with a less trivial value | Major | test | Andrew Wang | Andrew Wang | | | Upgrade HSQLDB to 2.3.4 | Minor | build | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Fix javac warning caused by the deprecated key used in TestDFSClientRetries#testFailuresArePerOperation | Minor | . | Yiqun Lin | Yiqun Lin | | | TestRMAdminCLI has very low test timeouts | Major | test | Jason Lowe | Eric Badger | | | correct spelling mistake in FileSystemRMStateStore | Trivial | . | Yeliang Cang | Yeliang Cang | | | Fix ReservationSystem creation of default ReservationQueue | Major |

| Carlo Curino | Carlo Curino | | | TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Mover should move the file blocks to default storage once policy is unset | Major | balancer & mover | Surendra Singh Lilhore | Surendra Singh Lilhore | | | Upgrade frontend-maven-plugin to 1.1 to fix new YARN UI build error in ppc64le | Major | yarn-ui-v2 | Sonia Garudi | Sonia Garudi | | | TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest | Major | test | Jason Lowe | Jason Lowe | | | FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close() | Critical | nodemanager | Daryn Sharp | Haibo Chen | | | Unify Container Resizing code paths with Container Updates making it scheduler agnostic | Major | capacity scheduler, fairscheduler, resourcemanager | Arun Suresh | Arun Suresh | | | TestCapacityScheduler.testAMLimitUsage fails intermittently | Major | . | Eric Badger | Eric Badger | | | Only accessible cgroup mount directories should be selected for a controller | Major | nodemanager | Miklos Szegedi | Miklos Szegedi | | | Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart | Major | . | Eric Badger | Eric Badger | | | Add python2.7-dev to Dockerfile | Major | . | Allen Wittenauer | Allen Wittenauer | | | Rename mapred-site.xml.template to mapred-site.xml | Minor | build | Allen Wittenauer | Yuanbo Liu | | | Skip rm.transitionToActive call to RM if RM is already active. | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S | | | FSNamesystemLock metrics can be inaccurate due to millisecond precision | Major | hdfs | Erik Krogen | Erik Krogen | | | Remove non-existent setfattr command option from FileSystemShell.md | Minor | documentation | Doris Gu | Doris Gu | | | Python example in the rack awareness document doesn't work due to bad indentation | Minor | documentation | Kengo Seki | Kengo Seki | | | HttpFSServerWebServer$deprecateEnv may leak secret | Major | httpfs, security | John Zhuge | John Zhuge | | | KMSWebServer$deprecateEnv may leak secret | Major | kms, security | John Zhuge | John Zhuge | | | Typo in metrics docs | Trivial | documentation | Daniel Templeton | Ana Krasteva | | | Code can be improved in ContainersMonitorImpl.java | Minor | nodemanager | Miklos Szegedi | Miklos Szegedi | | | Get static SLS html resources from classpath | Blocker | scheduler-load-simulator | Allen Wittenauer | Yufei Gu | | | Configuration item Dispatcher.DISPATCHER\EXIT\ON\ERROR\KEY is disregarded | Major | nodemanager, resourcemanager | Yufei Gu | Yufei Gu | | | Fail the node if Linux Container Executor is not configured properly | Minor | . | Miklos Szegedi | Miklos Szegedi | | | TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails | Major | erasure-coding, test | Andrew Wang | Andrew Wang | | | TestFsDatasetCache#testPageRounder fails intermittently with AssertionError | Major | test | Andrew Wang | Andrew Wang | | | fairscheduler-statedump.log gets generated regardless of service | Blocker | fairscheduler, scheduler | Allen Wittenauer | Yufei Gu | | | Extending SLS: Synthetic Load Generator | Major | . | Carlo Curino | Carlo Curino | | | keepContainer does not work when AM retry window is set | Major | resourcemanager | kyungwan nam | kyungwan nam | | | New exception thrown by DFSClient#isHDFSEncryptionEnabled broke hacky hive code | Major |

| Yongjun Zhang | Yongjun Zhang | | | Improve and refactor user-limit calculation in capacity scheduler | Major | capacity scheduler | Sunil Govindan | Sunil Govindan | | | Add libHDFS API to return last exception | Critical | libhdfs | Sailesh Mukil | Sailesh Mukil | | | Do not mount inaccessible cgroups directories in CgroupsLCEResourcesHandler | Major | nodemanager | Miklos Szegedi | Miklos Szegedi | | | Add a proper scheme to the datanode links in NN web UI | Major | . | Kihwal Lee | Kihwal Lee | | | Support multi-line value for ssl.server.exclude.cipher.list | Major | . | John Zhuge | John Zhuge | | | AMs only intended to run one attempt can be run more than once | Major | resourcemanager | Jason Lowe | Jason Lowe | | | Fix profs stat file warning caused by process names that includes parenthesis | Major | . | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | Azure: RemoteWasbAuthorizerImpl and RemoteSASKeyGeneratorImpl should not use Kerberos interactive user cache | Major | fs/azure | Santhosh G Nayak | Santhosh G Nayak | | | Fix warnings from Spotbugs in hadoop-mapreduce | Major | . | Weiwei Yang | Weiwei Yang | | | CryptoOutputStream throws IOException on flush() if stream is closed | Major | . | Pierre Lacave | Pierre Lacave | | | StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully | Critical | ha, namenode | Zhe Zhang | Erik Krogen | | | ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled | Blocker | . | Junping Du | Rohith Sharma K S | | | SysInfoWindows is not thread safe | Major | . | igo Goiri | igo Goiri | | | fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 | Blocker | yarn | Haibo Chen | Haibo Chen | | | Improve Java sandbox regex | Major | . | Miklos Szegedi | Greg Phillips | | | TestIPC.testIpcWithReaderQueuing fails intermittently | Major | . | Eric Badger | Eric Badger | | | TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently | Major | . | Eric Badger | Jason Lowe | | | DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException | Blocker | erasure-coding | Manoj Govindassamy | Manoj Govindassamy | | | Inconsistent default block location in FileSystem javadoc | Trivial | fs | Mingliang Liu | Chen Liang | | | Fix ASF License warnings | Major | build | Akira Ajisaka | Akira Ajisaka | | | Fix warnings from Spotbugs in hadoop-yarn-server-timelineservice | Major | . | Weiwei Yang | Weiwei Yang | | | Fix warnings from Spotbugs in hadoop-yarn-client | Major | . | Weiwei Yang | Weiwei Yang | | | Some blocks can be permanently lost if nodes are decommissioned while dead | Blocker | namenode | Kihwal Lee | Kihwal Lee | | | libhdfs compilation is broken on OS X | Blocker | libhdfs | Allen Wittenauer | John Zhuge | | | Blocks can be committed with wrong size | Critical | hdfs-client | Daryn Sharp | Jing Zhao | | | Newly added NN storage directory won't get initialized and cause space exhaustion | Critical | . | Kihwal Lee | Kihwal Lee | | | maven upgrade broke start-build-env.sh | Blocker | build | Allen Wittenauer | Akira Ajisaka | | |

SimpleHttpProxyHandler#exceptionCaught log level from info to debug | Minor | datanode | Xiaoyu Yao | Xiaobing Zhou | | | hadoop-hdfs-native-client build fails in trunk in Windows after HDFS-11529 | Blocker | native | Vinayakumar B | Sailesh Mukil | | | License error in TestLoadBalancingKMSClientProvider.java | Major | . | hu xiaodong | hu xiaodong | | | NetworkTopology calls expensive toString() when logging | Major | . | igo Goiri | igo Goiri | | | Fix TestKafkaMetrics#testPutMetrics | Major | metrics | Akira Ajisaka | Alison Yu | | | Fix warnings from Spotbugs in hadoop-yarn-server-resourcemanager | Major | resourcemanager | Weiwei Yang | Weiwei Yang | | | Yarn top shows negative container number in FS | Major | yarn | Yufei Gu | Tao Jie | | | TestLocalFileSystem tests have very low timeouts | Major | . | Eric Badger | Eric Badger | | | TestSymlinkLocalFS timeouts are too low | Major | . | Eric Badger | Eric Badger | | | Fix regression in tests caused by YARN-679 | Major | test | Steve Loughran | Steve Loughran | | | Add shouldReplicate option to create builder | Blocker | balancer & mover, erasure-coding | Andrew Wang | Sammi Chen | | | Make the Guava version Hadoop which builds with configurable | Major | build | Steve Loughran | Steve Loughran | | | JN log segment syncing should support HA upgrade | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler | Blocker | rpc-server | Surendra Singh Lilhore | Surendra Singh Lilhore | | | TestHadoopArchiveLogsRunner fails | Major | test | Akira Ajisaka | Akira Ajisaka | | | Remove indefinite caching of key provider uri in DFSClient | Major | hdfs-client | Rushabh S Shah | Rushabh S Shah | | | Quit throwing NMNotYetReadyException | Major | nodemanager | Karthik Kambatla | Manikandan R | | | License error in GridmixTestUtils.java | Major | . | lixinglong | lixinglong | | | Upgrade Jsch jar to latest version to fix vulnerability in old versions | Critical | . | Vinayakumar B | Vinayakumar B | | | NM mount cpu cgroups failed on some systems | Major | . | sandflee | Miklos Szegedi | | | Increase Common test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | YARN RM will shut down if ZKClient creation times out | Major | resourcemanager | Wilfred Spiegelenburg | Daniel Templeton | | | License error In org.apache.hadoop.metrics2.util.Servers | Major | . | hu xiaodong | hu xiaodong | | | Fix warnings from spotbugs in hadoop-tools | Major | tools | Weiwei Yang | Weiwei Yang | | | Increase YARN test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | Increase MapReduce test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | Fix some long function checkstyle issues | Trivial | . | Miklos Szegedi | Soumabrata Chakraborty | | | Fix performance regression due to incorrect use of DataChecksum | Major | native, performance | LiXin Ge | LiXin Ge | | | Increase HDFS test timeouts from 1 second to 10 seconds | Major | . | Eric Badger | Eric Badger | | | Underconstruction blocks can be considered missing | Major |

| Nathan Roberts | Nathan Roberts | | | Fix JavaDoc issues in SchedulingPolicy | Trivial | fairscheduler | Daniel Templeton | Weiwei Yang | | | Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations | Major | . | Carlo Curino | Carlo Curino | | | Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently | Major | fs/azure | Trupti Dhavle | Santhosh G Nayak | | | DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set. | Major | . | Virajith Jalaparti | Virajith Jalaparti | | | Correct spelling of 'beginning' and variants | Trivial | . | Dongtao Zhang | Dongtao Zhang | | | ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread | Major | capacityscheduler, resourcemanager | Min Shen | Min Shen | | | FSAppAttempt keeps redundant copy of the queue | Major | fairscheduler | Daniel Templeton | Daniel Templeton | | | reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered | Critical | datanode | Vinayakumar B | Vinayakumar B | | | Incorrect logger for FairSharePolicy | Minor | fairscheduler | Yufei Gu | Vrushali C | | | Memory leak when reading a compressed file using the native library | Major | common, io | Eli Acherkan | Eli Acherkan | | | TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently | Major | . | Eric Badger | Nathan Roberts | | | Support for querying outputstream capabilities | Major | erasure-coding | Andrew Wang | Manoj Govindassamy | | | History server getApplicationReport NPE when fetching report for pre-2.8 job | Blocker | timelineserver | Jason Lowe | Jason Lowe | | | NPE in RMAppsBlock | Major | resourcemanager | Jason Lowe | Jason Lowe | | | HDFS architecture documentation describes outdated placement policy | Minor | . | dud | Chen Liang | | | Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger | Major | fs/azure, security | Sivaguru Sankaridurg | Sivaguru Sankaridurg | | | Program needs to exit when SLS finishes. | Major | scheduler-load-simulator | Yufei Gu | Yufei Gu | | | NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method | Major | . | xupeng | xupeng | | | HostsFileReader#getHostDetails is very expensive on large clusters | Major | util | Jason Lowe | Jason Lowe | | | Native task crashes when merging spilled file on ppc64 | Major | . | Tao Jie | Tao Jie | | | Avoid reloading of Configuration in ViewFileSystem creation. | Major | viewfs | Vinayakumar B | Vinayakumar B | | | Use MoveFileEx to allow renaming a file when the destination exists | Major | native | Lukas Majercak | Lukas Majercak | | | TestDataNodeOutlierDetectionViaMetrics UT fails | Major | . | Yesha Vora | Hanisha Koneru | | | Remove unused ContainerLocalization classes | Minor | nodemanager | ZhangBing Lin | ZhangBing Lin | | | Suppress ParameterNumber checkstyle violations for overridden methods | Major | . | Sidharta Seethana | Jonathan Eagles | | | TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once | Minor | test | Jason Lowe | Jason Lowe | | | Resource Manager is spelled "Resource Manger" in ResourceManagerRestart.md and ResourceManagerHA.md | Trivial | site | Grant Sohn | Grant Sohn | | | TestFairSchedulerPreemption fails

| Major | fairscheduler, resourcemanager | Sean Po | Tao Jie | | | Impersonation does not work if standby RM is contacted first | Blocker | client | Robert Kanter | Robert Kanter | | | Option -v missing for du command in FileSystemShell.md | Minor | documentation | Yiqun Lin | Yiqun Lin | | | Document missing metrics for blocks count in pending IBR | Minor | documentation | Yiqun Lin | Yiqun Lin | | | JournalNode startup failure exception should be logged in log file | Major | journal-node | Surendra Singh Lilhore | Surendra Singh Lilhore | | | JournalNode Sync should be off by default in hdfs-default.xml | Major | . | Hanisha Koneru | Hanisha Koneru | | | Correct license headers in hadoop-common, hdfs, yarn and mapreduce | Trivial | . | Yeliang Cang | Yeliang Cang | | | Document Metrics to track usage of memory for writes | Major | documentation | Brahma Reddy Battula | Yiqun Lin | | | AmIpFilter drops query parameters on redirect | Major | . | Wilfred Spiegelenburg | Wilfred Spiegelenburg | | | The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct | Minor | common, documentation | ZhangBing Lin | ZhangBing Lin | | | Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used | Major | common | Surendra Singh Lilhore | Surendra Singh Lilhore | | | FileJournalManager#getLogFile should ignore in progress edit logs during JN sync | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | GetContentSummary uses excessive amounts of memory | Blocker | namenode | Nathan Roberts | Wei-Chiu Chuang | | | FileSystem contract tests to replace JUnit 3 with 4 | Major | fs | Mingliang Liu | Xiaobing Zhou | | | ppc64le on Linux doesn't trigger \\linux get\_executable codepath | Major | nodemanager | Sonia Garudi | Ayappan | | | Configuration does not correctly XInclude absolute file URIs | Blocker | conf | Andrew Wang | Jonathan Eagles | | | the accessTime of FileStatus returned by SFTPFileSystem's getFileStatus method is always 0 | Trivial | fs | Hongyuan Li | Hongyuan Li | | | FSCK shows overall health status as corrupt even one replica is corrupt | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Fix journal missing log httpServerUrl address in JournalNodeSyncer | Major | hdfs | Hanisha Koneru | Hanisha Koneru | | | Fix JN sync interval in case of exception | Major | . | Hanisha Koneru | Hanisha Koneru | | | TestRMFailover fails rarely due to port conflict | Major | test | Robert Kanter | Robert Kanter | | | A faulty node can cause a lease leak and NPE on accessing data | Critical | . | Kihwal Lee | Kihwal Lee | | | Non-public resource localization on a bad disk causes subsequent containers failure | Major | . | Kuhu Shukla | Kuhu Shukla | | | ModifyTime of FileStatus returned by SFTPFileSystem's getFileStatus method is wrong | Major | fs | Hongyuan Li | Hongyuan Li | | | Modifier 'static' is redundant for inner enums | Minor | . | ZhangBing Lin | ZhangBing Lin | | | Fix NPE in LazyPersistFileScrubber | Major | . | igo Goiri | igo Goiri | | | hadoop-aws doc header

#5 line wrapped | Trivial | documentation, fs/s3 | John Zhuge | John Zhuge | | | Modifier 'static' is redundant for inner enums | Minor | . | ZhangBing Lin | ZhangBing Lin | | | Add missing imports to TestAliyunOSSFileSystemContract.java | Trivial | fs/oss, test | Mingliang Liu | Mingliang Liu | | | Modifier 'static' is redundant for inner enums | Minor | . | ZhangBing Lin | ZhangBing Lin | | | TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Refactor the NodeManager DeletionService to support additional DeletionTask types. | Major | nodemanager, yarn | Shane Kumpf | Shane Kumpf | | | Modifier 'static' is redundant for inner enums | Minor | . | ZhangBing Lin | ZhangBing Lin | | | Completed files lost after power failure | Critical | . | Dave Latham | Vinayakumar B | | | RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception | Critical | . | Jonathan Eagles | Jonathan Eagles | | | License information is missing for native CRC32 code | Critical | . | Timothy St. Clair | Andrew Wang | | | Remove useless document from TestAliyunOSSFileSystemContract.java | Minor | documentation | Akira Ajisaka | Chen Liang | | | Fix TestDFSShell.testMoveWithTargetPortEmpty failure. | Major | test | Konstantin Shvachko | Brahma Reddy Battula | | | Azure: update doc for live and contract tests | Major | documentation, fs/azure | Mingliang Liu | Mingliang Liu | | | Long running balancer may fail due to expired DataEncryptionKey | Major | balancer & mover | Wei-Chiu Chuang | Wei-Chiu Chuang | | | Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates | Major | hdfs-client, rolling upgrades | Vinayakumar B | Vinayakumar B | | | Fix license header inconsistency in hdfs | Trivial | . | Yeliang Cang | Yeliang Cang | | | Remove the redundant colon in ViewFs.md | Major | documentation | maobaolong | maobaolong | | | ASF License warnings generated intermittently in trunk | Major | . | Yiqun Lin | Yiqun Lin | | | Use yarn package manager to lock down dependency versions for new web UI | Major | . | Sreenath Somarajapuram | Sreenath Somarajapuram | | | s3a: mkdir appears to be broken | Blocker | fs/s3 | Aaron Fabbri | Mingliang Liu | | | Invalid event: COLLECTOR\_UPDATE at KILLED | Major | . | Jian He | Rohith Sharma K S | | | Segment overflow in FileDistributionCalculator | Major | tools | LiXin Ge | LiXin Ge | | | TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor | Major | . | Eric Badger | Eric Badger | | | Optimize NativeAzureFsInputStream for positional reads | Major | fs/azure | Rajesh Balamohan | Rajesh Balamohan | | | Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently | Major | fs/azure, test | Mingliang Liu | Mingliang Liu | | | BPServiceActor thread name is not correctly set | Major | hdfs | Chen Liang | Chen Liang | | | Enhance SLS-based tests leveraging invariant checker | Major |

| Carlo Curino | Carlo Curino | | | Positional read will fail if replicas moved to different DNs after stream is opened | Critical | hdfs-client | Vinayakumar B | Vinayakumar B | | | Document missing processor of hdfs oiv\_legacy command | Minor | documentation, tools | LiXin Ge | LiXin Ge | | | DN should not delete the block On "Too many open files" Exception | Critical | datanode | Brahma Reddy Battula | Brahma Reddy Battula | | | NNBench should Throw IOException when rename and delete fails | Major | . | Brahma Reddy Battula | Brahma Reddy Battula | | | Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} fails | Major | fs/azure, test | Mingliang Liu | Rajesh Balamohan | | | getGlobalJNIEnv() may deadlock if exception is thrown | Blocker | libhdfs | Henry Robinson | Sailesh Mukil | | | Internal lease recovery may not be retried for a long time | Major | namenode | Kihwal Lee | Kihwal Lee | | | Upgrade AWS SDK to 1.11.134 | Critical | fs/s3 | Aaron Fabbri | Aaron Fabbri | | | WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename | Major | fs/azure | Duo Xu | Duo Xu | | | RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels. | Blocker | . | Eric Payne | Sunil Govindan | | | RM startup failure with old state store due to version mismatch | Critical | . | Bibin A Chundatt | Varun Saxena | | | Switch from aalto-xml to woodstox to handle odd XML features | Blocker | conf | Andrew Wang | Jonathan Eagles | | | TestJMXGet fails occasionally | Major | . | Arpit Agarwal | Arpit Agarwal | | | When constructing a thread name, BPOfferService may print a bogus warning message | Minor | datanode | Tsz Wo Nicholas Sze | Weiwei Yang | | | Document wrong spelling in usage of MapredTestDriver tools. | Major | documentation | LiXin Ge | LiXin Ge | | | Job end notification not send due to YarnRuntimeException | Major | applicationmaster | yunjiong zhao | yunjiong zhao | | | TestBalancer#testBalancerWithStripedFile is flaky | Major | test | Andrew Wang | Lei (Eddy) Xu | | | ITestJets3tNativeS3FileSystemContract tests NPEs in teardown if store undefined | Minor | fs/s3, test | Steve Loughran | Steve Loughran | | | TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0 | Major | fs | Sonia Garudi | Hongyuan Li | | | Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeException | Minor | . | Junping Du | Gergely Novk | | | Fix warnings from Spotbugs in hadoop-yarn-common | Major | . | Weiwei Yang | Weiwei Yang | | | Replace MRv1 specific terms in HostsFileReader | Minor | documentation | Akira Ajisaka | hu xiaodong | | | HDFS Architecture documentation incorrectly describes writing to a local temporary file. | Minor | documentation | Chris Nauroth | Nanda kumar | | | Handle NPE in BlockRecoveryWorker when DN is getting shoutdown. | Major | datanode | Surendra Singh Lilhore | Surendra Singh Lilhore | | | OIV tests should not write outside 'target' directory. | Major | . | Konstantin Shvachko | Yiqun Lin | | | Fix dead link in the Javadoc of FairSchedulerEventLog.java | Minor | documentation | Akira Ajisaka | Weiwei Yang | | | Size of args cannot be less than zero

TraceAdmin#run as its linkedlist | Trivial | common, tracing | Weisen Han | Weisen Han | | | Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc | Minor | documentation | Wenxin He | Wenxin He | | | Successfully closed files can stay under-replicated. | Critical | . | Kihwal Lee | Kihwal Lee | | | FTPFileSystem#getFsAction always returns FsAction.NONE | Major | fs | Hongyuan Li | Hongyuan Li | | | Arguments check for ErasureCodingPolicy-\>composePolicyName | Minor | hdfs-client | lufei | lufei | | | TestCopyPreserveFlag fails consistently because of mismatch in access time | Major | hdfs, test | Mukul Kumar Singh | Mukul Kumar Singh | | | Accept human-friendly units in dfsadmin -setBalancerBandwidth and -setQuota | Major | shell | Andrew Wang | Andrew Wang | | | GenericTestUtils#waitFor missing parameter verification | Major | test | Yiqun Lin | Yiqun Lin | | | Fix typo's in FsDatasetImpl.java | Major | . | Yasen Liu | Yasen Liu | | | KerberosAuthenticationHandler should authenticate with SPN in AP-REQ | Major | security | Daryn Sharp | Daryn Sharp | | | TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk | Major | . | Varun Saxena | Robert Kanter | | | ZKFC should use getAversion() while setting the zkacl | Major | . | Brahma Reddy Battula | Brahma Reddy Battula | | | ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk | Critical | resourcemanager | dongtingting | Bibin A Chundatt | | | Azure: handle failure gracefully in case of missing account access key | Major | fs/azure | Mingliang Liu | Mingliang Liu | | | Inaccurate comment on DatanodeDescriptor#getNumberOfBlocksToBeErasureCoded | Trivial | namenode | Andrew Wang | Andrew Wang | | | Do not require a storage ID or target storage IDs when writing a block | Blocker | . | Andrew Wang | Ewan Higgs | | | DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks. | Major | erasure-coding | Lei (Eddy) Xu | Lei (Eddy) Xu | | | HADOOP\JOB\HISTORY\OPTS should be HADOOP\JOB\HISTORYSERVER\OPTS in mapred-config.sh | Critical | scripts | Robert Kanter | Robert Kanter | | | TestFsDatasetImpl.testCleanShutdownOfVolume fails | Major | test | Akira Ajisaka | hu xiaodong | | | ITestS3AFileOperationCost::testFakeDirectoryDeletion to uncomment metric assertions | Major | fs/s3 | Mingliang Liu | Mingliang Liu | | | CSQueueMetrics needs to update the current metrics for default partition only | Major | capacity scheduler | Naganarasimha G R | Manikandan R | | | yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml | Trivial | . | Daniel Templeton | Lori Loberg | | | hadoop-pipes doesn't use maven properties for openssl | Blocker | pipes | Allen Wittenauer | Allen Wittenauer | | | Erasurecode testcase failures with native enabled | Critical | common | Ayappan | Sammi Chen | | | Add parameter for rack locality delay in CapacityScheduler | Major | capacityscheduler | Konstantinos Karanasos | Konstantinos Karanasos | | | Concurrent task limits should only be applied when necessary | Major | mrv2 | Jason Lowe | Nathan Roberts | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Unit test for NameNodeStatusMXBean | Major | hdfs, test | Hanisha Koneru | Hanisha Koneru | | | Replace assertThat with assertTrue in MetricsAsserts | Minor |

| Akira Ajisaka | Akira Ajisaka | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Maintenance state expiry should be an epoch time and not jvm monotonic | Major | . | Manoj Govindassamy | Manoj Govindassamy | | | Add assertions to BlockInfo#addStorage to protect from breaking reportedBlock-blockGroup mapping | Critical | erasure-coding | Takanobu Asanuma | Takanobu Asanuma | | | Improve webservice to list aggregated log files | Major | . | Xuan Gong | Xuan Gong | | | Report blockIds of internal blocks for EC files in Fsck | Major | erasure-coding | Takanobu Asanuma | Takanobu Asanuma | | | FairScheduler: Avoid preempting AM containers | Major | fairscheduler | Karthik Kambatla | Yufei Gu | | | Handle localization sym-linking correctly at the YARN level | Major | . | Chris Trezzo | Chris Trezzo | | | Obtaining app logs for Running application fails with "Unable to parse json from webservice. Error:" | Major | . | Sumana Sathish | Xuan Gong | | | Fix few issues reported by jshint in new YARN UI | Major | yarn-ui-v2 | Akhil PB | Akhil PB | | | improve YARN webservice to output aggregated container logs | Major | . | Xuan Gong | Xuan Gong | | | Improve AHS webservice to accept NM address as a parameter to get container logs | Major | . | Xuan Gong | Xuan Gong | | | Make navigation link active when selecting sub tabs in "Applications" and "Nodes" page for new UI | Minor | yarn-ui-v2 | Kai Sasaki | Kai Sasaki | | | Document Use of Docker with LinuxContainerExecutor | Critical | documentation | Daniel Templeton | Daniel Templeton | | | AliyunOSS: oss directory filestatus should use meta time | Major | fs/oss | Fei Hui | Fei Hui | | | Reduce fair call queue priority inversion | Major | ipc | Daryn Sharp | Daryn Sharp | | | Allow ipc layer exceptions to selectively close connections | Major | ipc | Daryn Sharp | Daryn Sharp | | | Reduce fair call queue lock contention | Major | ipc | Daryn Sharp | Daryn Sharp | | | AliyunOSS: handle the failure in the batch delete operation \`deleteDirs\`. | Major | fs | Genmao Yu | Genmao Yu | | | TimelineReaderServer should wait to join with HttpServer2 | Minor | timelinereader | Sangjin Lee | Sangjin Lee | | | Add support for SSE-KMS and SSE-C in s3a filesystem | Major | fs/s3 | Andrew Olson | Steve Moist | | | AliyunOSS: listStatus returns wrong file info | Major | fs/oss | Fei Hui | Fei Hui | | | AliyunOSS: update oss sdk version | Major | fs, fs/oss | Genmao Yu | Genmao Yu | | | re-direct NM Web Service to get container logs for finished applications | Major | . | Xuan Gong | Xuan Gong | | | AMRMClient changes to support ExecutionType update | Major | . | Arun Suresh | Arun Suresh | | | Fix breadcrumb issues for various pages in new YARN UI | Minor | yarn-ui-v2 | Akhil PB | Akhil PB | | | AliyunOSS: Failed to read from stream when seek beyond the download size | Major | fs/oss | Genmao Yu | Genmao Yu | | | AM blacklisting to consider node label partition | Major |

| Bibin A Chundatt | Bibin A Chundatt | | | Few missing informations in Application and Application Attempt pages for new YARN UI. | Major | . | Akhil PB | Akhil PB | | | Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI | Major | datanode, namenode | Manoj Govindassamy | Elek, Marton | | | FS Preemption is a trickle for severely starved applications | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla | | | Set UncaughtExceptionHandler for all FairScheduler threads | Major | fairscheduler | Karthik Kambatla | Yufei Gu | | | Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2 | Major | timelineserver | Naganarasimha G R | Naganarasimha G R | | | fix some typos in the s3a docs | Minor | documentation, fs/s3 | Steve Loughran | Steve Loughran | | | Use shaded aws-sdk uber-JAR 1.11.86 | Major | build, fs/s3 | Steve Loughran | Steve Loughran | | | FairScheduler might not trigger preemption when using DRF | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla | | | S3A: Consider avoiding array copy in S3ABlockOutputStream (ByteArrayBlock) | Minor | fs/s3 | Rajesh Balamohan | Rajesh Balamohan | | | Documentation changes for TimelineV2Client | Minor | documentation | Varun Saxena | Naganarasimha G R | | | Separate class InnerNode from class NetworkTopology and make it extendable | Major | namenode | Chen Liang | Tsz Wo Nicholas Sze | | | Introduce loading icon in each page of new YARN UI | Major | . | Akhil PB | Akhil PB | | | Split S3 testing documentation out into its own file | Minor | documentation, fs/s3 | Steve Loughran | Steve Loughran | | | Avoid OutOfMemoryError in TestMaintenanceState test runs | Major | datanode, namenode | Manoj Govindassamy | Manoj Govindassamy | | | Relax error message assertion in S3A test ITestS3AEncryptionSSEC | Minor | fs/s3 | Mingliang Liu | Mingliang Liu | | | QJM: Sychronize past log segments to JNs that missed them | Major | ha | Todd Lipcon | Hanisha Koneru | | | CORS support in timeline v2 | Major | timelinereader | Sreenath Somarajapuram | Rohith Sharma K S | | | Fix incompatible issue caused by YARN-3583 | Blocker | rolling upgrade | Wangda Tan | Sunil Govindan | | | review ADL Docs | Minor | documentation, fs/adl | Steve Loughran | Steve Loughran | | | Fix AM container allocation logic in SLS | Major | scheduler-load-simulator | Wangda Tan | Wangda Tan | | | EntityGroupFSTimelineStore should allow configurable cache stores. | Major | timelineserver | Li Lu | Li Lu | | | FairScheduler preemption and update should not run concurrently | Major | fairscheduler, test | Sunil Govindan | Tao Jie | | | [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed. | Major | . | Wangda Tan | Wangda Tan | | | move jets3t into a dependency on hadoop-aws JAR | Major | build, fs/s3 | Steve Loughran | Akira Ajisaka | | | Use em-table in app/nodes pages for new YARN UI | Major |

| Sunil Govindan | Sunil Govindan | | | HDFS specific network topology classes with storage type info included | Major | namenode | Chen Liang | Chen Liang | | | Maintenance minimum replication config value allowable range should be [0, DefaultReplication] | Major | datanode, namenode | Manoj Govindassamy | Manoj Govindassamy | | | Fix package.html to compile with Java 9 | Major | documentation | Akira Ajisaka | Akira Ajisaka | | | Relax permission checking for EC related operations | Blocker | erasure-coding | Kai Zheng | Andrew Wang | | | Update maven-javadoc-plugin to 2.10.4 | Major | build | Akira Ajisaka | Akira Ajisaka | | | Fail to show real-time tracking charts in SLS | Major | scheduler-load-simulator | Yufei Gu | Yufei Gu | | | OIV tool should make an EC file explicit | Major | . | Wei-Chiu Chuang | Manoj Govindassamy | | | Add support for Docker pull | Major | yarn | Zhankun Tang | luhuichun | | | Expose # of pre-emptions as a queue counter | Major | fairscheduler | Philip Zeyliger | Karthik Kambatla | | | Remove misplaced ADL service provider config file for FileSystem | Minor | fs/adl | John Zhuge | John Zhuge | | | ADL module has messed doc structure | Major | fs/adl | Mingliang Liu | Mingliang Liu | | | Improve Resource Donut chart with better label in Node page of new YARN UI | Major | . | Akhil PB | Akhil PB | | | cut some obsolete, ignored s3 tests in TestS3Credentials | Minor | fs/s3, test | Steve Loughran | Yuanbo Liu | | | Cleanup when AMRMProxy fails to initialize a new interceptor chain | Minor | . | Botong Huang | Botong Huang | | | Remove unused AdlConfKeys#ADL\EVENTS\TRACKING\_SOURCE | Trivial | fs/adl | John Zhuge | John Zhuge | | | Add storage type demand to into DFSNetworkTopology#chooseRandom | Major | namenode | Chen Liang | Chen Liang | | | Make Node Heatmap Chart categories clickable in new YARN UI | Major | . | Yesha Vora | Gergely Novk | | | Potential infinite redirection on YARN log redirection web service | Major | . | Xuan Gong | Xuan Gong | | | yarn logs cli should provide logs for a completed container even when application is still running | Major | . | Siddharth Seth | Xuan Gong | | | DFSTopologyNodeImpl#chooseRandom optimizations | Major | namenode | Chen Liang | Chen Liang | | | BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy | Major | namenode | Rui Gao | Manoj Govindassamy | | | Aliyun OSS FileSystem contract test should implement getTestBaseDir() | Major | fs/oss | Mingliang Liu | Mingliang Liu | | | Use frontend-maven-plugin 0.0.22 version for new yarn ui | Major | . | Kai Sasaki | Kai Sasaki | | | DiskBalancer: Report command supports reading nodes from host file | Major | diskbalancer | Yiqun Lin | Yiqun Lin | | | YARN logs CLI needs alway check containerLogsInfo/containerLogInfo before parse the JSON object from NMWebService | Major | . | Siddharth Seth | Xuan Gong | | | Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS | Major | scheduler-load-simulator | Yufei Gu | Yufei Gu | | | needless

in S3ABlockOutputStream putObject() | Minor | fs/s3 | Steve Loughran | Yuanbo Liu | | | Remove URI parameter in AWSCredentialProvider constructors | Major | fs/s3 | Mingliang Liu | Mingliang Liu | | | Azure Data Lake doc is missing required config entry | Major | fs/adl | Atul Sikaria | Atul Sikaria | | | Fix ADLS doc for credential provider | Major | documentation, fs/adl | John Zhuge | John Zhuge | | | Add isErasureCoded() API to FileStatus class | Blocker | fs | Wei-Chiu Chuang | Manoj Govindassamy | | | TestAdlFileSystemContractLive fails to clean up | Minor | fs/adl, test | John Zhuge | John Zhuge | | | Rename ADLS credential properties | Minor | fs/adl | John Zhuge | John Zhuge | | | Combine the old and the new chooseRandom for better performance | Major | namenode | Chen Liang | Chen Liang | | | Implement putEntitiesAsync API in TimelineCollector | Major | ATSv2, timelineserver | Joep Rottinghuis | Haibo Chen | | | Distcp should not copy replication factor if source file is erasure coded | Blocker | distcp | Wei-Chiu Chuang | Manoj Govindassamy | | | Call RawErasureEncoder and RawErasureDecoder release() methods | Major | erasure-coding | Lszl Bence Nagy | Sammi Chen | | | Not be able to run SLS with FairScheduler | Major | . | Wangda Tan | Yufei Gu | | | Make TimelineV2Client's drain timeout after stop configurable | Major | . | Jian He | Haibo Chen | | | Exceptions caused by synchronous putEntities requests can be swallowed | Critical | ATSv2 | Haibo Chen | Haibo Chen | | | ATSv2 HBase related tests fail due to guava version upgrade | Major | timelineserver | Sonia Garudi | Haibo Chen | | | NMTimelinePublisher#serviceStop does not stop timeline clients | Major | yarn | Haibo Chen | Haibo Chen | | | Add an ability to convert ChildQueue to ParentQueue | Major | capacity scheduler | Xuan Gong | Xuan Gong | | | TimelineCollector is not stopped when an app finishes in RM | Critical | timelineserver | Varun Saxena | Varun Saxena | | | localBaseAddress for CORS proxy configuration is not working when suffixed with forward slash in new YARN UI. | Major | . | Gergely Novk | Gergely Novk | | | Update SLF4J from 1.7.10 to 1.7.25 | Major | . | Akira Ajisaka | Akira Ajisaka | | | Add a toggle button to switch between timeline view / table view for containers and application-attempts in new YARN UI | Major | webapp | Wangda Tan | Akhil PB | | | Add default value for NM disk validator | Major | nodemanager | Yufei Gu | Yufei Gu | | | Ability to specify per-file EC policy at create time | Major | erasure-coding | Andrew Wang | Sammi Chen | | | S3A to delete unnecessary fake directory objects in mkdirs() | Major | fs/s3 | Mingliang Liu | Mingliang Liu | | | FairScheduler: Reserve preempted resources for corresponding applications | Major |

| Miklos Szegedi | Miklos Szegedi | | | Explicitly exclude S3A root dir ITests from parallel runs | Minor | fs/s3, test | Steve Loughran | Steve Loughran | | | Add ADLS sensitive config keys to default list | Minor | fs, fs/adl, security | John Zhuge | John Zhuge | | | Move 'Long Running Services' to an independent tab at top level for new Yarn UI | Major | webapp | Sunil Govindan | Akhil PB | | | Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics | Blocker | fs/s3 | Steve Loughran | Steve Loughran | | | Define and parse erasure code policies | Major | erasure-coding | Kai Zheng | Frank Zeng | | | Some refactoring work for erasure coding raw coder | Major | . | Kai Zheng | Frank Zeng | | | Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation in new YARN UI | Major | . | Gergely Novk | Gergely Novk | | | S3A SSE tests won't run in parallel: Bad request in directory GetFileStatus | Minor | fs/s3, test | Steve Loughran | Steve Moist | | | Queue metrics doesn't work for Fair Scheduler in SLS | Major | scheduler-load-simulator | Yufei Gu | Yufei Gu | | | Rename ADLS CONTRACT\ENABLE\KEY | Minor | fs/adl | Mingliang Liu | Mingliang Liu | | | StorageType should be encoded in the block token | Major | datanode, namenode | Arpit Agarwal | Ewan Higgs | | | Add javadoc for storage policy and erasure coding policy | Minor | documentation | Kai Sasaki | Kai Sasaki | | | Remove httpclient dependency from hadoop-openstack | Blocker | . | Akira Ajisaka | Akira Ajisaka | | | Enhance the timelinewriter.flush() race condition fix | Major | yarn | Haibo Chen | Haibo Chen | | | Allow user to customize new erasure code policies | Major | erasure-coding | Kai Zheng | Huafeng Wang | | | Update LowCost agents logic to take advantage of YARN-4358 | Major | capacityscheduler, fairscheduler, resourcemanager | Carlo Curino | Ishai Menache | | | Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent | Major | reservation system | Subru Krishnan | Subru Krishnan | | | Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem | Major | resourcemanager | Subru Krishnan | Sangeetha Abdu Jyothi | | | Improve test coverage and add utility classes for common Docker operations | Major | nodemanager, yarn | Shane Kumpf | Shane Kumpf | | | App level aggregation should not consider metric values reported in the previous aggregation cycle | Major | timelineserver | Varun Saxena | Varun Saxena | | | Make SLS JSON input file format simple and scalable | Major | scheduler-load-simulator | Yufei Gu | Yufei Gu | | | Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault | Major | namenode | Yiqun Lin | Yiqun Lin | | | Fix memory leak and finish app trigger in AMRMProxy | Critical | . | Botong Huang | Botong Huang | | | Erasure coding: client should update and commit block based on acknowledged size | Critical | erasure-coding | Zhe Zhang | Sammi Chen | | | Support multiple attempts on the node when AMRMProxy is enabled | Major | amrmproxy, federation, nodemanager | Subru Krishnan | Giovanni Matteo Fumarola | | | Reduce the visibility of FileSystem#newFSDataOutputStreamBuilder before the API becomes stable | Blocker | fs | Lei (Eddy) Xu | Lei (Eddy) Xu | | | ConcurrentModificationException in TimelineCollectorManager while stopping RM | Major | resourcemanager | Rohith Sharma K S | Haibo Chen | | | [ATSv2] Can't retrieve more than 1000 versions of metrics in time series | Critical | timelineserver | Rohith Sharma K S | Vrushali C | | | Update exception message during timeline collector aux service initialization | Minor | timelineserver | Vrushali C | Vrushali C | | | NMClient API change for container upgrade | Major |

| Jian He | Arun Suresh | | | s3a delete() operation fails during a concurrent delete of child entries | Major | fs/s3 | Steve Loughran | Steve Loughran | | | SLS doesn't honor node total resource specified in sls-runner.xml | Major | . | Wangda Tan | Wangda Tan | | | S3A copyFromLocalFile to be robust, tested | Major | fs | Steve Loughran | Steve Loughran | | | Show timeline data from ATS v2 in new web UI | Major | . | Sunil Govindan | Akhil PB | | | Rumen input does't work in SLS | Major | scheduler-load-simulator | YuJie Huang | Yufei Gu | | | Performance analysis of new DFSNetworkTopology#chooseRandom | Major | namenode | Chen Liang | Chen Liang | | | Add ec sub command -listCodec to show currently supported ec codecs | Major | erasure-coding | Sammi Chen | Sammi Chen | | | Extend TestDFSStripedIutputStream/TestDFSStripedOutputStream with a random EC policy | Major | erasure-coding, test | Takanobu Asanuma | Takanobu Asanuma | | | Refactor of ResourceManager#startWebApp in a Util class | Major | nodemanager, resourcemanager | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola | | | Store application flow context in NM state store for work-preserving restart | Major | timelineserver | Vrushali C | Rohith Sharma K S | | | TestMaintenanceState#testWithNNAndDNRestart fails intermittently | Major | . | Yiqun Lin | Yiqun Lin | | | Refactor yarn-app pages in new YARN UI. | Major | . | Akhil PB | Akhil PB | | | Identifying starved apps does not need the scheduler writelock | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla | | | Reuse iip in unprotectedRemoveXAttrs calls | Major | . | Xiao Chen | Xiao Chen | | | DFSAdmin report command supports displaying maintenance state datanodes | Major | datanode, namenode | Yiqun Lin | Yiqun Lin | | | Provide help information and documentation for TimelineSchemaCreator | Major | timelineserver | Li Lu | Haibo Chen | | | Reduce fair call queue backoff's impact on clients | Major | ipc | Daryn Sharp | Daryn Sharp | | | Allow metric TTL for Application table to be specified through cmd | Major | ATSv2 | Haibo Chen | Haibo Chen | | | Reduce Resource instance overhead via non-PBImpl | Major | resourcemanager | Daryn Sharp | Daryn Sharp | | | Add more debug logs for delegation tokens and authentication | Minor | security | Xiao Chen | Xiao Chen | | | KMS should log error details in KMSExceptionsProvider | Major | kms | Xiao Chen | Xiao Chen | | | Improve performance of AssignmentInformation datastructures | Major | . | Daryn Sharp | Daryn Sharp | | | [ATSv2] Update HBase version to 1.2.6 | Major | timelineserver | Varun Saxena | Vrushali C | | | Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats | Major | erasure-coding | Wei-Chiu Chuang | Manoj Govindassamy | | | Provide Builder pattern for DistributedFileSystem.create | Major | fs | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Move log4j APIs over to slf4j in hadoop-common | Major | . | Akira Ajisaka | Akira Ajisaka | | | Provide Builder pattern for

| Major | fs | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Fix TestFilterFileSystem and TestHarFileSystem failures after DistributedFileSystem.append API | Major | fs | Lei (Eddy) Xu | Lei (Eddy) Xu | | | Extend TestErasureCodingPolicies/TestErasureCodingPolicyWithSnapshot with a random EC policy | Major | erasure-coding, test | Takanobu Asanuma | Takanobu Asanuma | | | Avoid locking overhead for NO\_LABEL lookups | Major | resourcemanager | Daryn Sharp | Daryn Sharp | | | Move logging APIs over to slf4j in hadoop-tools | Major | . | Akira Ajisaka | Akira Ajisaka | | | Add CLI cmd to remove an erasure code policy | Major | erasure-coding | Kai Zheng | Tim Yao | | | Enable DFSNetworkTopology as default | Major | namenode | Chen Liang | Chen Liang | | | Add IOUtils.cleanupWithLogger that accepts slf4j logger API | Major | . | Akira Ajisaka | Chen Liang | | | Fix warnings from Spotbugs in hadoop-common | Major | . | Akira Ajisaka | Akira Ajisaka | | | [WASB] the configured retry policy is not used for all storage operations. | Major | fs/azure | Thomas Marquardt | Thomas Marquardt | | | Use GenericTestUtils.setLogLevel when available in hadoop-tools | Major | . | Akira Ajisaka | Wenxin He | | | regression: Azure tests which capture logs failing with move to SLF4J | Major | fs/azure, test | Steve Loughran | Steve Loughran | | | Azure: Concurrent I/O does not work when secure.mode is enabled | Major | fs/azure | Thomas Marquardt | Thomas Marquardt | | | add more on s3 regions to the s3a documentation | Minor | documentation, fs/s3 | Steve Loughran | Steve Loughran | | | Update the documentation about the new ec codecs config keys | Major | documentation | Kai Sasaki | Kai Sasaki | | | NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks an error code | Major | fs/azure | Steve Loughran | Steve Loughran | | | Document graceful decommission CLI and usage | Major | documentation | Junping Du | Elek, Marton | | | Azure: Reuse ObjectMapper | Major | fs/azure | Mingliang Liu | Mingliang Liu | | | AWS SDK 1.11+ aborts() on close() if \> 0 bytes in stream; logs error | Blocker | fs/s3 | Steve Loughran | Steve Loughran | | | Add cross-user preemption within CapacityScheduler's leaf-queue | Major | capacity scheduler | Vinod Kumar Vavilapalli | Sunil Govindan | | | Use deployed webapp folder to launch new YARN UI | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Convert BlockTokenIdentifier to use Protobuf | Major | hdfs, hdfs-client | Ewan Higgs | Ewan Higgs | | | AbstractFileSystem implementaion for 'wasbs' scheme | Major | fs/azure | Varada Hemeswari | Varada Hemeswari | | | Documentation refers to incorrect nodemanager health checker interval property | Trivial | documentation | Charles Zhang | Weiwei Yang | | | Clean up the overwrite of createDispatcher() in subclass of MockRM | Minor | resourcemanager | Yufei Gu | Yufei Gu | | | Revert HADOOP-13606 swift FS to add a service load metadata file | Major | . | John Zhuge | John Zhuge | | | Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully | Minor | ha, namenode | Erik Krogen | Erik Krogen | | | Add CLI cmd to enable/disable an