Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.2.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Define constraints on Auxiliary Service names. Change ShuffleHandler service name from mapreduce.shuffle to mapreduce\_shuffle. | Blocker | nodemanager | Tassapol Athiapinya | Xuan Gong | | | Clean up Fair Scheduler configuration loading | Major | scheduler | Sandy Ryza | Sandy Ryza | | | disable symlinks temporarily | Blocker | fs | Colin P. McCabe | Sanjay Radia | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | make HDFS advisory caching configurable on a per-file basis | Minor | hdfs-client | Colin P. McCabe | Colin P. McCabe | | | Provide configuration option for FileSystem/FileContext symlink resolution | Major | . | Andrew Wang | Andrew Wang | | | Remove redundant -R option from setrep | Major | tools | Arpit Agarwal | Arpit Agarwal | | | Log application status in the rm log when app is done running | Minor | . | Arpit Gupta | Arpit Gupta | | | Use guava LoadingCache to implement DFSClientCache | Major | nfs | Haohui Mai | Haohui Mai | | | Support SASL-authenticated ZooKeeper in ActiveStandbyElector | Major | auto-failover, ha | Todd Lipcon | Todd Lipcon | | | Restore config to ban submitting to undeclared pools in the Fair Scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza | | | Replace HttpConfig#getSchemePrefix with implicit schemes in HDFS JSP | Major | . | Haohui Mai | Haohui Mai | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | BlockScanner scans the block multiple times and on restart scans everything | Blocker | datanode | Vinayakumar B | Vinayakumar B | | | Job recovery fails after killing all the running containers for the app | Major | . | Arpit Gupta | Jian He | | | Application Manager UI does not appear with Https enabled | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Race between the initialization of NameNode and the http server | Major | . | Haohui Mai | Haohui Mai | | | The RemoteIterator returned by DistributedFileSystem.listFiles(..) may throw NPE | Blocker | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Need to add https port related property in Job history server | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | FifoPolicy.computeShares throws NPE on empty list of Schedulables | Major | scheduler | Sandy Ryza | Karthik Kambatla | | | HarFileSystem.listStatus() returns invalid authority if port number is empty | Major | fs | shanyu zhao | shanyu zhao | | | ViewFileSystem#rename fails when using DistributedFileSystem | Blocker | viewfs | Andrew Wang | Andrew Wang | | |

is failing | Blocker | mrv2 | Jason Lowe | Jian He | | | ResourceManager UI has invalid tracking URL link for distributed shell application | Major | resourcemanager | Tassapol Athiapinya | Xuan Gong | | | incorrect exception message if min node size \> min rack size | Trivial | mrv2 | Sangjin Lee | Sangjin Lee | | | Skip tests in TestHDFSCLI that are not applicable on Windows. | Minor | test | Chris Nauroth | Chuan Liu | | | Different versions of avro and avro-maven-plugin | Major | . | Karthik Kambatla | Karthik Kambatla | | | ConcurrentModificationException in JobControl | Major | . | Jason Lowe | Robert Parker | | | org.apache.hadoop.mapred.TestTaskAttemptListenerImpl.testCommitWindow times out | Major | . | Robert Kanter | Robert Kanter | | | NFS write commit verifier is not set in a few places | Major | nfs | Brandon Li | Brandon Li | | | Namenode fails to start when dfs.https.port is unspecified | Major | . | Haohui Mai | Haohui Mai | | | With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely | Major | resourcemanager, scheduler | Sandy Ryza | Siqi Li | | | test-container-executor has gotten out of sync with the changes to container-executor | Major | nodemanager | Roman Shaposhnik | Roman Shaposhnik | | | JobClient#getJob loads job conf twice | Major | . | Sandy Ryza | Sandy Ryza | | | Yarn URL should include userinfo | Major | api | Chuan Liu | Chuan Liu | | | TestApplicationCleanup relies on all containers assigned in a single heartbeat | Major | . | Sandy Ryza | Karthik Kambatla | | | HarFileSystem.listLocatedStatus() fails | Major | fs | Jason Dere | | | | Distcp job fails with hsftp when https is enabled in insecure cluster | Major | . | Yesha Vora | Arpit Agarwal | | | mapreduce.jobhistory.webapp.https.address property is not respected | Blocker | . | Yesha Vora | Omkar Vinit Joshi | | | Secure Oozie jobs fail with delegation token renewal exception in Namenode HA setup | Blocker | ha | Arpit Gupta | Suresh Srinivas | | | Guard against NullPointerException in NameNode JSP pages before initialization of FSNamesystem. | Major | namenode | Chris Nauroth | Chris Nauroth | | | Update the doc of running MRv1 examples jar on YARN | Major | . | Zhijie Shen | Zhijie Shen | | | Updating resource requests should be decoupled with updating blacklist | Major | . | Zhijie Shen | Zhijie Shen | | | hdfs-site.xml included in hadoop-mapreduce-client-jobclient tests jar is breaking tests for downstream components | Minor | test | Robert Kanter | Robert Kanter | | | Node resource is added twice when node comes back from unhealthy to healthy | Major | resourcemanager | Peng Zhang | Peng Zhang | | | Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure | Major | test | Aaron

Myers | Aaron T. Myers | | | MR jobs hangs as it does not use the node-blacklisting feature in RM requests | Critical | . | Yesha Vora | Zhijie Shen | | | The roundup for memory values on resource manager UI is misleading | Major | resourcemanager | Trupti Dhavle | Xuan Gong | | | FairScheduler setting queue name in RMApp is not working | Major | resourcemanager | Sandy Ryza | Sandy Ryza | | | "Text file busy" errors launching containers again | Major | nodemanager | Sandy Ryza | Sandy Ryza | | | NM throws InvalidStateTransitonException: Invalid event: APPLICATION\LOG\HANDLING\_FINISHED at RUNNING | Major | . | Ramya Sunil | Xuan Gong | | | $HADOOP\MAPRED\HOME/$HADOOP\CONF\DIR setting not working on Windows | Major | client | Yingda Chen | Yingda Chen | | | FSDownload changes file suffix making FileUtil.unTar() throw exception | Major | nodemanager | shanyu zhao | shanyu zhao | | | Speculative execution does not function for reduce | Major | applicationmaster | Tassapol Athiapinya | Xuan Gong | | | FSNameSystem#deleteSnapshot() should not check owner in case of permissions disabled | Major | namenode | Vinayakumar B | Vinayakumar B | | | TestDistributedShell#TestDSShell failed with timeout | Major | applications/distributed-shell | Junping Du | Xuan Gong | | | Submitted distributed shell application shows appMasterHost = empty | Major | applications/distributed-shell | Tassapol Athiapinya | Xuan Gong | | | Distributed shell does not account for start container failures reported asynchronously. | Major | . | Hitesh Shah | Hitesh Shah | | | NPE in RackResolve | Critical | . | Lohit Vijayarenu | Lohit Vijayarenu | | | Job does not get into Pending State | Major | . | Yesha Vora | Jian He | | | LCE fails to run containers that don't have resources to localize | Blocker | nodemanager | Alejandro Abdelnur | Siddharth Seth | | | New AM does not start after rm restart | Blocker | . | Yesha Vora | Hitesh Shah | | | DFS client hangs in updatePipeline RPC when failover happened | Blocker | namenode | Vinayakumar B | Vinayakumar B | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add a config value to CLITestHelper to skip tests on Windows | Minor | test | Chuan Liu | Chuan Liu | | | TestFileJournalManager fails on Windows due to file handle leaks | Minor | namenode, test | Chuan Liu | Chuan Liu | | | Increase timeout of TestDFSIO.testAppend and TestMRJobsWithHistoryService.testJobHistoryData | Minor | mrv2, test | Chuan Liu | Chuan Liu | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Application Manager UI does not appear with Https enabled | Major |

| Yesha Vora | Omkar Vinit Joshi | | | Need to add https port related property in Yarn | Major | . | Yesha Vora | Omkar Vinit Joshi | | | Clients should be notified job finished only after job successfully unregistered | Critical | . | Jian He | Zhijie Shen | | | Register ClientToken MasterKey in SecretManager after it is saved | Critical | resourcemanager | Jian He | Jian He | | | Make Hadoop nfs server port and mount daemon port configurable | Major | nfs | Jinghui Wang | Jinghui Wang | | | Improve distributed shell application to work on a secure cluster | Major | applications/distributed-shell | Hitesh Shah | Vinod Kumar Vavilapalli | | | Binary and source incompatibility in mapreduce.TaskID and mapreduce.TaskAttemptID between branch-1 and branch-2 | Blocker | mrv1, mrv2 | Robert Kanter | Robert Kanter | | | Binary incompatibilities in mapred.lib.TotalOrderPartitioner between branch-1 and branch-2 | Blocker | mrv1, mrv2 | Robert Kanter | Robert Kanter | | | Get queue administration ACLs working | Major | scheduler | Sandy Ryza | Xuan Gong | | | MRAppMaster#shutDownJob shouldn't send job end notification before checking isLastRetry | Blocker | . | Zhijie Shen | Zhijie Shen | | | Introduce RpcInfo to decouple XDR classes from the RPC API | Major | nfs | Haohui Mai | Haohui Mai | | | ContainerImpl State Machine: Invalid event: CONTAINER\KILLED\ON\REQUEST at CONTAINER\CLEANEDUP\AFTER\KILL | Major | nodemanager | Hitesh Shah | Zhijie Shen | | | Binary Incompatibility of O.A.H.U.mapred.SequenceFileAsBinaryOutputFormat.WritableValueBytes | Blocker | . | Zhijie Shen | Zhijie Shen | | | RM\_HOME link breaks when webapp.https.address related properties are not specified | Major | . | Yesha Vora | Omkar Vinit Joshi | | | Binary and source incompatibility in mapred.lib.CombineFileInputFormat between branch-1 and branch-2 | Blocker | mrv1, mrv2 | Robert Kanter | Robert Kanter | | | RM triggers web auth failure before first job | Critical | resourcemanager | Allen Wittenauer | Omkar Vinit Joshi | | | NM silently ignores non-existent service in StartContainerRequest | Critical | . | Bikas Saha | Xuan Gong | | | $yarn logs command should return an appropriate error message if YARN application is still running | Minor | client | Tassapol Athiapinya | Siddharth Seth | | | NM is polluting container's credentials | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | | | Datanode https port is not available at the namenode | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas | | | Fix NPE in DFSClient#getDelegationToken when doing Distcp from a secured cluster to an insecured cluster | Major | . | Jing Zhao | Haohui Mai | | | Add http policy support for YARN daemons | Major | . | Suresh Srinivas | Omkar Vinit Joshi | | | MR AM should exit when unregister() throws exception | Major | . | Zhijie Shen | Zhijie Shen | | | Support client which combines appended data with old data before sends it to NFS server | Major | nfs | Yesha Vora | Brandon Li |