Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.1.0-beta.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Remove KFS support | Major | fs | Eli Collins | Eli Collins | | | The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy | Major | ipc | Sanjay Radia | Sanjay Radia | | | Include RPC error info in RpcResponseHeader instead of sending it separately | Major | ipc | Sanjay Radia | Sanjay Radia | | | Rationalize AllocateResponse in RM scheduler API | Major | . | Bikas Saha | Zhijie Shen | | | Add totalLength to rpc response | Major | ipc | Sanjay Radia | Sanjay Radia | | | Flatten NodeHeartbeatResponse | Major | . | Siddharth Seth | Xuan Gong | | | Flatten RegisterNodeManagerResponse | Major | . | Siddharth Seth | Xuan Gong | | | RPC Support for QoS | Major | ipc | Luke Lu | Junping Du | | | Remove ContainerStatus, ContainerState from Container api interface as they will not be called by the container object | Major | . | Xuan Gong | Xuan Gong | | | Nodemanager should set some key information into the environment of every container that it launches. | Major | . | Hitesh Shah | Xuan Gong | | | Hadoop does not close output file / does not call Mapper.cleanup if exception in map | Major | . | Daniel Dai | Arun C Murthy | | | Add a configurable limit on number of blocks per file, and min block size | Minor | namenode | Todd Lipcon | Andrew Wang | | | Make ApplicationToken part of Container's token list to help RM-restart | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Support setting execution bit for regular files | Major | namenode | Brandon Li | Brandon Li | | | Provide a mapping from INodeId to INode | Major | namenode | Brandon Li | Suresh Srinivas | | | Add error codes to rpc-response | Major | ipc | Sanjay Radia | Sanjay Radia | | | Make YarnRemoteException not be rooted at IOException | Major | . | Xuan Gong | Xuan Gong | | | Change RMAdminProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong | | | Change ContainerManager api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong | | | Change ClientRMProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong | | | Change AMRMProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong | | | Replace YarnRemoteException with IOException in MRv2 APIs | Critical | . | Jitendra Nath Pandey | Xuan Gong | | | ContainerLaunchContext.containerTokens should simply be called tokens | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Signature changes for getTaskId of TaskReport in mapred | Major | . | Zhijie Shen | Mayank Bansal | | | Hadoop-examples-1.x.x.jar cannot run on Yarn | Blocker | . | Zhijie Shen | Zhijie Shen | | | Functions are changed or removed from Job in jobcontrol | Major | . | Zhijie Shen | Mayank Bansal | | | User should not be part of ContainerLaunchContext | Major |

| Hitesh Shah | Omkar Vinit Joshi | | | ClusterStatus incompatiblity issues with MR1 | Major | . | Zhijie Shen | Zhijie Shen | | | Make ApplicationID immutable | Major | . | Siddharth Seth | Siddharth Seth | | | ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Preemptable annotations (to support preemption in MR) | Major | mrv2 | Carlo Curino | Carlo Curino | | | Make ApplicationAttemptID, ContainerID, NodeID immutable | Major | . | Jian He | Jian He | | | Rename ResourceRequest (get,set)HostName to (get,set)ResourceName | Major | . | Arun C Murthy | Arun C Murthy | | | container-log4j.properties should not refer to mapreduce properties | Major | . | Siddharth Seth | Zhijie Shen | | | Two function signature changes in filecache.DistributedCache | Major | . | Zhijie Shen | Zhijie Shen | | | Move BuilderUtils from yarn-common to yarn-server-common | Major | . | Jian He | Jian He | | | Rename YarnRemoteException to YarnException | Major | . | Xuan Gong | Siddharth Seth | | | Rename AllocateResponse.reboot to AllocateResponse.resync | Major | . | Bikas Saha | Bikas Saha | | | Move PreemptionContainer/PremptionContract/PreemptionMessage/StrictPreemptionContract/PreemptionResourceRequest to api.records | Major | . | Jian He | Jian He | | | Add individual factory method for api protocol records | Major | . | Jian He | Jian He | | | Move ProtoBase from api.records to api.records.impl.pb | Major | . | Jian He | Jian He | | | Remove unreferenced objects from proto | Major | . | Jian He | Jian He | | | Fix up /nodes REST API to have 1 param and be consistent with the Java API | Major | api, resourcemanager | Sandy Ryza | Sandy Ryza | | | Remove IpcSerializationType | Major | ipc | Luke Lu | Junping Du | | | mapreduce.Job killTask/failTask/getTaskCompletionEvents methods have incompatible signature changes | Blocker | . | Alejandro Abdelnur | Karthik Kambatla | | | Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services | Major | . | Steve Loughran | Steve Loughran | | | rename Service.register() and Service.unregister() to registerServiceListener() & unregisterServiceListener() respectively | Major | . | Steve Loughran | Steve Loughran | | | Move NodeHealthStatus from yarn.api.record to yarn.server.api.record | Major | . | Jian He | Jian He | | | Move ContainerExitStatus from yarn.api to yarn.api.records | Major | . | Jian He | Jian He | | | mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1 | Major | mrv2 | Robert Kanter | Robert Kanter | | | Protocol buffer support cannot compile under C | Blocker | namenode | Ralph Castain | Arpit Agarwal | | | Rename FinishApplicationMasterRequest.setFinishApplicationStatus to setFinalApplicationStatus to be consistent with getter | Major | . | Jian He | Jian He | | | Remove resource min from Yarn client API | Blocker | api | Alejandro Abdelnur | Alejandro Abdelnur | | | Rename RMTokenSelector to be RMDelegationTokenSelector | Major | . | Zhijie Shen | Zhijie Shen | | | Remove YarnVersionAnnotation | Major | . | Zhijie Shen | Zhijie Shen | | | Move RMAdmin from yarn.client to yarn.client.cli and rename as RMAdminCLI | Major | . | Jian He | Jian He | | | Fix inconsistent protocol naming | Blocker |

| Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Remove resource min from GetNewApplicationResponse | Blocker | . | Jian He | Jian He | | | Add static factory to yarn client lib interface and change it to abstract class | Major | . | Jian He | Jian He | | | Move Clock/SystemClock to util package | Major | . | Zhijie Shen | Zhijie Shen | | | Promote YARN service life-cycle libraries into Hadoop Common | Blocker | . | Zhijie Shen | Zhijie Shen | | | ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn | Major | . | Zhijie Shen | Zhijie Shen | | | Rename ApplicationToken to AMRMToken | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | ClientToken (ClientToAMToken) should not be set in the environment | Blocker | . | Siddharth Seth | Omkar Vinit Joshi | | | Review/fix annotations for yarn-client module and clearly differentiate \*Async apis | Blocker | . | Arun C Murthy | Zhijie Shen | | | Move ProtoUtils to yarn.api.records.pb.impl | Major | . | Jian He | Jian He | | | Annotate and document AuxService APIs | Major | . | Siddharth Seth | Vinod Kumar Vavilapalli | | | Start using NMTokens to authenticate all communication with NM | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Have YarnClient generate a directly usable ApplicationSubmissionContext | Minor | client | Harsh J | Karthik Kambatla | | | Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently. | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Convert SASL to use ProtoBuf and provide negotiation capabilities | Blocker | . | Sanjay Radia | Daryn Sharp | | | ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API | Blocker | api, resourcemanager | Sandy Ryza | Sandy Ryza | | | Wrap IpcConnectionContext in RPC headers | Blocker | ipc | Luke Lu | Daryn Sharp | | | ApplicationTokens should be used irrespective of kerberos | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | ApplicationMasterProtocol doesn't need ApplicationAttemptId in the payload after YARN-701 | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | ContainerManagerProtcol APIs should take in requests for multiple containers | Blocker | . | Vinod Kumar Vavilapalli | Jian He | | | RPCv9 client must honor server's SASL negotiate response | Blocker | ipc | Daryn Sharp | Daryn Sharp | | | Add RPC header to client ping | Blocker | ipc | Daryn Sharp | Daryn Sharp | | | RPCv9 wire protocol is insufficient to support multiplexing | Blocker | ipc, security | Daryn Sharp | Daryn Sharp | | | Update the HDFS compatibility version range | Blocker | . | Kihwal Lee | Kihwal Lee | | | Fix configs yarn.resourcemanager.resourcemanager.connect.{max.wait.secs\|retry\_interval.secs} | Trivial | . | Karthik Kambatla | Karthik Kambatla | | | Support for RW/RO snapshots in HDFS | Major | namenode | Hari Mankude | Tsz Wo Nicholas Sze | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | |

INodeDirectory#getExistingPathINodes() to enable returning more than INode array | Minor | . | Jing Zhao | Jing Zhao | | | Add support for running the Hadoop client on AIX | Major | security | Aaron T. Myers | Aaron T. Myers | | | Add shell command to dump file checksums | Major | fs, tools | Todd Lipcon | Todd Lipcon | | | Add a new block-volume device choosing policy that looks at free space | Minor | datanode | Harsh J | Aaron T. Myers | | | Add tag info to JH files | Minor | . | Billie Rinaldi | Billie Rinaldi | | | Namenode should have a favored nodes hint to enable clients to have control over block placement. | Major | hdfs-client, namenode | Pritam Damania | Devaraj Das | | | Enhancements to support Hadoop on Windows Server and Windows Azure environments | Major | . | Bikas Saha | Bikas Saha | | | Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology | Major | namenode | Junping Du | Junping Du | | | Update Balancer to support new NetworkTopology with NodeGroup | Major | balancer & mover | Junping Du | Junping Du | | | Add multi-resource scheduling to the fair scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza | | | Implement ONCRPC and XDR | Major | . | Brandon Li | Brandon Li | | | Move MapReduce services to YARN-117 stricter lifecycle | Major | applicationmaster | Steve Loughran | Steve Loughran | | | Add general interface for NFS and Mount | Major | . | Brandon Li | Brandon Li | | | Add status NameNode startup to webUI | Major | namenode | Suresh Srinivas | Chris Nauroth | | | Add symlink support to FileSystem | Major | fs | Eli Collins | Andrew Wang | | | Extends LightWeightGSet to support eviction of expired elements | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Umbrella Jira for HDFS-HA Phase 2 | Major | . | Sanjay Radia | Todd Lipcon | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Unnecessary double-check in DN#getHostName | Trivial | datanode | Harsh J | Harsh J | | | Cleanup BlockInfo class | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | [Gridmix] Improve STRESS mode | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | | TestHDFSCLI.testAll fails if the user name is not all lowercase | Trivial | test | Brandon Li | Brandon Li | | | getDouble() and setDouble() in org.apache.hadoop.conf.Configuration | Minor | conf | Jan van der Lugt | Jan van der Lugt | | | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li | | | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li | | | Use Builder to get RPC server in HDFS | Minor | datanode, ha, namenode, security | Brandon Li | Brandon Li | | | Use Builder to get RPC server in YARN | Minor | . | Brandon Li | Brandon Li | | | Increase the default block size | Major |

| Eli Collins | Eli Collins | | | Passing INodesInPath instead of INode[] in FSDirectory | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add a new class for the parameter in INode.collectSubtreeBlocksAndClear(..) | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao | | | Change the fields in INode and its subclasses to private | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Improvements on INode and image loading | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Use the generic code for choosing datanode in Balancer | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add maven plugin alternative to shell script to save package-info.java | Major | build | Chris Nauroth | Chris Nauroth | | | ResourceRequestPBImpl's toString() is missing location and # containers | Major | api | Sandy Ryza | Sandy Ryza | | | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash | | | Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) | Major | capacityscheduler | Ravi Prakash | Ravi Prakash | | | detabify LCEResourcesHandler classes | Trivial | nodemanager | Steve Loughran | Steve Loughran | | | replace protoc ant plugin exec with a maven plugin | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Some JobQueueInfo methods are public in MR1 but protected in MR2 | Major | client | Sandy Ryza | Sandy Ryza | | | Make FSEditLogOp.MAX\OP\SIZE configurable | Major | namenode | Todd Lipcon | Colin P. McCabe | | | Document the need to build hadoop-maven-plugins for eclipse and separate project builds | Major | build, documentation | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Update netty version | Minor | build | Nicolas Liochon | Nicolas Liochon | | | mapred shell script should respect usage flags (--help -help -h) | Minor | . | Andrew Wang | Andrew Wang | | | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp | | | TestRackResolver fails when local network resolves "host1" to a valid host | Minor | . | Hitesh Shah | Hitesh Shah | | | Expose UGI.setLoginUser for tests | Major | security | Daryn Sharp | Daryn Sharp | | | Allow additional exceptions through the RPC layer | Major | . | Siddharth Seth | Siddharth Seth | | | Native-code implementation of bzip2 codec | Major | io | Govind Kamat | Govind Kamat | | | use DFSUtil.getSpnegoKeytabKey() to get the spnego keytab key in secondary namenode and namenode http server | Minor | security | Arpit Gupta | Arpit Gupta | | | Small image transfer related cleanups. | Trivial | . | Andrew Wang | Andrew Wang | | | capture the ulimit info after printing the log to the console | Trivial |

| Arpit Gupta | Arpit Gupta | | | If we are navigating to Nodemanager UI from Resourcemanager,then there is not link to navigate back to Resource manager | Minor | nodemanager | Ramgopal N | Jian He | | | Refreshing the RM page forgets how many rows I had in my Datatables | Major | resourcemanager | Ravi Prakash | Jian He | | | when exiting on a signal, print the signal name first | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla | | | Improve hashCode implementations for PB records | Major | . | Arun C Murthy | Xuan Gong | | | The exclude node list should be more forgiving, for each output stream | Minor | hdfs-client | Harsh J | Harsh J | | | FileSystemContractBaseTest doesn't test filesystem's mkdir/isDirectory() logic rigorously enough | Trivial | fs | Steve Loughran | Steve Loughran | | | Move BlockManager#computeCapacity to LightWeightGSet | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta | | | applicationComparator improvement for CS | Minor | scheduler | Nemon Lou | Nemon Lou | | | SchedulerUtils improve way normalizeRequest sets the resource capabilities | Major | scheduler | Thomas Graves | Zhijie Shen | | | Improve FS docs | Minor | documentation | Eli Collins | Sandy Ryza | | | RM address DNS lookup can cause unnecessary slowness on every JHS page load | Major | . | Sandy Ryza | Sandy Ryza | | | CodecPool: Add counters for number of (de)compressors leased out | Major | . | Karthik Kambatla | Karthik Kambatla | | | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves | | | Add Gset#clear method and clear the block map when namenode is shutdown | Minor | . | Eli Collins | Suresh Srinivas | | | Namenode operation checks should be done in a consistent manner | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Recovery should restore task state from job history info directly | Critical | mr-am | Jason Lowe | Jason Lowe | | | Optimising the LineRecordReader initialize() method | Major | mrv1, mrv2, performance | Arun A K | Gelesh | | | Fair Scheduler's document link could be added to the hadoop 2.x main doc page | Major | documentation | Dapeng Sun | Sandy Ryza | | | mapred-default.xml is missing a bunch of history server configs | Major | documentation, jobhistoryserver | Sandy Ryza | Sandy Ryza | | | HADOOP\USER\CLASSPATH\_FIRST is not honored; CLASSPATH is PREpended instead of APpended | Major | scripts | Mitch Wyle | Harsh J | | | add concrete common implementations of CombineFileInputFormat | Minor | mrv1, mrv2 | Sangjin Lee | Sangjin Lee | | | Remove sleep between IPC client connect timeouts | Minor | ipc | Varun Sharma | Varun Sharma | | | Speed up lease/block recovery when DN fails and a block goes into recovery | Major | namenode | Varun Sharma | Varun Sharma | | | LdapGroupsMapping doesn't seem to set a timeout for its directory search | Minor | security | Harsh J | Harsh J | | | FsShell Copy Commands Should Optionally Preserve File Attributes | Major | fs | Nick White | Nick White | | | Add Configuration API for parsing time durations | Minor | conf | Todd Lipcon | Chris Douglas | | | winutils support for readlink command | Major | util | Chris Nauroth | Arpit Agarwal | | | Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils. | Major |

| Omkar Vinit Joshi | Omkar Vinit Joshi | | | WARN when users set the block balanced preference percent below 0.5 or above 1.0 | Minor | . | Stephen Chu | Stephen Chu | | | Add virtual cores to queue metrics | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | Add an optional mesage to RegisterNodeManagerResponse as to why NM is being asked to resync or shutdown | Major | . | Vinod Kumar Vavilapalli | Mayank Bansal | | | metrics2#JvmMetrics should have max memory size of JVM | Minor | metrics | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs | Major | . | Tian Hong Wang | Tian Hong Wang | | | provide client-side metrics for remote reads, local reads, and short-circuit reads | Minor | hdfs-client | Colin P. McCabe | Colin P. McCabe | | | DFS read performance suboptimal when client co-located on nodes with data | Major | datanode, hdfs-client, performance | George Porter | Colin P. McCabe | | | Create a new HdfsConfiguration before each TestDFSClientRetries testcases | Major | . | Tian Hong Wang | Tian Hong Wang | | | Adding application type to submission context | Major | . | Mayank Bansal | Mayank Bansal | | | copyFromLocal and renaming a file to ".snapshot" should output that ".snapshot" is a reserved name | Minor | snapshots | Stephen Chu | Jing Zhao | | | Update junit dependency | Major | build | Timothy St. Clair | | | | Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass | Major | namenode | Junping Du | Junping Du | | | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla | | | Over 10 different tests have near identical implementations of AppContext | Major | applicationmaster, test | Sandy Ryza | Sandy Ryza | | | Wrong Javadoc of FSDataOutputStream | Minor | fs | Jingguo Yao | Jingguo Yao | | | HADOOP\_OPTS not picked up by hadoop command | Minor | bin, conf | Paul Han | Paul Han | | | Hook up cgroups CPU settings to the number of virtual cores allocated | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | Enhance YARN service model | Major | . | Steve Loughran | Steve Loughran | | | vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way | Critical | nodemanager | Sandy Ryza | Sandy Ryza | | | have the service interface extend Closeable and use close() as its shutdown operation | Minor | mrv2 | Steve Loughran | | | | factor out scheduler config validation from the ResourceManager to each scheduler implementation | Major | resourcemanager, scheduler | Alejandro Abdelnur | Alejandro Abdelnur | | | Enable zero capabilities resource requests in fair scheduler | Major | scheduler | Alejandro Abdelnur | Alejandro Abdelnur | | | In AMRMClient, automatically add corresponding rack requests for requested nodes | Major | api, applications | Sandy Ryza | Sandy Ryza | | | Expose blacklisted nodes from the MR AM REST API | Major | applicationmaster | Sandy Ryza | Sandy Ryza | | | DirectoryScanner: volume path prefix takes up memory for every block that is scanned | Minor | . | Colin P. McCabe | Colin

McCabe | | | When possible, Use DFSClient.Conf instead of Configuration | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add number of children in HdfsFileStatus | Minor | namenode | Brandon Li | Brandon Li | | | Add a multi-resource fair sharing metric | Major | scheduler | Sandy Ryza | Sandy Ryza | | | Allow metrics sources to be extended | Major | metrics | Sandy Ryza | Sandy Ryza | | | Avoid a wide line on the name node webUI if we have more Journal nodes | Minor | ha, namenode | Fengdong Yu | Fengdong Yu | | | NetworkTopology: when a node can't be added, print out its location for diagnostic purposes | Trivial | net | Colin P. McCabe | Colin P. McCabe | | | Expose Fair Scheduler-specific queue metrics | Major | scheduler | Sandy Ryza | Sandy Ryza | | | make maximum RPC buffer size configurable | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Optimize datanode ReplicasMap and ReplicaInfo | Major | datanode | Suresh Srinivas | Aaron T. Myers | | | Move from randomly generated block ID to sequentially generated block ID | Major | namenode | Suresh Srinivas | Arpit Agarwal | | | Make disallowSnapshot idempotent | Major | . | Jing Zhao | Jing Zhao | | | Cleanup FSNamesystem#startFileInternal | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | invalid network topologies should not be cached | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Require c99 when building libhdfs | Minor | libhdfs | Eli Collins | | | | Make balancer's thread count configurable | Major | balancer & mover | Max Lapan | Max Lapan | | | MR changes for YARN-513 | Major | . | Bikas Saha | Jian He | | | Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol | Minor | ipc | Jason Lowe | Jason Lowe | | | Print trash configuration and trash emptier state in namenode log | Minor | namenode | Suresh Srinivas | Arpit Agarwal | | | RM webservices can't query based on application Types | Major | . | Xuan Gong | Xuan Gong | | | ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it | Minor | namenode | Chris Nauroth | Chris Nauroth | | | Print paths of loaded native libraries in NativeLibraryChecker | Minor | native | Binglin Chang | Binglin Chang | | | Add retry attempt count to the RPC requests | Major | ipc | Suresh Srinivas | Jing Zhao | | | Replace hard-coded property keys with DFSConfigKeys fields | Minor | . | Kousuke Saruta | Kousuke Saruta | | | Reduce the frequency of getCurrentUser() calls from namenode | Major | namenode, performance | Kihwal Lee | Kihwal Lee | | | Add globally unique Client ID to RPC requests | Blocker | ipc | Suresh Srinivas | Suresh Srinivas | | | RPC clients can generate call ID using AtomicInteger instead of synchronizing on the Client

| Minor | ipc | Chris Nauroth | Chris Nauroth | | | Move the Rpc request call ID generation to client side InvocationHandler | Major | ipc | Suresh Srinivas | Tsz Wo Nicholas Sze | | | Add clientId and retryCount to RpcResponseHeaderProto | Major | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Clean up RPC code | Minor | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Make ClientProtocol#abandonBlock() idempotent | Major | namenode | Suresh Srinivas | Jing Zhao | | | Move GSet and LightWeightGSet to hadoop-common | Major | util | Suresh Srinivas | Suresh Srinivas | | | Make DatanodeProtocol#blockReceivedAndDeleted idempotent | Major | namenode | Jing Zhao | Jing Zhao | | | RetryCache utility for implementing RPC retries | Major | util | Suresh Srinivas | Suresh Srinivas | | | Make RetryCache#state non volatile | Minor | util | Suresh Srinivas | Suresh Srinivas | | | Additional cleanup RPC code | Minor | ipc | Junping Du | Junping Du | | | YARN CLI should show CPU info besides memory info in node status | Major | client | Junping Du | Junping Du | | | On startup, DN should scan volumes in parallel | Major | datanode | Aaron T. Myers | Aaron T. Myers | | | Retry the methods that are tagged @AtMostOnce along with @Idempotent | Major | ipc | Suresh Srinivas | Suresh Srinivas | | | Optimize node local splits generated by CombineFileInputFormat | Major | . | Siddharth Seth | Siddharth Seth | | | Update protobuf to 2.5 from 2.4.x | Blocker | performance | stack | Alejandro Abdelnur | | | Improve toString implementation for PBImpls | Major | . | Siddharth Seth | Jian He | | | Add retry cache support in Namenode | Major | ha, namenode | Suresh Srinivas | Suresh Srinivas | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | DFSClient islocaladdress() can use similar routine in netutils | Trivial | hdfs-client | Hari Mankude | Hari Mankude | | | Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | [Gridmix] Gridmix should give better error message when input-data directory already exists and -generate option is given | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task | Major | . | Ravi Gummadi | Ravi Gummadi | | | Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | GridMix emulated job tasks.resource-usage emulator for CPU usage throws NPE when Trace contains cumulativeCpuUsage value of 0 at attempt level | Major | contrib/gridmix | Karam Singh | Amar Kamat | | | Rumen fails to parse certain counter strings | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | Sometimes gridmix emulates data larger much larger then acutal counter for map only jobs | Minor | contrib/gridmix | Karam Singh | Amar Kamat | | | Provide access to ParsedTask.obtainTaskAttempts() | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | Fix two findbugs introduced by HDFS-3695 | Trivial | build, namenode | Todd Lipcon | Todd Lipcon | | | Clean up the addNode/addChild/addChildNoQuotaCheck methods in FSDirectory | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | |

does not update parent | Major | namenode | Tsz Wo Nicholas Sze | Jing Zhao | | | Add layout version for HDFS-4256 for release 1.2.0 | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Fix typo MAX\NOT\CHANGED\_INTERATIONS | Major | . | Ted Yu | Ted Yu | | | Submit a job to a queue that not allowed in fairScheduler, client will hold forever. | Major | resourcemanager, scheduler | Hong Shen | Hong Shen | | | mvn clean without running mvn install before fails | Major | build | Karthik Kambatla | Karthik Kambatla | | | port change to use Java untar API on Windows from branch-1-win to trunk | Major | fs | Chris Nauroth | Chris Nauroth | | | AM does not tell the RM about container requests that are no longer needed | Major | . | Bikas Saha | Bikas Saha | | | AMRMClientImpl should handle null rmClient in stop() | Minor | . | Hitesh Shah | Hitesh Shah | | | several HDFS tests attempt file operations on invalid HDFS paths when running on Windows | Major | . | Chris Nauroth | Chris Nauroth | | | Fix TestContainersMonitor for HADOOP-9252 | Minor | . | Tsz Wo Nicholas Sze | Chris Nauroth | | | Namenode WebUI file browsing does not work with wildcard addresses configured | Major | namenode | Andrew Wang | Andrew Wang | | | Unexpected extra results when using webUI table search | Minor | . | Jason Lowe | Ravi Prakash | | | GetGroupsTestBase fails on Windows | Major | test | Chris Nauroth | Chris Nauroth | | | Edits dir in dfs.namenode.edits.dir.required will be silently ignored if it is not in dfs.namenode.edits.dir | Major | namenode | Mark Yang | Arpit Agarwal | | | HDFS docs not linked from top level | Major | documentation | Thomas Graves | Andy Isaacson | | | command manual dfsadmin missing entry for restoreFailedStorage option | Major | . | Thomas Graves | Andy Isaacson | | | Execution phase for hadoop-maven-plugin should be process-resources | Major | build | Karthik Kambatla | Karthik Kambatla | | | TaskImpl.getCounters() can return the counters for the wrong task attempt when task is speculating | Critical | mr-am | Jason Lowe | Jason Lowe | | | Add support for running the Hadoop client on 64-bit AIX | Major | security | Aaron T. Myers | Aaron T. Myers | | | Allow client-side lease renewal to be retried beyond soft-limit | Major | hdfs-client | Kihwal Lee | Kihwal Lee | | | -jt generic command line option does not work | Major | client | Sandy Ryza | Sandy Ryza | | | remove old record IO generation and tests | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | |

SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla | | | remove addition of avro genreated-sources dirs to build | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member | Critical | mrv1 | Robert Parker | Robert Parker | | | RM can return null application resource usage report leading to NPE in client | Critical | resourcemanager | Jason Lowe | Jason Lowe | | | RM should point tracking URL to RM web page when app fails to start | Major | resourcemanager | Jason Lowe | Jason Lowe | | | mapred.JobStatus compatibility: MR2 missing constructors from MR1 | Major | client | Sandy Ryza | Sandy Ryza | | | hadoop -help, -h, --help should show usage instructions | Minor | . | Andrew Wang | Andrew Wang | | | DatanodeManager#registerDatanode rejects all datanode registrations from localhost in single-node developer setup | Major | namenode | Chris Nauroth | Chris Nauroth | | | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng | | | CMakeLists.txt: define \GNU\SOURCE and \LARGEFILE\SOURCE | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Typos in API documentation | Minor | documentation, fs, io, record | Hao Zhong | Suresh Srinivas | | | when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings | Minor | . | Colin P. McCabe | Colin P. McCabe | | | DF should throw a more reasonable exception when mount cannot be determined | Major | fs | Todd Lipcon | Andrew Wang | | | ApplicationCLI and NodeCLI use hard-coded platform-specific line separator, which causes test failures on Windows | Major | client | Chris Nauroth | Chris Nauroth | | | add LOCALE.US to toLowerCase in SecurityUtil.replacePattern | Major | . | Arpit Gupta | Arpit Gupta | | | Merger progress miscounts with respect to EOF\_MARKER | Major | . | Sandy Ryza | Sandy Ryza | | | Failure to download a public resource on a node prevents further downloads of the resource from that node | Critical | nodemanager | Jason Lowe | Jason Lowe | | | CombineFileInputFormat node input split can be skewed on small clusters | Major | . | Bikas Saha | Bikas Saha | | | Historyserver should provide counters for failed tasks | Major | jobhistoryserver, mrv2 | Jason Lowe | Xuan Gong | | | IPC.Server incorrectly sets UGI auth type | Major | ipc | Daryn Sharp | Daryn Sharp | | | Remove jline from distribution | Major | build | Thomas Weise | Thomas Weise | | | TestUniformSizeInputFormat fails intermittently | Major | test | Karthik Kambatla | Karthik Kambatla | | | AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize | Major | mrv2 | Jason Lowe | Jason Lowe | | | Resource Manager not logging the health\check\script result when taking it out | Major | resourcemanager | Thomas Graves | Jason Lowe | | | Finer grained metrics for HDFS capacity | Major | . | Arpit Agarwal | Arpit Agarwal | | | Confusing output when running hadoop version from one hadoop installation when HADOOP\_HOME points to another | Major | tools | Sandy Ryza | Sandy Ryza | | | Apps that have completed can appear as RUNNING on the NM UI | Blocker | resourcemanager | Jason Lowe | Jason Lowe | | | "mapred queue -info" spits out ugly exception when queue does not exist | Major | client, scheduler | Sandy Ryza | Sandy Ryza | | | yarn node -status prints Last-Last-Health-Update | Major | client | Thomas Graves | Omkar Vinit Joshi | | | New lines in diagnostics for a failed app on the per-application page make it hard to read | Major |

| Vinod Kumar Vavilapalli | Omkar Vinit Joshi | | | DefaultSpeculator generates error messages on normal shutdown | Major | applicationmaster | Jason Lowe | Jason Lowe | | | 2NN gets stuck in inconsistent state if edit log replay fails in the middle | Major | namenode | Todd Lipcon | Kihwal Lee | | | RPC call queue may fill due to current user lookup | Critical | namenode | Daryn Sharp | Daryn Sharp | | | set hadoop.log.dir and hadoop.id.str when starting secure datanode so it writes the logs to the correct dir by default | Major | datanode, security | Arpit Gupta | Arpit Gupta | | | Remove unnecessary hflush from log aggregation | Major | nodemanager | Kihwal Lee | Kihwal Lee | | | Fetch failure processing can cause AM event queue to backup and eventually OOM | Blocker | mr-am | Jason Lowe | Jason Lowe | | | Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager | Critical | nodemanager | Devaraj K | Robert Parker | | | org.apache.hadoop.fs.DF.getMount() does not work on Mac OS | Major | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | namenode http server should use the web authentication keytab for spnego principal | Major | security | Arpit Gupta | Arpit Gupta | | | Support override of jsvc binary and log file locations when launching secure datanode. | Major | datanode, scripts | Chris Nauroth | Chris Nauroth | | | Application expiration difficult to debug for end-users | Major | resourcemanager | Jason Lowe | Jason Lowe | | | Shuffle does not limit number of outstanding connections | Major | . | Jason Lowe | Robert Parker | | | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty | | | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal | | | Merge CHANGES.branch-trunk-win.txt to CHANGES.txt | Minor | . | Suresh Srinivas | Suresh Srinivas | | | Fix bad timeout annotations on tests | Major | . | Arpit Agarwal | Arpit Agarwal | | | TestProxyUserFromEnv fails on a Windows domain joined machine | Major | . | Ivan Mitic | Ivan Mitic | | | TestHAZKUtil fails on Windows | Major | . | Ivan Mitic | Ivan Mitic | | | PathData#expandAsGlob does not return correct results for absolute paths on Windows | Major | . | Ivan Mitic | Ivan Mitic | | | DNS#reverseDns() can return hostname with . appended at the end | Major | net | Karthik Kambatla | Karthik Kambatla | | | Fix TestINodeFile on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs | Major | util | Chris Nauroth | Chris Nauroth | | | Fix TestJournal failures on Windows | Major | namenode, test | Arpit Agarwal | Arpit Agarwal | | | HTTPFS tests fail on Windows | Major | webhdfs | Chris Nauroth | Chris Nauroth | | | TestFsShellCopy fails on Windows | Major | . | Ivan Mitic | Ivan Mitic | | | TestDataDirs.testGetDataDirsFromURIs fails with all directories in dfs.datanode.data.dir are invalid | Major | . | Ivan Mitic | Ivan Mitic | | | Fetch failures that time out only count against the first map task | Critical |

| Robert Joseph Evans | Robert Joseph Evans | | | TestHftpURLTimeouts throws NPE | Trivial | hdfs-client | Chao Shi | Chao Shi | | | Default values for access time precision are out of sync between hdfs-default.xml and the code | Minor | namenode | Aaron T. Myers | Aaron T. Myers | | | LightWeightGSet expects incrementing a volatile to be atomic | Minor | . | Colin P. McCabe | Colin P. McCabe | | | libwebhdfs compilation broken with gcc 4.6.2 | Minor | . | Colin P. McCabe | Colin P. McCabe | | | TestSaveNamespace fails on Windows | Major | . | Arpit Agarwal | Arpit Agarwal | | | When short circuit read is fails, DFSClient does not fallback to regular reads | Major | hdfs-client | Suresh Srinivas | Suresh Srinivas | | | TestNodeCount fails | Major | . | Ivan Mitic | Ivan Mitic | | | TestHostsFiles fails on Windows | Major | . | Ivan Mitic | Ivan Mitic | | | HA clients can fail to fail over while Standby NN is performing long checkpoint | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers | | | Incremental dist tar build fails | Major | build | Jason Lowe | Chris Nauroth | | | fail over to loading a different FSImage if the first one we try to load is corrupt | Major | . | Colin P. McCabe | Andrew Wang | | | Shutting down namenode during checkpointing can lead to md5sum error | Major | namenode | Andrew Wang | Andrew Wang | | | misleading description for net.topology.table.file.name property in core-default.xml | Minor | conf | rajeshbabu | rajeshbabu | | | Nodemanager should be more robust in handling connection failure to ResourceManager when a cluster is started | Major | nodemanager | Ramgopal N | Xuan Gong | | | TestMiniDFSCluster fails on Windows | Major | . | Ivan Mitic | Ivan Mitic | | | TestHsWebServicesJobs fails on jdk7 | Major | webapps | Thomas Graves | Thomas Graves | | | TestHsWebServicesJobsQuery.testJobsQueryStateInvalid fails with jdk7 | Major | jobhistoryserver | Thomas Graves | Thomas Graves | | | TestJournalNode fails on Windows | Major | . | Ivan Mitic | Ivan Mitic | | | Reducer unable to fetch for a map task that was recovered | Blocker | mr-am, security | Jason Lowe | Jason Lowe | | | TestProcfsProcessTree#testProcessTree() doesn't wait long enough for the process to die | Major | . | Karthik Kambatla | Karthik Kambatla | | | Add AM Host and RPC Port to ApplicationCLI Status Output | Major | client | Chris Riccomini | Chris Riccomini | | | FSNamesystem#getContentSummary should use getPermissionChecker helper method | Trivial | namenode | Aaron T. Myers | Aaron T. Myers | | | DistCp leaks input file handles | Major | distcp | Chris Nauroth | Chris Nauroth | | | TestContainerManagerSecurity fails on Windows | Major | nodemanager | Chris Nauroth | Chris Nauroth | | | TestDistributedShell fails on Windows | Major | applications/distributed-shell | Chris Nauroth | Chris Nauroth | | | TestContainerLogsPage fails on Windows | Major | nodemanager | Chris Nauroth | Chris Nauroth | | | TestMRAppMaster fails on Windows due to mismatched path separators | Major | client | Chris Nauroth | Chris Nauroth | | | event handling races in ContainerLauncherImpl and TestContainerLauncher | Major | client, mrv2 | Patrick Hunt | Robert Kanter | | | Documentation for dfs.namenode.rpc-address specifies wrong format | Major | documentation | Sandy Ryza | Sandy Ryza | |

TestGetConf#testGetSpecificKey fails on Windows | Minor | test | Ivan Mitic | Ivan Mitic | | | TestAuditLogs should release log handles between tests | Minor | test | Ivan Mitic | Ivan Mitic | | | Fix TestDFSShell failures on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | Fix TestNNWithQJM failures on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | TestDFVariations fails on Windows after the merge | Minor | fs | Ivan Mitic | Ivan Mitic | | | Activate native-win profile by default on Windows | Major | build | Arpit Agarwal | Arpit Agarwal | | | FileSystemContractTestBase never verifies that files are files | Minor | fs | Steve Loughran | Steve Loughran | | | .tmp file is not deleted for localized archives | Major | nodemanager | Jason Lowe | Mayank Bansal | | | Ensure/confirm that the NodeManager cleans up local-dirs on restart | Critical | nodemanager | Vinod Kumar Vavilapalli | Xuan Gong | | | MR AM should read max-retries information from the RM | Major | . | Vinod Kumar Vavilapalli | Zhijie Shen | | | WebHDFS concat: the default value of sources in the code does not match the doc | Minor | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Cleanup: mapreduce.util.ResourceCalculatorPlugin and related code should be removed | Minor | mrv2 | Karthik Kambatla | Karthik Kambatla | | | TestSSLFactory fails on IBM JVM | Major | security | Amir Sanjar | | | | Fair scheduler configs are refreshed inconsistently in reinitialize | Minor | scheduler | Sandy Ryza | Sandy Ryza | | | CapacityScheduler does not activate applications when maximum-am-resource-percent configuration is refreshed | Major | capacityscheduler | Hitesh Shah | Zhijie Shen | | | additional logging to help diagnose slow QJM logSync | Minor | ha, qjm | Todd Lipcon | Todd Lipcon | | | default for checkpoint txn interval is too low | Major | namenode | Todd Lipcon | Todd Lipcon | | | Capacity scheduler doesn't trigger app-activation after adding nodes | Major | capacityscheduler | Bikas Saha | Zhijie Shen | | | "Auth failed" log should include exception string | Major | ipc, security | Todd Lipcon | Todd Lipcon | | | LdapGroupsMapping threw CommunicationException after some idle time | Major | security | Kai Zheng | Kai Zheng | | | Nodemanager fails to start if log aggregation enabled and namenode unavailable | Major | nodemanager | Jason Lowe | Sandy Ryza | | | Unnecessary DNS resolution attempts for logical URIs | Critical | fs/s3, ha, performance, viewfs | Todd Lipcon | Todd Lipcon | | | CS user left in list of active users for the queue even when application finished | Blocker | capacityscheduler | Thomas Graves | Thomas Graves | | | AM hangs in RecoveryService when recovering tasks with speculative attempts | Critical | mr-am | Robert Parker | Robert Parker | | | Node Manager not getting the master key | Blocker | . | Robert Joseph Evans | Robert Joseph Evans | | | DNA\_FINALIZE is logged as being an unknown command by the DN when received from the standby NN | Minor | datanode | Aaron T. Myers | Aaron T. Myers | | | Standby NN will log that it has received a block report "after becoming active" | Trivial | ha, namenode | Aaron T. Myers | Aaron

Myers | | | If the heartbeat message loss, the nodestatus info of complete container will loss too. | Minor | nodemanager | xieguiming | Xuan Gong | | | YARN daemon addresses must be placed in many different configs | Major | nodemanager, resourcemanager | Sandy Ryza | Sandy Ryza | | | Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled | Major | net | Junping Du | Junping Du | | | TestConfiguration fails with IBM JAVA | Major | test | Amir Sanjar | | | | Make TestNNWithQJM#testNewNamenodeTakesOverWriter work on Windows | Minor | test | Arpit Agarwal | Ivan Mitic | | | RMAdminProtocolPBClientImpl should implement Closeable | Major | . | Siddharth Seth | Siddharth Seth | | | Scheduler.normalizeRequest does not account for allocation requests that exceed maximumAllocation limits | Major | resourcemanager | Hitesh Shah | Zhijie Shen | | | NM retry behavior for connection to RM should be similar for lost heartbeats | Major | . | Hitesh Shah | Jian He | | | TestUnmanagedAMLauncher fails on Windows | Major | applications | Chris Nauroth | Chris Nauroth | | | TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory | Minor | test | Suresh Srinivas | Suresh Srinivas | | | TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI | Major | test | Chris Nauroth | Chris Nauroth | | | TestBlockPoolManager fails using IBM java | Major | test | Tian Hong Wang | Tian Hong Wang | | | Fix LocalDistributedCacheManager after YARN-112 | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | | | Fix flakiness in TestQuorumJournalManager | Trivial | qjm, test | Todd Lipcon | Todd Lipcon | | | TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in NativeIOException | Major | test | Chris Nauroth | Chris Nauroth | | | TestDiskFailures fails on Windows due to path mishandling | Major | nodemanager | Chris Nauroth | Chris Nauroth | | | Change NM behavior of reboot to resync | Major | . | Jian He | Jian He | | | Streaming input/output types are ignored with java mapper/reducer | Major | . | Sandy Ryza | Sandy Ryza | | | Fix findbugs warnings in gridmix | Major | contrib/gridmix | Karthik Kambatla | Karthik Kambatla | | | AM web UI: clicking on Map Task results in 500 error | Major | applicationmaster | Thomas Graves | Thomas Graves | | | TestJobImpl-\>testJobNoTasks fails with IBM JAVA | Major | . | Amir Sanjar | Amir Sanjar | | | WordMean, WordMedian, WordStandardDeviation missing from ExamplesDriver | Minor | . | Plamen Jeliazkov | Plamen Jeliazkov | | | Update MR App after YARN-486 | Major | . | Vinod Kumar Vavilapalli | Xuan Gong | | | TestDFSIO supports compression but usages doesn't reflect | Trivial |

| Plamen Jeliazkov | Plamen Jeliazkov | | | Streaming tests have multiple failures on Windows | Major | contrib/streaming, test | Chris Nauroth | Chris Nauroth | | | FifoScheduler incorrectly checking for node locality | Minor | scheduler | Roger Hoover | Roger Hoover | | | HADOOP\CLIENT\OPTS default setting fixes max heap size at 128m, disregards HADOOP\_HEAPSIZE | Major | conf | Sarah Weissman | Plamen Jeliazkov | | | startFileInternal() should not increment generation stamp | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov | | | Update MR App after YARN-444 | Major | . | Vinod Kumar Vavilapalli | Sandy Ryza | | | Some test cases in TestCheckpoint do not clean up after themselves | Minor | test | Arpit Agarwal | Arpit Agarwal | | | DistCp should skip checksum comparisons if block-sizes are different on source/target. | Major | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | | | ResourceManager webapp is using next port if configured port is already in use | Major | resourcemanager | Nishan Shetty | Kenji Kikushima | | | TestEditLog leaks open file handles between tests | Major | test | Ivan Mitic | Ivan Mitic | | | MR part of YARN-514 | Major | . | Zhijie Shen | Zhijie Shen | | | ProcfsBasedProcessTree info message confuses users | Minor | . | Jason Lowe | Sandy Ryza | | | TestFairScheduler#testNotAllowSubmitApplication is broken due to YARN-514 | Major | . | Zhijie Shen | Zhijie Shen | | | FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1 | Major | mrv2 | Robert Kanter | Robert Kanter | | | MR App is not using Container from RM | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | mapreduce.job#getTaskCompletionEvents incompatible with Hadoop 1 | Major | mrv2 | Robert Kanter | Robert Kanter | | | Update MR App after YARN-441 | Major | . | Vinod Kumar Vavilapalli | Xuan Gong | | | NodeManager job control logic flaws on Windows | Major | nodemanager | Chris Nauroth | Chris Nauroth | | | Promote Windows and Shell related utils from YARN to Hadoop Common | Major | . | Vinod Kumar Vavilapalli | Chris Nauroth | | | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth | | | FileUtil#createJarWithClassPath only substitutes environment variables from current process environment/does not support overriding when launching new process | Major | fs | Chris Nauroth | Chris Nauroth | | | container launch on Windows does not correctly populate classpath with new process's environment variables and localized resources | Major | nodemanager | Chris Nauroth | Chris Nauroth | | | TestMRJobs#testDistributedCache fails on Windows due to classpath problems and unexpected behavior of symlinks | Major | distributed-cache, nodemanager | Chris Nauroth | Chris Nauroth | | | Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly | Major | mrv2 | Robert Parker | Robert Parker | | | mapreduce/yarn source jars not included in dist tarball | Major | . | Thomas Graves | Robert Parker | | | Typo in ApplicationSubmissionContext#setApplicationId | Trivial | . | Zhijie Shen | Zhijie Shen | | | Change the default global AM max-attempts value to be not one | Major | . | Vinod Kumar Vavilapalli | Zhijie Shen | | | JobTracker should set a timeout when calling into job.end.notification.url | Major | . | Ivan Mitic | Ivan Mitic | | | Port winutils static code analysis change to trunk | Major | . | Chuan Liu | Chuan Liu | | | Update test and add comments in YARN-534 | Major |

| Jian He | Jian He | | | typo in FileUtil copy() method | Trivial | fs | Glen Mazza | | | | application classloader may be used too early to load classes | Minor | task | Sangjin Lee | Sangjin Lee | | | fix HDFS file handle leaks | Major | namenode, test, tools | Chris Nauroth | Chris Nauroth | | | TestDFSUpgradeFromImage fails on Windows due to failure to unpack old image tarball that contains hard links | Minor | test | Chris Nauroth | Chris Nauroth | | | Update MR App to not set envs that will be set by NMs anyways after YARN-561 | Major | . | Vinod Kumar Vavilapalli | Xuan Gong | | | JVM path embedded in fuse binaries | Major | . | Sean Mackrory | Sean Mackrory | | | Bad merge of HADOOP-9450 on branch-2 breaks all bin/hadoop calls that need HADOOP\_CLASSPATH | Critical | bin | Gopal V | Harsh J | | | Failing unit test in TestNMWebServices when using git for source control | Major | . | Hitesh Shah | Hitesh Shah | | | NN can miscalculate the number of extra edit log segments to retain | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | ConcurrentModificationException in LocalJobRunner | Blocker | . | Gunther Hagleitner | Sandy Ryza | | | RMCommunicator should not use AMToken from the env | Major | applicationmaster | Siddharth Seth | Vinod Kumar Vavilapalli | | | TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure | Major | test | Chris Nauroth | Chris Nauroth | | | Fix use of BuilderUtils#newApplicationReport as a result of YARN-577. | Major | . | Hitesh Shah | Hitesh Shah | | | Fair scheduler allows reservations that won't fit on node | Major | . | Sandy Ryza | Sandy Ryza | | | yarn proxyserver fails to find webapps/proxy directory on startup | Major | . | Jason Lowe | Kenji Kikushima | | | Update MR App after YARN-562 | Major | . | Vinod Kumar Vavilapalli | Jian He | | | File handle leak in datanode when a block pool is removed | Major | datanode | Chris Nauroth | Chris Nauroth | | | TestStorageRestore#testStorageRestoreFailure fails on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures | Major | qjm, test | Chris Nauroth | Chris Nauroth | | | TestNNStorageRetentionManager fails on Windows | Major | test | Chris Nauroth | Chris Nauroth | | | Fixes for a few test failures on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | TestGetConf#testFederation times out on Windows | Major | test | Ivan Mitic | Ivan Mitic | | | TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe | Major | test | Chris Nauroth | Chris Nauroth | | | LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename | Major | fs | Ivan Mitic | Ivan Mitic | | | Address HDFS test failures on Windows because of invalid dfs.namenode.name.dir | Minor | . | Ivan Mitic | Ivan Mitic | | | RM should not allow registrations from NMs that do not satisfy minimum scheduler allocations | Major | . | Hitesh Shah | Kenji Kikushima | | | Change TestHSWebServices to do string equal check on hadoop build version similar to YARN-605 | Major | . | Hitesh Shah | Hitesh Shah | | | Fix ShellCommandFencer to work on Windows | Major | ha | Arpit Agarwal | Arpit Agarwal | | | HDFS Tests that use ShellCommandFencer are broken on Windows | Major | . | Arpit Agarwal | Arpit Agarwal | | | Make HttpFS username pattern configurable | Major |

| Alejandro Abdelnur | Alejandro Abdelnur | | | Some tests cannot load native library | Major | build, native | Arpit Agarwal | Chris Nauroth | | | TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7 | Minor | test | Andrew Wang | Andrew Wang | | | Introduce common utils for File#setReadable/Writable/Executable and File#canRead/Write/Execute that work cross-platform | Major | . | Ivan Mitic | Ivan Mitic | | | Move to common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute | Major | . | Ivan Mitic | Ivan Mitic | | | Move to common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute | Major | . | Ivan Mitic | Ivan Mitic | | | Move to using common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute | Major | . | Ivan Mitic | Ivan Mitic | | | Refactoring submitApplication in ClientRMService and RMAppManager | Major | . | Zhijie Shen | Zhijie Shen | | | Invoke getPipeline in the chooseTarget implementation that has favoredNodes | Major | namenode | Devaraj Das | Devaraj Das | | | Change default max-attempts to be more than one for MR jobs as well | Major | . | Zhijie Shen | Zhijie Shen | | | HADOOP\CLIENT\OPTS appended twice causes JVM failures | Minor | bin | Sangjin Lee | Chris Nauroth | | | HADOOP\CLIENT\OPTS is appended twice by Windows cmd scripts | Minor | bin | Chris Nauroth | Chris Nauroth | | | Modify RM\INVALID\IDENTIFIER to a -ve number | Major | . | Jian He | Jian He | | | A few MR tests use block sizes which are smaller than the default minimum block size | Major | test | Aaron T. Myers | Andrew Wang | | | disallow in winutils creating symlinks with forwards slashes | Major | util | Chris Nauroth | Chris Nauroth | | | Apps fail in secure cluster setup | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Move RMDelegationTokenSecretManager from yarn-server-common to yarn-server-resourcemanager | Major | . | Jian He | Jian He | | | Handle YarnRemoteException separately from IOException in MR api | Major | . | Xuan Gong | Xuan Gong | | | [Preemption] Scheduler feedback to AM to release containers | Major | resourcemanager | Chris Douglas | Carlo Curino | | | Some issues in Fair Scheduler's document | Major | documentation | Dapeng Sun | Dapeng Sun | | | ShuffleScheduler log message incorrect | Minor | mrv2 | Radim Kolar | Tsuyoshi Ozawa | | | Handle exception related changes in YARN's ClientRMProtocol api after YARN-631 | Major | . | Xuan Gong | Xuan Gong | | | Handle exception related changes in YARN's AMRMProtocol api after YARN-630 | Major | . | Xuan Gong | Xuan Gong | | | Remove aspectj dependency | Major |

| Karthik Kambatla | Karthik Kambatla | | | Add interface visibility and stability annotations to FS interfaces/classes | Minor | scheduler | Karthik Kambatla | Karthik Kambatla | | | FS: maxAssign is not honored | Major | scheduler | Karthik Kambatla | Karthik Kambatla | | | Fair scheduler metrics should subtract allocated memory from available memory | Major | scheduler | Sandy Ryza | Sandy Ryza | | | several HDFS HA tests have timeouts that are too short | Major | test | Chris Nauroth | Chris Nauroth | | | disable HA tests on Windows that fail due to ZooKeeper client connection management bug | Major | ha, test | Chris Nauroth | Chris Nauroth | | | TestAuthenticationToken fails on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | WebHdfsFileSystem hangs on close() | Blocker | security | Kihwal Lee | Daryn Sharp | | | Corrupt replica can be prematurely removed from corruptReplicas map | Blocker | namenode | Todd Lipcon | Todd Lipcon | | | TestLeaseRenewer#testThreadName flakes | Minor | test | Andrew Wang | Andrew Wang | | | Broken conditional logic with HADOOP\SNAPPY\LIBRARY | Minor | . | Vadim Bondarev | Vadim Bondarev | | | No default value in the code for hadoop.rpc.socket.factory.class.default | Minor | net | Colin P. McCabe | Colin P. McCabe | | | Update MR App to reflect YarnRemoteException changes after YARN-634 | Major | . | Vinod Kumar Vavilapalli | Siddharth Seth | | | SpillRecord and ShuffleHandler should use SecureIOUtils for reading index file and map output | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | TransferFsImage.downloadEditsToStorage should use a tmp file for destination | Critical | . | Todd Lipcon | Andrew Wang | | | Permission check of symlink deletion incorrectly throws UnresolvedLinkException | Major | namenode | Andrew Wang | Andrew Wang | | | TestFSDownload fails on Windows because of dependencies on tar/gzip/jar tools | Major | . | Ivan Mitic | Ivan Mitic | | | ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb | Critical | ha | Vinayakumar B | Vinayakumar B | | | Unnecessary transition to standby in ActiveStandbyElector | Critical | ha | Tom White | Tom White | | | BlocksMap may throw NullPointerException during shutdown | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao | | | Add socket timeouts to webhdfs | Major | webhdfs | Daryn Sharp | Chris Nauroth | | | Fix incompatibility introduced by HADOOP-9523 | Major | util | Kihwal Lee | Tian Hong Wang | | | TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk | Minor | test | Chris Nauroth | Chris Nauroth | | | Secondary namenode may retain old tokens | Critical | security | Kihwal Lee | Daryn Sharp | | | RM exits on token cancel/renew problems | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | | | Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml | Minor | . | Aaron T. Myers | Aaron T. Myers | | | Performing direct read using libhdfs sometimes raises SIGPIPE (which in turn throws SIGABRT) causing client crashes | Major | native | Lenni Kuff | Colin P. McCabe | | | FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner | Major | hdfs-client | Henry Robinson | Colin P. McCabe | | | Historyserver 500 error due to NPE when accessing specific counters page for failed job | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar | | | TestContainerLauncherImpl fails | Major | mr-am, mrv2 | Jason Lowe | Omkar Vinit Joshi | | | Webhdfs client is fragile to token renewal errors | Critical | webhdfs | Daryn Sharp | Daryn Sharp | | | TestQueue#testQueue fails with timeout on Windows | Major |

| Ivan Mitic | Ivan Mitic | | | inside of FileOutputCommitter the initialized Credentials cache appears to be empty | Blocker | mrv2 | Roman Shaposhnik | Vinod Kumar Vavilapalli | | | Issue handling checksum errors in write pipeline | Critical | datanode, hdfs-client | Todd Lipcon | Kihwal Lee | | | Race Condition in TestFSDownload | Major | . | Zhijie Shen | Zhijie Shen | | | StorageRetentionManager spews warnings when used with QJM | Major | namenode | Todd Lipcon | Aaron T. Myers | | | TestDistributedShell and TestUnmanagedAMLauncher are failing | Major | . | Siddharth Seth | Vinod Kumar Vavilapalli | | | DFSOutputStream.createSocketForPipeline() should not include timeout extension on connect | Major | . | Kihwal Lee | Cristina L. Abad | | | Log short messages in Namenode RPC server for exceptions meant for clients | Major | namenode | Kihwal Lee | Kihwal Lee | | | stack trace printed at ERROR for all yarn clients without hadoop.home set | Major | util | Steve Loughran | Steve Loughran | | | commons-daemon 1.0.3 dependency has bad group id causing build issues | Major | build | Sangjin Lee | Sangjin Lee | | | Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side | Major | . | Jian He | Jian He | | | webhdfs / httpfs tests broken because of min block size change | Major | webhdfs | Andrew Wang | Andrew Wang | | | Use the correct relogin method for services | Minor | namenode | Kihwal Lee | Robert Parker | | | Slight update to the implementation of API for handling favored nodes in DFSClient | Major | . | Devaraj Das | Devaraj Das | | | Log aggregation root directory check is more expensive than it needs to be | Minor | nodemanager | Jason Lowe | Maysam Yabandeh | | | Remove sub resource warning from httpfs log at startup time | Major | . | Wei Yan | Wei Yan | | | Clean up snapshot CLI commands output stacktrace for invalid arguments | Minor | snapshots | Stephen Chu | Jing Zhao | | | Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage | Major | snapshots | Jing Zhao | Jing Zhao | | | The root directory should be added to the snapshottable directory list while loading fsimage | Major | snapshots | Jing Zhao | Jing Zhao | | | Add new methods in AbstractDelegationTokenSecretManager for restoring RMDelegationTokens on RMRestart | Major | . | Jian He | Jian He | | | Fixes in Javadoc build | Minor | documentation | Timothy St. Clair | | | | Update MR App to use immutable ApplicationID after YARN-716 | Major | . | Vinod Kumar Vavilapalli | Siddharth Seth | | | Document Interface Classification from HADOOP-5073 | Major | . | Sanjay Radia | Sanjay Radia | | | Update MR App to use immutable ApplicationAttemptID, ContainerID, NodeID after YARN-735 | Major | . | Jian He | | | | Update MR App to use Token directly after YARN-717 | Major | . | Vinod Kumar Vavilapalli | Jian He | | | TestNMClient fails occasionally | Major | . | Zhijie Shen | Zhijie Shen | | | Change MR App to use update property names in container-log4j.properties | Major |

| Siddharth Seth | Zhijie Shen | | | In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup | Major | namenode | Junping Du | Junping Du | | | TestBalancerWithNodeGroup times out | Major | balancer & mover | Tsz Wo Nicholas Sze | Junping Du | | | Queue, FinishTime fields broken on RM UI | Critical | . | Siddharth Seth | Mayank Bansal | | | Update MR App since BuilderUtils is moved to yarn-server-common after YARN-748 | Major | . | Jian He | Jian He | | | TestRMRestart failing/stuck on trunk | Blocker | . | Bikas Saha | Bikas Saha | | | Update MR code to work with YARN-635 changes | Major | . | Siddharth Seth | Siddharth Seth | | | ReplicationMonitor gets NPE during shutdown | Major | namenode | Kihwal Lee | Kihwal Lee | | | Changes on MR after moving ProtoBase to package impl.pb on YARN-724 | Major | . | Jian He | Jian He | | | TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed | Major | datanode, test | Tian Hong Wang | Tian Hong Wang | | | Log aggregation causes a lot of redundant setPermission calls | Major | nodemanager | Kihwal Lee | Jason Lowe | | | fix OfflineImageViewer to work on fsimages with empty files or snapshots | Major | tools | Stephen Chu | Jing Zhao | | | AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs | Major | fs | Chris Nauroth | Chris Nauroth | | | TestLocalFileSystem#testListStatusWithColons cannot run on Windows | Major | test | Chris Nauroth | Chris Nauroth | | | TestSocketIOWithTimeout fails on Windows | Major | net | Chris Nauroth | Chris Nauroth | | | ViewFs:Non absolute mount name failures when running multiple tests on Windows | Major | viewfs | Chris Nauroth | Chris Nauroth | | | blank Used Resources on Capacity Scheduler page | Major | resourcemanager | Nemon Lou | Nemon Lou | | | Snapshot: fix the scenario where a directory is renamed under its prior descendant | Blocker | snapshots | Jing Zhao | Jing Zhao | | | metaSave NPEs when there are invalid blocks in repl queue. | Major | namenode | Kihwal Lee | Plamen Jeliazkov | | | TestNMClientAsync fails sometimes | Major | . | Vinod Kumar Vavilapalli | Zhijie Shen | | | SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually | Major | . | Ravi Prakash | Ravi Prakash | | | NodeManager throws AvroRuntimeException on failed start | Major | nodemanager | Sandy Ryza | Niranjan Singh | | | Diagnostic logging while loading name/edits files | Major | namenode | Arpit Agarwal | Suresh Srinivas | | | Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave | Critical | . | Ravi Prakash | Ravi Prakash | | | TestRMNMInfo is failing | Major | . | Alejandro Abdelnur | Sandy Ryza | | | hadoop-config.cmd doesn't set JAVA\LIBRARY\PATH correctly | Major | . | Mostafa Elhemali | Mostafa Elhemali | | | Editlog should support synchronous writes | Major | . | Ivan Mitic | Ivan Mitic | | | hadoop --config non-existent directory should result in error | Major | scripts | Ashwin Shankar | Ashwin Shankar | | | Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs | Major | . | Nathan Roberts | Nathan Roberts | | | DistCp reports success even on

| Critical | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | | | callGetBlockLocations returns incorrect number of blocks for snapshotted files | Major | snapshots | Hari Mankude | Jing Zhao | | | Initialize Application status metrics when QueueMetrics is initialized | Major | . | Jian He | Jian He | | | Fair scheduler queue metrics should subtract allocated vCores from available vCores | Major | scheduler | Wei Yan | Wei Yan | | | TestShellCommandFencer and TestShell fail on Windows | Major | test | Arpit Agarwal | Arpit Agarwal | | | parallel test changes caused invalid test path for several HDFS tests on Windows | Major | test | Chris Nauroth | Andrey Klochkov | | | TestTaskLog fails on Windows because of path separators missmatch | Major | test | Ivan Mitic | Ivan Mitic | | | FS: Add documentation for pluggable policy | Major | scheduler | Karthik Kambatla | Karthik Kambatla | | | TestInfoBlock fails on Windows because of line ending missmatch | Major | . | Ivan Mitic | Ivan Mitic | | | On Remove Block, Block is not Removed from neededReplications queue | Major | namenode | Tao Luo | Tao Luo | | | DFSClient.getSnapshotDiffReport should use string path rather than o.a.h.fs.Path | Major | snapshots | Binglin Chang | Binglin Chang | | | -list-attempt-ids is not working | Minor | client | B Anil Kumar | Ashwin Shankar | | | FSEditLogLoader gets NPE while accessing INodeMap in TestEditLogRace | Critical | namenode | Kihwal Lee | Arpit Agarwal | | | Enabling app summary logs causes 'FileNotFound' errors | Major | . | Ramya Sunil | Siddharth Seth | | | Job.xml file does not has 'user.name' property for Hadoop2 | Major | . | Yesha Vora | Xuan Gong | | | TestDelegationTokensWithHA#testHAUtilClonesDelegationTokens fails on Windows | Major | test | Chris Nauroth | Chris Nauroth | | | MRAM should not normalize allocation request capabilities | Major | applicationmaster | Alejandro Abdelnur | Alejandro Abdelnur | | | duplicative dfs\_hosts entries handled wrong | Minor | . | Andy Isaacson | Colin P. McCabe | | | Make AM of Distributed Shell Use NMClient | Major | applications/distributed-shell | Zhijie Shen | Zhijie Shen | | | TestShellCommandFencer will fail if there is a 'host' machine in the network | Minor | . | Chuan Liu | Chuan Liu | | | Move Graph and VisualizeStateMachine into yarn.state package | Major | . | Zhijie Shen | Zhijie Shen | | | Document Hadoop Compatibility | Blocker | documentation | Arun C Murthy | Karthik Kambatla | | | TestPermission failed in branch-2 | Major | . | Chuan Liu | Chuan Liu | | | TestContainerLaunch.testContainerEnvVariables fails on Windows | Minor | . | Chuan Liu | Chuan Liu | | | several HDFS tests that attempt to make directories unusable do not work correctly on Windows | Minor | namenode, test | Chris Nauroth | Chris Nauroth | | | CgroupsLCEResourcesHandler tries to write to cgroup.procs | Major | nodemanager | Chris Riccomini | Chris Riccomini | | | HDFS Output streams should not accept writes after being closed | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers | | | Adding Native Fstat for Windows as needed by YARN | Major | . | Chuan Liu | Chuan Liu | | | Nodemanager does not register with RM using the fully qualified hostname | Major | . | Hitesh Shah | Hitesh Shah | | |

ignored additional parameters besides -upgrade | Major | datanode, namenode | Fengdong Yu | Fengdong Yu | | | Start-dfs.sh cannot pass the parameters correctly | Major | datanode, namenode | Fengdong Yu | Fengdong Yu | | | TestAggregatedLogFormat.testContainerLogsFileAccess fails on Windows | Minor | . | Chuan Liu | Chuan Liu | | | TestContainerLauncherImpl is failing | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | App submission fails on secure deploy | Blocker | . | Ramya Sunil | Omkar Vinit Joshi | | | TestContainerManager is failing | Critical | nodemanager | Devaraj K | Vinod Kumar Vavilapalli | | | complete() should verify fileId | Major | namenode | Konstantin Shvachko | Tao Luo | | | fsck fails with symlinks | Major | hdfs-client | Andy Isaacson | Jason Lowe | | | JniBasedUnixGroupsMapping: fix some crash bugs | Minor | native | Colin P. McCabe | Colin P. McCabe | | | CreateEditsLog creates inodes with an invalid inode ID, which then cannot be loaded by a namenode. | Minor | test | Chris Nauroth | Chris Nauroth | | | Gridmix unit tests fail on Windows and Linux | Minor | test, tools | Chuan Liu | Chuan Liu | | | Tracking YARN/MR test failures after HADOOP-9421 and YARN-827 | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Add version to shuffle header | Blocker | . | Arun C Murthy | Zhijie Shen | | | BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF | Critical | . | Zhijie Shen | Zhijie Shen | | | ClientToken should not be set in the environment | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. | Major | webhdfs | Chris Nauroth | Chris Nauroth | | | TestClusterMapReduceTestCase and TestJobName fail on Windows in branch-2 | Minor | . | Chuan Liu | Chuan Liu | | | BlockScanInfo does not override equals(..) and hashCode() consistently | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Refactor and fix FSNamesystem.getTurnOffTip to sanity | Major | . | Ravi Prakash | Ravi Prakash | | | TestRPC#testStopsAllThreads intermittently fails on Windows | Major | . | Ivan Mitic | Ivan Mitic | | | WebHdfsFileSystem does not work when original file path has encoded chars | Minor | webhdfs | Jerry He | Jerry He | | | FileUtil.unTarUsingJava() should close the InputStream upon finishing | Minor | . | Chuan Liu | Chuan Liu | | | Make NetworkTopology support user specified topology class | Major | datanode | Junping Du | Junping Du | | | MiniMRYarnCluster with localFs does not work on Windows | Minor | . | Chuan Liu | Chuan Liu | | | mvn site for hadoop-hdfs-nfs fails | Major | . | Robert Joseph Evans | Brandon Li | | | JobHistory should not use File.separator to match timestamp in path | Minor | . | Chuan Liu | Chuan Liu | | | Job staging directory owner checking could fail on Windows | Minor |

| Chuan Liu | Chuan Liu | | | compile failure in branch-2: getFlushedOffset should catch or rethrow IOException | Major | nfs | Brandon Li | Brandon Li | | | TestMRJobClient fails on Windows due to path format | Minor | test | Chuan Liu | Chuan Liu | | | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie | | | TestMRAsyncDiskService fails on Windows | Minor | test | Chuan Liu | Chuan Liu | | | BufferedFSInputStream.read returns wrong results after certain seeks | Major | fs | Todd Lipcon | Todd Lipcon | | | Create mapreduce command scripts on Windows | Major | mrv2 | Chuan Liu | Chuan Liu | | | FsShell commands using secure webhfds fail ClientFinalizer shutdown hook | Major | security, webhdfs | Stephen Chu | Robert Kanter | | | NodeHealthScriptRunner timeout checking is inaccurate on Windows | Minor | nodemanager | Chuan Liu | Chuan Liu | | | HarFileSystem.decodeHarURI fails for URIs whose host contains numbers | Minor | fs | Ivan Mitic | Ivan Mitic | | | FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer | Major | security | Robert Kanter | Robert Kanter | | | ClientRMProtocol.getAllApplications should accept ApplicationType as a parameterMR changes | Major | . | Xuan Gong | Xuan Gong | | | TestNNThroughputBenchmark exits abruptly | Blocker | benchmarks, test | Kihwal Lee | Kihwal Lee | | | Fix typo "defiend" should be "defined" in error output | Trivial | . | Albert Chu | Albert Chu | | | Fix child task environment variable config and add support for Windows | Minor | mrv2 | Chuan Liu | Chuan Liu | | | WebhdfsFileSystem expects non-standard WEBHDFS Json element | Blocker | test, webhdfs | Robert Kanter | Robert Kanter | | | Incorrect logging.properties file for hadoop-httpfs | Major | build | Mark Grover | Mark Grover | | | Schedulers cannot control the queue-name of an application | Major | . | Sandy Ryza | Sandy Ryza | | | JournalNode should relogin from keytab before fetching logs from other JNs | Major | journal-node, security | Todd Lipcon | Todd Lipcon | | | getAllocatedContainers() is not returning all the allocated containers | Blocker | resourcemanager | Krishna Kishore Bonagiri | Bikas Saha | | | AMRMClientAsync should stop heartbeating after receiving shutdown from RM | Major | . | Bikas Saha | Xuan Gong | | | AMRMClient: Perform sanity checks for parameters of public methods | Major | . | Bikas Saha | Xuan Gong | | | Disable TestLinuxContainerExecutorWithMocks on Windows | Minor | nodemanager | Chuan Liu | Chuan Liu | | | Fix register lists for crc32c inline assembly | Minor | util | Todd Lipcon | Todd Lipcon | | | fix TestShortCircuitLocalRead on branch-2 | Major | . | Kihwal Lee | Colin P. McCabe | | | NM fails to cleanup local directories for users | Major | nodemanager | Jason Lowe | Omkar Vinit Joshi | | | TestUnderReplicatedBlocks fails intermittently | Major | test | Kihwal Lee | Kihwal Lee | | | TestDistCh fails | Major | tools | Kihwal Lee | Jing Zhao | | | Create exceptions package in common/api for yarn and move client facing exceptions to them | Major | . | Bikas Saha | Mayank Bansal | | | Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol | Major | . | Jing Zhao | Jing Zhao | | | TestNNThroughputBenchmark failed caused by existing directories | Minor | test | Xi Fang | Xi Fang | | | org.apache.hadoop.security.SecurityUtil calls toUpperCase(Locale.getDefault()) as well as toLowerCase(Locale.getDefault()) on hadoop.security.authentication

| Minor | security | Mark Miller | Mark Miller | | | Document setting default heap sizes in yarn env | Minor | . | Mayank Bansal | Mayank Bansal | | | CapacityScheduler wrongly sorted queues | Blocker | capacityscheduler | Djellel Eddine Difallah | Djellel Eddine Difallah | | | Misspelled DFSConfigKeys#DFS\NAMENODE\STALE\DATANODE\INTERVAL\_DEFAULT in javadoc of DatanodeInfo#isStale() | Minor | . | Ted Yu | Ted Yu | | | maximum-am-resource-percent doesn't work after refreshQueues command | Major | capacityscheduler | Devaraj K | Devaraj K | | | Add support for NativeCodeLoader#getLibraryName on Windows | Critical | . | Chuan Liu | Chuan Liu | | | Change MR to use multiple containers API of ContainerManager after YARN-926 | Major | . | Jian He | Jian He | | | RM admin commands don't work | Blocker | . | Kihwal Lee | Vinod Kumar Vavilapalli | | | Application can hang if AMRMClientAsync callback thread has exception | Major | . | Bikas Saha | Xuan Gong | | | Re-assess TokenCache methods marked @Private | Minor | . | Karthik Kambatla | Karthik Kambatla | | | mvn site ambiguous links in hadoop-common | Minor | documentation | Steve Loughran | Karthik Kambatla | | | Make DatanodeProtocol#commitBlockSynchronization idempotent | Major | namenode | Arpit Agarwal | Arpit Agarwal | | | Containers not cleaned up when NM received SHUTDOWN event from NodeStatusUpdater | Major | . | Jian He | Jian He | | | TestLightWeightCache fails | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Deadlock in pipeline recovery causes Datanode to be marked dead | Blocker | . | Devaraj Das | Suresh Srinivas | | | TestNonExistentJob is failed due to recent changes in YARN | Blocker | test | Junping Du | Junping Du | | | LocalFileSystem rename() is broken in some cases when destination exists | Minor | fs | Mostafa Elhemali | Chris Nauroth | | | TestSlive is getting FileNotFound Exception | Major | mrv2 | Robert Parker | Robert Parker | | | TestMRCredentials and TestBinaryTokenFile are failing on trunk | Blocker | . | Alejandro Abdelnur | Daryn Sharp | | | Fix unmanaged AM in non-secure/secure setup post YARN-701 | Blocker | applications/unmanaged-AM-launcher | Arun C Murthy | Alejandro Abdelnur | | | Job overview shows average merge time larger than for any reduce attempt | Major | jobhistoryserver, webapps | Jason Lowe | Omkar Vinit Joshi | | | TestResourceLocalizationService.testLocalizationInit can fail on JDK7 | Major | . | Sandy Ryza | Karthik Kambatla | | | AM register failing after AMRMToken | Blocker | . | Bikas Saha | Vinod Kumar Vavilapalli | | | RetryInvocationHandler#isRpcInvocation should support ProtocolTranslator | Major | . | Jing Zhao | Jing Zhao | | | ShutdownHelper util to shutdown threads and threadpools | Major | util | Karthik Kambatla | Karthik Kambatla | | | RPC Sasl QOP is broken | Blocker | ipc, security | Daryn Sharp | Daryn Sharp | | | Unnecessary Configuration instantiation in IFileInputStream slows down merge | Blocker | mrv1, mrv2 | Stanislav Barton | Stanislav Barton | | | RPC kerberos errors don't trigger relogin | Blocker | ipc | Daryn Sharp | Daryn Sharp | | | YARN Queue metrics are getting pushed to neither file nor Ganglia | Major | . | Yusaku Sako | Jian He | | | In scheduler UI, including reserved memory in "Memory Total" can make it exceed cluster

| Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | Disable mem monitoring by default in MiniYARNCluster | Major | . | Karthik Kambatla | Karthik Kambatla | | | Add symlink support to LocalFileSystem on Windows | Major | fs, test | Arpit Agarwal | Arpit Agarwal | | | Improve protoc version handling and detection | Blocker | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Use InodeID as as an identifier of a file in HDFS protocols and APIs | Major | namenode | Brandon Li | Brandon Li | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add utility methods to dump NameNode in memory tree for testing | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Coverage fixing for org.apache.hadoop.mapreduce.jobhistory | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | | coverage fixing for org.apache.hadoop.mapred | Major | test | Aleksey Gorshkov | Aleksey Gorshkov | | | coverage for gridmix | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | | fix coverage org.apache.hadoop.mapreduce.v2.hs | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | | Cover package with org.apache.hadoop.io.lz4 unit tests | Major | . | Vadim Bondarev | Vadim Bondarev | | | Cover package org.apache.hadoop.io.compress.zlib with unit tests | Major | . | Vadim Bondarev | Vadim Bondarev | | | Coverage fix for org.apache.hadoop.mapreduce.tools.CLI | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | | Parallel testing hadoop-common | Major | test | Tsuyoshi Ozawa | Andrey Klochkov | | | TestFSMainOperationsLocalFileSystem failed when the Hadoop test root path has "X" in its name | Minor | test | Xi Fang | Xi Fang | | | Add test for class ResourceWeights | Major | . | Wei Yan | Wei Yan | | | Add test that verifies MRAM works correctly when sending requests with non-normalized capabilities | Major | mr-am | Alejandro Abdelnur | Wei Yan | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Cleanup rpc PB protos | Major | ipc | Sanjay Radia | Sanjay Radia | | | Add a unique id to each INode | Major | namenode | Brandon Li | Brandon Li | | | Refactor INodeId and GenerationStamp | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | HDFS-347: DN should chmod socket path a+w | Critical | datanode | Todd Lipcon | Colin

McCabe | | | Update addBlock() to inculde inode id as additional argument | Major | hdfs-client, namenode | Brandon Li | Brandon Li | | | Document the Rpc-wrappers used internally | Major | ipc | Sanjay Radia | Sanjay Radia | | | standby namenode become active fails because starting log segment fail on shared storage | Critical | ha | liaowenrui | | | | WebHdfsFileSystem handling of fileld breaks compatibility | Blocker | webhdfs | Alejandro Abdelnur | Brandon Li | | | Container preemption interpreted as task failure | Major | applicationmaster, mr-am, mrv2 | Sandy Ryza | Sandy Ryza | | | Each NM heartbeat should not generate an event for the Scheduler | Major | resourcemanager, scheduler | Siddharth Seth | Xuan Gong | | | Webhdfs doesn't support secure proxy users | Blocker | webhdfs | Daryn Sharp | Daryn Sharp | | | coverage fix for org.apache.hadoop.yarn.server.webproxy.amfilter | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | | yarn log does not output all needed information, and is in a binary format | Major | . | Robert Joseph Evans | Ravi Prakash | | | Create AMRMClient wrapper that provides asynchronous callbacks | Major | api, applications | Sandy Ryza | Sandy Ryza | | | ApplicationMaster retry times should be set by Client | Major | client, resourcemanager | xieguiming | Zhijie Shen | | | Make scheduling mode in FS pluggable | Major | scheduler | Karthik Kambatla | Karthik Kambatla | | | Define value for \* in the scheduling protocol | Major | . | Bikas Saha | Zhijie Shen | | | Remove ApplicationConstants.AM\APP\ATTEMPT\ID\ENV as it is no longer set in an AM's environment | Major | . | Hitesh Shah | Hitesh Shah | | | Make RM provide heartbeat interval to NM | Major | resourcemanager | Xuan Gong | Xuan Gong | | | Jobs fail during resource localization when public distributed-cache hits unix directory limits | Major | nodemanager | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Provide an API for knowing that whether file is closed or not. | Major | namenode | Uma Maheswara Rao G | SreeHari | | | MR app master deletes staging dir when sent a reboot command from the RM | Major | . | Jian He | Jian He | | | Persist inode id in fsimage and editlog | Major | namenode | Brandon Li | Brandon Li | | | Jobs fail during resource localization when private distributed-cache hits unix directory limits | Major | nodemanager | Devaraj K | Omkar Vinit Joshi | | | Race in localization can cause containers to fail | Major | nodemanager | Jason Lowe | Omkar Vinit Joshi | | | AM max attempts is not checked when RM restart and try to recover attempts | Major | resourcemanager | Jian He | Jian He | | | LocalizedResources are leaked in memory in case resource localization fails | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Change startContainer NM API to accept Container as a parameter and make ContainerLaunchContext user land | Major | . | Bikas Saha | Xuan Gong | | | Move special container exit codes from YarnConfiguration to API | Major | api, applications/distributed-shell | Sandy Ryza | Sandy Ryza | | | Delayed store operations should not result in RM unavailability for app submission | Major | resourcemanager | Bikas Saha | Zhijie Shen | | | FS: Extend SchedulingMode to intermediate queues | Major | scheduler | Karthik Kambatla | Karthik Kambatla | | | Clean up unused collection methods in various APIs | Major | . | Siddharth Seth | Xuan Gong | | | Race condition in Public / Private Localizer may result into resource getting downloaded again | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | YarnClient.submitApplication should wait for application to be accepted by the RM | Major | . | Zhijie Shen | Zhijie Shen | | | Application cache files should be localized under local-dir/usercache/userid/appcache/appid/filecache | Major |

| Omkar Vinit Joshi | Omkar Vinit Joshi | | | Test and verify that app delegation tokens are added to tokenRenewer after RM restart | Major | resourcemanager | Bikas Saha | Jian He | | | ApplicationReport does not provide progress value of application | Major | . | Hitesh Shah | Hitesh Shah | | | Refactor fair scheduler to use common Resources | Major | scheduler | Sandy Ryza | Sandy Ryza | | | RM recovery related records do not belong to the API | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | NM should reject containers allocated by previous RM | Major | resourcemanager | Jian He | Jian He | | | Concat operation does not remove concatenated files from InodeMap | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | NPE in FSDirectory.resolvePath() | Major | namenode | Brandon Li | Brandon Li | | | Move unwrapAndThrowException from YarnRemoteExceptionPBImpl to RPCUtil | Major | . | Siddharth Seth | Siddharth Seth | | | Change ContainerManagerPBClientImpl and RMAdminProtocolPBClientImpl to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong | | | Restore appToken and clientToken for app attempt after RM restart | Major | resourcemanager | Bikas Saha | Jian He | | | Aggregatewordcount and aggregatewordhist in hadoop-1 examples are not binary compatible with hadoop-2 mapred.lib.aggregate | Major | . | Zhijie Shen | Zhijie Shen | | | Sort in hadoop-1 examples is not binary compatible with hadoop-2 mapred.lib | Major | . | Zhijie Shen | Zhijie Shen | | | FairScheduler: support for work-preserving preemption | Major | scheduler | Carlo Curino | Carlo Curino | | | RM changes to support preemption for FairScheduler and CapacityScheduler | Major | resourcemanager | Carlo Curino | Carlo Curino | | | fix various bugs in short circuit read | Major | datanode, hdfs-client | Colin P. McCabe | Colin P. McCabe | | | Make YarnRemoteException not backed by PB and introduce a SerializedException | Major | . | Siddharth Seth | Siddharth Seth | | | Change ResourceTracker API and LocalizationProtocol API to throw YarnRemoteException and IOException | Major | . | Xuan Gong | Xuan Gong | | | Fix JobClient incompatibilities with MR1 | Major | . | Karthik Kambatla | Karthik Kambatla | | | Two functions changed their visibility in JobStatus | Major | . | Zhijie Shen | Zhijie Shen | | | Fix YarnException unwrapping | Major | . | Siddharth Seth | Siddharth Seth | | | In unsercure mode, AM can fake resource requirements | Minor | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | | | masterContainer and status are in ApplicationReportProto but not in ApplicationReport | Major | . | Zhijie Shen | Zhijie Shen | | | mapred.Counters incompatiblity issues with MR1 | Major | . | Zhijie Shen | Mayank Bansal | | | Add application type to ApplicationReport | Major | . | Thomas Weise | Mayank Bansal | | | Add tests for YarnUncaughtExceptionHandler | Major | . | Vadim Bondarev | Vadim Bondarev | | | Copy BuilderUtil methods into individual records | Major | . | Vinod Kumar Vavilapalli | Jian He | | | createFileSplit is removed from NLineInputFormat of mapred | Major | . | Zhijie Shen | Mayank Bansal | | | Add NM client library | Major |

| Bikas Saha | Zhijie Shen | | | Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree | Major | snapshots | Jing Zhao | Jing Zhao | | | NodeManager should use SecureIOUtils for serving and aggregating logs | Major | nodemanager | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | | | AMRM protocol changes for sending NMToken list | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Restore RMDelegationTokens after RM Restart | Major | resourcemanager | Jian He | Jian He | | | Move RMIdentifier from Container to ContainerTokenIdentifier | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Enum Counter is removed from FileInputFormat and FileOutputFormat of both mapred and mapreduce | Major | . | Zhijie Shen | Mayank Bansal | | | Make it possible to specify hard locality constraints in resource requests | Major | resourcemanager | Bikas Saha | Sandy Ryza | | | Constructor of DBInputFormat.DBRecordReader in mapred is changed | Major | . | Zhijie Shen | Zhijie Shen | | | Protected variables are removed from CombineFileRecordReader in both mapred and mapreduce | Major | . | Zhijie Shen | Mayank Bansal | | | Mapreduce API: ClusterMetrics incompatibility issues with MR1 | Major | . | Zhijie Shen | Mayank Bansal | | | Improve AMRMClient with matching requests | Major | . | Bikas Saha | Bikas Saha | | | Copy BuilderUtil methods into token-related records | Major | . | Jian He | Jian He | | | TEMP\DIR\NAME is removed from of FileOutputCommitter of mapreduce | Major | . | Zhijie Shen | Zhijie Shen | | | Mapreduce API: String toHex(byte[]) is removed from SecureShuffleUtils | Major | . | Zhijie Shen | Mayank Bansal | | | Make NetworkTopology class pluggable | Major | . | Junping Du | Junping Du | | | Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup) | Major | . | Junping Du | Junping Du | | | Enhance CS to allow for white-list of resources | Major | . | Arun C Murthy | Arun C Murthy | | | Mapred API: TaskCompletionEvent incompatibility issues with MR1 | Major | client | Sandy Ryza | Zhijie Shen | | | Mapred API: Function signature change in JobControl | Major | . | Zhijie Shen | Zhijie Shen | | | filecache.DistributedCache incompatiblity issues with MR1 | Major | . | Zhijie Shen | Zhijie Shen | | | Mapred API: void setTaskID(TaskAttemptID) is missing in TaskCompletionEvent | Major | . | Zhijie Shen | Zhijie Shen | | | A number of public static variables are removed from JobConf | Major | . | Zhijie Shen | Zhijie Shen | | | The javadoc of FileWithSnapshot is incorrect | Minor | snapshots | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Allow for black-listing resources in YARN API and Impl in CS | Major | . | Arun C Murthy | Arun C Murthy | | | Create Command enum in AllocateResponse | Major | . | Bikas Saha | Bikas Saha | | | Flatten NodeReport | Major | api | Sandy Ryza | Sandy Ryza | | | Some Exceptions no longer need to be wrapped by YarnException and can be directly thrown out after YARN-142 | Major | . | Jian He | Jian He | | | RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions | Major |

| Siddharth Seth | Zhijie Shen | | | Update Snapshot doc for HDFS-4758 | Minor | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Make yarn Resource Manager services robust against shutdown | Minor | . | Steve Loughran | Steve Loughran | | | Make Yarn Node Manager services robust against shutdown | Minor | . | Steve Loughran | Steve Loughran | | | Make Yarn Client service shutdown operations robust | Minor | . | Steve Loughran | Steve Loughran | | | AppTokens file can/should be removed | Blocker | security | Vinod Kumar Vavilapalli | Daryn Sharp | | | Move YarnRuntimeException from package api.yarn to api.yarn.exceptions | Major | . | Jian He | Jian He | | | Creating NMToken master key on RM and sharing it with NM as a part of RM-NM heartbeat. | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Mapreduce API: TokenCache incompatibility issues with MR1 | Major | . | Zhijie Shen | Mayank Bansal | | | Expose LOGDIR that containers should use for logging | Major | . | Devaraj Das | Jian He | | | Sending NMToken to AM on allocate call | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2 | Major | documentation | Arun C Murthy | Zhijie Shen | | | Fix yarn-common javadoc annotations | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Add a test for testing snapshot file length | Minor | snapshots, test | Tsz Wo Nicholas Sze | Arpit Agarwal | | | Fix yarn-api javadoc annotations | Blocker | . | Jian He | Jian He | | | Move pb Impl from yarn-api to yarn-common | Major | . | Jian He | Jian He | | | Rename getClusterAvailableResources to getAvailableResources in AMRMClients | Major | . | Jian He | Jian He | | | NM startContainer should validate the NodeId | Major | . | Siddharth Seth | Omkar Vinit Joshi | | | Create NM proxy per NM instead of per container | Major | . | Bikas Saha | Omkar Vinit Joshi | | | Mark stability of .proto files | Major | documentation | Sanjay Radia | Sanjay Radia | | | Need to make Resource arithmetic methods accessible | Critical | . | Bikas Saha | Jian He | | | Abstract symlink tests to use either FileContext or FileSystem | Major | fs | Andrew Wang | Andrew Wang | | | Allow for black-listing resources in FifoScheduler | Major | scheduler | Junping Du | Junping Du | | | Refactor out FSLinkResolver and relevant helper methods | Major | fs | Andrew Wang | Andrew Wang | | | Provide HDFS based NFSv3 and Mountd implementation | Major | nfs | Brandon Li | Brandon Li | | | Add new symlink resolution methods in FileSystem and FileSystemLinkResolver | Major | fs | Andrew Wang | Andrew Wang | | | RM crash with NPE on NODE\_UPDATE | Major | resourcemanager | Arpit Gupta | Mayank Bansal | | | ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter | Blocker |

| Siddharth Seth | Xuan Gong | | | Handle ( or throw a proper error when receiving) status updates from application masters that have not registered | Major | resourcemanager | Hitesh Shah | Mayank Bansal | | | Resource Manager throws InvalidStateTransitonException: Invalid event: CONTAINER\_FINISHED at ALLOCATED for RMAppAttemptImpl | Major | resourcemanager | Devaraj K | Mayank Bansal | | | Reduce snapshot inode memory usage | Major | namenode, snapshots | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | CapacityScheduler: support for preemption (using a capacity monitor) | Major | capacityscheduler | Carlo Curino | Carlo Curino | | | Track NameNode startup progress | Major | namenode | Chris Nauroth | Chris Nauroth | | | Add HTTP API for querying NameNode startup progress | Major | namenode | Chris Nauroth | Chris Nauroth | | | Display NameNode startup progress in UI | Major | namenode | Chris Nauroth | Chris Nauroth | | | Add symlink resolution support to DistributedFileSystem | Major | fs | Andrew Wang | Andrew Wang | | | Augment AM - RM client module to be able to request containers only at specific locations | Major | api | Sandy Ryza | Sandy Ryza | | | Container localization failures aren't reported from NM to RM | Major | . | Vinod Kumar Vavilapalli | Jian He | | | Create common proxy client for communicating with RM | Major | resourcemanager | Bikas Saha | Jian He | | | NodeManager has invalid state transition after error in resource localization | Major | . | Bikas Saha | Mayank Bansal | | | AM should not be able to abuse container tokens for repetitive container launches | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | | | Change FileSystemRMStateStore to use directories | Major | resourcemanager | Jian He | Jian He | | | Difficult to diagnose a failed container launch when error due to invalid environment variable | Major | . | Hitesh Shah | Jian He | | | Rename Client#uuid to Client#clientId | Major | . | Suresh Srinivas | Arpit Agarwal | | | Analyze and add annotations to Namenode protocol methods and enable retry | Major | ha, namenode | Suresh Srinivas | Suresh Srinivas | | | TestBookKeeperHACheckpoints fails | Major | . | Suresh Srinivas | Uma Maheswara Rao G | | | YARNClient.getApplicationReport(unknownAppId) returns a null report | Major | . | Bikas Saha | Xuan Gong | | | Implement retry cache on the namenode | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | ContainerManagerImpl should enforce token on server. Today it is [TOKEN, SIMPLE] | Blocker | . | Omkar Vinit Joshi | Omkar Vinit Joshi | | | Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA failover | Major | ha, namenode | Jing Zhao | Jing Zhao | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Move RecordFactory classes to hadoop-yarn-api, miscellaneous fixes to the interfaces | Major | . | Siddharth Seth | Siddharth Seth | | | startContainer call should use the ContainerToken instead of Container [YARN-684] | Major | . | Siddharth Seth | Vinod Kumar Vavilapalli | | | [Umbrella] Cleanup YARN APIs w.r.t exceptions | Blocker | . | Siddharth Seth | | | | Separate TCE resolution from fetch | Minor | task |