Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.23.3.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | User set java.library.path seems to overwrite default creating problems native lib loading | Major | mrv2 | Anupam Seth | Anupam Seth | | | Lower default allocation sizes, fix allocation configurations and document them | Major | mrv2, performance | Vinod Kumar Vavilapalli | Harsh J | | | Hftp hangs on transfers \>2GB | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp | | | Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla | | | fs -mkdir creates parent directories without the -p option | Major | fs | Robert Joseph Evans | John George | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | The NameNode should expose name dir statuses via JMX | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | Add queue metrics with buckets for job run times | Major | jobtracker | Owen O'Malley | Owen O'Malley | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | name node should warn if only one dir is listed in dfs.name.dir | Minor | namenode | Allen Wittenauer | Uma Maheswara Rao G | | | Annotate Counters.Counter and Counters.Group as @Public | Major | client | Tom White | Tom White | | | Add method to init krb5 cipher suites | Trivial | security | Todd Lipcon | Todd Lipcon | | | AbstractDelegationTokenIdentifier: add getter methods for owner and realuser | Minor | . | Colin P. McCabe | Colin P. McCabe | | | The history server should have a separate pluggable storage/query interface | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Add jobname to jobsummary log | Trivial | jobhistoryserver, jobtracker | Koji Noguchi | Thomas Graves | | | Tokens should use original hostname provided instead of ip | Major | security | Daryn Sharp | Daryn Sharp | | | Simplify getting a socket address from conf | Major | conf | Daryn Sharp | Daryn Sharp | | | RM scheduler web page should filter apps to those that are relevant to scheduling | Major | mrv2, webapps | Jason Lowe | Jason Lowe | | | Port token service changes from 205 | Major | . | Daryn Sharp | Daryn Sharp | | | Improve web UI for task attempts userlog link | Major | mrv2, webapps | Thomas Graves | Thomas Graves | | | Allow MR AppMaster to limit ephemeral port range. | Blocker | mr-am, mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Allow RPC to limit ephemeral port range. | Blocker |

| Robert Joseph Evans | Robert Joseph Evans | | | Improve Configuration's address handling | Major | util | Daryn Sharp | Daryn Sharp | | | Expose listener address for WebApp | Major | webapps | Daryn Sharp | Daryn Sharp | | | retrofit all JVM shutdown hooks to use ShutdownHookManager | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | | | Avoid redundant calls for tokens in TokenCache | Major | security | Daryn Sharp | Daryn Sharp | | | Port RPC.getServerAddress to 0.23 | Major | ipc | Daryn Sharp | Daryn Sharp | | | Host-based token support | Major | security | Daryn Sharp | Daryn Sharp | | | Dedupe some strings in MRAM for memory savings | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans | | | stop webpages from automatic refreshing | Critical | mrv2, webapps | Alejandro Abdelnur | Thomas Graves | | | Allow symlinking in LocalJobRunner DistributedCache | Major | distributed-cache | Tom White | Tom White | | | Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) | Major | build | Jonathan Eagles | Jonathan Eagles | | | Document entries mapred-default.xml for the jobhistory server. | Minor | documentation | Eugene Koontz | Eugene Koontz | | | Fix inconsistency in documentation regarding mapreduce.jobhistory.principal | Trivial | documentation | Eugene Koontz | Eugene Koontz | | | Provide Improved Traceability for Configuration | Trivial | . | Robert Joseph Evans | Robert Joseph Evans | | | Display tail of aggregated logs by default | Major | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe | | | Cannot cancel paths registered deleteOnExit | Critical | fs | Daryn Sharp | Daryn Sharp | | | Show Configuration Tracability in MR UI | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans | | | Move the checksum type constants to an enum | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Improve the concurrency of SerialNumberMap in NameNode | Major | namenode | Hairong Kuang | Jing Zhao | | | Allow users to specify a checksum type on create() | Major | fs | Kihwal Lee | Kihwal Lee | | | Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used | Major | fs | Kihwal Lee | Kihwal Lee | | | Simplify debugging a job's tokens | Major | client, task | Daryn Sharp | Daryn Sharp | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | alfredo config should be in a file not readable by users | Critical | security | Alejandro Abdelnur | Aaron T. Myers | | | BackupNode should reject requests trying to modify namespace | Major | namenode | Konstantin Shvachko | Konstantin Shvachko | | | Inconsistent Jackson versions | Major | . | Colin P. McCabe | Alejandro Abdelnur | | | ShuffleHandler can't access results when configured in a secure mode | Critical | mrv2, nodemanager | Roman Shaposhnik | Ding Yuan | | | TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy | Minor | test | Aaron T. Myers | Aaron T. Myers | | | mapred job -status fails to give info even if the job is present in History | Major | mrv2 | Devaraj K | Devaraj K | | | Configuration deprecation logic breaks backwards compatibility | Blocker | conf | Alejandro Abdelnur | Alejandro Abdelnur | | | NPE in

if read is repeated on corrupted block | Major | hdfs-client | Henry Robinson | Henry Robinson | | | TestWritableJobConf fails on trunk | Critical | mrv2 | Jason Lowe | Alejandro Abdelnur | | | Configuration logs WARNs on every use of a deprecated key | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur | | | Reduce fetcher doesn't verify HTTP status code of response | Major | mrv1 | Todd Lipcon | Todd Lipcon | | | hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur | | | tools testcases failing because of MAPREDUCE-4082 | Critical | build, test | Alejandro Abdelnur | Alejandro Abdelnur | | | commitJob Exception does not fail job (regression in 0.23 vs 0.20) | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Hung Tasks never time out. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | RM webservices can't query on finalStatus | Major | mrv2 | Thomas Graves | Thomas Graves | | | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe | | | Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used) | Minor | . | Koji Noguchi | Thomas Graves | | | AM Launcher thread can hang forever | Major | mrv2 | Thomas Graves | Thomas Graves | | | mapreduce.job.local.dir doesn't point to a single directory on a node. | Major | mrv2 | Vinod Kumar Vavilapalli | Eric Payne | | | Hftp connections do not have a timeout | Critical | hdfs-client | Daryn Sharp | Daryn Sharp | | | Tracking link gives an error if the AppMaster hasn't started yet | Major | mrv2, webapps | Ravi Prakash | Ravi Prakash | | | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee | | | Web services returns incorrect JSON for deep queue tree | Major | mrv2, webapps | Jason Lowe | Anupam Seth | | | Killed maps shouldn't be counted towards JobCounter.NUM\FAILED\MAPS | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Anupam Seth | | | Tracker URL says AM tasks run on localhost | Major | mrv2 | David Capwell | Ravi Prakash | | | archive command take wrong path for input file with current directory | Major | harchive | Rajit Saha | John George | | | testGetTokensForHftpFS() fails | Blocker | mrv2 | Thomas Graves | Ravi Prakash | | | User-group mapping cache incorrectly does negative caching on transient failures | Major | security | Kihwal Lee | Kihwal Lee | | | risk of NPE in CopyCommands processArguments() | Minor | fs | Steve Loughran | Daryn Sharp | | | tools testcases fail because missing mrapp-generated-classpath file in classpath | Major | build | Alejandro Abdelnur | Roman Shaposhnik | | | Remove hsqldb since its not needed from pom.xml | Major | . | Ravi Prakash | Ravi Prakash | | | Fix

It should not include the size of the directory or follow symbolic links | Critical | fs | Owen O'Malley | Ravi Prakash | | | TestDBJob and TestDataDrivenDBInputFormat ant tests fail | Major | mrv2 | Thomas Graves | Ravi Prakash | | | CS assigns multiple off-switch containers when using multi-level-queues | Critical | mrv2, scheduler | Siddharth Seth | Siddharth Seth | | | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe | | | ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary | Major | fs | Daryn Sharp | John George | | | mapred job -status throws NullPointerException | Critical | client, mrv2 | Devaraj K | Devaraj K | | | History links should use hostname rather than IP address. | Minor | jobhistoryserver, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | ApplicationMaster may fail to remove staging directory | Critical | mrv2 | Jason Lowe | Jason Lowe | | | MR tasks failing and crashing the AM when available-resources/headRoom becomes zero | Critical | mr-am, mrv2 | Vinod Kumar Vavilapalli | Robert Joseph Evans | | | mapreduce classes incorrectly importing "clover.org.apache.\*" classes | Major | client, mrv2 | Patrick Hunt | Patrick Hunt | | | pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node | Minor | io | Junping Du | Junping Du | | | Invalid node link | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | AM Recovery expects all attempts of a completed task to also be completed. | Major | mrv2 | Bikas Saha | Bikas Saha | | | Multiple SLF4J binding message in .out file for all daemons | Major | scripts | Joe Crobak | Jason Lowe | | | ResourceManager NPE while handling NODE\_UPDATE | Critical | mrv2 | Jason Lowe | Jason Lowe | | | ant build fails compiling JobInProgress | Major | build | Thomas Graves | Thomas Graves | | | some mrv1 ant tests fail with timeout - due to 4156 | Major | test | Thomas Graves | Thomas Graves | | | Potential ResourceManager deadlock when SchedulerEventDispatcher is stopped | Major | mrv2 | Jason Lowe | Jason Lowe | | | Client continuously retries to RM When RM goes down before launching Application Master | Major | . | Devaraj K | xieguiming | | | Remove references of mapred.child.ulimit etc. since they are not being used any more | Major | . | Ravi Prakash | Ravi Prakash | | | Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero | Major | mrv2 | Nishan Shetty | Devaraj K | | | Committing is misspelled as commiting in task logs | Trivial | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Lots of unneeded counters log messages | Major | mrv2 | Ahmed Radwan | Ahmed Radwan | | | yarn.app.mapreduce.am.resource.mb not documented | Minor | . | Todd Lipcon | Devaraj K | | | hftp/webhdfs can't get tokens if authority has no port | Critical | webhdfs | Daryn Sharp | Daryn Sharp | | | MR over viewfs is broken | Major | . | John George | John George | | | Hftp selects wrong token service | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp | | | Error message for insufficient data nodes to come out of safemode is wrong. | Major |

| Ravi Prakash | Ravi Prakash | | | ConcurrentModificationError in DirectoryCollection | Major | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Container Logs appear in unsorted order | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | TestContainerManagerSecurity is failing | Critical | mrv2 | Devaraj K | Devaraj K | | | distcp over viewfs is broken | Major | viewfs | John George | John George | | | ByteRangeInputStream leaks streams | Major | hdfs-client | Daryn Sharp | Daryn Sharp | | | setBalancerBandwidth do not checkSuperuserPrivilege | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | junit dependency in hadoop-mapreduce-client is missing scope test | Major | build | Radim Kolar | | | | Sorting by Last Health-Update on the RM nodes page sorts does not work correctly | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | HttpServer sometimes returns incorrect port | Major | . | Daryn Sharp | Daryn Sharp | | | Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook | Critical | fs | Alejandro Abdelnur | Alejandro Abdelnur | | | TestSequenceFile.testCreateUsesFsArg() is broken | Minor | test | John George | John George | | | Error conditions (missing appid, appid not found) are masked in the RM app page | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Update maven-assembly-plugin to 2.3 - fix build on FreeBSD | Major | build | Radim Kolar | | | | Configuration no longer sets all keys in a deprecated key list. | Critical | conf | Robert Joseph Evans | Anupam Seth | | | HDFS command fails with exception following merge of HADOOP-8325 | Major | fs | Randy Clayton | Alejandro Abdelnur | | | DFSClient.close should close cached sockets | Critical | hdfs-client | Todd Lipcon | Todd Lipcon | | | NullPointerException exception while accessing the Application Master UI | Major | mrv2 | Devaraj K | Devaraj K | | | distcpv2 and distcpv1 jars should not coexist | Major | . | Dave Thompson | Dave Thompson | | | Duplicate FileSystem Statistics object for 'file' scheme | Major | fs | Tom White | Tom White | | | RM apps page starttime/endtime sorts are incorrect | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | ConcurrentModificationException in FileSystemCounterGroup | Major | mrv2 | Tom White | Tom White | | | Fix or filter findbugs issues in hadoop-tools | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | RM app page shows 500 error on appid parse error | Major | mrv2 | Jonathan Eagles | Jonathan Eagles | | | TestNodeStatusUpdater can fail if localhost has a domain associated with it | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | NPE can happen in RMNMNodeInfo. | Critical | . | Robert Joseph Evans | Robert Joseph Evans | | | mavenize data\_join | Critical | mrv2 | Thomas Graves | Thomas Graves | | | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | scripts | Patrick Hunt | Patrick Hunt | | | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | nodemanager | Patrick Hunt | Patrick Hunt | | | job counters not available in Jobhistory webui for killed jobs | Major | webapps | Thomas Graves | Bhallamudi Venkata Siva Kamesh | | | Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | Mavenize Gridmix. | Critical | mrv2 | Mahadev konar | Thomas Graves | | | Include the hsqldb jar in the hadoop-mapreduce tar file | Major |

| Ravi Prakash | Ravi Prakash | | | documentation: Gridmix has javadoc warnings in StressJobFactory | Major | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Invalid App Metrics | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | map task left hanging after AM dies trying to connect to RM | Major | mrv2 | Thomas Graves | Thomas Graves | | | Usersmap file in gridmix should not fail on empty lines | Major | contrib/gridmix | Ravi Prakash | Ravi Prakash | | | offlineimageviewer can't read fsimage files that contain persistent delegation tokens | Minor | security, tools | Colin P. McCabe | Colin P. McCabe | | | NM goes down if error encountered during log aggregation | Critical | nodemanager | Daryn Sharp | Daryn Sharp | | | Incorrect count for Missing Replicas in FSCK report | Minor | . | suja s | Andrew Wang | | | TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem | Major | mrv2 | Ahmed Radwan | Ahmed Radwan | | | Remove src/test/system | Trivial | test | Colin P. McCabe | Eli Collins | | | Per-app RM page should have the list of application-attempts like on the app JHS page | Critical | mrv2, webapps | Vinod Kumar Vavilapalli | Jonathan Eagles | | | Shuffle hang when set map.failures.percent | Critical | mrv2 | MengWang | Bhallamudi Venkata Siva Kamesh | | | Gridmix fails to compile on OpenJDK7u4 | Major | benchmarks | Radim Kolar | Radim Kolar | | | Update Netty to avoid leaking file descriptors during shuffle | Critical | build | Jason Lowe | Jason Lowe | | | add types to capacity scheduler properties documentation | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla | | | mavenize pipes | Critical | mrv2 | Thomas Graves | Thomas Graves | | | data\_join test classes are in the wrong packge | Major | mrv2 | Brock Noland | Thomas Graves | | | job client tries to use /tasklog interface, but that doesn't exist anymore | Critical | mrv2 | Thomas Graves | Devaraj K | | | gridmix mainClass wrong in pom.xml | Major | contrib/gridmix | Thomas Graves | Thomas Graves | | | RM crashes due to DNS issue | Critical | mrv2, resourcemanager | Thomas Graves | Thomas Graves | | | Node Manager hangs on shut down | Critical | mrv2, nodemanager | Devaraj K | Devaraj K | | | Fix detailed metrics for protobuf-based RPC on 0.23 | Major | mrv2 | Jason Lowe | Jason Lowe | | | JobStatus.getState() API is giving ambiguous values | Major | mrv2 | Nishan Shetty | Devaraj K | | | Permissions race can make getStagingDir fail on local filesystem | Major | job submission | Todd Lipcon | Ahmed Radwan | | | ViewFileSystemTestSetup setupForViewFileSystem is erring when the user's home directory is somewhere other than /home (eg. /User) etc. | Major | fs, test | Ravi Prakash | Ahmed Radwan | | | mapreduce.job.reduce.slowstart.completedmaps is not working properly to delay the scheduling of the reduce tasks | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe | | | Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager | Major | mrv2, resourcemanager | Devaraj K | Devaraj K | | | TestClusterMRNotification times out | Major | mrv2, test | Jason Lowe | Kihwal Lee | | | TestViewFsTrash occasionally fails | Major | fs | Tsz Wo Nicholas Sze | Jason Lowe | |

FSPermissionChecker#checkPermission sticky bit check missing range check | Major | namenode | Eli Collins | Eli Collins | | | Counters.makeCompactString() changed behavior from 0.20 | Major | mrv2 | Jason Lowe | Jason Lowe | | | Race conditions in IndexCache | Major | nodemanager | Kihwal Lee | Kihwal Lee | | | RM gets fatal error and exits during TestRM | Major | resourcemanager | Kihwal Lee | Kihwal Lee | | | Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts | Blocker | mrv2, nodemanager | Devaraj K | Devaraj K | | | Backport HDFS-3357 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | Decouple TestHDFSTrash from TestTrash | Major | test | Jason Lowe | Jason Lowe | | | TestFileInputFormat fails intermittently | Major | test | Jason Lowe | Jason Lowe | | | OOM in AM can turn it into a zombie. | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans | | | MR2 job never completes with 1 pending task | Major | mrv2 | Tom White | Tom White | | | Configuration tries to read from an inputstream resource multiple times. | Major | conf | Robert Joseph Evans | Robert Joseph Evans | | | HarFileSystem access of harMetaCache isn't threadsafe | Minor | fs | Eli Collins | Eli Collins | | | ./mapred queue -info \<queuename\> -showJobs displays all the jobs irrespective of \<queuename\> | Major | mrv2 | Nishan Shetty | Devaraj K | | | Terasort hangs with MR2 FifoScheduler | Major | mrv2 | Tom White | Tom White | | | Invalid pom.xml files on 0.23 branch | Major | build | Radim Kolar | Radim Kolar | | | Possible NPE at ClientDistributedCacheManager#determineTimestamps | Critical | distributed-cache, job submission, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | Backport HDFS-3541 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | Race in MR ApplicationMaster can cause reducers to never be scheduled | Critical | applicationmaster, mrv2 | Jason Lowe | Jason Lowe | | | Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file | Major | fs | Andrey Klochkov | Andrey Klochkov | | | Incorrect MR\HISTORY\STORAGE property name in JHAdminConfig | Major | mrv2 | Ahmed Radwan | Ahmed Radwan | | | Nodemanager crashes upon application cleanup if aggregation failed to start | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe | | | LeaseRenewer can hold reference to inactive DFSClient instances forever | Critical | hdfs-client | Kihwal Lee | Kihwal Lee | | | WebHdfsFileSystem can not read files larger than 24KB | Blocker | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze | | | SNN can fail to start on upgrade | Minor | namenode | Andy Isaacson | Andy Isaacson | | | Namenode loses datanode hostname if datanode re-registers | Major | datanode | Jason Lowe | Jason Lowe | | | allow capacity scheduler configs maximum-applications and maximum-am-resource-percent configurable on a per queue basis | Critical | mrv2 | Thomas Graves | Thomas Graves | | |

may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp | | | IndexCache failures due to missing synchronization | Critical | nodemanager | Andrey Klochkov | Kihwal Lee | | | Potential infinite fetching of map output | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze | | | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp | | | FS deleteOnExit may delete the wrong path | Critical | fs | Daryn Sharp | Daryn Sharp | | | Ensure FileSystem#close doesn't squawk for deleteOnExit paths | Critical | fs | Daryn Sharp | Daryn Sharp | | | hadoop fs -touchz automatically created parent directories | Major | fs | Robert Joseph Evans | John George | | | LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | AM logs link is missing user name | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe | | | FilterFileSystem#setWriteChecksum is broken | Critical | fs | Daryn Sharp | Daryn Sharp | | | Distibuted Cache Compatability Issues | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull | Minor | mrv2 | Nishan Shetty | Mayank Bansal | | | Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found | Major | native | Trevor Robinson | Trevor Robinson | | | mr job invalid transition TA\TOO\MANY\FETCH\FAILURE at FAILED | Critical | mrv2 | Thomas Graves | Robert Joseph Evans | | | nodemanager fails to start when one of the local-dirs is bad | Blocker | nodemanager | Nathan Roberts | Jason Lowe | | | Interrupted FsShell copies may leave tmp files | Critical | fs | Daryn Sharp | Daryn Sharp | | | SortValidator writes to wrong directory | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | teragen terasort jobs fail when using webhdfs:// | Critical | mrv2 | Arpit Gupta | Jason Lowe | | | Symlinks to peer distributed cache files no longer work | Major | nodemanager | Jason Lowe | Jason Lowe | | | Counters group names deprecation is wrong, iterating over group names deprecated names don't show up | Major | mrv2 | Alejandro Abdelnur | Robert Joseph Evans | | | Datanode won't shutdown because of runaway DataBlockScanner thread | Critical | datanode | Kihwal Lee | Kihwal Lee | | | WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header. | Major | webhdfs | Ravi Prakash | Ravi Prakash | | | distcpV2: turn CRC checking off for 0 byte size | Major | . | Dave Thompson | Dave Thompson | | | Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name | Major |

| Jarek Jarcec Cecho | Jarek Jarcec Cecho | | | TestFileSystemCanonicalization fails with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | distcp can't copy large files using webhdfs due to missing Content-Length header | Critical | webhdfs | Eli Collins | Tsz Wo Nicholas Sze | | | TestLocalDirAllocator fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | TestSecurityUtil fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | TestWritableName fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | remove old aggregated logs | Major | . | Thomas Graves | Robert Joseph Evans | | | TestPathData fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | Need generalized multi-token filesystem support | Critical | fs, security | Daryn Sharp | Daryn Sharp | | | Failed refreshQueues due to misconfiguration prevents further refreshing of queues | Major | . | Ramya Sunil | Arun C Murthy | | | NM leaks filesystems | Critical | nodemanager | Daryn Sharp | Jason Lowe | | | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker | | | Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException | Minor | client, mrv2 | Ratandeep Ratti | Jason Lowe | | | ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/\<pid\>/stat is not found. | Minor | mrv2 | Ahmed Radwan | Ahmed Radwan | | | Jars in lib subdirectory of the submittable JAR are not added to the classpath | Blocker | mrv2 | Ahmed Radwan | Robert Kanter | | | Port HDFS-3835 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | DistCp fails when invoked by Oozie | Blocker | security | Mithun Radhakrishnan | Daryn Sharp | | | "Text File Busy" errors launching MR tasks | Major | . | Todd Lipcon | Andy Isaacson | | | globStatus changed behavior from 0.20/1.x | Critical | fs | Jason Lowe | Jason Lowe | | | MR is broken when security is off | Blocker | security | Daryn Sharp | Daryn Sharp | | | Allow DFSClient to find out and use the CRC type being used for a file. | Major | datanode, hdfs-client | Kihwal Lee | Kihwal Lee | | | Add a capability to discover and set checksum types per file. | Major | fs, util | Kihwal Lee | Kihwal Lee | | | TestDelegationTokenRenewer fails on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | TestTokenCache.java from MRV1 no longer compiles | Critical | . | Robert Joseph Evans | Daryn Sharp | | | IOUtils#skipFully hangs forever on EOF | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Deadlock in DFSClient | Blocker | hdfs-client | Kihwal Lee | Kihwal Lee | | | The Secrets in Credentials are not available to MR tasks | Major | security | Benoy Antony | Daryn Sharp | | | TestHsWebServicesJobsQuery fails on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | RMNodeImpl is missing valid transitions from the UNHEALTHY state | Major | resourcemanager | Jason Lowe | Jason Lowe | | | Gracefully deprecate dfs.umaskmode in 2.x onwards | Major | conf | Harsh J | Harsh J | | | aggregated logs permissions not set properly | Critical | nodemanager | Thomas Graves | Thomas Graves | | | job summary file permissions not set when its created | Critical | . | Thomas Graves | Thomas Graves | | | MR AM dies badly when Node is decomissioned | Critical | . | Robert Joseph Evans | Robert Joseph Evans | | | In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as

| Critical | mrv2 | Ravi Prakash | Ravi Prakash | | | Hftp assumes security is disabled if token fetch fails | Major | hdfs-client | Daryn Sharp | Daryn Sharp | | | TestHftpDelegationToken is broken after HADOOP-8225 | Major | hdfs-client, security | Aaron T. Myers | Daryn Sharp | | | NodeManager will refuse to shutdown indefinitely due to container log aggregation | Major | nodemanager | patrick white | Daryn Sharp | | | NM ResourceLocalizationService does not set permissions of local cache directories | Critical | nodemanager | Jason Lowe | Jason Lowe | | | filecontext mkdirs doesn't apply umask as expected | Critical | . | Thomas Graves | Thomas Graves | | | history server doesn't set permissions on all subdirs | Critical | jobhistoryserver | Thomas Graves | oss.wakayama | | | Exception in commitJob marks job as successful in job history | Major | mrv2 | Jason Lowe | Jason Lowe | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add a test to verify getFileChecksum works with ViewFS | Minor | test | Ravi Prakash | Ravi Prakash | | | TestTTResourceReporting can fail, and should just be deleted | Major | mrv1 | Robert Joseph Evans | Ravi Prakash | | | Allow tests to control token service value | Major | test | Daryn Sharp | Daryn Sharp | | | Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node) | Major | test | Eli Collins | Junping Du | | | TestJobClientGetJob sometimes fails | Major | test | Daryn Sharp | Daryn Sharp | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Clean up FSNamesystem and BlockManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Randomize master key generation for ApplicationTokenSecretManager and roll it every so often | Major | mrv2, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Locking and exception issues in JobHistory Server. | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | create sockets consistently | Major | client, mrv2 | Daryn Sharp | Daryn Sharp | | | web service calls header contains 2 content types | Critical | mrv2 | Thomas Graves | Thomas Graves | | | consistently set the bind address | Major | mrv2 | Daryn Sharp | Daryn Sharp | | | Correctly set token service | Major | client, mrv2 | Daryn Sharp | Daryn Sharp | | | ContainerTokens should have an expiry interval | Major | mrv2, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | RM-NM secret-keys should be randomly generated and rolled every so often | Critical | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | NMs rejects all container tokens after secret key rolls | Blocker | nodemanager | Daryn Sharp | Vinod Kumar Vavilapalli | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Remove the empty hadoop-mapreduce-project/assembly/all.xml file | Major | . | Ravi Prakash | Ravi Prakash | | | Remove references of mapred.child.ulimit etc. since they are not being used any more | Major | mrv2 | Ravi Prakash | Ravi Prakash | | | Move YARN out of hadoop-mapreduce | Major