Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.22.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Bug in FileContext#copy and provide base class for FileContext tests | Major | fs, test | Eli Collins | Ravi Phulari | | | HFTP and URL Encoding | Major | contrib/hdfsproxy, datanode | Dmytro Molkov | Dmytro Molkov | | | Memory footprint optimization for INodeFile object. | Minor | namenode | Bharath Mundlapudi | Bharath Mundlapudi | | | Remove JNI calls from ClusterStatus cstr | Major | jobtracker | Chris Douglas | Luke Lu | | | Factor out glob pattern code from FileContext and Filesystem | Major | fs | Luke Lu | Luke Lu | | | SecondaryNameNode image transfer should use the defined http address rather than local ip address | Major | namenode | Jakob Homan | Jakob Homan | | | Support concatenated gzip files | Major | io | Tom White | Greg Roelofs | | | Authentication between pipes processes and java counterparts. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Add fsck event to audit log and remove other audit log events corresponding to FSCK listStatus and open calls | Major | namenode, tools | Suresh Srinivas | Suresh Srinivas | | | Remove deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils | Minor | contrib/streaming | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Datanode Web UIs should provide robots.txt | Trivial | datanode | Allen Wittenauer | Allen Wittenauer | | | Add a bulk FIleSystem.getFileBlockLocations | Major | hdfs-client, namenode | Arun C Murthy | Hairong Kuang | | | Better logging messages when a delegation token is invalid | Major | security | Kan Zhang | Kan Zhang | | | Job Acls affect Queue Acls | Major | security | Ravi Gummadi | Ravi Gummadi | | | Provide an option to store fsimage compressed | Major | namenode | Hairong Kuang | Hairong Kuang | | | NN should verify images and edit logs on startup | Critical | namenode | Eli Collins | Hairong Kuang | | | Context.setStatus() and progress() api are ignored | Blocker | task | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Add boolean field isCorrupt to BlockLocation | Major | . | Patrick Kling | Patrick Kling | | | dfs.data.dir permissions should default to 700 | Minor | datanode | Todd Lipcon | Todd Lipcon | | | Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting | Major | io | Navis | Matt Foley | | | Absolute path to kinit in auto-renewal thread | Major | security | Aaron T. Myers | Aaron T. Myers | | | Remove thriftfs contrib | Major | . | Nigel Daley | Nigel Daley | | | Remove hod contrib | Major | . | Nigel Daley | Nigel Daley | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add a metrics to track the number of heartbeats processed | Major | jobtracker | Hong Tang | Dick King | | | authorization checks for inter-server protocol (based on HADOOP-6600) | Major | . | Boris Shkolnik | Boris Shkolnik | | | mechanism for authorization check for inter-server protocols | Major |

| Boris Shkolnik | Boris Shkolnik | | | HDFS implementation should throw exceptions defined in AbstractFileSystem | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Stress-test tool for HDFS introduced in HDFS-708 | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko | | | A stress-test tool for HDFS. | Major | test, tools | Konstantin Shvachko | Joshua Harlow | | | Re-factor block access token implementation to conform to the generic Token interface in Common | Major | security | Kan Zhang | Kan Zhang | | | allow dfsadmin/mradmin refresh of superuser proxy group mappings | Major | security | Boris Shkolnik | Boris Shkolnik | | | Log authentication and authorization failures and successes | Major | security | Boris Shkolnik | Boris Shkolnik | | | JobTracker should issue a delegation token only for kerberos authenticated client | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Add interface classification stable & scope to HDFS | Major | . | Suresh Srinivas | Suresh Srinivas | | | Update NN to support Kerberized SSL from HADOOP-6584 | Major | namenode | Jakob Homan | Jakob Homan | | | Fsck security | Major | . | Jitendra Nath Pandey | Boris Shkolnik | | | Support for Sleep Jobs in gridmix | Major | contrib/gridmix | rahul k singh | rahul k singh | | | Add FileSystem#listLocatedStatus to list a directory's content together with each file's block locations | Major | fs | Hairong Kuang | Hairong Kuang | | | Common component of HDFS-1150 (Verify datanodes' identities to clients in secure clusters) | Major | security | Jakob Homan | Jakob Homan | | | Verify datanodes' identities to clients in secure clusters | Major | datanode | Jakob Homan | Jakob Homan | | | HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scripts | Major | . | Suresh Srinivas | Tanping Wang | | | Collecting cpu and memory usage for MapReduce tasks | Major | task, tasktracker | Hong Tang | Scott Chen | | | getCorruptFiles() should give some hint that the list is not complete | Major | . | Rodrigo Schmidt | Sriram Rao | | | streaming should support running on background | Major | contrib/streaming | Bochun Bai | Bochun Bai | | | add tokenCache option to GenericOptionsParser for passing file with secret keys to a map reduce job | Major |

| Boris Shkolnik | Boris Shkolnik | | | Allow CodecFactory to return a codec object given a codec' class name | Major | io | Hairong Kuang | Hairong Kuang | | | Security features for Hadoop | Major | security | Kan Zhang | Kan Zhang | | | Add metrics, failure reporting and additional tests for HDFS-457 | Minor | test | Ravi Phulari | Eli Collins | | | Add ability for safemode to wait for a minimum number of live datanodes | Major | scripts | Todd Lipcon | Todd Lipcon | | | Add JNI support for secure IO operations | Blocker | io, native, security | Todd Lipcon | Todd Lipcon | | | Provide a web server plugin that uses a static user for the web UI | Major | security | Owen O'Malley | Owen O'Malley | | | Make RPCs to DataNodes timeout | Major | datanode | Hairong Kuang | John George | | | Make RPC to have an option to timeout | Major | ipc | Hairong Kuang | John George | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | separate jvm param for mapper and reducer | Minor | . | Koji Noguchi | Arun C Murthy | | | Split RPC metrics into summary and detailed metrics | Major | . | Suresh Srinivas | Suresh Srinivas | | | Jobtracker JSP pages should automatically redirect to the corresponding history page if not in memory | Minor | . | Scott Chen | Scott Chen | | | Add StringUtils.split for non-escaped single-character separator | Minor | util | Todd Lipcon | Todd Lipcon | | | INode.getPathNames could split more efficiently | Minor | namenode | Todd Lipcon | Dmytro Molkov | | | The HDFS webUI should show a metric that summarizes whether the cluster is balanced regarding disk space usage | Major | namenode | dhruba borthakur | Dmytro Molkov | | | FairScheduler should allow separate configuration of node and rack locality wait time | Major | . | Scott Chen | Scott Chen | | | Improve Trash Emptier | Major | . | Dmytro Molkov | Dmytro Molkov | | | FsShell 'hadoop fs -text' does not support compression codecs | Major | . | Patrick Angeles | Patrick Angeles | | | normalize property names for JT kerberos principal names in configuration (from HADOOP 6633) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Incremental enhancements to the JobTracker for better scalability | Critical | jobtracker | Devaraj Das | Dick King | | | Add streaming config option for not emitting the key | Minor | contrib/streaming | Eli Collins | Eli Collins | | | Refresh for proxy superuser config (common part for HDFS-1096) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Replace tabs in code with spaces | Minor | . | Jeff Ames | Jeff Ames | | | Support for file sizes less than 1MB in DFSIO benchmark. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko | | | Remove duplicate now() functions in DataNode, FSNamesystem | Minor | datanode, namenode | Jeff Ames | Jeff Ames | | | Remove some duplicate code in NamenodeJspHelper.java | Minor | namenode | Jeff Ames | Jeff Ames | | | Performance Improvement in Secure RPC | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Add 'first-task-launched' to job-summary | Major | jobtracker | Arun C Murthy | Luke Lu | | | Add a setValue() method in Counter | Major | . | Scott Chen | Scott Chen | | | Remove unused getNamenode() method from DataNode. | Minor | datanode | Jeff Ames | Jeff Ames | | | Namenode heap optimization - reuse objects for commonly used file names | Major | . | Suresh Srinivas | Suresh Srinivas | | | Method in UGI to get the authentication method of the real user. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | |

should use min() to find the candidate instead of sort() | Major | jobtracker | Scott Chen | Scott Chen | | | Reducing NameNode memory usage by an alternate hash table | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Improve Namenode robustness by prioritizing datanode heartbeats over client requests | Major | namenode | dhruba borthakur | Dmytro Molkov | | | The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas | Major | . | dhruba borthakur | Dmytro Molkov | | | Delete or recreate obsolete har files used on hdfs raid | Major | contrib/raid | Rodrigo Schmidt | Rodrigo Schmidt | | | Document configuration parameters in streaming | Major | contrib/streaming, documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Add read timeout on userlog pull | Major | client | Krishna Ramachandran | Krishna Ramachandran | | | CompletedJobStatusStore initialization should fail if {mapred.job.tracker.persist.jobstatus.dir} is unwritable | Major | jobtracker | Amar Kamat | Krishna Ramachandran | | | Include job submit host information (name and ip) in jobconf and jobdetails display | Major | . | Krishna Ramachandran | Krishna Ramachandran | | | Multiple reducers for Slive | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko | | | Provide Kerberized SSL encryption for webservices | Major | . | Jakob Homan | Jakob Homan | | | DistRaid map tasks have large variance in running times | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | Datanode could log what hostname and ports its listening on on startup | Minor | datanode | Steve Loughran | Steve Loughran | | | Redundant memory copying in StreamKeyValUtil | Minor | contrib/streaming | Ruibang He | Ruibang He | | | Speedup INode.getPathComponents | Minor | namenode | Dmytro Molkov | Dmytro Molkov | | | TokenStorage renamed to Credentials. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | HDFS changes corresponding to rename of TokenStorage to Credentials | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | In secure clusters, NN and SNN should verify that the remote principal during image and edits transfer | Major | namenode, security | Jakob Homan | Jakob Homan | | | Allow http server to start as regular principal if https principal not defined. | Major | namenode | Jakob Homan | Jakob Homan | | | FileStatus needs unit tests | Major | . | Rodrigo Schmidt | Rodrigo Schmidt | | | [Gridmix] Exploit/Add security features in GridMix | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | | Support for varied user submission in Gridmix | Major | contrib/gridmix | Chris Douglas | Chris Douglas | | | Gridmix should provide an option to submit jobs to the same queues as specified in the trace. | Major | contrib/gridmix | Hong Tang | rahul k singh | | | Cache the job related information while submitting the job , this would avoid many RPC calls to JobTracker. | Major | contrib/gridmix | rahul k singh | rahul k singh | | | Put number of speculative, data local, rack local tasks in JobTracker metrics | Major | jobtracker | Scott Chen | Scott Chen | | | Introduce additional statistics to FileSystem | Major |

| Suresh Srinivas | Suresh Srinivas | | | Add support in HDFS to update statistics that tracks number of file system operations in FileSystem | Major | . | Suresh Srinivas | Suresh Srinivas | | | HFTP needs to be updated to use delegation tokens (from HDFS-1007) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Support for using different Kerberos keys for different instances of Hadoop services | Major | . | Kan Zhang | Kan Zhang | | | Support for using different Kerberos keys for Namenode and datanode. | Major | . | Jitendra Nath Pandey | Kan Zhang | | | Support for using different Kerberos keys for Jobtracker and TaskTrackers | Major | . | Kan Zhang | Kan Zhang | | | Performance regression in DistributedFileSystem::getFileBlockLocations in secure systems | Major | security | Jakob Homan | Jakob Homan | | | Add start time, end time and total time taken for FSCK to FSCK report | Major | namenode, tools | Suresh Srinivas | Suresh Srinivas | | | [gridmix3] Make Gridmix3 more customizable. | Major | contrib/gridmix | Hong Tang | Hong Tang | | | Method in Credentials to read and write a token storage file. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Use writeTokenStorageToStream method in Credentials to store credentials to a file. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Common part of HDFS-1178 | Major | ipc | Kan Zhang | Kan Zhang | | | The NameNode servlets should not use RPC to connect to the NameNode | Major | namenode | Owen O'Malley | Owen O'Malley | | | adding some java doc to Server.RpcMetrics, UGI | Minor | ipc | Boris Shkolnik | Boris Shkolnik | | | Improve listFiles API introduced by HADOOP-6870 | Major | fs | Hairong Kuang | Hairong Kuang | | | Fix some comments | Trivial | documentation | Jeff Ames | Jeff Ames | | | Add api to add user/group to AccessControlList | Major | security | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | doc update for DelegationTokenFetcher (part of HDFS-1036) | Minor | . | Boris Shkolnik | | | | Making Mumak work with Capacity-Scheduler | Major | contrib/mumak | Anirban Dasgupta | Anirban Dasgupta | | | Add metrics to track kerberos login activity | Major | . | Suresh Srinivas | Suresh Srinivas | | | Provide information as to whether or not security is enabled on web interface for NameNode (part of HADOOP-6822) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Add LOG.isDebugEnabled() guard for each LOG.debug("...") | Major | . | Erik Steffl | Erik Steffl | | | Add LOG.isDebugEnabled() guard for each LOG.debug("...") | Major | . | Erik Steffl | Erik Steffl | | | Remove most of getBlockLocation optimization | Major | namenode | Jakob Homan | Jakob Homan | | | FSDatasetAsyncDiskService should name its threads | Major | datanode | Todd Lipcon | Todd Lipcon | | | A CombineFileInputSplit cannot be less than a dfs block | Major | . | Namit Jain | dhruba borthakur | | | Invalid javadoc reference in FSDatasetMBean.java | Trivial | datanode | Eli Collins | Eli Collins | | | Refactor DataNode Packet header into DataTransferProtocol | Major |

| Todd Lipcon | Todd Lipcon | | | Add documentation to Rumen | Major | tools/rumen | Amar Kamat | Amar Kamat | | | Add @Override annotation to FSDataset methods that implement FSDatasetInterface | Major | datanode | Suresh Srinivas | Suresh Srinivas | | | Suggest that HADOOP\_CLASSPATH should be preserved in hadoop-env.sh.template | Trivial | scripts | Philip Zeyliger | Philip Zeyliger | | | Better error messages on hftp | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock | Major | namenode | dhruba borthakur | dhruba borthakur | | | Use Block in DataTransferProtocol | Major | . | Suresh Srinivas | Suresh Srinivas | | | There is no unit test for HftpFileSystem.open(..) | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Hadoop archives should be able to preserve times and other properties from original files | Major | harchive | Rodrigo Schmidt | Rodrigo Schmidt | | | Add @Override annotation to SimulatedFSDataset methods that implement FSDatasetInterface | Major | . | Suresh Srinivas | Suresh Srinivas | | | Add a block counter to DatanodeDescriptor | Major | namenode | Hairong Kuang | Hairong Kuang | | | Remove unused method BlockInfo#listCount | Major | namenode | Hairong Kuang | Hairong Kuang | | | SequenceFile and MapFile need cleanup to remove redundant constructors | Major | io | Owen O'Malley | Owen O'Malley | | | HAR files used for RAID parity need to have configurable partfile size | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | Provide SSH based (Jsch) remote execution API for system tests | Major | build, test | Iyappan Srinivasan | Konstantin Boudnik | | | Refactor Datanode#startDataNode method | Major | datanode | Suresh Srinivas | Suresh Srinivas | | | Use JUnit Rule to optionally fail test cases that run more than 10 seconds | Major | test | Jakob Homan | Jakob Homan | | | RaidNode should be smarter in submitting Raid jobs | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | Provide builder for constructing instances of MiniDFSCluster | Major | test | Jakob Homan | Jakob Homan | | | Re-generate fair scheduler design doc PDF | Trivial | . | Matei Zaharia | Matei Zaharia | | | upgrade clover on the builds servers to v 3.0.2 | Major | . | Giridharan Kesavan | Giridharan Kesavan | | | Need a command line option in RaidShell to fix blocks using raid | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | JobInProgress has some redundant lines in its ctor | Trivial | jobtracker | Harsh J | Harsh J | | | JobQueueJobInProgressListener's javadoc is inconsistent with source code | Minor | jobtracker | Jingguo Yao | Jingguo Yao | | | Refactor DFSck to allow programmatic access to output | Major | tools | Ramkumar Vadali | Ramkumar Vadali | | | Update test-patch.sh to remove callback to Hudson master | Major | test | Nigel Daley | Nigel Daley | | | update the hudson-test-patch target to work with the latest test-patch script. | Major | build | Giridharan Kesavan | Giridharan Kesavan | | | Suggest that HADOOP\_OPTS be preserved in

| Minor | . | Ramkumar Vadali | Ramkumar Vadali | | | Typo in FileSystem.java | Minor | fs | Jingguo Yao | Jingguo Yao | | | MD5Hash provides a public factory method that creates an instance of MessageDigest | Major | io | Hairong Kuang | Hairong Kuang | | | RaidNode should periodically fix corrupt blocks | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | RaidNode should specify a pool name incase the cluster is using FairScheduler | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | Typo in BlockPlacementPolicy.java | Minor | . | Jingguo Yao | Jingguo Yao | | | Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warnings | Major | test | Nigel Daley | Giridharan Kesavan | | | RaidNode can allow layered policies more efficiently | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | Provide a JNI-based implementation of GroupMappingServiceProvider | Major | security | Devaraj Das | Devaraj Das | | | The GroupMappingServiceProvider interface should be public | Major | security | Aaron T. Myers | Aaron T. Myers | | | Limit transmission rate when transfering image between primary and secondary NNs | Major | namenode | Hairong Kuang | Hairong Kuang | | | Generate Eclipse's .classpath file from Ivy config | Major | build | Tom White | Nigel Daley | | | Generate Eclipse's .classpath file from Ivy config | Major | build | Tom White | Tom White | | | Current Ganglia metrics implementation is incompatible with Ganglia 3.1 | Major | metrics | Brian Bockelman | Brian Bockelman | | | Herriot daemon clients should vend statistics | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | Add an "extra data" field to Task for use by Mesos | Minor | . | Matei Zaharia | Matei Zaharia | | | Herriot NN and DN clients should vend statistics | Major | test | Al Thompson | Konstantin Boudnik | | | Herriot JT and TT clients should vend statistics | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | Faster directory traversal for raid node | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fs | Major | . | Sanjay Radia | Sanjay Radia | | | Improve some FSDataset warnings and comments | Major | datanode | Eli Collins | Eli Collins | | | Provide info on failed volumes in the web ui | Major | namenode | Jakob Homan | Eli Collins | | | Assert type constraints in the FileStatus constructor | Major | fs | Eli Collins | Eli Collins | | | FileContextSymlinkBaseTest should use FileContextTestHelper | Minor | test | Eli Collins | Eli Collins | | | Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903) | Major |

| Sanjay Radia | Sanjay Radia | | | Modify fetchdt to allow renewing and canceling token | Major | security | Owen O'Malley | Owen O'Malley | | | DataNode should sleep before reentering service loop after an exception | Major | datanode | Todd Lipcon | Todd Lipcon | | | Update HDFS permissions guide for security | Major | documentation, security | Todd Lipcon | Todd Lipcon | | | Make NN and DN handle in a intuitive way comma-separated configuration strings | Minor | datanode, namenode | Michele Catasta | Michele Catasta | | | Improve thread naming for DataXceivers | Major | datanode | Todd Lipcon | Todd Lipcon | | | configuration parameter to prevent accidental formatting of HDFS filesystem | Minor | namenode | Andrew Ryan | Andrew Ryan | | | Gridmix forrest documentation | Major | contrib/gridmix | rahul k singh | Ranjit Mathew | | | Port DistRaid.java to new mapreduce API | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | Fix a number of warnings | Minor | . | Eli Collins | Eli Collins | | | Task Initialization should be delayed till when a job can be run | Major | contrib/fair-share | Ramkumar Vadali | Ramkumar Vadali | | | Allow hflush/sync to occur in parallel with new writes to the file | Major | hdfs-client | dhruba borthakur | Todd Lipcon | | | Add MRUnit documentation | Major | contrib/mrunit | Aaron Kimball | Aaron Kimball | | | Change NN LoadGenerator to use the new FileContext api | Major | . | Sanjay Radia | Sanjay Radia | | | BytesWritable#getBytes is a bad name that leads to programming mistakes | Major | . | Nathan Marz | Owen O'Malley | | | Configuration should trim whitespace around a lot of value types | Minor | conf | Todd Lipcon | Michele Catasta | | | Remove EC2 bash scripts | Blocker | . | Tom White | Tom White | | | DataNode makeInstance should report the directory list when failing to start up | Minor | datanode | Steve Loughran | Steve Loughran | | | Use java.net.preferIPv4Stack to force IPv4 | Major | scripts | Steve Loughran | Michele Catasta | | | MRAsyncDiscService should tolerate missing local.dir | Major | . | Scott Chen | Zheng Shao | | | Implement chmod with JNI | Major | io, native | Todd Lipcon | Todd Lipcon | | | Remove auto-generated native build files | Major | . | Eli Collins | Roman Shaposhnik | | | Remove auto-generated native build files | Major | build | Roman Shaposhnik | Roman Shaposhnik | | | Remove auto-generated native build files | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik | | | JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters() | Major | . | Scott Chen | Joydeep Sen Sarma | | | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik | | | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik | | | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik | | | Limit Job name on jobtracker.jsp to be 80 char long | Trivial | . | Zheng Shao | Harsh J | | | Should set MALLOC\ARENA\MAX in

| Minor | scripts | Todd Lipcon | Todd Lipcon | | | Break dependency between DatanodeJspHelper and FsShell | Minor | datanode | Daryn Sharp | Daryn Sharp | | | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer | | | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | documentation, namenode | Patrick Angeles | Harsh J | | | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J | | | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Remove dependence of public MapReduce API on classes in server package | Major | . | Tom White | Tom White | | | fix typo of command 'hadoop fs -help tail' | Minor | fs, test | Wei Yongjun | Wei Yongjun | | | Rename dfs.datanode.max.xcievers and bump its default value | Major | datanode | Eli Collins | Eli Collins | | | Documentation change for updated configuration keys | Blocker | documentation | Tom White | Tom White | | | Document dfs.datanode.max.transfer.threads in hdfs-default.xml | Minor | datanode, documentation | Eli Collins | Harsh J | | | Add ability to enable 'debug' property in JAAS configuration | Minor | security | Todd Lipcon | Ted Yu | | | document multiple keys per reducer oddity in hadoop streaming FAQ | Minor | contrib/streaming, documentation | Dieter Plaetinck | Harsh J | | | Publish Javadoc for all contrib packages with user-facing APIs | Major | documentation | Tom White | Jolly Chen | | | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon | | | fs -stat docs aren't updated to reflect the format features | Trivial | documentation | Harsh J | Harsh J | | | DFSClient should use mapreduce.task.attempt.id | Trivial | hdfs-client | Eli Collins | Eli Collins | | | JobSubmitter should use mapreduce.job.maps | Trivial | job submission | Eli Collins | Eli Collins | | | Explain how to use ACLs in the fair scheduler | Minor | contrib/fair-share, documentation | Matei Zaharia | Matei Zaharia | | | Documentation for HFTP | Minor | documentation | Ari Rabkin | Ari Rabkin | | | TaskLogAppender mechanism shouldn't be set in log4j.properties | Major | task | Todd Lipcon | Todd Lipcon | | | Add audience and stability annotations to HttpServer class | Major | . | stack | stack | | | Force entropy to come from non-true random for tests | Minor | build, test | Todd Lipcon | Todd Lipcon | | | Update the documentation to reflect true client caching strategy | Major | documentation, hdfs-client | Jeff Hammerbacher | Harsh J | | | Send back nicer error to clients using outdated IPC version | Major | ipc | Todd Lipcon | Todd Lipcon | | | Move build/webapps deeper in directory heirarchy to aid eclipse users | Major | build | Todd Lipcon | Todd Lipcon | | | hadoop command - do not accept class names starting with a hyphen | Minor | scripts | Brock Noland | Brock Noland | | | TestNameNodeMetrics uses a bad test root path | Major |

| Todd Lipcon | Todd Lipcon | | | Remove AC\_TYPE\* from the libhdfs | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik | | | Improve corrupt files warning message on NameNode web UI | Major | namenode | philo vivero | Patrick Hunt | | | Add JAVA\_HOME detection to hadoop-config | Minor | . | Chad Metcalf | Eli Collins | | | Re-organize hadoop subversion layout | Blocker | build | Nigel Daley | Todd Lipcon | | | Datanode xceiver protocol should allow reuse of a connection | Major | datanode, hdfs-client, performance | Todd Lipcon | bc Wong | | | BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() | Minor | datanode | Kihwal Lee | Kihwal Lee | | | DataXceiverServer logs AsynchronousCloseException at shutdown | Trivial | datanode | Todd Lipcon | Todd Lipcon | | | Remove out-of-date Chinese language documentation | Blocker | documentation | Jakob Homan | Jakob Homan | | | Build should not redownload ivy on every invocation | Minor | build | Todd Lipcon | Joep Rottinghuis | | | Remove HDFS-specific configuration keys defined in FsConfig | Major | . | Eli Collins | Eli Collins | | | Improve log levels when exceptions caught in RPC handler | Minor | ipc | Todd Lipcon | Todd Lipcon | | | changes2html.pl should generate links to HADOOP, HDFS, and MAPREDUCE jiras | Major | documentation | Konstantin Shvachko | Konstantin Shvachko | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota. | Major | fs | gary murry | Jakob Homan | | | libhdfs test is broken | Blocker | libhdfs | Eli Collins | Eli Collins | | | TaskRunner can get NPE in getting ugi from TaskTracker | Major | tasktracker | Amareshwari Sriramadasu | Vinod Kumar Vavilapalli | | | zlib.compress.level ignored for DefaultCodec initialization | Minor | io | Koji Noguchi | Koji Noguchi | | | Incorrect exit codes for "dfs -chown", "dfs -chgrp" when input is given in wildcard format. | Minor | fs | Ravi Phulari | Ravi Phulari | | | Modification times are being overwritten when FSImage loads | Major | . | Dmytro Molkov | Dmytro Molkov | | | Delegation token is obtained as the superuser | Major | job submission, security | Devaraj Das | Devaraj Das | | | Remove verbose logging from the Groups class | Major | . | Owen O'Malley | Boris Shkolnik | | | specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) | Major | security | Boris Shkolnik | Boris Shkolnik | | | Protocols RefreshUserToGroupMappingsProtocol and RefreshAuthorizationPolicyProtocol will fail with security enabled | Major | security | Boris Shkolnik | Boris Shkolnik | | | specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in DFSAdmin (for HADOOP-6612) | Major | security | Boris Shkolnik | Boris Shkolnik | | | FSImage writing should always fsync before close | Critical | namenode | Todd Lipcon | Todd Lipcon | | | security audit log shouldn't have exception in it. | Major | . | Boris Shkolnik | Boris Shkolnik | | |

and close() can be removed | Major | tasktracker | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | TestBadRecords failed once in our test runs | Major | test | Amareshwari Sriramadasu | Luke Lu | | | Edit log buffer should not grow unboundedly | Major | namenode | Hairong Kuang | Hairong Kuang | | | add isRunning() method to AbstractDelegationTokenSecretManager (for HDFS-1044) | Major | . | Boris Shkolnik | Boris Shkolnik | | | In nn\_browsedfscontent.jsp fetch delegation token only if security is enabled. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Rename the generated artifacts to common instead of core | Blocker | build | Owen O'Malley | Tom White | | | TestNetUtils fails on Mac OS X | Major | . | Luke Lu | Todd Lipcon | | | Update year to 2010. | Trivial | . | Ravi Phulari | Ravi Phulari | | | streaming doesn't support jobclient.output.filter | Major | contrib/streaming | Alok Singh | Amareshwari Sriramadasu | | | Service should be set in the token in JspHelper.getUGI | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | MRBench reuses jobConf and credentials there in. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | If #link is missing from uri format of -cacheArchive then streaming does not throw error. | Minor | contrib/streaming | Karam Singh | Amareshwari Sriramadasu | | | Incorrect default values for delegation tokens in hdfs-default.xml | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Javadoc for getDelegationTokenSecretManager in FSNamesystem | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Refresh for proxy superuser config (mr part for HDFS-1096) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Cluster class should create the rpc client only when needed | Major | client | Devaraj Das | Dick King | | | Log messages of JobACLsManager should use security logging of HADOOP-6586 | Major | security | Vinod Kumar Vavilapalli | Luke Lu | | | Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString() | Major | jobtracker | Rajesh Balamohan | Dick King | | | Resolving cross-realm principals | Major | namenode | Jitendra Nath Pandey | Jitendra Nath Pandey | | | NPE in PipeMapred.MRErrorThread | Major | contrib/streaming | Amareshwari Sriramadasu | Ravi Gummadi | | | NPE if renewer is passed as null in getDelegationToken | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | RPC server should check for version mismatch first | Major | ipc, security | Kan Zhang | Kan Zhang | | | NetUtils:normalizeHostName does not process hostnames starting with [a-f] correctly | Major | io | Jakob Homan | Jakob Homan | | | ShellBasedUnixGroupsMapping shouldn't have a cache | Major | . | Devaraj Das | Devaraj Das | | | MultipleOutputs does not cache TaskAttemptContext | Critical | task | Torsten Curdt | Torsten Curdt | | | completeFile does not check lease ownership | Blocker | namenode | Todd Lipcon | Todd Lipcon | | | TT successfully localizes a task even though the corresponding cache-file has already changed on

| Major | tasktracker | Vinod Kumar Vavilapalli | Zhong Wang | | | Update the DistCp forrest doc to make it consistent with the latest changes (5472, 5620, 5762, 5826) | Major | documentation | Rodrigo Schmidt | Rodrigo Schmidt | | | The DelegationTokenRenewal timer task should use the jobtracker's credentials to create the filesystem | Major | jobtracker | Devaraj Das | Devaraj Das | | | DFSOutputStream socket leak when cannot connect to DataNode | Major | . | Zheng Shao | Zheng Shao | | | "java.lang.ArithmeticException: Non-terminating decimal expansion; no exact representable decimal result." while running "hadoop jar hadoop-0.20.1+169.89-examples.jar pi 4 30" | Minor | examples | Victor Pakhomov | Tsz Wo Nicholas Sze | | | refreshSuperUserGroupsConfiguration should use server side configuration for the refresh | Major | . | Boris Shkolnik | Boris Shkolnik | | | browsedfs jsp should call JspHelper.getUGI rather than using createRemoteUser() | Major | security | Jakob Homan | Jakob Homan | | | in DelegationTokenFetch dfs.getURI returns no port | Major | . | Boris Shkolnik | Boris Shkolnik | | | Remove unused streaming configuration from src | Trivial | contrib/streaming | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | MRAsyncDiskService does not properly absolutize volume root paths | Major | . | Aaron Kimball | Aaron Kimball | | | [Rumen] Null failedMapAttemptCDFs in job traces generated by Rumen | Major | tools/rumen | Amar Kamat | Amar Kamat | | | Namenode accepts block report from dead datanodes | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | FairScheduler.tasksToPeempt() can return negative number | Major | contrib/fair-share | Scott Chen | Scott Chen | | | PipeMapRed.java has uninitialized members log\_ and LOGNAME | Major | contrib/streaming | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | When NameNode is shutdown it tries to exit safemode | Major | namenode | dhruba borthakur | dhruba borthakur | | | Clean up and add documentation for configuration keys in CommonConfigurationKeys.java | Major | fs | Erik Steffl | Erik Steffl | | | normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Streaming overrides user given output key and value types. | Major | contrib/streaming | Amareshwari Sriramadasu | Ravi Gummadi | | | Duplicate Mapper input when using StreamXmlRecordReader | Major | contrib/streaming | David Campbell | Ravi Gummadi | | | DistributedRaidFileSystem.readFully() does not return | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | DataBlockScanner throws NPE when updated before initialized | Major | datanode | Todd Lipcon | Todd Lipcon | | | Clearing namespace quota on "/" corrupts FS image | Blocker | namenode | Aaron T. Myers | Aaron T. Myers | | | ant eclipse-files has drifted again | Major | build | Jakob Homan | Jakob Homan | | | InputSampler does not create a deep copy of the key object when creating a sample, which causes problems with some formats like SequenceFile\<Text,Text\> | Major | . | Alex Kozlov | Alex Kozlov | | | Common component of HDFS-1045 | Major | . | Jakob Homan | Jakob Homan | | | getImage/putImage http requests should be https for the case of security enabled. | Major | . | Boris Shkolnik | Boris Shkolnik | | | In secure clusters, re-login is necessary for https clients before opening connections | Major | security | Jakob Homan | Jakob Homan | | | TokenStorage should not be static | Major |

| Owen O'Malley | Jitendra Nath Pandey | | | Datanode secure mode is broken | Major | datanode | Kan Zhang | Kan Zhang | | | Credentials should ignore null tokens | Major | security | Owen O'Malley | Devaraj Das | | | HFTP needs to be updated to use delegation tokens | Major | security | Devaraj Das | Devaraj Das | | | [Rumen] Rumen should also support jobhistory files generated using trunk | Major | tools/rumen | Amar Kamat | Amar Kamat | | | Streaming's TextOutputReader.getLastOutput throws NPE if it has never read any output | Major | contrib/streaming | Todd Lipcon | Amareshwari Sriramadasu | | | TFile.append compares initial key against null lastKey | Major | io | Ahad Rana | Hong Tang | | | UserGroupInformation doesn't support use in hash tables | Major | security | Owen O'Malley | Owen O'Malley | | | Fix errors in -info option in streaming | Major | contrib/streaming | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Hadoop streaming doc should not use IdentityMapper as an example | Minor | contrib/streaming, documentation | Marco Nicosia | Amareshwari Sriramadasu | | | hftp read failing silently | Major | datanode | Koji Noguchi | Tsz Wo Nicholas Sze | | | FileUtil.fullyDelete(dir) behavior is not defined when we pass a symlink as the argument | Major | fs | Amareshwari Sriramadasu | Ravi Gummadi | | | Need to add a mechanism to import tokens and secrets into a submitted job. | Major | security | Owen O'Malley | Jitendra Nath Pandey | | | TestRumenJobTraces fails in trunk | Major | tools/rumen | Amareshwari Sriramadasu | Ravi Gummadi | | | job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem (part of MR-1718) | Major | . | Boris Shkolnik | Boris Shkolnik | | | job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem | Major | . | Boris Shkolnik | Boris Shkolnik | | | AccessControlException while renewing a delegation token in not correctly handled in the JobTracker | Major | jobtracker | Devaraj Das | Boris Shkolnik | | | Security framework needs to renew Kerberos tickets while the process is running | Major | . | Owen O'Malley | Devaraj Das | | | Cannot submit mapreduce job from secure client to unsecure sever | Major | . | Boris Shkolnik | Boris Shkolnik | | | Being able to close all cached FileSystem objects for a given UGI | Major | fs, security | Kan Zhang | Kan Zhang | | | HDFSProxy needs additional changes to work after changes to streamFile servlet in HDFS-1109 | Major | contrib/hdfsproxy | Rohini Palaniswamy | Rohini Palaniswamy | | | using delegation token over hftp for long running clients (part of hdfs 1296) | Major | . | Boris Shkolnik | Boris Shkolnik | | | ClassNotFoundException for custom format classes provided in libjars | Minor | contrib/streaming, test | Paul Burkhardt | Paul Burkhardt | | | DistributedCache localizes only once per cache URI | Critical | distributed-cache, security, tasktracker | Devaraj Das | Devaraj Das | | | sed in build.xml fails | Minor |

| Allen Wittenauer | Allen Wittenauer | | | Relogin behavior for RPC clients could be improved | Major | security | Devaraj Das | Devaraj Das | | | [Rumen] TraceBuilder's output shows jobname as NULL for jobhistory files with valid jobnames | Major | tools/rumen | Amar Kamat | Ravi Gummadi | | | TestSimulatorDeterministicReplay timesout on trunk | Major | contrib/mumak | Amareshwari Sriramadasu | Hong Tang | | | using delegation token over hftp for long running clients (spawn from hdfs-1007). | Major | . | Boris Shkolnik | Boris Shkolnik | | | using delegation token over hftp for long running clients (part of hdfs 1296) | Major | . | Boris Shkolnik | Boris Shkolnik | | | TestTrackerDistributedCacheManagerWithLinuxTaskController fails on trunk | Major | . | Devaraj Das | Devaraj Das | | | MapReduce daemons should close FileSystems that are not needed anymore | Major | jobtracker, tasktracker | Devaraj Das | Kan Zhang | | | Pass Administrator acl to HTTPServer for common servlet access. | Major | security | Amareshwari Sriramadasu | Devaraj Das | | | ClientProtocol incorrectly uses hdfs DelegationTokenSelector | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | open in HftpFileSystem does not add delegation tokens to the url. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | FileSystem#listLocatedStatus should not throw generic RuntimeException to indicate error conditions | Major | . | Suresh Srinivas | Hairong Kuang | | | AccessControlList.toString() returns empty string when we set acl to "\*" | Major | security, util | Ravi Gummadi | Ravi Gummadi | | | AccessControlList.toString() is used for serialization of ACL in JobStatus.java | Major | jobtracker | Ravi Gummadi | Ravi Gummadi | | | [gridmix3] ConcurrentModificationException when shutting down Gridmix | Major | contrib/gridmix | Hong Tang | Hong Tang | | | Rumen is not able to extract counters for Job history logs from Hadoop 0.20 | Major | tools/rumen | Hong Tang | Hong Tang | | | NPE in JobTracker's constructor | Major | jobtracker | Ravi Gummadi | Kan Zhang | | | TestHDFSProxy need to use server side conf for ProxyUser stuff. | Major | . | Boris Shkolnik | Boris Shkolnik | | | A null delegation token is appended to the url if security is disabled when browsing filesystem. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Fix java doc warnings in Groups and RefreshUserMappingsProtocol | Major | security | Eli Collins | Eli Collins | | | GenericOptionsParser constructor that takes Options and String[] ignores options | Minor | util | Chris Wilkes | Eli Collins | | | TestDelegationToken uses mortbay.log for logging | Major | test | Boris Shkolnik | Boris Shkolnik | | | FileContext copy() utility doesn't work with recursive copying of directories. | Major | fs | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Modifications introduced by HDFS-1150 are breaking aspect's bindings | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | trunk build broken | Blocker | test | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Remove empty java files | Major | . | Tom White | Eli Collins | | | BZip2Codec incorrectly implements read() | Critical | io | Todd Lipcon | Todd Lipcon | | | Fix jsvc.location | Major | build | Eli Collins | Eli Collins | | | IPC leaks call parameters when exceptions thrown | Blocker |

| Todd Lipcon | Todd Lipcon | | | RAID should avoid policies that scan their own destination path | Major | contrib/raid | Rodrigo Schmidt | Ramkumar Vadali | | | RaidNode should only Har a directory if all its parity files have been created | Major | contrib/raid | Rodrigo Schmidt | Ramkumar Vadali | | | Namenode start (init) fails because of invalid kerberos key, even when security set to "simple" | Major | . | Boris Shkolnik | Boris Shkolnik | | | Circular initialization between UserGroupInformation and KerberosName | Major | security | Kan Zhang | Kan Zhang | | | Rpc client doesn't use the per-connection conf to figure out server's Kerberos principal | Major | ipc, security | Kan Zhang | Kan Zhang | | | CombineFileInputFormat returns duplicate hostnames in split locations | Major | client | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | TestFileArgs fails intermittently | Major | contrib/streaming, test | Amar Kamat | Todd Lipcon | | | TestDFSIO read test may not read specified bytes. | Major | benchmarks | Hong Tang | Hong Tang | | | TestBlockToken fails | Major | test | Konstantin Shvachko | Kan Zhang | | | ConnectionId.getRemotePrincipal() should check if security is enabled | Major | ipc, security | Kan Zhang | Kan Zhang | | | ant veryclean (clean-cache) doesn't clean enough | Major | build | Luke Lu | Luke Lu | | | TestTaskLauncher and TestTaskTrackerLocalization fail with NPE in trunk. | Major | tasktracker, test | Amareshwari Sriramadasu | Ravi Gummadi | | | gridmix shows unnecessary InterruptedException | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | combinefileinputformat does not work with non-splittable files | Major | . | Namit Jain | Amareshwari Sriramadasu | | | hdfsJniHelper.c: #include \<error.h\> is not portable | Major | . | Allen Wittenauer | Allen Wittenauer | | | AvroRpcEngine doesn't work with generated Avro code | Major | ipc | Sharad Agarwal | Sharad Agarwal | | | Add -fileStatus operation to NNThroughputBenchmark | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | TestJobOutputCommitter fails in ant test run | Major | task | Amareshwari Sriramadasu | Dick King | | | RawLocalFileSystem's markSupported method misnamed markSupport | Minor | fs | Tom White | Tom White | | | HFTP traffic served by DataNode shouldn't use service port on NameNode | Major | datanode, security | Kan Zhang | Kan Zhang | | | "Output directory already exists" error in gridmix when gridmix.output.directory is not defined | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | COMMON part of MAPREDUCE-1664 | Major | documentation, security | Ravi Gummadi | Ravi Gummadi | | | TraceBuilder unable to generate the traces while giving the job history path by globing. | Major | tools/rumen | Vinay Kumar Thota | Amar Kamat | | | Eclipse Plugin does not work with Eclipse Ganymede (3.4) | Major | . | Aaron Kimball | Alex Kozlov | | | HDFS does not support blocks greater than 2GB | Major | . | dhruba borthakur | Patrick Kling | | | Gridmix3 doesn't emit out proper mesage when user resolver is set and no user list is given | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | Method in UGI to get Kerberos ticket. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | HFTP client should support relogin from keytab | Major | security | Kan Zhang | Jitendra Nath Pandey | | | Distinct minicluster services

NN and JT) overwrite each other's service policies | Major | security | Aaron T. Myers | Aaron T. Myers | | | Distinct minicluster services (e.g. NN and JT) overwrite each other's service policies | Major | security | Aaron T. Myers | Aaron T. Myers | | | Distinct minicluster services (e.g. NN and JT) overwrite each other's service policies | Major | security | Aaron T. Myers | Aaron T. Myers | | | DistributedRaidFileSystem not removed from cache on close() | Major | contrib/raid | Paul Yang | Ramkumar Vadali | | | Fix test failures - TestPread and TestFileLimit | Major | test | Suresh Srinivas | Suresh Srinivas | | | Race condition in writing the jobtoken password file when launching pipes jobs | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | TestSetFile is failing on trunk | Major | . | Jakob Homan | Chris Douglas | | | TestComputeInvalidateWork fails intermittently | Major | test | Suresh Srinivas | Suresh Srinivas | | | NPE from SequenceFile::Writer.CompressionCodecOption | Minor | io | Chris Douglas | Chris Douglas | | | Broken link on cluster setup page of docs | Major | documentation | Aaron T. Myers | Eli Collins | | | TestListFiles is flaky | Minor | test | Todd Lipcon | Todd Lipcon | | | refreshSuperUserGroupsConfiguration should use server side configuration for the refresh (for HADOOP-6815) | Major | . | Boris Shkolnik | Boris Shkolnik | | | Gridmix unable to run for compressed traces(.gz format). | Major | contrib/gridmix | Vinay Kumar Thota | Ranjit Mathew | | | DistributedRaidFileSystem does not handle ChecksumException correctly | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | HarFileSystem is not able to handle spaces in its path | Major | harchive | Ramkumar Vadali | Ramkumar Vadali | | | Kerberos relogin should set refreshKrb5Config to true | Major | security | Todd Lipcon | Todd Lipcon | | | IPC doesn't properly handle IOEs thrown by socket factory | Major | ipc | Todd Lipcon | Todd Lipcon | | | Remove unused methods in org.apache.hadoop.streaming.StreamUtil | Minor | contrib/streaming | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | hadoop fs -getmerge does not work using codebase from trunk. | Major | fs | Chris Nauroth | Chris Nauroth | | | Raid should not affect access time of a source file | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file | Major | io | Kang Xiao | Kang Xiao | | | SequenceFile::Reader discards length for files, does not call openFile | Minor | . | Chris Douglas | Chris Douglas | | | RaidNode should recreate outdated parity HARs | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | KerberosName.main(...) throws NPE | Major | . | Aaron T. Myers | Aaron T. Myers | | | integer overflow in S3InputStream for blocks \> 2GB | Major | . | Patrick Kling | Patrick Kling | | | MapFile.fix does not allow index interval definition | Major |

| Gianmarco De Francisci Morales | Gianmarco De Francisci Morales | | | SocketInputStream incorrectly implements read() | Minor | io | Todd Lipcon | Todd Lipcon | | | Race condition in TestBlockFixer causes intermittent failure | Major | . | Patrick Kling | Patrick Kling | | | RaidBlockSender.java compilation fails | Blocker | contrib/raid | Giridharan Kesavan | Ramkumar Vadali | | | TestHdfsProxy is failing | Major | contrib/hdfsproxy | Eli Collins | Todd Lipcon | | | RawLocalFileSystem#setWorkingDir() does not work for relative names | Major | fs | Sanjay Radia | Sanjay Radia | | | bug setting block size hdfsOpenFile | Blocker | libhdfs | Eli Collins | Eli Collins | | | FSDirectory#unprotectedConcat calls setModificationTime on a file | Minor | namenode | Eli Collins | Eli Collins | | | TestFcHdfsSymlink relies on /tmp/test not existing | Minor | test | Todd Lipcon | Eli Collins | | | IFile should check for null compressor | Minor | . | Eli Collins | Eli Collins | | | TestOfflineImageViewer failing on trunk | Major | test, tools | Todd Lipcon | Todd Lipcon | | | TestHDFSFileContextMainOperations fails on weirdly configured DNS hosts | Major | hdfs-client, test | Todd Lipcon | Todd Lipcon | | | ant eclipse does not include requisite ant.jar in the classpath | Minor | build | Patrick Angeles | Patrick Angeles | | | DFSClient.getBlockLocations returns BlockLocations with no indication that the corresponding blocks are corrupt | Major | hdfs-client | Patrick Kling | Patrick Kling | | | TestAbandonBlock should abandon a block | Minor | test | Eli Collins | Eli Collins | | | FSDirectory.removeBlock() should update diskspace count of the block owner node | Major | namenode | Zhong Wang | Zhong Wang | | | DataXceiver and BlockReader disagree on when to send/recv CHECKSUM\_OK | Minor | datanode | bc Wong | bc Wong | | | New property for local conf directory in system-test-mapreduce.xml file. | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | Append pipeline never succeeds with more than one replica | Blocker | datanode | Todd Lipcon | Todd Lipcon | | | TestUmbilicalProtocolWithJobToken is failing without Krb evironment: needs to be conditional | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | misspelling of threshold in conf/log4j.properties | Major | conf | Jingguo Yao | Jingguo Yao | | | wrong FSNamesystem Audit logging setting in conf/log4j.properties | Minor | conf | Jingguo Yao | Jingguo Yao | | | TestSaveNamespace fails | Minor | test | Eli Collins | Todd Lipcon | | | IOUtils.readFully and IOUtils.skipFully have typo in exception creation's message | Minor | util | Konstantin Boudnik | Konstantin Boudnik | | | Image loader should make sure to read every byte in image file | Blocker | namenode | Hairong Kuang | Hairong Kuang | | | TestLargeBlock is failing on trunk | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | TestBlockRecovery triggers NPE in assert | Minor | . | Eli Collins | Hairong Kuang | | | Exclude Findbugs warning in FSImageFormat$Saver | Major | test | Todd Lipcon | Todd Lipcon | | |

fails for blocks \>= 2GB on 32 bit JVM | Major | datanode | Patrick Kling | Patrick Kling | | | Clean up stack traces due to duplicate MXBean registration | Trivial | datanode, namenode | Todd Lipcon | Todd Lipcon | | | TestBalancer and TestBlockTokenWithDFS fail Balancer assert | Major | test | Konstantin Shvachko | Todd Lipcon | | | Quota bug for partial blocks allows quotas to be violated | Blocker | namenode | Eli Collins | Eli Collins | | | saveVersion script includes an additional \\r while running whoami under windows | Minor | build | Wang Xu | Wang Xu | | | TestFiHFlush fails intermittently | Major | test | Tsz Wo Nicholas Sze | Konstantin Boudnik | | | 98 Release Audit warnings on trunk and branch-0.22 | Blocker | . | Nigel Daley | Jakob Homan | | | Synchronization bugs in JvmManager | Critical | tasktracker | Todd Lipcon | Todd Lipcon | | | JobConf.findContainingJar unescapes unnecessarily on Linux | Major | . | Todd Lipcon | Todd Lipcon | | | NPE when listing a file with no location | Blocker | hdfs-client | Hairong Kuang | Hairong Kuang | | | Configuration.writeXML should not hold lock while outputting | Critical | conf | Todd Lipcon | Todd Lipcon | | | JAAS configuration should delegate unknown application names to pre-existing configuration | Critical | security | Todd Lipcon | Todd Lipcon | | | Secure local filesystem IO from symlink vulnerabilities | Blocker | jobtracker, security, tasktracker | Todd Lipcon | Todd Lipcon | | | Deadlock in Configuration.writeXml when serialized form is larger than one DFS block | Critical | hdfs-client | Todd Lipcon | Todd Lipcon | | | JT should not try to remove mapred.system.dir during startup | Major | jobtracker | Todd Lipcon | Todd Lipcon | | | FSImageSaver should catch all exceptions, not just IOE | Minor | namenode | Todd Lipcon | Todd Lipcon | | | reloginFromKeytab() should happen even if TGT can't be found | Major | security | Kan Zhang | Kan Zhang | | | Deprecated org.apache.hadoop.util package in MapReduce produces deprecations in Common classes in Eclipse | Blocker | documentation | Tom White | Tom White | | | SequenceFile.createWriter ignores FileSystem parameter | Blocker | io | Todd Lipcon | Todd Lipcon | | | Build broken by HADOOP-6811 | Blocker | build, contrib/cloud | Todd Lipcon | Todd Lipcon | | | java.library.path missing basedir | Blocker | build, native | Noah Watkins | Noah Watkins | | | Remove "fs.ramfs.impl" field from core-deafult.xml | Major | conf | Konstantin Shvachko | Konstantin Shvachko | | | Servlets should default to text/plain | Major | io | Todd Lipcon | Todd Lipcon | | | Fix link resolution logic in hadoop-config.sh | Minor | scripts | Eli Collins | Eli Collins | | | Remove unnecessary DNS reverse lookups from RPC layer | Major | ipc, security | Kan Zhang | Kan Zhang | | | Checkpointer should trigger checkpoint with specified period. | Blocker | . | Liyin Liang | Jakob Homan | | | For tasks, "ulimit -v -1" is being run when user doesn't specify mapred.child.ulimit | Minor | tasktracker | Ravi Gummadi | Todd Lipcon | | | BackupNode listens on default host | Blocker | namenode | Konstantin Shvachko | Konstantin Shvachko | | | MapReduce tests don't compile following HDFS-1561 | Blocker | test | Tom White | Konstantin Shvachko | | | 1 Findbugs warning on trunk and

| Blocker | security | Nigel Daley | Po Cheung | | | Undeletable build directories | Critical | build, test | Eli Collins | Todd Lipcon | | | TestCapacitySchedulerWithJobTracker fails sometimes | Minor | capacity-sched | Todd Lipcon | Todd Lipcon | | | NPE in Configuration.writeXml | Blocker | . | Todd Lipcon | Todd Lipcon | | | Servlets should specify content type | Critical | . | Todd Lipcon | Todd Lipcon | | | 200 new Findbugs warnings | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | TestBlockFixer hangs initializing MiniMRCluster | Blocker | contrib/raid | Nigel Daley | Ramkumar Vadali | | | Timed out shell commands leak Timer threads | Critical | util | Todd Lipcon | Todd Lipcon | | | ListPathsServlet excludes .\*.crc files | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Replace mapred.persmissions.supergroup with an acl : mapreduce.cluster.administrators | Major | jobtracker | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | fs.inmemory.size.mb not listed in conf. Cluster setup page gives wrong advice. | Major | documentation | Edward Capriolo | Chris Douglas | | | FairScheduler fairshare preemption from multiple pools may preempt all tasks from one pool causing that pool to go below fairshare. | Major | contrib/fair-share | Priyo Mustafi | Priyo Mustafi | | | TestDFSShell fails in trunk | Major | . | Po Cheung | Po Cheung | | | Fix javac, javadoc, findbugs warnings | Major | . | Po Cheung | Po Cheung | | | Fix javac, javadoc, findbugs warnings | Major | . | Po Cheung | Po Cheung | | | Fix javac, javadoc, findbugs warnings | Major | . | Arun C Murthy | Po Cheung | | | Name clash in the deprecated o.a.h.util.MemoryCalculatorPlugin | Major | . | Luke Lu | Luke Lu | | | The new API MultithreadedMapper doesn't call the initialize method of the RecordReader | Major | . | Owen O'Malley | Owen O'Malley | | | Corrupt replicas are not tracked correctly through block report from DN | Blocker | . | Todd Lipcon | Konstantin Shvachko | | | Incorrect handling of interrupts in waitForAckedSeqno can cause deadlock | Blocker | hdfs-client | Todd Lipcon | Todd Lipcon | | | IndexCache - getIndexInformation - check reduce index Out Of Bounds | Trivial | tasktracker | Rares Vernica | Priyo Mustafi | | | FairScheduler can preempt the same task many times | Major | contrib/fair-share | Scott Chen | Scott Chen | | | TestMRCLI fails when hostname has a hyphen (-) | Minor | test | Priyo Mustafi | Priyo Mustafi | | | jobqueue\_details.jsp and FairSchedulerServelet should not call finishedMaps and finishedReduces when job is not initialized | Major | jobtracker | Amareshwari Sriramadasu | Scott Chen | | | MiniMRCluster does not start after ant test-patch | Blocker | test | Ramkumar Vadali | Todd Lipcon | | | Batched edit log syncs can reset synctxid throw assertions | Blocker | . | Todd Lipcon | Todd Lipcon | | | TestFairScheduler failing on trunk | Blocker | contrib/fair-share | Todd Lipcon | Scott Chen | | | javadoc is failing in nightly | Blocker | . | Todd Lipcon | Todd Lipcon | | | NameNode storage failed replica restoration is broken | Major | namenode | Konstantin Boudnik | Boris Shkolnik | | | IPC Reader threads do not stop when server stops | Critical | . | Todd Lipcon | Todd Lipcon | | |

got lost during project split | Blocker | build | Todd Lipcon | Konstantin Boudnik | | | Configuration.getLocalPath should trim whitespace from the provided directories | Major | . | Todd Lipcon | Todd Lipcon | | | SecurityAuth.audit should be generated under /build | Major | build | Konstantin Shvachko | Boris Shkolnik | | | HDFS Design Documentation is outdated | Minor | documentation | Joe Crobak | Joe Crobak | | | Hierarchical queue implementation broke dynamic queue addition in Dynamic Scheduler | Major | contrib/dynamic-scheduler | Thomas Sandholm | Thomas Sandholm | | | API: Reducer.reduce() method detail misstatement | Trivial | documentation | Glynn Durham | Harsh J | | | TestDataNodeMXBean fails if disk space usage changes during test run | Minor | test | Todd Lipcon | Tsz Wo Nicholas Sze | | | FsShell: call srcFs.listStatus(src) twice | Minor | fs | Alexey Diomin | Alexey Diomin | | | Job ACL file should not be executable | Trivial | tasktracker | Todd Lipcon | Harsh J | | | Remove mapreduce.job.userhistorylocation config | Major | . | Todd Lipcon | Harsh J | | | Balancer sleeps inadequately | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | TestLocalRunner.testMultiMaps times out | Critical | test | Todd Lipcon | Todd Lipcon | | | SecondaryNameNode.checkpointSize is in byte but not MB. | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Tool-related packages should be in the Tool javadoc group | Major | documentation | Tom White | Tom White | | | getpwuid\_r is not thread-safe on RHEL6 | Critical | . | Todd Lipcon | Todd Lipcon | | | JUnit output format doesn't propagate into some contrib builds | Blocker | . | Todd Lipcon | Todd Lipcon | | | TaskTracker shutdown in the tests sometimes take 60s | Major | . | Tom White | Tom White | | | fs -ls hftp://file not working | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | null is displayed in the console,if the src path is invalid while doing copyToLocal operation from commandLine | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Socket Leak in org.apache.hadoop.metrics.ganglia.GangliaContext | Major | metrics | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Potential Resource leak in IOUtils.java | Major | io | Devaraj K | Devaraj K | | | jsvc executable delivered into wrong package... | Major | scripts | John George | John George | | | FSNamesystem.startFileInternal(..) throws NullPointerException | Major | namenode | John George | John George | | | Quota counts missed between clear quota and set quota | Major | namenode | Kang Xiao | John George | | | FileSystem.copyToLocal creates files with 777 permissions | Blocker | fs, security | Todd Lipcon | Aaron T. Myers | | | SLive should process only part\* files while generating the report. | Blocker | test | Konstantin Shvachko | Konstantin Shvachko | | | FileContext.createSymlink with kerberos enabled sets wrong owner | Major | . | John George | John George | | | TestBlockReport.blockReport\08() and \09() are timing-dependent and likely to fail on fast servers | Major | datanode, namenode | Matt Foley | Matt Foley | | | symlink comes up as directory after namenode restart | Major |

| John George | John George | | | SecureIO should not check owner on non-secure clusters that have no native support | Critical | io, security | Todd Lipcon | Todd Lipcon | | | HadoopArchives throwing NullPointerException while creating hadoop archives (.har files) | Minor | harchive | Devaraj K | Devaraj K | | | NoSuchMethodError: org.apache.hadoop.hdfs.TestDatanodeBlockScanner.corruptReplica(..) | Minor | contrib/raid, test | Tsz Wo Nicholas Sze | Eli Collins | | | start-dfs.sh script fails if HADOOP\_HOME is not set | Blocker | scripts | Tom White | Tom White | | | start-mapred.sh script fails if HADOOP\_HOME is not set | Blocker | . | Tom White | Tom White | | | Editlog opcodes overlap between 20 security and later releases | Blocker | namenode | Suresh Srinivas | Suresh Srinivas | | | TestMiniMRWithDFSWithDistinctUsers is very broken | Major | security, test | Todd Lipcon | Todd Lipcon | | | Remove deprecated local.cache.size from core-default.xml | Major | documentation, filecache | Todd Lipcon | Todd Lipcon | | | job submission should inject group.name (on the JT side) | Critical | jobtracker | Alejandro Abdelnur | Alejandro Abdelnur | | | DN should transmit absolute failed volume count rather than increments to the NN | Major | datanode, namenode | Eli Collins | Eli Collins | | | Extra whitespace in mapred.child.java.opts breaks JVM initialization | Major | task-controller | Todd Lipcon | Aaron T. Myers | | | FsConfig should use constants in CommonConfigurationKeys | Major | . | Tom White | Tom White | | | Documentation change for updated configuration keys. | Blocker | . | Jitendra Nath Pandey | Tom White | | | WritableComparator.get should not cache comparator objects | Blocker | . | Todd Lipcon | Tom White | | | TestBackupNode fails intermittently | Major | test | Suresh Srinivas | Suresh Srinivas | | | TestHDFSCLI fails due to typo in expected output | Major | . | Tom White | Tom White | | | Ivy resolve force mode should be turned off by default | Major | . | Luke Lu | Luke Lu | | | Ivy resolve force mode should be turned off by default | Major | . | Luke Lu | Luke Lu | | | Ivy resolve force mode should be turned off by default | Major | . | Luke Lu | Luke Lu | | | seek() on closed DFS input stream throws NPE | Major | . | Todd Lipcon | Scott Carey | | | Documention refers to removed option dfs.network.script | Minor | documentation | Ari Rabkin | Andrew Whang | | | 0.22 - snapshot incorrect dependency published in .pom files | Blocker | . | Dmitriy V. Ryaboy | Todd Lipcon | | | Documentation for config to set map/reduce task environment | Major | documentation, task | Arun C Murthy | Alejandro Abdelnur | | | Fix references to hadoop-common-${version} in build.xml | Major | . | Todd Lipcon | Jolly Chen | | | MapTask doesn't need to put username information in SpillRecord | Blocker | . | Todd Lipcon | Todd Lipcon | | | The FsPermission(FsPermission) constructor does not use the sticky bit | Minor | fs | Siddharth Seth | Siddharth Seth | | | saveNamespace appears to succeed even if all directories fail to save | Blocker |

| Todd Lipcon | Aaron T. Myers | | | Configuration methods that return collections are inconsistent about mutability | Major | conf | Todd Lipcon | Todd Lipcon | | | SafeModeInfo should use DFS\NAMENODE\SAFEMODE\THRESHOLD\PCT\_DEFAULT instead of 0.95 | Major | . | Konstantin Shvachko | Joey Echeverria | | | MapReduce references obsolete options | Major | jobtracker | Ari Rabkin | Ari Rabkin | | | viewing block from web UI broken | Blocker | . | Todd Lipcon | Aaron T. Myers | | | webinterface.private.actions should not be in common | Major | documentation | Ari Rabkin | Ari Rabkin | | | option to control sensitive web actions | Minor | . | Ari Rabkin | Ari Rabkin | | | Ensure that HDFS configuration deprecations are set up in every spot that HDFS configurations are loaded. | Critical | . | Todd Lipcon | Jolly Chen | | | Save namespace can cause NN to be unable to come up on restart | Blocker | . | Aaron T. Myers | Matt Foley | | | MD5Hash factory should reset the digester it returns | Critical | io | Todd Lipcon | Todd Lipcon | | | All but first option in LIBHDFS\_OPTS is ignored | Major | libhdfs | Brock Noland | Eli Collins | | | Configuration deprecation mechanism doesn't work properly for GenericOptionsParser/Tools | Blocker | conf | Todd Lipcon | Aaron T. Myers | | | IPCs done using block token-based tickets can't reuse connections | Critical | security | Todd Lipcon | Todd Lipcon | | | Incorrect HTML unescaping in DatanodeJspHelper.java | Major | . | Aaron T. Myers | Aaron T. Myers | | | RPC server leaks file descriptors | Major | . | Todd Lipcon | Todd Lipcon | | | Missing deprecation for io.bytes.per.checksum | Major | . | Aaron T. Myers | Aaron T. Myers | | | core-default.xml lists configuration version as 0.21 | Minor | conf | Todd Lipcon | Harsh J | | | DataNode.createInterDataNodeProtocolProxy() guards a log at the wrong level | Trivial | datanode | Steve Loughran | Harsh J | | | Exceptions while serializing IPC call response are not handled well | Critical | ipc | Todd Lipcon | Todd Lipcon | | | Updating the layout version from HDFS-1822 causes upgrade problems. | Blocker | namenode | Suresh Srinivas | Suresh Srinivas | | | Regression: HttpServer#getWebAppsPath used to be protected so subclasses could supply alternate webapps path but it was made private by HADOOP-6461 | Major | . | stack | stack | | | HADOOP-7121 accidentally disabled some tests | Major | ipc, test | Todd Lipcon | Todd Lipcon | | | Running rollback on new-version namenode destroys namespace | Blocker | namenode | Todd Lipcon | Todd Lipcon | | | ChainReducer uses MAPPER\BY\VALUE instead of REDUCER\BY\VALUE | Minor | . | Forrest Vines | Devaraj K | | | CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException | Blocker |

| Bochun Bai | Bochun Bai | | | Some cli test cases expect a "null" message | Minor | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | The "register" method of the BackupNode class should be "UnsupportedActionException("register")" | Trivial | namenode | Ching-Shen Chen | Ching-Shen Chen | | | saveNamespace race can corrupt the edits log | Blocker | namenode | dhruba borthakur | Eli Collins | | | Use of isConnected() in DataXceiver is invalid | Minor | datanode | Kihwal Lee | Kihwal Lee | | | VersionInfo not generated properly in git after unsplit | Minor | build | Thomas Graves | Todd Lipcon | | | FSEditLog.open() appears to succeed even if all EDITS directories fail | Major | . | Matt Foley | Andrew | | | JUnit shows up as a compile time dependency | Minor | build, conf, test | Pony | Harsh J | | | When namenode goes down while checkpointing and if is started again subsequent Checkpointing is always failing | Blocker | namenode | ramkrishna.s.vasudevan | Uma Maheswara Rao G | | | mapreduce trunk builds are failing on hudson | Major | build, pipes | Giridharan Kesavan | Bruno Mah | | | Build does not pass along properties to contrib builds | Blocker | build | Joep Rottinghuis | Joep Rottinghuis | | | mvn-deploy target fails | Major | build | Joep Rottinghuis | Joep Rottinghuis | | | Build fails with ClassCastException when running both mvn-install and mvn-deploy targets | Minor | build | Joep Rottinghuis | Joep Rottinghuis | | | Generated POMs hardcode dependency on hadoop-common version 0.22.0-SNAPSHOT | Major | build | Joep Rottinghuis | Joep Rottinghuis | | | Build does not pass along properties to contrib builds | Minor | build | Joep Rottinghuis | Joep Rottinghuis | | | Generated POMs hardcode dependency on hadoop-common version 0.22.0-SNAPSHOT | Major | build | Joep Rottinghuis | Joep Rottinghuis | | | TT does not start due to backwards compatibility wrt. EventCounter | Minor | metrics | Joep Rottinghuis | Joep Rottinghuis | | | FindBugs OutOfMemoryError | Blocker | build | Joep Rottinghuis | Joep Rottinghuis | | | TestLeaseRecovery2 fails as lease hard limit is not reset to default | Major | namenode, test | Konstantin Shvachko | Konstantin Shvachko | | | Remove Linux task-controller from 0.22 branch | Blocker | security | Milind Bhandarkar | Milind Bhandarkar | | | guava-r09 dependency missing from "ivy/hadoop-hdfs-template.xml" in HDFS. | Blocker | . | Plamen Jeliazkov | Joep Rottinghuis | | | Build fails with ant 1.7.0 but works with 1.8.0 | Blocker | build | Joep Rottinghuis | Joep Rottinghuis | | | NPE in checkpoint during processIOError() | Major | namenode | Konstantin Shvachko | Uma Maheswara Rao G | | | BackupNode fails with MD5 checksum Exception during checkpoint if BN's image is outdated. | Major | namenode | Konstantin Shvachko | Konstantin Shvachko | | | Hadoop streaming test failure, post MR-2767 | Major | contrib/streaming | Milind Bhandarkar | Mahadev konar | | | TestHDFSCLI fails on 0.22 branch | Blocker | test | Konstantin Shvachko | Plamen Jeliazkov | | | Build fails with ant 1.7.0 but works with 1.8.0 | Major | build | Joep Rottinghuis | Joep Rottinghuis | | | Contrib Raid compilation broken after HDFS-1620 | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | SequenceFile should not print into stdout | Major | io | Konstantin Shvachko | Plamen Jeliazkov | | | queueinfo.jsp fails to show queue status if any Capacity scheduler queue name has dash/hiphen in it. | Major | scheduler | Priyo Mustafi | Priyo Mustafi | | | startJournalSpool should invoke ProcessIOError with failed storage directories if createEditLogFile throws any

| Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Contribs not building | Blocker | build | Joep Rottinghuis | Joep Rottinghuis | | | Contribs not building | Blocker | build | Joep Rottinghuis | Joep Rottinghuis | | | Block with corrupt replica is not getting replicated | Major | namenode | Konstantin Shvachko | Benoy Antony | | | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal | | | When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer Exception | Major | jobtracker | Mayank Bansal | Mayank Bansal | | | Make hdfs use same version of avro as HBase | Blocker | hdfs-client | Joep Rottinghuis | Joep Rottinghuis | | | Make hadoop-common use same version of avro as HBase | Major | io, ipc | Joep Rottinghuis | Joep Rottinghuis | | | Make mapreduce use same version of avro as HBase | Major | capacity-sched, contrib/fair-share, contrib/gridmix, contrib/mrunit, contrib/mumak, contrib/raid, contrib/streaming, jobhistoryserver | Joep Rottinghuis | Joep Rottinghuis | | | Clover 2.4.3 breaks build for 0.22 branch | Major | build | Konstantin Shvachko | Konstantin Shvachko | | | Remove dependency on different version of slf4j in avro | Major | build | Konstantin Shvachko | Konstantin Shvachko | | | Remove dependency on different version of slf4j in avro | Major | build | Konstantin Shvachko | Konstantin Shvachko | | | TestDfsOverAvroRpc is failing on 0.22 | Blocker | test | Konstantin Shvachko | Konstantin Shvachko | | | JobSplitWriter.java can't handle large job.split file | Major | job submission | Ming Ma | Ming Ma | | | Allow for applications to deal with MAPREDUCE-954 | Blocker | client, mrv2 | Arun C Murthy | Owen O'Malley | | | org.apache.hadoop.mapred.jobcontrol.getAssignedJobID throw class cast exception | Blocker | client | Robert Joseph Evans | Robert Joseph Evans | | | Contrib tests failing | Major | contrib/vertica | Joep Rottinghuis | Joep Rottinghuis | | | Recurring failure of TestBalancer due to incorrect treatment of nodes whose utilization equals avgUtilization. | Blocker | balancer & mover, test | Aaron T. Myers | Uma Maheswara Rao G | | | OutOfMemoryError in DataXceiverServer takes down the DataNode | Major | datanode | Konstantin Shvachko | Uma Maheswara Rao G | | | TestBalancer can fail when datanode utilization and avgUtilization is exactly same. | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Incorrect computation of needed blocks in getTurnOffTip() | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov | | | SlivePartitioner generates negative partitions | Major | test | Konstantin Shvachko | Jakob Homan | | | Capacity Scheduler scheduling information is hard to read / should be tabular format | Major | capacity-sched | Allen Wittenauer | Krishna Ramachandran | | | fail to start datanode while start-dfs.sh is executed by root user | Blocker | scripts | Wei Yongjun | Matt Foley | | | TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods | Blocker | test | Uma Maheswara Rao G | Laxman | | | Bump jetty to

| Blocker | build | Jitendra Nath Pandey | Konstantin Boudnik | | | Few contrib tests are failing because of the missing commons-lang dependency | Major | capacity-sched, contrib/gridmix | Konstantin Boudnik | Konstantin Boudnik | | | TestFiDataXceiverServer is failing, not testing OOME | Major | datanode, test | Konstantin Shvachko | Konstantin Boudnik | | | Link resolution bug for intermediate symlinks with relative targets | Major | namenode | Eli Collins | Eli Collins | | | RecoveryManager attempts to add jobtracker.info | Major | jobtracker | Dan Adkins | Subroto Sanyal | | | TestParallelRead has a small off-by-one bug | Trivial | test | Todd Lipcon | Todd Lipcon | | | TestRaidNode fails because of "Too many open files" | Major | contrib/raid | Konstantin Shvachko | Ramkumar Vadali | | | HttpServer sends wrong content-type for CSS files (and others) | Minor | . | Lars Francke | Ivan Mitic | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Enable asserts for tests by default | Major | test | Eli Collins | Eli Collins | | | Refactor TestFileStatus | Minor | test | Eli Collins | Eli Collins | | | Add native gzip read/write coverage to TestCodec | Major | io | Eli Collins | Eli Collins | | | test for ByteWritable comparator | Major | record | Johannes Zillmann | Johannes Zillmann | | | TestFileConcurrentReader fails | Major | hdfs-client | Suresh Srinivas | sam rash | | | Contribute a fair scheduler preemption system test | Major | contrib/fair-share | Todd Lipcon | Todd Lipcon | | | TestSubmitJob triggers NPE instead of permissions error | Trivial | test | Todd Lipcon | Todd Lipcon | | | TestTrackerDistributedCacheManager should be up-front about requirements on build environment | Trivial | distributed-cache, test | Todd Lipcon | Todd Lipcon | | | Create a test method for adding file systems during tests. | Major | test | Kan Zhang | Kan Zhang | | | Java assertion failures triggered by tests | Major | test | Eli Collins | Eli Collins | | | Add TestPath tests to cover dot, dot dot, and slash normalization | Major | fs | Eli Collins | Eli Collins | | | Enable asserts for tests by default | Major | . | Eli Collins | Eli Collins | | | Add coverage of fair scheduler servlet to system test | Minor | contrib/fair-share | Todd Lipcon | Todd Lipcon | | | TestDelegationToken#testDelegationTokenWithRealUser is failing | Blocker | contrib/hdfsproxy, security | Eli Collins | Po Cheung | | | test-contrib fails due to test-cactus failure | Blocker | contrib/hdfsproxy | Eli Collins | Konstantin Boudnik | | | ClusterWithLinuxTaskController should accept relative path on the command line | Trivial | task-controller, test | Todd Lipcon | Todd Lipcon | | |

part 2 fails in two different ways | Major | test | Matt Foley | Matt Foley | | | Add rack policy tests | Major | namenode, test | Eli Collins | Eli Collins | | | Add test utility for writing multi-threaded tests | Major | test | Todd Lipcon | Todd Lipcon | | | Allow TestHDFSCLI to be run against a cluster | Major | build, test | Tom White | Konstantin Boudnik | | | Allow TestMRCLI to be run against a cluster | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | Add more symlink tests that cover intermediate links | Major | fs | Eli Collins | Eli Collins | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Cleanup of task-logs should happen in TaskTracker instead of the Child | Major | security, tasktracker | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu | | | Refactor BlocksMap with GettableSet | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Concurrent readers hit ChecksumExceptions if following a writer to very end of file | Blocker | datanode | Todd Lipcon | sam rash | | | Fix location of re-login for secondary namenode from HDFS-999 | Major | namenode | Jakob Homan | Jakob Homan | | | Reed-Solomon code implementation to be used in raid | Major | contrib/raid | Scott Chen | Scott Chen | | | Refactor edit log loading to a separate class from edit log writing | Major | namenode | Todd Lipcon | Todd Lipcon | | | savenamespace should write the fsimage to all configured fs.name.dir in parallel | Major | namenode | dhruba borthakur | Dmytro Molkov | | | Remove intentionally corrupt 0.13 directory layout creation | Major | . | Todd Lipcon | Todd Lipcon | | | the first optimization: ZlibCompressor does not fully utilize the buffer | Minor | io | Kang Xiao | Kang Xiao | | | Refactor storage management into separate classes than fsimage file reading/writing | Major | namenode | Todd Lipcon | Todd Lipcon | | | If Localizer can't create task log directory, it should fail on the spot | Major | tasktracker | Todd Lipcon | Todd Lipcon | | | Image transfer process misreports client side exceptions | Major | namenode | Todd Lipcon | Todd Lipcon | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Move libhdfs from mr to hdfs | Major | libhdfs | Eli Collins | Eli Collins | | | Split map/reduce into sub-project | Major | . | Owen O'Malley | Owen O'Malley | | | Refactor RaidNode to remove dependence on map reduce | Major | . | Patrick Kling | Patrick Kling | | | Integrated Reed-Solomon code with RaidNode | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | New property for local conf directory in system-test-hdfs.xml file. | Major | test | Vinay Kumar Thota | Vinay Kumar Thota | | | Improve documentation of DistributedCache methods | Major | distributed-cache, documentation | Todd Lipcon | Harsh J | | | HDFS part of HADOOP-7291 | Major | . | Eli Collins | Eli Collins | | | Update Hudson job not to run test-contrib | Major | . | Eli Collins | Eli Collins | | | Scripts for building Hadoop