Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.20.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Findbugs warnings are printed related to equals implementation of several classes | Major | . | Suresh Srinivas | Suresh Srinivas | | | Fix warnings generated by FindBugs | Major | conf, fs, record | Suresh Srinivas | Suresh Srinivas | | | INode and its sub-classes should be package private | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Move http server from FSNamesystem into NameNode. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | GetFileBlockLocations should return the NetworkTopology information of the machines that hosts those blocks | Major | . | dhruba borthakur | dhruba borthakur | | | The JobTracker should display the amount of heap memory used | Minor | . | dhruba borthakur | dhruba borthakur | | | Deprecate org.apache.hadoop.mapred.StatusHttpServer | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove Task's dependency on concrete file systems | Major | . | Tom White | Sharad Agarwal | | | Upgrade Jetty to 6.x | Major | . | Devaraj Das | Chris Douglas | | | JobClient should not have a static configuration | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | S3 file systems should not create bucket | Major | fs/s3 | David Phillips | David Phillips | | | Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen | Major | metrics | Jason | stack | | | Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory | Blocker | . | Hemanth Yamijala | Vinod Kumar Vavilapalli | | | Fix and enforce module dependencies | Major | . | Tom White | Sharad Agarwal | | | File globbing with a PathFilter is too restrictive | Major | fs | Tom White | Tom White | | | Modify pending tasks count in the UI to pending jobs count in the UI | Major | . | Hemanth Yamijala | Sreekanth Ramakrishnan | | | Wrong number of running map/reduce tasks are displayed in queue information. | Major | . | Karam Singh | Sreekanth Ramakrishnan | | | NameNode should report status and performance for each replica of image and log | Major | . | Robert Chansler | Boris Shkolnik | | | Admin command saveNamespace. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Split the default configurations into 3 parts | Major | conf | Owen O'Malley | Sharad Agarwal | | | libhdfs: always builds 32bit, even when x86\_64 Java used | Major | build | Craig Macdonald | Giridharan Kesavan | | | Change fair scheduler to share between pools by default, not between invidual jobs | Minor | . | Matei Zaharia | Matei Zaharia | | | Use the full path when move files to .Trash/Current | Major | . | Prasad Chakka | Prasad Chakka | | | Alert for missing blocks | Major | . | Christian Kunz | Raghu Angadi | | | History files are given world readable permissions. | Blocker |

| Hemanth Yamijala | Amareshwari Sriramadasu | | | Remove Chukwa on branch-0.20 | Blocker | . | Nigel Daley | Nigel Daley | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Support for user configurable global filters on HttpServer | Major | security | Kan Zhang | Kan Zhang | | | An independent HTTPS proxy for HDFS | Major | security | Kan Zhang | Kan Zhang | | | Explicitly specify interpretor for non-native binaries | Minor | . | Fredrik Hedberg | Fredrik Hedberg | | | distch: a tool for distributed ch{mod,own} | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs | Major | . | Suhas Gogate | Suhas Gogate | | | Adding service-level authorization to Hadoop | Major | security | Kan Zhang | Arun C Murthy | | | [HOD] Include ringmaster RPC port information in the notes attribute | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi | | | Create Forrest documentation for the fair scheduler | Minor | . | Matei Zaharia | Sreekanth Ramakrishnan | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | KFS: Allow KFS layer to interface with multiple KFS namenodes | Minor | fs | Sriram Rao | Sriram Rao | | | In "ant test-patch", runContribTestOnEclipseFiles should not be run on Hudson only | Major | build, test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | add name of faulty class to WritableName.getClass IOException upon ClassNotFoundException | Trivial | io | Pete Wyckoff | Pete Wyckoff | | | The capacity scheduler's defaults for queues should be configurable. | Blocker | . | Owen O'Malley | Sreekanth Ramakrishnan | | | LineReader::readLine cleanup | Minor | . | Yuri Pradkin | Yuri Pradkin | | | TestJobInProgressListener should also test for jobs killed in queued state | Minor | test | Amar Kamat | Amar Kamat | | | The mapred.\*ID classes are inefficient for hashCode and serialization | Major | . | Owen O'Malley | Owen O'Malley | | | ant compile-native shorthand | Trivial | build | Enis Soztutar | Enis Soztutar | | | Support comments in 'slaves' file | Minor | conf, scripts | Rama, Ramasamy | Rama, Ramasamy | | | Remove dfs.StringBytesWritbale | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Use qMC sequence to improve the accuracy of PiEstimator | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | BlocksMap and BlockInfo should be package private. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Improve ssl handling for distcp | Major | . | Chris Douglas | Kan Zhang | | | Allow access to HDFS web UI on EC2 | Major | contrib/cloud | Tom White | Tom White | | | Enhance how memory-intensive user tasks are handled | Major | . | Vivek Ratan | Vinod Kumar Vavilapalli | | | Improve JavaDoc on

to better document restrictions on combiners | Major | documentation | Owen O'Malley | Owen O'Malley | | | Add ability to split text files compressed with lzo | Trivial | io | Johan Oskarsson | Johan Oskarsson | | | Launch reduces only after a few maps have run in the Fair Scheduler | Major | . | Matei Zaharia | Matei Zaharia | | | Improve FsShell -du/-dus and FileSystem.getContentSummary efficiency | Major | fs | David Phillips | David Phillips | | | Add counters to show number of key/values that have been sorted and merged in the maps and reduces | Major | . | Owen O'Malley | Ravi Gummadi | | | [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi | | | Improve abstraction for spill indices | Minor | . | Chris Douglas | Chris Douglas | | | improve composition, submission and result collection of gridmix | Major | benchmarks | Lingyun Yang | Runping Qi | | | Add support for dfsadmin commands for test TestCLI unit test | Major | test | Boris Shkolnik | Boris Shkolnik | | | Add a splitter for metrics contexts | Minor | metrics | Chris Douglas | Chris Douglas | | | fuse-dfs - create source file/function + utils + config + main source files | Minor | . | Pete Wyckoff | Pete Wyckoff | | | Reuse FileStatus in FsShell where possible | Minor | fs | David Phillips | David Phillips | | | repeatedly blacklisted tasktrackers should get declared dead | Major | . | Christian Kunz | Amareshwari Sriramadasu | | | Move Hive out of Core | Major | . | Owen O'Malley | | | | reducer should output input data size when shuffling is done | Major | . | Zheng Shao | He Yongqiang | | | Move HADOOP\CONF\DIR to chukwa-env.sh | Major | . | Jerome Boulon | Jerome Boulon | | | Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce | Major | . | Chris Douglas | Chris Douglas | | | BloomMapFile - fail-fast version of MapFile for sparsely populated key space | Major | io | Andrzej Bialecki | Andrzej Bialecki | | | Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes | Major | . | Owen O'Malley | Owen O'Malley | | | Cleanup Metrics and the MBeans | Major | . | Sanjay Radia | Sanjay Radia | | | Assign multiple tasks per TaskTracker heartbeat | Major | . | Devaraj Das | Arun C Murthy | | | Add an example of a secondary sort | Major | . | Owen O'Malley | Owen O'Malley | | | gridmix2 code can be condensed | Minor | benchmarks | Chris Douglas | Chris Douglas | | | Improve data aggregation in database | Major | . | Eric Yang | Eric Yang | | | Improvements to TestJobTrackerRestart | Major | test | Arun C Murthy | Amar Kamat | | | Clean up map/reduce api to take JobContext in the static methods | Major | . | Owen O'Malley | Owen O'Malley | | | do not keep forrest output in subversion | Major | documentation | Doug Cutting | Doug Cutting | | | Cleanup the Capacity Scheduler code | Major |

| Vivek Ratan | Vivek Ratan | | | adjust build.xml to reference external properties when building the "init.d" for the rpm | Major | . | Eric Yang | Eric Yang | | | CompressorStream and BlockCompressorStream should be public | Major | io | Owen O'Malley | Owen O'Malley | | | Collect Job History log file and Job Conf file into Chukwa | Major | . | Eric Yang | Eric Yang | | | Chukwa RPM build improvements | Major | . | Eric Yang | Eric Yang | | | Update documentation for default configuration | Major | documentation | Sharad Agarwal | Sharad Agarwal | | | libhdfs test conf uses deprecated fs.default.name value | Trivial | test | Craig Macdonald | Craig Macdonald | | | MultiFileInputSplit can use data locality information to create splits | Major | . | dhruba borthakur | dhruba borthakur | | | ivy directory should be there in hadoop tar ball | Major | build | Suman Sehgal | Giridharan Kesavan | | | Throw exception instead of writing to System.err when there is a CRC error on CBZip2InputStream | Minor | io | Rodrigo Schmidt | Rodrigo Schmidt | | | When queue ACLs are enabled, the error message shown when a job is submitted to a non-existent queue is misleading | Major | . | Hemanth Yamijala | rahul k singh | | | Parallelize job initialization | Blocker | . | Matei Zaharia | Jothi Padmanabhan | | | CSS Style Changes for Hadoop Doc Headers and Code | Major | documentation | Corinne Chandel | Corinne Chandel | | | Add waiting/failed tasks to JobTracker metrics | Major | metrics | Chris Douglas | Chris Douglas | | | Remove dependency of testcases on RESTART\_COUNT | Major | test | Amar Kamat | Ravi Gummadi | | | Change Hadoop doc menu to sub-menus | Major | documentation | Corinne Chandel | Corinne Chandel | | | Typo in diskQuota help documentation | Trivial | documentation | Ravi Phulari | Ravi Phulari | | | Remove claims from mapred-default.xml that prime numbers of tasks are helpful. | Major | . | Owen O'Malley | Owen O'Malley | | | Allow Xinclude in hadoop config file | Minor | conf | Rama, Ramasamy | Rama, Ramasamy | | | Need to be able to instantiate a comparator instance from a comparator string without creating a TFile.Reader object | Minor | io | Hong Tang | Hong Tang | | | Startup scripts will not start instances of Hadoop daemons w/different configs w/o setting separate PID directories | Major | conf | Vetle Roeim | | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | KFS: Update the kfs jar file | Major | fs | Sriram Rao | Sriram Rao | | | message generated when the client exception has a null message is not useful | Minor | ipc | Steve Loughran | | | | Fix warnings generated by FindBugs | Blocker | . | Suresh Srinivas | Suresh Srinivas | | | update derby.jar to eliminate the one time wait of 2-3 minutes while running junit tests | Minor | . | Prasad Chakka | Prasad Chakka | | | Hadoop SocketInputStream.read() should return -1 in case of

| Minor | io | Raghu Angadi | Raghu Angadi | | | FsAction operations shouldn't create new Objects | Minor | fs | Chris Douglas | Chris Douglas | | | [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A" | Major | . | Vinod Kumar Vavilapalli | Sreekanth Ramakrishnan | | | There is a window where the JobTracker is in the RUNNING state (i.e ready to accept jobs) and never executes them. | Major | . | Amar Kamat | Hemanth Yamijala | | | Hadoop triggers a "soft" fd leak. | Major | io | Raghu Angadi | Raghu Angadi | | | Bug in Datanode transferBlocks code | Major | . | Suresh Srinivas | Suresh Srinivas | | | typo in javadoc for map.input.file | Trivial | documentation | Koji Noguchi | Koji Noguchi | | | In fsck, HttpServletResponse sendError fails with IllegalStateException | Major | . | Koji Noguchi | Hairong Kuang | | | Race condition creating S3 buffer directory for NativeS3FileSystem | Major | fs/s3 | David Phillips | David Phillips | | | Code optimization/cleanup in HDFS | Major | . | Suresh Srinivas | Suresh Srinivas | | | javadoc: warning - Multiple sources of package comments found for some packages | Major | documentation | Tsz Wo Nicholas Sze | Kan Zhang | | | chukwa conf files are not cleaned up | Minor | . | Tsz Wo Nicholas Sze | Eric Yang | | | Fix the PiEstimator output messages and code comments | Minor | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | local.cache.size is set to 10 GB, while DEFAULT\CACHE\SIZE is set to 1 MB | Trivial | filecache | Jeff Hammerbacher | Jeff Hammerbacher | | | Examples -Driver does not check first argument. | Major | . | Edward J. Yoon | Edward J. Yoon | | | hdfs proxy doesn't package itself right. | Major | . | Owen O'Malley | Kan Zhang | | | There is a cygpath error if log directory does not exist | Minor | scripts | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | ScriptBasedMapping has infinite loop with invalid jobconf parameter | Minor | . | Aaron Kimball | Aaron Kimball | | | When an input split spans cross block boundary, the split location should be the host having most of bytes on it. | Major | . | Runping Qi | Jothi Padmanabhan | | | In the javadoc of IndexedSortable.compare(...), the link is wrong. | Minor | documentation, util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | '-setrep' command skips under-replicated blocks | Minor | . | Koji Noguchi | Hairong Kuang | | | Misconfigured UNIX Groups Break Hadoop | Minor | . | Alex Loddengaard | Alex Loddengaard | | | Go back to Job has a wrong URL on blacklisted trackers page | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | javadoc: "the the" =\> "the" | Trivial | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Capacity scheduler should initialize tasks asynchronously | Major | . | Hemanth Yamijala | Sreekanth Ramakrishnan | | | FileSystem.getFileBlockLocations() (aka default implementation for Local FileSystem)

| Major | fs | Hong Tang | Hong Tang | | | A file-open sometimes may not set the access time of a file | Major | . | dhruba borthakur | dhruba borthakur | | | connectionTimeout and readTimeout are passed in wrong order in ReduceTask.java | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | changing the number of reduces dramatically changes the time of the map time | Major | . | Owen O'Malley | | | | Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other | Major | . | Karam Singh | Amar Kamat | | | gridmix2 run script doesn't work on trunk | Trivial | benchmarks | Chris Douglas | Chris Douglas | | | saveVersion.sh could write a package-info.java that cannot be compiled when used with git | Trivial | build | Hemanth Yamijala | Chris Douglas | | | Running tasks are not maintained by JobInProgress if speculation is off | Major | . | Amar Kamat | Amar Kamat | | | TestTrackerBlacklistAcrossJobs compilation is broken | Blocker | . | Hemanth Yamijala | Hemanth Yamijala | | | avoid two calls to System.currentTimeMillis() in heartbeat | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Chukwa build process generates files not tracked by svn | Major | build | Chris Douglas | Chris Douglas | | | Test target for chukwa build.xml needs to comply to hadoop build.xml test suites | Major | build | Eric Yang | Eric Yang | | | StorageDirectory is not removed from the storage directories list when writing to an edits fails | Major | . | Boris Shkolnik | Boris Shkolnik | | | Import style sheet images for Chukwa | Trivial | . | Eric Yang | Eric Yang | | | Remove black list feature from Chukwa Agent to Chukwa Collector communication | Major | . | Eric Yang | Eric Yang | | | Job end notification should give status as "KILLED" when job gets killed. | Major | . | Ruchir Shah | Amareshwari Sriramadasu | | | Chukwa - change jps to ps for process status detection | Major | . | Eric Yang | Eric Yang | | | Document deprecation of o.a.h.fs.permission.AccessControlException better | Minor | documentation, fs | Arun C Murthy | Arun C Murthy | | | IFileOutputStream.close should call close of the underlying stream | Minor | . | Jothi Padmanabhan | Jothi Padmanabhan | | | Move the call to getMapCompletionEvents in ReduceTask.ReduceCopier.fetchOutputs to a separate thread | Major | . | Devaraj Das | Jothi Padmanabhan | | | Fix help message in MRAdmin | Minor | fs, security | Arun C Murthy | Arun C Murthy | | | Remove unused method FSNamesystem.deleteInSafeMode | Minor | . | Suresh Srinivas | Suresh Srinivas | | | TestMapRed fails with 64bit JDK | Major | test | Nigel Daley | Nigel Daley | | | File Tailing Adaptor test cases causes random failure | Major | . | Eric Yang | Eric Yang | | | Clover breaks nightly builds | Major | build | Tom White | Tom White | | | Shuffle counter issues | Major |

| Chris Douglas | He Yongqiang | | | TestJobTrackerRestart fails on trunk | Blocker | test | Arun C Murthy | Owen O'Malley | | | Improve rpm build process for Chukwa | Major | . | Eric Yang | Eric Yang | | | FSImage saveFSImage() will have problem. | Major | . | Ruyue Ma | Ruyue Ma | | | After introduction of ivy ant test-patch always returns -1 score | Blocker | build | Sreekanth Ramakrishnan | Giridharan Kesavan | | | Remove bindings to lzo | Blocker | io | Owen O'Malley | Owen O'Malley | | | CapacityScheduler should work even if capacity-scheduler.xml is not in the classpath i.e with the code defaults | Major | . | Amar Kamat | Sreekanth Ramakrishnan | | | Capacity reclaimation for queue would not work as intended | Blocker | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan | | | [HOD] HOD opens up directory permissions more than required | Blocker | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi | | | Document service level authorization - HADOOP-4348 | Major | documentation, scripts | Arun C Murthy | Arun C Murthy | | | fix Chukwa's jettyCollector.sh | Minor | . | Ari Rabkin | Ari Rabkin | | | File descriptor leak in Chukwa's ExecPlugin | Major | . | Ari Rabkin | Ari Rabkin | | | Chukwa RPM needs to chown user/group in build stage instead of post install stage. | Trivial | . | Eric Yang | Eric Yang | | | Lost Trackers may not be able to join back | Blocker | . | Devaraj Das | Amareshwari Sriramadasu | | | testRestartWithLostTracker frequently times out | Blocker | . | Johan Oskarsson | Amar Kamat | | | Capacity Scheduler should read the reclaim-capacity-interval config value from its own config file | Minor | . | Vivek Ratan | Sreekanth Ramakrishnan | | | hdfs fsck does not load hdfs configuration. | Blocker | . | Raghu Angadi | Raghu Angadi | | | NPE when jobdetails.jsp | Blocker | . | Devaraj Das | Devaraj Das | | | Capacity Scheduler does not always return no task to a TT if a job's memry requirements are not met | Major | . | Vivek Ratan | Vivek Ratan | | | Have end to end tests based on MiniMRCluster to verify that queue capacities are honoured. | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Native compilation is broken | Blocker | . | Chris Douglas | Chris Douglas | | | TestTrackerBlacklistAcrossJobs fails randomly | Blocker | test | Hemanth Yamijala | Amareshwari Sriramadasu | | | Support chkconfig for chukwa start up scripts | Trivial | . | Eric Yang | Eric Yang | | | Change Date format pattern for Time Series graph | Trivial | . | Eric Yang | Eric Yang | | | Chukwa HTTP connection policies are too hard to configure | Major | . | Ari Rabkin | Ari Rabkin | | | use regex to parse chukwa commands | Minor | . | Ari Rabkin | Ari Rabkin | | | Startup scripts should be svn-executable | Minor | . | Andy Konwinski | Andy Konwinski | | | Deadlock between reclaimCapacity and assignTasks | Blocker | . | Matei Zaharia | Vivek Ratan | | | An earlier fix, for HADOOP-4373, results in a problem with reclaiming capacity when one or more queues have a capacity equal to zero | Blocker |

| Vivek Ratan | Vivek Ratan | | | setOutputFormatClass in mapreduce.Job fails for SequenceFileOutputFormat | Major | . | Chris Douglas | Chris Douglas | | | Enable JobTracker Instrumentation API with user job configuration | Major | . | Eric Yang | Eric Yang | | | chukwa agent startup should be more modular | Major | . | Ari Rabkin | Ari Rabkin | | | Sometimes job is still displayed in jobqueue\_details page for long time after job was killed. | Major | . | Karam Singh | Sreekanth Ramakrishnan | | | Potential infinite loop in updateMinSlots | Blocker | . | Matei Zaharia | Matei Zaharia | | | Make some "flag" booleans volatile because they are set/read in different threads | Minor | . | Owen O'Malley | Chris Douglas | | | IndexOutOfBoundsException in FSEditLog | Major | . | Boris Shkolnik | Boris Shkolnik | | | RPC call throws IllegalArgumentException complaining duplicate metrics registration | Major | ipc | Hairong Kuang | Hairong Kuang | | | Copying a file to local with Crc throws an exception | Major | fs | Hairong Kuang | Hairong Kuang | | | HashFunction inadvertently destroys some randomness | Major | util | Jonathan Ellis | Jonathan Ellis | | | TestSetupAndCleanupFailure fails with timeout | Major | . | Enis Soztutar | Enis Soztutar | | | display minMaps/Reduces on advanced scheduler page | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma | | | Namenode in infinite loop for replicating/deleting corrupted block | Major | . | Hairong Kuang | Hairong Kuang | | | Fix for HADOOP-5079 HashFunction inadvertently destroys some randomness | Minor | io | stack | Jonathan Ellis | | | TaskTracker.runningTasks holding FAILED\UNCLEAN and KILLED\UNCLEAN taskStatuses forever in some cases. | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | ConcurrentModificationException in FairScheduler.getTotalSlots | Blocker | . | Vinod Kumar Vavilapalli | rahul k singh | | | Reducer not Succeded after 100% | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero. | Blocker | . | Vinod Kumar Vavilapalli | Amar Kamat | | | Running tasks on lost trackers are incorrectly logging the attempt and task failures | Blocker | . | Amar Kamat | Amar Kamat | | | Logs saying org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker are not relevant | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | KFS: calling getFileBlockLocations() on 0-length file causes a NPE | Major | . | Sriram Rao | Sriram Rao | | | JobTracker hangs for long periods of time | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das | | | Reduce tasks get stuck because of over-estimated task size (regression from 0.18) | Blocker | . | Andy Pavlo | Sharad Agarwal | | | MapWritable#putAll does not store classes | Minor | io | Doacan Gney | | | | When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap. | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das | | | JobTracker does not log TIP start information after restart | Critical | . | Amar Kamat | Amar Kamat | | | 4-way deadlock in FairShare scheduler | Blocker |

| Vinod Kumar Vavilapalli | Matei Zaharia | | | Job History file can have empty string as http port after JobTracker Restart in case of lost TT, which can result in NumberFormatException when JT is restarted 2nd time | Blocker | . | Ravi Gummadi | Amar Kamat | | | Job directories could remain undeleted in some scenarios after job completes. | Blocker | . | Hemanth Yamijala | Devaraj Das | | | Generic mapreduce classes cannot be used with Job::set\* methods | Major | . | Chris Douglas | Chris Douglas | | | LocalDirAllocator misses files on the local filesystem | Blocker | . | Arun C Murthy | Devaraj Das | | | bzip2 codec (CBZip2OutputStream) creates corrupted output file for some inputs | Major | io | Rodrigo Schmidt | Rodrigo Schmidt | | | Wrong resolution of hostname and port | Blocker | . | Amareshwari Sriramadasu | Jothi Padmanabhan | | | Exception thrown in/from RecoveryManager.recover() should be caught and handled | Blocker | . | Amar Kamat | Amar Kamat | | | gridmix2 is not getting compiled to generate gridmix.jar | Critical | benchmarks | Suman Sehgal | Chris Douglas | | | ant binary should not compile docs | Major | build | Amareshwari Sriramadasu | Giridharan Kesavan | | | DataNodeCluster should not create blocks with generationStamp == 1 | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Balancer sometimes runs out of memory after days or weeks running | Major | . | Hairong Kuang | Hairong Kuang | | | Reduce tasks are stuck waiting for map outputs when none are in progress | Blocker | . | Ramya Sunil | Amar Kamat | | | JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsException | Blocker | . | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu | | | TestGlobalFilter.testServletFilter fails | Blocker | test | Tsz Wo Nicholas Sze | Kan Zhang | | | Unit test fails out on trunk org.apache.hadoop.http.TestServletFilter.testServletFilter | Major | test | Lee Tucker | Tsz Wo Nicholas Sze | | | TestHdfsProxy fails on 0.20 | Major | . | Chris Douglas | Chris Douglas | | | Wrong description of " hadoop fs -test " in FS Shell guide . | Trivial | documentation | Ravi Phulari | Ravi Phulari | | | Job files for a job failing because of ACLs are not clean from the system directory | Blocker | . | Karam Singh | Amar Kamat | | | Successful taskid are not removed from TaskMemoryManager | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Blocks remain under-replicated | Blocker | . | Hairong Kuang | Hairong Kuang | | | TestParallelInitialization failed on NoSuchElementException | Blocker | . | Hairong Kuang | Jothi Padmanabhan | | | Shuffle copiers do not return Codecs back to the pool at the end of shuffling | Blocker | . | Devaraj Das | Jothi Padmanabhan | | | TestMissingBlocksAlert fails on 0.20. | Major | . | Raghu Angadi | Raghu Angadi | | | IO exception while executing hadoop fs -touchz fileName | Major | fs | Ravi Phulari | Hairong Kuang | | | Directory/file cleanup thread throws IllegalStateException | Major | . | Hairong Kuang | | | | GzipCodec fails second time it is used in a process | Blocker |

| Ben Maurer | Chris Douglas | | | Balancer throws "Not a host:port pair" unless port is specified in fs.default.name | Minor | . | Stuart White | Stuart White | | | NameNode should not send empty block replication request to DataNode | Critical | . | Hairong Kuang | Hairong Kuang | | | Job with output hdfs:/user/\<username\>/outputpath (no authority) fails with Wrong FS | Major | fs | Koji Noguchi | Doug Cutting | | | JobTracker metrics do not match job counters | Major | metrics | Chris Douglas | | | | TaskMemoryManagerThread crashes in a corner case | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | The new map/reduce api doesn't support combiners | Blocker | . | Owen O'Malley | Owen O'Malley | | | SyncLogs thread in Child.java would update wrong file for a cleanup attempt, in some cases. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Document job setup/cleaup tasks and task cleanup tasks in mapred tutorial | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Deadlock triggered by FairScheduler scheduler's servlet due to changes from HADOOP-5214. | Blocker | . | Vinod Kumar Vavilapalli | rahul k singh | | | Renaming of Job histroy file is incorrect if Jobtracker is restarted multimple times | Major | . | Karam Singh | Amar Kamat | | | IPC client drops interrupted exceptions | Blocker | ipc | Owen O'Malley | Owen O'Malley | | | TestMapReduceLocal is missing a close() that is causing it to fail while running the test on NFS | Minor | test | Jothi Padmanabhan | Jothi Padmanabhan | | | ReplicationMonitor should schedule both replication and deletion work in one iteration | Major | . | Hairong Kuang | Hairong Kuang | | | DataNodeCluster should create blocks with the same generation stamp as the blocks created in CreateEditsLog | Major | test | Hairong Kuang | Hairong Kuang | | | TestRecoveryManager fails wtih FileAlreadyExistsException | Major | test | Hairong Kuang | Amar Kamat | | | Two minor problems in TestOverReplicatedBlocks | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | hadoop command uses large JVM heap size | Blocker | build | Suresh Srinivas | Suresh Srinivas | | | The job instrumentation API needs to have a method for finalizeJob, | Major | . | Jerome Boulon | Jerome Boulon | | | hdfsproxy includes duplicate jars in tarball, source in binary tarball | Major | build | Chris Douglas | zhiyong zhang | | | CRC errors not detected reading intermediate output into memory with problematic length | Major | . | Chris Douglas | Chris Douglas | | | TupleWritable can return incorrect results if it contains more than 32 values | Major | . | Jingkei Ly | Jingkei Ly | | | hadoop commands seem extremely slow in 0.20 branch | Blocker | fs | Koji Noguchi | Hairong Kuang | | | Race condition in command-line kill for a task | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Namenode permits directory destruction on overwrite | Critical | . | Brian Bockelman | Brian Bockelman | | | LocalJobRunner does not run jobs using new MapReduce API | Blocker |

| Tom White | Tom White | | | JVM should not be killed but given an opportunity to exit gracefully | Major | . | Devaraj Das | Ravi Gummadi | | | The Job.waitForCompletion doesn't print status as the job runs | Blocker | . | Owen O'Malley | Owen O'Malley | | | TestCapacityScheduler fails with NPE | Major | test | Chris Douglas | Chris Douglas | | | All the replicas incorrectly got marked as corrupt. | Blocker | . | Raghu Angadi | Hairong Kuang | | | JobTracker greedily schedules tasks without running tasks to join | Major | . | Karam Singh | Amar Kamat | | | distcp -delete option deletes all files from the destination directory | Major | . | Suhas Gogate | Tsz Wo Nicholas Sze | | | Unit test org.apache.hadoop.fs.TestCopyFiles.testMapCount fails on trunk | Minor | test | Ramya Sunil | Tsz Wo Nicholas Sze | | | Unit test for jvm -reuse | Blocker | . | Amareshwari Sriramadasu | Owen O'Malley | | | Observed negative running maps on the job tracker | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu | | | NameNode seems unstable on a cluster with little space left | Major | . | Raghu Angadi | Hairong Kuang | | | testClusterBlockingForLackOfMemory in TestCapacityScheduler fails randomly | Major | . | Sreekanth Ramakrishnan | Vinod Kumar Vavilapalli | | | FileSystem statistic counters are too high when JVM reuse is enabled. | Blocker | . | Owen O'Malley | Owen O'Malley | | | JobTracker might schedule 2 attempts of the same task with the same attempt id across restarts | Critical | . | Amar Kamat | Amar Kamat | | | After HADOOP-4920 we need a place to checkin releasenotes.html | Major | build | Nigel Daley | Nigel Daley | | | Namnode is stuck in safe mode | Major | . | Suresh Srinivas | Suresh Srinivas | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add a unit test to test faulty setup task and cleanup task killing the job | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | adding tests for quotas command line error messages | Minor | test | Boris Shkolnik | Boris Shkolnik | | | multiple spills/reducers test case for mergeParts() needed | Major | . | Yuri Pradkin | Chris Douglas | | | Tests for NameNode -checkpoint option with different configurations | Minor | . | Boris Shkolnik | Boris Shkolnik | | | TestUlimit is failing after Hadoop-4620 | Blocker | test | Sharad Agarwal | Ravi Gummadi | | | Add a unit test for applications creating symlinks in wokring directory | Major | test | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Test behavior of very large (32GB) name nodes | Major | . | Robert Chansler | | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable | Major | . | Tom White | Sharad Agarwal | | | Remove RunJar's dependency on JobClient | Major | . | Sharad Agarwal | Sharad Agarwal | | | Add setVerifyChecksum() method to FileSystem | Major | fs | Tom White | Sharad Agarwal |