Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.14.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Hadoop Pipes for writing map/reduce jobs in C++ and python | Major | . | Sanjay Dahiya | Owen O'Malley | | | Integrate Findbugs into nightly build process | Major | test | Nigel Daley | Nigel Daley | | | Support for textInputFormat in contrib/data\_join | Minor | . | Senthil Subramanian | Senthil Subramanian | | | Asynchronous table creation | Minor | . | James Kennedy | stack | | | Creation time and modification time for hadoop files and directories | Major | . | dhruba borthakur | dhruba borthakur | | | MultiFileSplit, MultiFileInputFormat | Major | . | Enis Soztutar | Enis Soztutar | | | ant Task for FsShell operations | Minor | build, fs | Chris Douglas | Chris Douglas | | | Add a per-job configuration knob to control loading of native hadoop libraries | Major | io | Arun C Murthy | Arun C Murthy | | | Add job priority | Minor | . | Johan Oskarsson | Johan Oskarsson | | | Distributed upgrade status reporting and post upgrade features. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko | | | Report Java VM metrics | Major | metrics | David Bowen | David Bowen | | | Block level CRCs in HDFS | Major | . | Raghu Angadi | Raghu Angadi | | | NameNode Schema for HttpFileSystem | Major | fs | Chris Douglas | Chris Douglas | | | Eclipse plugin for developing and executing MapReduce programs on Hadoop | Major | . | Eugene Hung | Christophe Taton | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Deprecate the Configuration.set(String,Object) method and make Configuration Iterable | Major | conf | Owen O'Malley | Owen O'Malley | | | A configurable limit on the number of unique values should be set on the UniqueValueCount and ValueHistogram aggregators | Major | . | Runping Qi | Runping Qi | | | md5 file in filecache should inherit replication factor from the file it belongs to. | Major | . | Christian Kunz | dhruba borthakur | | | dfs client protocol should allow asking for parts of the block map | Major | . | Owen O'Malley | Konstantin Shvachko | | | A new example to do tile placements using distributed dancing links | Major | . | Owen O'Malley | Owen O'Malley | | | More improvements to DFS browsing WI | Major | . | arkady borkovsky | Enis Soztutar | | | fix warning about cast of Map\<String, Map\<String, JobInfo\>\> in jobhistory.jsp | Major | . | Owen O'Malley | Owen O'Malley | | | RandomWriter should be tweaked to generate input data for terasort | Major | . | Devaraj Das | Devaraj Das | | | RPC Server won't go quietly | Minor | ipc | stack | stack | | | checksums should be closer to data generation and consumption | Major | fs | Doug Cutting | Doug Cutting | | | Remove redundant counters from WordCount example | Major |

| Owen O'Malley | Owen O'Malley | | | Grammatical / wording / copy edits for Hadoop Distributed File System: Architecture and Design white paper | Trivial | documentation | Luke Nezda | | | | Counters for monitoring task assignments | Minor | . | Devaraj Das | Arun C Murthy | | | Exclude some Findbugs detectors | Minor | build | Nigel Daley | Nigel Daley | | | Rewrite 'random-writer' to use '-reducer NONE' | Minor | . | Arun C Murthy | Arun C Murthy | | | Kill jobs from web interface | Minor | . | Enis Soztutar | Enis Soztutar | | | Proposal to batch commits to edits log. | Major | . | Raghu Angadi | dhruba borthakur | | | better links to mailing list archives | Major | documentation | Daniel Naber | Tom White | | | Better progress reporting from a Task | Major | . | Vivek Ratan | Vivek Ratan | | | JobClient should not sort input-splits | Major | . | Milind Bhandarkar | Senthil Subramanian | | | Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf | Major | . | Christian Kunz | Devaraj Das | | | remove all @author tags from source | Minor | . | Doug Cutting | Doug Cutting | | | Eliminate internal UTF8 to String and vice versa conversions in the name-node. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Add session id to metric data | Major | . | David Bowen | David Bowen | | | dfs -copyToLocal should guarantee file is complete | Major | . | eric baldeschwieler | Tsz Wo Nicholas Sze | | | Servers should log startup and shutdown messages | Major | . | Nigel Daley | Tsz Wo Nicholas Sze | | | Metrics should be there for reporting shuffle failures/successes | Major | . | Devaraj Das | Devaraj Das | | | Distributed cluster upgrade | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | provide better error message when subprocesses fail in hadoop streaming | Minor | . | John Heidemann | John Heidemann | | | Make jobids unique across jobtracker restarts | Major | . | Owen O'Malley | Owen O'Malley | | | hdfsRead and hdfsPread should return 0 instead of -1 at end-of-file. | Minor | . | Christian Kunz | Christian Kunz | | | Rework FSInputChecker and FSOutputSummer to support checksum code sharing between ChecksumFileSystem and block level crc dfs | Major | fs | Hairong Kuang | Hairong Kuang | | | GenericWritable should use generics | Minor | io | Espen Amble Kolstad | Espen Amble Kolstad | | | Provide examples for aggregate library | Major | . | Tom White | Runping Qi | | | FileSystem should have fewer abstract methods | Major | . | Doug Cutting | Doug Cutting | | | The blockStream of DFSClient.FSInputStream should not be buffered | Major | . | Hairong Kuang | Hairong Kuang | | | FSDirectory class code cleanup | Trivial | . | Christophe Taton | Christophe Taton | | |

front page is not user-friendly | Minor | documentation | Marco Nicosia | Doug Cutting | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | The misleading Configuration.set(String, Object) should be removed | Minor | conf | Owen O'Malley | Owen O'Malley | | | getJobName not accessible from JobClient | Minor | . | Michael Bieniosek | | | | Possible null pointer dereference in TaskLogAppender.append(LoggingEvent) | Minor | . | Nigel Daley | Arun C Murthy | | | Call to equals() comparing different types in CopyFiles.cleanup(Configuration, JobConf, String, String) | Minor | util | Nigel Daley | Arun C Murthy | | | C++ reducers under hadoop-pipes are not started when there are no key-value pairs to be reduced | Major | . | Christian Kunz | Owen O'Malley | | | Variable dereferenced then later checked for null | Minor | . | Nigel Daley | Hairong Kuang | | | Inconsistent synchronization of SequenceFile$Reader.noBufferedValues; locked 66% of time | Minor | io | Nigel Daley | Owen O'Malley | | | Inconsistent Synchronization cleanup for {Configuration, TaskLog, MapTask, Server}.java | Minor | conf, ipc | Devaraj Das | Devaraj Das | | | using Math.abs(Random.getInt()) does not guarantee a positive number | Major | . | Owen O'Malley | Owen O'Malley | | | FindBugs -\> Performance | Major | . | Arun C Murthy | Arun C Murthy | | | Metrics based on Map-Reduce Counters are not cleaned up | Major | . | David Bowen | David Bowen | | | FindBugs : Performance : in dfs | Major | . | Raghu Angadi | Raghu Angadi | | | makeQualified should return an instance of a DfsPath when passed a DfsPath | Major | . | Koji Noguchi | dhruba borthakur | | | TestFileCorruption fails with ArrayIndexOutOfBoundsException | Critical | . | Nigel Daley | Konstantin Shvachko | | | Corner-case deadlock in TaskTracker | Blocker | . | Arun C Murthy | Arun C Murthy | | | Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail | Major | . | Devaraj Das | Devaraj Das | | | Findbugs - Bad Practice | Major | . | dhruba borthakur | dhruba borthakur | | | FindBugs : Fix some correctness bugs reported in DFS, FS, etc. | Major | . | Raghu Angadi | Raghu Angadi | | | FindBugs: Dodgy bugs in fs, filecache, io, and util packages | Major | . | Hairong Kuang | Hairong Kuang | | | NPE in HStore#get if StoreFile only has keys \< than passed key | Minor | . | stack | stack | | | Restart of the same data-node should not generate edits log records. | Minor | . | Konstantin Shvachko | Raghu Angadi | | | Bug in BytesWritable.set(byte[] newData, int offset, int length) | Major | io | Srikanth Kakani | dhruba borthakur | | | TestDecommission fails with assertion Number of replicas for block1 expected:\<3\> but was:\<2\> | Major | . | dhruba borthakur | dhruba borthakur | | | FileNotFound exception on DFS block | Blocker | . | Devaraj Das | dhruba borthakur | | | All block trasitions should be logged at log level INFO | Major | . | dhruba borthakur | dhruba borthakur | | | DFS Scalability: namenode throughput impacted becuase of global FSNamesystem lock | Major |

| dhruba borthakur | dhruba borthakur | | | Timed-out tasks are marked as 'KILLED' rather than as 'FAILED' which means the framework doesn't fail a TIP with 4 or more timed-out attempts | Blocker | . | Arun C Murthy | Arun C Murthy | | | map tasks fail because they do not find application in file cache | Major | . | Christian Kunz | Arun C Murthy | | | SecondaryNameNode does not roll ports | Major | . | dhruba borthakur | dhruba borthakur | | | deletion of excess replicas does not take into account 'rack-locality' | Major | . | Koji Noguchi | Hairong Kuang | | | FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce | Blocker | . | Arun C Murthy | dhruba borthakur | | | possible double setting of java.library.path introduced by HADOOP-838 | Major | . | Enis Soztutar | Enis Soztutar | | | DFS Clients should start using the org.apache.hadoop.fs.LocalDirAllocator | Major | . | Devaraj Das | dhruba borthakur | | | Map/reduce job gets OutOfMemoryException when set map out to be compressed | Blocker | . | Hairong Kuang | Arun C Murthy | | | DataNode version mismatch during handshake() causes NullPointerException. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Zero-byte input files are not included in InputSplit | Major | . | Milind Bhandarkar | Senthil Subramanian | | | Block allocation method does not check pendingCreates for duplicate block ids | Major | . | dhruba borthakur | dhruba borthakur | | | hdfs -rm should NOT fail if one of the files to remove is missing | Minor | . | arkady borkovsky | Tsz Wo Nicholas Sze | | | Fix for broken build by HADOOP-1498 | Major | . | stack | stack | | | local filecache disappears | Blocker | . | Christian Kunz | Owen O'Malley | | | terminate-hadoop-cluster may be overzealous | Blocker | fs/s3 | Doug Cutting | Tom White | | | exists() not necessary before DFS.open | Major | . | Raghu Angadi | Raghu Angadi | | | Input file get truncated for text files with \\r\\n | Major | io | Bwolen Yang | | | | Block reports from all datanodes arrive at the namenode within a small band of time | Major | . | dhruba borthakur | dhruba borthakur | | | Three methods in FSNamesystem should not be synchronized. | Critical | . | Konstantin Shvachko | Konstantin Shvachko | | | TestTextInputFormat fails on Windows | Major | . | Konstantin Shvachko | | | | Progress reporting not handled for the case where a reducer currently doesn't have anything to fetch | Blocker | . | Devaraj Das | Vivek Ratan | | | Inconsistent synchronization of NetworkTopology.distFrom; locked 50% of time | Major | io | Nigel Daley | Hairong Kuang | | | libhdfs tests failing | Blocker | . | Nigel Daley | dhruba borthakur | | | IndexOutOfBoundsException in FSEditLog.processIOError | Blocker | . | Nigel Daley | dhruba borthakur | | | Incorrect task/tip being scheduled (looks like speculative execution) | Blocker |

| Nigel Daley | Owen O'Malley | | | A likely race condition between the creation of a directory and checking for its existence in the DiskChecker class | Critical | fs | Devaraj Das | Devaraj Das | | | The DFS WebUI shows an incorrect column for file Creatin Time | Major | . | dhruba borthakur | dhruba borthakur | | | NPE in jobcontrol | Major | . | Johan Oskarsson | Owen O'Malley | | | 9 unit test failures: file.out.index already exists | Major | . | Nigel Daley | Devaraj Das | | | Fix the JobHistory to display things like the number of nodes the job ran on, the number of killed/failed tasks | Major | . | Devaraj Das | Devaraj Das | | | Setting the replication factor of a file too high causes namenode cpu overload | Major | . | dhruba borthakur | Hairong Kuang | | | Data-nodes should send storage ID to the name-node during registration | Blocker | . | Konstantin Shvachko | Konstantin Shvachko | | | Bug in readFields of GenericWritable | Minor | io | Espen Amble Kolstad | Espen Amble Kolstad | | | Multithreading issue with libhdfs library | Blocker | . | Christian Kunz | Christian Kunz | | | ReplicationMonitor thread goes away | Blocker | . | Koji Noguchi | dhruba borthakur | | | Jobtracker web interface contains several absolute href links instead of relative ones | Major | . | Thomas Friol | | | | TestSymLink is failing | Blocker | . | Doug Cutting | Owen O'Malley | | | Wrong comparator used to merge files in Reduce phase | Major | . | Vivek Ratan | Vivek Ratan | | | ChecksumFileSystem : some operations implicitly not supported. | Major | fs | Raghu Angadi | | | | ChecksumFileSystem does not handle ChecksumError correctly | Major | fs | Hairong Kuang | Hairong Kuang | | | web interface inconsistencies when using speculative execution | Blocker | . | Christian Kunz | Arun C Murthy | | | Task Logs userlogs don't show up for a while | Major | . | Michael Bieniosek | Michael Bieniosek | | | TestCopyFiles with IllegalArgumentException on Windows | Blocker | fs | Nigel Daley | Senthil Subramanian | | | The dfs webui (dfshealth) shows "Last Contact" as a negative number | Minor | . | dhruba borthakur | dhruba borthakur | | | JobClient rpc times out getting job status | Blocker | . | Nigel Daley | Owen O'Malley | | | Write unit tests to detect CRC corruption | Major | . | dhruba borthakur | dhruba borthakur | | | ChecksumFileSystem : Can't read when io.file.buffer.size \< bytePerChecksum | Major | fs | Raghu Angadi | | | | "could not move files" exception in DataXceiver | Blocker | . | Konstantin Shvachko | Raghu Angadi | | | Unknown op code exception in DataXceiver. | Blocker | . | Konstantin Shvachko | Raghu Angadi | | | updating a hdfs file, doesn't cause the distributed file cache to update itself | Blocker | . | Owen O'Malley | Arun C Murthy | | | TestSymLink is failing fairly often and is blocking the regression | Major | . | Owen O'Malley | Mahadev konar | | | dfs -cp infinite loop creating sub-directories | Blocker | . | Koji Noguchi | dhruba borthakur | | | Replication gets set to 1 sometimes when Namenode restarted. | Blocker |

| Raghu Angadi | Raghu Angadi | | | Keypair Name Hardcoded | Minor | contrib/cloud | Stu Hood | | | | EC2 launch-hadoop-cluster awk Problem | Minor | contrib/cloud | Stu Hood | | | | Master node unable to bind to DNS hostname | Minor | contrib/cloud | Stu Hood | | | | IllegalArgumentException in fsck | Blocker | . | Konstantin Shvachko | Hairong Kuang | | | FSInputChecker attempts to seek past EOF | Blocker | fs | Nigel Daley | Hairong Kuang | | | TestDecommission fails on Windows | Blocker | . | Nigel Daley | dhruba borthakur | | | Tasks run by MiniMRCluster don't get sysprops from TestCases | Blocker | test | Alejandro Abdelnur | Devaraj Das | | | libhdfs API is out of sync with Filesystem API | Blocker | . | Christian Kunz | Sameer Paranjpye | | | DistributedFileSystem.getFileStatus() fails for path "/" | Blocker | . | Enis Soztutar | dhruba borthakur | | | NNBench benchmark hangs with trunk | Blocker | . | Raghu Angadi | Raghu Angadi | | | The FsShell Object cannot be used for multiple fs commands. | Minor | fs | dhruba borthakur | dhruba borthakur | | | Extensive logging of C++ application can slow down task by an order of magnitude | Blocker | . | Christian Kunz | Owen O'Malley | | | job id / job name mix-up | Blocker | . | Christian Kunz | Arun C Murthy | | | DFS Trash feature bugs | Blocker | . | Nigel Daley | dhruba borthakur | | | Performance regression with Block CRCs | Blocker | . | Raghu Angadi | Raghu Angadi | | | Improvements to Block CRC upgrade messages | Blocker | . | Raghu Angadi | Raghu Angadi | | | The SequenceFileRecordReader uses the default FileSystem rather than the supplied one | Major | . | Owen O'Malley | Owen O'Malley | | | add INCOMPATIBLE CHANGES section to CHANGES.txt for Hadoop 0.14 | Blocker | documentation | Nigel Daley | Nigel Daley | | | 7500+ reducers/partitions causes job to hang | Blocker | . | Srikanth Kakani | Devaraj Das | | | TestPipes.testPipes fails | Blocker | . | Nigel Daley | Owen O'Malley | | | TestDFSUpgradeFromImage fails on Windows | Blocker | test | Nigel Daley | Raghu Angadi | | | streaming returning 0 when submitJob fails with Exception | Major | . | Koji Noguchi | Koji Noguchi | | | Unhandled exception in Block CRC upgrade on datanode. | Blocker | . | Raghu Angadi | Raghu Angadi | | | TestDFSUpgradeFromImage fails on Solaris | Blocker | test | Nigel Daley | Raghu Angadi | | | Re organize StreamJob::submitAndMonitorJob() Exception handling | Minor | . | Lohit Vijayarenu | | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Block CRC Unit Tests: protocol tests | Blocker | . | Nigel Daley | Raghu Angadi | | | Block CRC Unit Tests: upgrade test | Blocker | . | Nigel Daley | Raghu Angadi | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | turn on speculative execution by defaul | Major | . | Owen O'Malley | Owen O'Malley | | | Example for contrib/data\_join | Minor | . | Senthil Subramanian | Senthil Subramanian |