Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.19.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Remove deprecated mapred.combine.once functionality | Major | . | Chris Douglas | Chris Douglas | | | Remove deprecated methods in JobConf | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Remove deprecated class OutputFormatBase | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Require Java 6 | Major | build | Doug Cutting | Doug Cutting | | | Append to files in HDFS | Major | . | stack | dhruba borthakur | | | fuse-dfs should take rw,ro,trashon,trashoff,protected=blah mount arguments rather than them being compiled in | Major | . | Pete Wyckoff | Pete Wyckoff | | | hadop streaming does not use progress reporting to detect hung tasks | Major | . | dhruba borthakur | dhruba borthakur | | | exit code from "hadoop dfs -test ..." is wrong for Unix shell | Minor | fs | Ben Slusky | Ben Slusky | | | distcp: Better Error Message should be thrown when accessing source files/directory with no read permission | Minor | . | Peeyush Bishnoi | Tsz Wo Nicholas Sze | | | Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks | Major | metrics | Runping Qi | Chris Douglas | | | Move task file promotion into the task | Major | . | Owen O'Malley | Amareshwari Sriramadasu | | | libhdfs should never exit on its own but rather return errors to the calling application | Minor | . | Pete Wyckoff | Pete Wyckoff | | | access times of HDFS files | Major | . | dhruba borthakur | dhruba borthakur | | | Need a distributed file checksum algorithm for HDFS | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Provide ability to persist running jobs (extend HADOOP-1876) | Major | . | Devaraj Das | Amar Kamat | | | ' -blocks ' option not being recognized | Minor | fs, util | Koji Noguchi | Lohit Vijayarenu | | | Provide a unified way to pass jobconf options from bin/hadoop | Minor | conf | Matei Zaharia | Enis Soztutar | | | Cluster summary at name node web has confusing report for space utilization | Major | . | Robert Chansler | Suresh Srinivas | | | Remove the deprecated, unused class ShellCommand. | Minor | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Quotas for disk space management | Major | . | Robert Chansler | Raghu Angadi | | | Balancer should provide better resource management | Blocker | . | Raghu Angadi | Hairong Kuang | | | Changes to JobHistory makes it backward incompatible | Blocker | . | Amar Kamat | Amar Kamat | | | Remove WritableJobConf | Major | . | Owen O'Malley | Owen O'Malley | | | Capacity reported in some of the commands is not consistent with the Web UI reported data | Blocker | . | Suresh Srinivas | Suresh Srinivas | | | Namenode Web UI capacity report is inconsistent with Balancer | Blocker |

| Suresh Srinivas | Suresh Srinivas | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | lzop-compatible CompresionCodec | Major | io | Chris Douglas | Chris Douglas | | | Add example code to support run terasort on hadoop | Major | . | Owen O'Malley | Owen O'Malley | | | Implement configuration items useful for Hadoop resource manager (v1) | Major | conf | Hemanth Yamijala | Hemanth Yamijala | | | [HOD] Have an ability to run multiple slaves per node | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli | | | supporting multiple outputs for M/R jobs | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | Bash tab completion support | Trivial | scripts | Chris Smith | Chris Smith | | | add new JobConf constructor that disables loading default configurations | Major | conf | Alejandro Abdelnur | Alejandro Abdelnur | | | should allow to specify different inputformat classes for different input dirs for Map/Reduce jobs | Major | . | Runping Qi | Chris Smith | | | fix writes | Minor | . | Pete Wyckoff | Pete Wyckoff | | | skip records that fail Task | Major | . | Doug Cutting | Sharad Agarwal | | | DistCp should have an option for limiting the number of files/bytes being copied | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Hardware Failure Monitoring in large clusters running Hadoop/HDFS | Minor | metrics | Ioannis Koltsidas | Ioannis Koltsidas | | | pipes should be able to set user counters | Major | . | Owen O'Malley | Arun C Murthy | | | org.apache.hadoop.http.HttpServer should support user configurable filter | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | A fair sharing job scheduler | Minor | . | Matei Zaharia | Matei Zaharia | | | Support a Thrift Interface to access files/directories in HDFS | Major | . | dhruba borthakur | dhruba borthakur | | | Write skipped records' bytes to DFS | Major | . | Sharad Agarwal | Sharad Agarwal | | | DistCp should support an option for deleting non-existing files. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Implement access control for submitting jobs to queues in the JobTracker | Major | . | Hemanth Yamijala | Hemanth Yamijala | | | Extend FileSystem API to return file-checksums/file-digests | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Implement renames for NativeS3FileSystem | Major | fs/s3 | Tom White | Tom White | | | add support for chaining Maps in a single Map and after a Reduce [M\/RM\] | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | Implementing core scheduler functionality in Resource Manager (V1) for Hadoop | Major | . | Vivek Ratan | Vivek Ratan | | | Synthetic Load Generator for NameNode testing | Major | . | Robert Chansler | Hairong Kuang | | | Narrown down skipped records based on user acceptable value | Major |

| Sharad Agarwal | Sharad Agarwal | | | Add explain plan capabilities to Hive QL | Major | . | Ashish Thusoo | Ashish Thusoo | | | add time, permission and user attribute support to libhdfs | Major | . | Pete Wyckoff | Pete Wyckoff | | | add time, permission and user attribute support to fuse-dfs | Major | . | Pete Wyckoff | Pete Wyckoff | | | Implement getFileChecksum(Path) in HftpFileSystem | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | [Hive] Provide a mechanism for registering UDFs from the query language | Major | . | Tom White | Tom White | | | MapReduce for MySQL | Minor | . | Fredrik Hedberg | Fredrik Hedberg | | | want input sampler & sorted partitioner | Major | . | Doug Cutting | Chris Douglas | | | Add a 'Killed' job status | Critical | . | Alejandro Abdelnur | Subru Krishnan | | | [Hive] print time taken by query in interactive shell | Minor | . | Raghotham Murthy | Raghotham Murthy | | | Forrest doc for skip bad records feature | Blocker | documentation | Sharad Agarwal | Sharad Agarwal | | | support show partitions in hive | Major | . | Ashish Thusoo | Ashish Thusoo | | | [Hive] enhance describe table & partition | Major | . | Prasad Chakka | Namit Jain | | | Add limit to Hive QL | Major | . | Ashish Thusoo | Namit Jain | | | Design and Implement a Test Plan to support appends to HDFS files | Blocker | test | dhruba borthakur | dhruba borthakur | | | Make TCTLSeparatedProtocol configurable and have DynamicSerDe initialize, initialize the SerDe | Major | . | Pete Wyckoff | Pete Wyckoff | | | want InputFormat for bzip2 files | Major | . | Doug Cutting | | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Seperate out datanode and namenode functionality of generation stamp upgrade process | Major | . | dhruba borthakur | dhruba borthakur | | | Tools to inject blocks into name node and simulated data nodes for testing | Minor | . | Sanjay Radia | Sanjay Radia | | | make key-value separators in hadoop streaming fully configurable | Major | . | Zheng Shao | Zheng Shao | | | Substitute the synchronized code in MD5Hash to avoid lock contention. Use ThreadLocal instead. | Major | io | Ivn de Prado | Ivn de Prado | | | provide more control options for the junit run | Minor | build | Steve Loughran | Steve Loughran | | | Add replication factor for injecting blocks in the data node cluster | Major | benchmarks | Sanjay Radia | Sanjay Radia | | | DFS write pipeline : only the last datanode needs to verify checksum | Major | . | Raghu Angadi | Raghu Angadi | | | The data\_join should allow the user to implement a customer cloning function | Major | . | Runping Qi | Runping Qi | | | CompositeRecordReader::next is unnecessarily complex | Major | . | Chris Douglas | Chris Douglas | | | The algorithm to decide map re-execution on fetch failures can be improved | Major |

| Jothi Padmanabhan | Jothi Padmanabhan | | | DFSAdmin incorrectly reports cluster data. | Minor | . | Konstantin Shvachko | Raghu Angadi | | | Writes from map serialization include redundant checks for accounting space | Major | . | Chris Douglas | Chris Douglas | | | Refactor the scheduler out of the JobTracker | Minor | . | Brice Arnould | Brice Arnould | | | CreateEditsLog could be improved to create tree directory structure | Minor | test | Lohit Vijayarenu | Lohit Vijayarenu | | | Add counter support to MultipleOutputs | Minor | . | Alejandro Abdelnur | Alejandro Abdelnur | | | Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile) | Major | . | Pete Wyckoff | Pete Wyckoff | | | LeaseChecker daemon should not be started in DFSClient constructor | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Providing bzip2 as codec | Major | conf, io | Abdul Qadeer | Abdul Qadeer | | | Make MapFile.Reader and Writer implement java.io.Closeable | Major | io | Tom White | Tom White | | | if MiniDFS startup time could be improved, testing time would be reduced | Major | test | Steve Loughran | Doug Cutting | | | Namenode should synchronously resolve a datanode's network location when the datanode registers | Major | . | Hairong Kuang | Hairong Kuang | | | Compare name-node performance when journaling is performed into local hard-drives or nfs. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko | | | improve fuse-dfs write performance which is 33% slower than hadoop dfs -copyFromLocal | Minor | . | Pete Wyckoff | | | | Streaming should provide an option for numerical sort of keys | Major | . | Lohit Vijayarenu | Devaraj Das | | | Include Unix group name in JobConf | Trivial | conf | Matei Zaharia | Matei Zaharia | | | Move multiple input format extension to library package | Major | . | Tom White | Tom White | | | Free temporary space should be modelled better | Major | . | Owen O'Malley | Ari Rabkin | | | Deprecate org.apache.hadoop.fs.FileUtil.fullyDelete(FileSystem fs, Path dir) | Major | fs | Tsz Wo Nicholas Sze | Amareshwari Sriramadasu | | | Can commons-logging.properties be pulled from hadoop-core? | Major | build | Steve Loughran | Steve Loughran | | | JobTracker should synchronously resolve the tasktracker's network location when the tracker registers | Major | . | Amar Kamat | Amar Kamat | | | If ShellCommandExecutor had a toString() operator that listed the command run, its error messages may be more meaningful | Minor | util | Steve Loughran | Steve Loughran | | | Remove deprecated methods introduced in changes to validating input paths (HADOOP-3095) | Major | . | Tom White | Tom White | | | Chukwa | Major | . | Ari Rabkin | Ari Rabkin | | | Extract classes from DataNode.java | Trivial | . | Johan Oskarsson | Johan Oskarsson | | | Create a generic interface for edits log. | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | meaningful errno values in libhdfs | Major |

| Ben Slusky | Ben Slusky | | | Pipes submit job should be Non-blocking | Critical | . | Srikanth Kakani | Arun C Murthy | | | TupleWritable listed as public class but cannot be used without methods private to the package | Trivial | documentation | Michael Andrews | Chris Douglas | | | Provide ability to run memory intensive jobs without affecting other running tasks on the nodes | Major | . | Hemanth Yamijala | Hemanth Yamijala | | | Make DataBlockScanner package private | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | Preallocate transaction log to improve namenode transaction logging performance | Major | . | dhruba borthakur | dhruba borthakur | | | Better error message if llibhdfs.so doesn't exist | Minor | . | Pete Wyckoff | Pete Wyckoff | | | Better safety of killing jobs via web interface | Minor | . | Daniel Naber | Enis Soztutar | | | expose static SampleMapper and SampleReducer classes of GenericMRLoadGenerator class for gridmix reuse | Major | test | Lingyun Yang | Lingyun Yang | | | Separate Namenodes edits and fsimage | Major | . | Lohit Vijayarenu | Lohit Vijayarenu | | | Improve Hadoop Jobtracker Admin | Major | scripts | craig weisenfluh | craig weisenfluh | | | NetworkTopology.pseudoSortByDistance does not need to be a synchronized method | Major | . | Hairong Kuang | Hairong Kuang | | | File globbing alternation should be able to span path components | Major | fs | Tom White | Tom White | | | Prevent memory intensive user tasks from taking down nodes | Major | . | Hemanth Yamijala | Vinod Kumar Vavilapalli | | | Added an abort on unset AWS\ACCOUNT\ID to luanch-hadoop-master | Minor | contrib/cloud | Al Hoang | Al Hoang | | | Reduce seeks during shuffle, by inline crcs | Major | . | Devaraj Das | Jothi Padmanabhan | | | libhdfs should never exit on its own but rather return errors to the calling application - missing diff files | Minor | . | Pete Wyckoff | Pete Wyckoff | | | The reduce task should not flush the in memory file system before starting the reducer | Critical | . | Owen O'Malley | Chris Douglas | | | [Hive]implement hive-site.xml similar to hadoop-site.xml | Minor | . | Prasad Chakka | Prasad Chakka | | | Add a memcmp-compatible interface for key types | Minor | . | Chris Douglas | Chris Douglas | | | Move non-client methods ou of ClientProtocol | Major | . | Konstantin Shvachko | Konstantin Shvachko | | | [Hive] refactor the SerDe library | Major | . | Zheng Shao | Zheng Shao | | | test-patch.sh should output the ant commands that it runs | Major | build | Nigel Daley | Ramya Sunil | | | Improve configurability of Hadoop EC2 instances | Major | contrib/cloud | Tom White | Tom White | | | Add support for larger EC2 instance types | Major | contrib/cloud | Tom White | Chris K Wensel | | | Decide how to integrate scheduler info into CLI and job tracker web page | Major | . | Matei Zaharia | Sreekanth Ramakrishnan | | | change new config attribute queue.name to mapred.job.queue.name | Major |

| Owen O'Malley | Hemanth Yamijala | | | Add JobConf and JobID to job related methods in JobTrackerInstrumentation | Major | . | Mac Yang | Mac Yang | | | Improving Map -\> Reduce performance and Task JVM reuse | Major | . | Benjamin Reed | Devaraj Das | | | Cache the iFile index files in memory to reduce seeks during map output serving | Major | . | Devaraj Das | Jothi Padmanabhan | | | test-patch can report the modifications found in the workspace along with the error message | Minor | test | Hemanth Yamijala | Ramya Sunil | | | Changing priority of a job should be available in CLI and available on the web UI only along with the Kill Job actions | Major | . | Hemanth Yamijala | Hemanth Yamijala | | | Augment JobHistory to store tasks' userlogs | Major | . | Arun C Murthy | Vinod Kumar Vavilapalli | | | IPC client does not need to be synchronized on the output stream when a connection is closed | Major | ipc | Hairong Kuang | Hairong Kuang | | | some minor things to make Hadoop friendlier to git | Major | build | Owen O'Malley | Owen O'Malley | | | The configuration file lists two paths to hadoop directories (bin and conf). Startup should check that these are valid directories and give appropriate messages. | Minor | . | Ashish Thusoo | Raghotham Murthy | | | [Hive] metastore and ql to use the refactored SerDe library | Major | . | Zheng Shao | Zheng Shao | | | write the random number generator seed to log in the append-related tests | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Schedulers need to know when a job has completed | Blocker | . | Vivek Ratan | Amar Kamat | | | menu layout change for Hadoop documentation | Blocker | documentation | Boris Shkolnik | Boris Shkolnik | | | Hive: GroupBy should not pass the whole row from mapper to reducer | Blocker | . | Zheng Shao | Ashish Thusoo | | | Hive: converting complex objects to JSON failed. | Minor | . | Zheng Shao | Zheng Shao | | | Catch Ctrl-C in Hive CLI so that corresponding hadoop jobs can be killed | Minor | . | Prasad Chakka | Pete Wyckoff | | | enable multi-line query from Hive CLI | Minor | . | Prasad Chakka | Prasad Chakka | | | add an option to describe table to show extended properties of the table such as serialization/deserialization properties | Major | . | Prasad Chakka | Prasad Chakka | | | Hive: Check that partitioning predicate is present when hive.partition.pruning = strict | Major | . | Ashish Thusoo | Ashish Thusoo | | | Add versionning/tags to Chukwa Chunk | Major | . | Jerome Boulon | Jerome Boulon | | | Improve data loader for collecting metrics and log files from hadoop and system | Major |

| Eric Yang | Eric Yang | | | include message of local exception in Client call failures | Minor | ipc | Steve Loughran | Steve Loughran | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Metrics FilesCreated and files\_deleted metrics do not match. | Blocker | metrics | Lohit Vijayarenu | Lohit Vijayarenu | | | Hadoop archives should not create \_logs file in the final archive directory. | Blocker | . | Mahadev konar | Mahadev konar | | | Archvies sometimes create empty part files. | Blocker | . | Mahadev konar | Mahadev konar | | | [HOD] If a cluster directory is specified as a relative path, an existing script.exitcode file will not be deleted. | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli | | | Need to increment the year field for the copyright notice | Trivial | documentation | Chris Douglas | Chris Douglas | | | NativeS3FsInputStream read() method for reading a single byte is incorrect | Major | fs/s3 | Tom White | Tom White | | | Streaming input is not parsed properly to find the separator | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | TestMiniMRMapRedDebugScript loses exception details | Minor | test | Steve Loughran | Steve Loughran | | | TestCLI loses exception details on setup/teardown | Minor | test | Steve Loughran | Steve Loughran | | | Block scanner should read block information during initialization. | Blocker | . | Konstantin Shvachko | Raghu Angadi | | | dfsadmin -refreshNodes should re-read the config file. | Major | . | Lohit Vijayarenu | Lohit Vijayarenu | | | libhdfs only accepts O\WRONLY and O\RDONLY so does not accept things like O\WRONLY \| O\CREAT | Minor | . | Pete Wyckoff | Pi Song | | | jobtasks.jsp when called for running tasks should ignore completed TIPs | Major | . | Amar Kamat | Amar Kamat | | | Failure to load native lzo libraries causes job failure | Major | . | Chris Douglas | Chris Douglas | | | Cannot run more than one instance of examples.SleepJob at the same time. | Minor | . | Brice Arnould | Brice Arnould | | | NameNode does not save image if different dfs.name.dir have different checkpoint stamps | Major | . | Lohit Vijayarenu | Lohit Vijayarenu | | | seek(long) in DFSInputStream should catch socket exception for retry later | Minor | . | Luo Ning | Luo Ning | | | dfs.client.buffer.dir isn't used in hdfs, but it's still in conf/hadoop-default.xml | Trivial | . | Michael Bieniosek | Raghu Angadi | | | NPE in NameNode with unknown blocks | Blocker | . | Raghu Angadi | Raghu Angadi | | | gridmix-env has a syntax error, and wrongly defines USE\REAL\DATASET by default | Major | benchmarks | Arun C Murthy | Arun C Murthy | | | can not get svn revision # at build time if locale is not english | Minor | build | Rong-En Fan | Rong-En Fan | | | TaskTracker.localizeJob calls getSystemDir for each task rather than caching it | Major | . | Arun C Murthy | Arun C Murthy | | | Use a thread-local rather than static ENCODER/DECODER variables in Text for synchronization | Critical | . | Arun C Murthy | Arun C Murthy | | | enabling BLOCK compression for map outputs breaks the reduce progress counters | Major |

| Colin Evans | Matei Zaharia | | | TestMultipleOutputs will fail if it is ran more than one times | Major | test | Tsz Wo Nicholas Sze | Alejandro Abdelnur | | | CreateEditsLog used for benchmark misses creating parent directories | Minor | benchmarks | Lohit Vijayarenu | Lohit Vijayarenu | | | A few tests still using old hdfs package name | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | [HOD]checknodes prints errors messages on stdout | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | INodeDirectoryWithQuota should be in its own .java file | Minor | . | Steve Loughran | Tsz Wo Nicholas Sze | | | hadoop conf got slightly mangled by 3772 | Minor | . | Ari Rabkin | Ari Rabkin | | | Fix TaskTracker's heartbeat timer to note the time the hearbeat RPC returned to decide next heartbeat time | Major | . | Arun C Murthy | Arun C Murthy | | | JobTracker lockup due to JobInProgress.initTasks taking significant time for large jobs on large clusters | Critical | . | Arun C Murthy | Arun C Murthy | | | mapred.local.dir temp dir. space allocation limited by smallest area | Minor | . | Paul Baclace | Ari Rabkin | | | spelling error in FSNamesystemMetrics log message | Trivial | . | Steve Loughran | Steve Loughran | | | KFS changes for faster directory listing | Minor | fs | Sriram Rao | Sriram Rao | | | Setting the conf twice in Pipes Submitter | Trivial | . | Koji Noguchi | Koji Noguchi | | | TestDataJoin references dfs.MiniDFSCluster instead of hdfs.MiniDFSCluster | Major | test | Owen O'Malley | Owen O'Malley | | | The package name used in FSNamesystem is incorrect | Trivial | . | Tsz Wo Nicholas Sze | Chris Douglas | | | TestMapRed fails on trunk | Blocker | test | Amareshwari Sriramadasu | Tom White | | | javadoc warnings: Multiple sources of package comments found for package | Major | build, documentation | Tsz Wo Nicholas Sze | Jerome Boulon | | | DataNode's BlockSender sends more data than necessary | Minor | . | Ning Li | Ning Li | | | Shell command "fs -count" should support paths with different file systsms | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Fix javac warnings in DistCp and the corresponding tests | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | TestMapRed ignores failures of the test case | Major | test | Owen O'Malley | Owen O'Malley | | | Incorrect destination IP logged for receiving blocks | Minor | . | Koji Noguchi | Chris Douglas | | | TestHDFSServerPorts fails on trunk | Major | . | Amar Kamat | Hairong Kuang | | | javadoc warnings by failmon | Major | build | Tsz Wo Nicholas Sze | dhruba borthakur | | | FileSystem cache should be case-insensitive | Major | fs | Doug Cutting | Bill de hOra | | | Occasional NPE in Jets3tFileSystemStore | Major | fs/s3 | Robert | Tom White | | | CompositeInputFormat is unable to parse InputFormat classes with names containing '\_' or '$' | Major |

| Jingkei Ly | Chris Douglas | | | javadoc warnings: incorrect references | Major | documentation | Tsz Wo Nicholas Sze | Owen O'Malley | | | LzopCodec shouldn't be in the default list of codecs i.e. io.compression.codecs | Major | io | Arun C Murthy | Arun C Murthy | | | resource estimation works badly in some cases | Blocker | . | Ari Rabkin | Ari Rabkin | | | Increment InterTrackerProtocol version number due to changes in HADOOP-3759 | Major | . | Hemanth Yamijala | Hemanth Yamijala | | | Pipes with a C++ record reader does not update progress in the map until it is 100% | Major | . | Owen O'Malley | Arun C Murthy | | | the rsync command in hadoop-daemon.sh also rsync the logs folder from the master, what deletes the datanode / tasktracker log files. | Critical | scripts | Stefan Groschupf | Craig Macdonald | | | Job history may get disabled due to overly long job names | Major | . | Matei Zaharia | Matei Zaharia | | | TestMapRed and TestMiniMRDFSSort failed on trunk | Major | test | Tsz Wo Nicholas Sze | Enis Soztutar | | | Are ClusterTestDFSNamespaceLogging and ClusterTestDFS still valid tests? | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Skip records enabled as default. | Critical | . | Koji Noguchi | Sharad Agarwal | | | TestFairScheduler failed on Linux | Major | . | Tsz Wo Nicholas Sze | Matei Zaharia | | | TestKosmosFileSystem fails on trunk | Blocker | fs | Amareshwari Sriramadasu | Lohit Vijayarenu | | | test-libhdfs fails on trunk | Major | . | Lohit Vijayarenu | Pete Wyckoff | | | Scheduler.assignTasks should not be dealing with cleanupTask | Major | . | Devaraj Das | Amareshwari Sriramadasu | | | Counters written to the job history cannot be recovered back | Major | . | Amar Kamat | Amar Kamat | | | Hive interaction with speculative execution is broken | Critical | . | Joydeep Sen Sarma | Joydeep Sen Sarma | | | Fix javac warning in WritableUtils | Minor | io | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | During edit log loading, an underconstruction file's lease gets removed twice | Major | . | Hairong Kuang | Hairong Kuang | | | FSNameSystem.isReplicationInProgress should add an underReplicated block to the neededReplication queue using method "add" not "update" | Major | . | Hairong Kuang | Hairong Kuang | | | Remove JobWithTaskContext from JobInProgress | Trivial | . | Amar Kamat | Amareshwari Sriramadasu | | | remove derby.log files form repository and also change the location where these files get created | Minor | . | Prasad Chakka | Prasad Chakka | | | Got ArrayOutOfBound exception while analyzing the job history | Major | . | Amar Kamat | Amareshwari Sriramadasu | | | slow-reading dfs clients do not recover from datanode-write-timeouts | Major | . | Christian Kunz | Raghu Angadi | | | JobHisotry::JOBTRACKER\START\TIME is not initialized properly | Major | . | Lohit Vijayarenu | Lohit Vijayarenu | | | HFTP interface compatibility with older releases broken | Blocker | fs | Kan Zhang | dhruba borthakur | | | Including user specified jar files in the client side classpath path in Hadoop 0.17 streaming | Major |

| Suhas Gogate | Sharad Agarwal | | | Memory limits of TaskTracker and Tasks should be in kiloBytes. | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | [Hive] multi group by statement is not optimized | Major | . | Namit Jain | Namit Jain | | | LeaseManager needs refactoring. | Major | . | Konstantin Shvachko | Tsz Wo Nicholas Sze | | | Reduce cleanup tip web ui is does not show attempts | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Make Hive metastore server to work for PHP & Python clients | Major | . | Prasad Chakka | Prasad Chakka | | | Need to update DATA\TRANSFER\VERSION | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | SequenceFile.Writer close() uses compressor after returning it to CodecPool. | Major | io | Hong Tang | Arun C Murthy | | | [HOD] --resource\_manager.options is not passed to qsub | Major | contrib/hod | Craig Macdonald | Vinod Kumar Vavilapalli | | | "deprecated filesystem name" warning on EC2 | Minor | contrib/cloud | Stuart Sierra | Tom White | | | updates to hadoop-ec2-env.sh for 0.18.0 | Minor | contrib/cloud | Karl Anderson | Tom White | | | JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory | Critical | . | Runping Qi | Amareshwari Sriramadasu | | | Hadoop-Patch build is failing | Major | build | Ramya Sunil | Ramya Sunil | | | HistoryViewer initialization failure should log exception trace | Trivial | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | NPE in TestLimitTasksPerJobTaskScheduler | Major | test | Tsz Wo Nicholas Sze | Sreekanth Ramakrishnan | | | Access permissions for setting access times and modification times for files | Blocker | . | dhruba borthakur | dhruba borthakur | | | org.apache.hadoop.fs.FileUtil.copy() will leak input streams if the destination can't be opened | Minor | fs | Steve Loughran | Bill de hOra | | | 'compressed' keyword in DDL syntax misleading and does not compress | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma | | | Incorporate metastore server review comments | Major | . | Prasad Chakka | Prasad Chakka | | | When streaming utility is run without specifying mapper/reducer/input/output options, it returns 0. | Major | . | Ramya Sunil | | | | Remove an extra ";" in FSDirectory | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove HADOOP-1230 API from 0.19 | Major | . | Owen O'Malley | Owen O'Malley | | | Declare hsqldb.jar in eclipse plugin | Blocker | contrib/eclipse-plugin | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | hadoop jar throwing exception when running examples | Blocker | . | Hemanth Yamijala | Owen O'Malley | | | LineRecordReader.LineReader should use util.LineReader | Major | util | Chris Douglas | Chris Douglas | | | test-libhdfs consistently fails on trunk | Blocker | . | Raghu Angadi | Pete Wyckoff | | | Cannot setSpaceQuota to 1TB | Blocker | . | Tsz Wo Nicholas Sze | Raghu Angadi | | | New public methods added to the \*ID classes | Major |

| Owen O'Malley | Owen O'Malley | | | TestProcfsBasedProcessTree failing on Windows machine | Major | test, util | Ramya Sunil | Vinod Kumar Vavilapalli | | | HADOOP-3245 is incomplete | Blocker | . | Amar Kamat | Amar Kamat | | | Capacity scheduler's implementation of getJobs modifies the list of running jobs inadvertently | Blocker | . | Hemanth Yamijala | Hemanth Yamijala | | | eclipse-plugin no longer compiles on trunk | Blocker | contrib/eclipse-plugin | Chris Douglas | Chris Douglas | | | Race condition in JVM reuse when more than one slot becomes free | Blocker | . | Devaraj Das | Devaraj Das | | | change max length of database columns for metastore to 767 | Minor | . | Prasad Chakka | Prasad Chakka | | | [Hive]unify Table.getCols() & get\_fields() | Major | . | Prasad Chakka | Prasad Chakka | | | TestReduceFetch fails intermittently | Blocker | . | Devaraj Das | Chris Douglas | | | fuse-dfs dfs\_read function may return less than the requested #of bytes even if EOF not reached | Blocker | . | Pete Wyckoff | Pete Wyckoff | | | Reduce task copy errors may not kill it eventually | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | The TaskAttemptID should not have the JobTracker start time | Blocker | . | Owen O'Malley | Amar Kamat | | | If a reducer failed at shuffling stage, the task should fail, not just logging an exception | Blocker | . | Runping Qi | Sharad Agarwal | | | Unable to access a file by a different user in the same group when permissions is set to 770 or when permissions is turned OFF | Blocker | . | Ramya Sunil | Hairong Kuang | | | Jobs failing in the init stage will never cleanup | Blocker | . | Amar Kamat | Amareshwari Sriramadasu | | | Remove Completed and Failed Job tables from jobqueue\_details.jsp | Blocker | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan | | | TestDBJob failed on Linux | Blocker | . | Raghu Angadi | Enis Soztutar | | | FSEditLog logs modification time instead of access time. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko | | | limit memory usage in jobtracker | Major | . | dhruba borthakur | dhruba borthakur | | | java.lang.NullPointerException is observed in Jobtracker log while call heartbeat | Blocker | . | Karam Singh | Amar Kamat | | | Make new classes in mapred package private instead of public | Major | . | Owen O'Malley | Owen O'Malley | | | DFS upgrade fails on Windows | Blocker | fs | NOMURA Yoshihide | Konstantin Shvachko | | | Merge AccessControlException and AccessControlIOException into one exception class | Blocker | fs | Owen O'Malley | Owen O'Malley | | | [mapred] jobqueue\_details.jsp shows negative count of running and waiting reduces with CapacityTaskScheduler. | Blocker | . | Vinod Kumar Vavilapalli | Sreekanth Ramakrishnan | | | Corner cases in killJob from command line | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Add "hdfs://" to fs.default.name on quickstart.html | Trivial | documentation | Jeff Hammerbacher | Jeff Hammerbacher | | | TestJobQueueInformation fails regularly | Blocker | test | Tsz Wo Nicholas Sze | Sreekanth Ramakrishnan | | | [HOD] Remove

generation, as this is removed in Hadoop 0.19. | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli | | | Fix line formatting in hadoop-default.xml for hadoop.http.filter.initializers | Blocker | conf | Enis Soztutar | Enis Soztutar | | | TestMiniMRDebugScript fails on trunk | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | JobTracker.killJob() fails to kill a job if the job is not yet initialized | Blocker | . | Amar Kamat | Sharad Agarwal | | | Guaranteed Capacity calculation is not calculated correctly | Blocker | . | Karam Singh | Hemanth Yamijala | | | FsShell -ls fails for file systems without owners or groups | Major | scripts | David Phillips | David Phillips | | | Update documentation in forrest for Mapred, streaming and pipes | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | reducers stuck at shuffling | Blocker | . | Runping Qi | dhruba borthakur | | | Edits log takes much longer to load | Blocker | . | Chris Douglas | Chris Douglas | | | Add new/missing commands in forrest | Blocker | documentation | Sharad Agarwal | Sreekanth Ramakrishnan | | | TestDatanodeDeath failed occasionally | Blocker | . | Tsz Wo Nicholas Sze | dhruba borthakur | | | FSDataset.getStoredBlock(id) should not return corrupted information | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | NPE from CreateEditsLog | Blocker | test | Chris Douglas | Raghu Angadi | | | Minor formatting changes to quota related commands | Trivial | . | Raghu Angadi | Raghu Angadi | | | Upload the derby.jar and TestSeDe.jar needed for fixes to 0.19 bugs | Blocker | . | Ashish Thusoo | Ashish Thusoo | | | Input split logging in history is broken in 0.19 | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu | | | Document the capacity scheduler in Forrest | Blocker | documentation | Hemanth Yamijala | Hemanth Yamijala | | | saveFSImage() should remove files from a storage directory that do not correspond to its type. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko | | | JobQueueJobInProgressListener.jobUpdated() might not work as expected | Blocker | . | Amar Kamat | Amar Kamat | | | Add new/missing dfs commands in forrest | Blocker | documentation | Hemanth Yamijala | Suresh Srinivas | | | Spasm of JobClient failures on successful jobs every once in a while | Blocker | . | Joydeep Sen Sarma | dhruba borthakur | | | Cleanup memory related resource management | Blocker | . | Hemanth Yamijala | Hemanth Yamijala | | | pipes examples aren't in the release | Major | . | Owen O'Malley | Owen O'Malley | | | Hive: [] operator with maps does not work | Major | . | Ashish Thusoo | Ashish Thusoo | | | Hive: AS clause with subqueries having group bys is not propogated to the outer query block | Major | . | Ashish Thusoo | Ashish Thusoo | | | Hive: Partition pruning causes semantic exception with joins | Major | . | Ashish Thusoo | Ashish Thusoo | | | Hive: trim and rtrim UDFs behaviors are reversed | Major |

| Ashish Thusoo | Ashish Thusoo | | | Hive: Cleanup temporary files once the job is done | Major | . | Ashish Thusoo | Ashish Thusoo | | | [Hive] null pointer exception on a join | Major | . | Namit Jain | Namit Jain | | | [Hive] error when user specifies the delimiter | Major | . | Namit Jain | Namit Jain | | | [Hive] job submission exception if input is null | Major | . | Namit Jain | Namit Jain | | | [Hive] extra new lines at output | Major | . | Namit Jain | Namit Jain | | | Create table hive does not set delimeters | Major | . | Edward Capriolo | Namit Jain | | | [hive] bug in partition pruning | Major | . | Namit Jain | Namit Jain | | | [Hive] for a 2-stage map-reduce job, number of reducers not set correctly | Major | . | Namit Jain | Namit Jain | | | -hiveconf config parameters in hive cli should override all config variables | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma | | | Hive: UDAF functions cannot handle NULL values | Major | . | Zheng Shao | Zheng Shao | | | hive 2 case sensitivity issues | Major | . | Zheng Shao | | | | Hive: Parser should pass field schema to SerDe | Major | . | Zheng Shao | | | | add ability to drop partitions through DDL | Minor | . | Prasad Chakka | Prasad Chakka | | | select \* to console issues in Hive | Major | . | Joydeep Sen Sarma | | | | Hive: Support "IS NULL", "IS NOT NULL", and size(x) for map and list | Major | . | Zheng Shao | Zheng Shao | | | [Hive] TCTLSeparatedProtocol implement maps/lists/sets read/writes | Major | . | Pete Wyckoff | | | | Remove short names of serdes from Deserializer, Serializer & SerDe interface and relevant code. | Major | . | Prasad Chakka | Prasad Chakka | | | all creation of hadoop dfs queries from with in hive shell | Minor | . | Prasad Chakka | Prasad Chakka | | | Provide way to replace existing column names for columnSet tables | Major | . | Prasad Chakka | Prasad Chakka | | | fix sampling bug in fractional bucket case | Minor | . | Prasad Chakka | Prasad Chakka | | | Hive: metadataTypedColumnsetSerDe should check if SERIALIZATION.LIB is old columnsetSerDe | Major | . | Zheng Shao | Prasad Chakka | | | TestHDFSFileSystemContract fails on windows | Blocker | test | Raghu Angadi | Raghu Angadi | | | SequenceFileOutputFormat is coupled to WritableComparable and Writable | Blocker | io | Chris K Wensel | Chris K Wensel | | | FileOutputFormat protects getTaskOutputPath | Blocker | . | Chris K Wensel | Chris K Wensel | | | Check if the tmp file used in the CLI exists before using it. | Major | . | Ashish Thusoo | | | | config ipc.server.tcpnodelay is no loger being respected | Major | ipc | Clint Morgan | Clint Morgan | | | JobHistory does not escape literal jobName when used in a regex pattern | Blocker |

| Chris K Wensel | Chris K Wensel | | | Update Scheduling Information display in Web UI | Major | . | Karam Singh | Sreekanth Ramakrishnan | | | User configurable filter fails to filter accesses to certain directories | Blocker | . | Kan Zhang | Tsz Wo Nicholas Sze | | | JVM Reuse triggers RuntimeException("Invalid state") | Major | . | Aaron Kimball | Devaraj Das | | | Deadlock in RPC Server | Major | ipc | Raghu Angadi | Raghu Angadi | | | Capacity Scheduler should maintain the right ordering of jobs in its running queue | Blocker | . | Vivek Ratan | Amar Kamat | | | multifilesplit is using job default filesystem incorrectly | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | contrib/data\_join needs unit tests | Major | test | Chris Douglas | Chris Douglas | | | Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run. | Minor | test | Ramya Sunil | Ramya Sunil | | | TestKosmosFileSystem can fail when run through ant test on systems shared by users | Minor | fs | Hemanth Yamijala | Lohit Vijayarenu | | | findbugs should run over the tools.jar also | Minor | test | Owen O'Malley | Chris Douglas | | | TestStreamingBadRecords.testNarrowDown fails intermittently | Minor | test | Sharad Agarwal | Sharad Agarwal | | | Add more unit tests to test appending to files in HDFS | Blocker | test | dhruba borthakur | Tsz Wo Nicholas Sze | | | TestCapacityScheduler is broken | Blocker | . | Hemanth Yamijala | Hemanth Yamijala | | | Separate testClientTriggeredLeaseRecovery() out from TestFileCreation | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Hive: test for case sensitivity in serde2 thrift serde | Minor | . | Zheng Shao | | | | Unit test for DynamicSerDe | Minor | . | Pete Wyckoff | Pete Wyckoff | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Refactor org.apache.hadoop.mapred.StatusHttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Move LineRecordReader.LineReader class to util package | Major | . | Tom White | Tom White | | | Fix simple module dependencies between core, hdfs and mapred | Major | . | Tom White | Tom White | | | Separate TestDatanodeDeath.testDatanodeDeath() into 4 tests | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Hive as a contrib project | Minor | . | Joydeep Sen Sarma | Ashish Thusoo | | | Use generics in ReflectionUtils | Trivial | . | Chris Smith | Chris Smith | | | fuse-dfs REAME lists wrong ant flags and is not specific in some place | Major | . | Pete Wyckoff | Pete Wyckoff | | | Update DistCp documentation | Blocker | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | libhdfs wiki is very out-of-date and contains mostly broken links | Minor | documentation | Pete Wyckoff | Pete Wyckoff |