Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.23.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Dfs client name for a map/reduce task should have some randomness | Major | hdfs-client | Hairong Kuang | Hairong Kuang | | | dfs.data.dir permissions should default to 700 | Minor | datanode | Todd Lipcon | Todd Lipcon | | | Improve HDFS WebUI | Major | . | Hairong Kuang | Hairong Kuang | | | Provide a JNI-based implementation of ShellBasedUnixGroupsNetgroupMapping (implementation of GroupMappingServiceProvider) | Major | security | Erik Steffl | Boris Shkolnik | | | A baby step towards inter-version RPC communications | Major | ipc | Hairong Kuang | Hairong Kuang | | | Statistics support in FileContext | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Remove failmon contrib | Major | . | Nigel Daley | Nigel Daley | | | MapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Nicholas Telford | Nicholas Telford | | | HDFS federation: Improve start/stop scripts and add script to decommission datanodes | Minor | scripts | Tanping Wang | Tanping Wang | | | Transfer RBW between datanodes | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting | Major | io | Navis | Matt Foley | | | Add a new DataTransferProtocol operation, Op.TRANSFER\_BLOCK, instead of using RPC | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Provide a stronger data guarantee in the write pipeline | Major | datanode, hdfs-client, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove protocol version check at proxy creation in Hadoop RPC. | Major | ipc | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Metrics2: metrics instrumentation | Major | . | Luke Lu | Luke Lu | | | metrics2: metrics plugins | Major | . | Luke Lu | Luke Lu | | | HDFS portion of HADOOP-6728 (ovehaul metrics framework) | Major | . | Luke Lu | Luke Lu | | | Removed deprecated fields in DataTransferProtocol | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Refactor FsShell's du/dus/df | Major | fs | Daryn Sharp | Daryn Sharp | | | Create an rpm integration project | Major | . | Owen O'Malley | Eric Yang | | | HDFS rpm integration project | Major | build | Eric Yang | Eric Yang | | | Remove deprecated JobTracker.State in favour of JobTrackerStatus | Major | build, client | Tom White | Tom White | | | Encapsulate individual DataTransferProtocol op header | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Make hadoop-daemon.sh to return 1 if daemon processes did not get started | Trivial | scripts | Tanping Wang | Tanping Wang | | | DataTransfer Protocol using protobufs | Major | . | Todd Lipcon | Todd Lipcon | | | Remove mrunit contrib | Major | . | Nigel Daley | Nigel Daley | | | Don't add

to the classpath when running Hadoop | Major | scripts | Eli Collins | Eli Collins | | | Create a package and individual class files for DataTransferProtocol | Major | datanode, hdfs-client, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add methods to DataTransferProtocol interface | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | quota errors messages should use the same scale | Minor | . | Allen Wittenauer | Jim Plush | | | Move block management code to a package | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove IsolationRunner | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | Configuration getInt, getLong, and getFloat replace invalid numbers with the default value | Major | conf | Owen O'Malley | Harsh J | | | Remove hdfsproxy | Major | contrib/hdfsproxy | Eli Collins | Eli Collins | | | Simpler model for Namenode's fs Image and edit Logs | Major | . | Sanjay Radia | Todd Lipcon | | | Changes to balancer bandwidth should not require datanode restart. | Major | balancer & mover, datanode | Eric Payne | Eric Payne | | | MapReduce portion of HADOOP-6728 (ovehaul metrics framework) | Major | . | Luke Lu | Luke Lu | | | Bump avro version to at least 1.4.1 | Major | io | Luke Lu | Luke Lu | | | Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ] | Minor | io | Uma Maheswara Rao G | Uma Maheswara Rao G | | | jvm metrics all use the same namespace | Major | metrics | Jeff Bean | Alejandro Abdelnur | | | Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol | Blocker | mrv2 | Hitesh Shah | Hitesh Shah | | | MR2 memory limits should be pmem, not vmem | Blocker | mrv2, nodemanager | Todd Lipcon | Todd Lipcon | | | Remove unused contrib components dependent on MR1 | Major | jobtracker, tasktracker | Eli Collins | Eli Collins | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Create multi-format parser for edits logs file, support binary and XML formats initially | Major | tools | Erik Steffl | Erik Steffl | | | MR-279: WebApp for Job History | Major | mrv2 | Mahadev konar | Krishna Ramachandran | | | Intrinsic limits for HDFS files, directories | Major | datanode | Daryn Sharp | Daryn Sharp | | | HDFS scalability with multiple namenodes | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | MR-279: ResourceManager metrics | Major | mrv2 | Luke Lu | Luke Lu | | | Federation Cluster Management Web Console | Major | . | Tanping Wang | Tanping Wang | | | A client side mount table to give per-application/per-job file system view | Major | . | Sanjay Radia | Sanjay Radia | | | Hadoop /usr/bin/groups equivalent | Major | . | Aaron T. Myers | Aaron T. Myers | | | HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent | Major | hdfs-client, namenode | Aaron T. Myers | Aaron

Myers | | | MR portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent | Major | jobtracker | Aaron T. Myers | Aaron T. Myers | | | Enable ServicePlugins for the JobTracker | Minor | . | Fredrik Hedberg | Fredrik Hedberg | | | Make Gridmix emulate usage of Distributed Cache files | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | MR-279: Metrics for reserved resource in ResourceManager | Major | mrv2 | Luke Lu | Luke Lu | | | MR-279: Metrics for MRAppMaster | Major | mrv2 | Luke Lu | Luke Lu | | | MR-279: Metrics for NodeManager | Major | mrv2 | Luke Lu | Luke Lu | | | Make Gridmix emulate usage of data compression | Major | contrib/gridmix | Ravi Gummadi | Amar Kamat | | | Mapreduce RPM integration project | Major | build | Eric Yang | Eric Yang | | | [Gridmix] Add support for HighRam jobs | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | | Expose JMX with something like JMXProxyServlet | Major | . | Luke Lu | Robert Joseph Evans | | | Add hflush support to libhdfs | Major | libhdfs | Travis Crawford | Travis Crawford | | | Adopt JMXJsonServlet into HDFS in order to query statistics | Major | . | Tanping Wang | Tanping Wang | | | Integrate Snappy compression | Major | . | Eli Collins | Alejandro Abdelnur | | | Add metrics to the fair scheduler | Major | contrib/fair-share | Todd Lipcon | Todd Lipcon | | | Add CRC32C as another DataChecksum implementation | Major | io, util | Todd Lipcon | Todd Lipcon | | | dfs does not support -rmdir (was HDFS-639) | Minor | fs | Scott Phillips | Daryn Sharp | | | Capturing interim progress times, CPU usage, and memory usage, when tasks reach certain progress thresholds | Major | . | Dick King | Dick King | | | [HDFS-362] Provide ShortWritable class in hadoop. | Major | io | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Make RPCs to DataNodes timeout | Major | datanode | Hairong Kuang | John George | | | Support HTTP REST in HttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | MR-279: Write a shell command application | Major | mrv2 | Sharad Agarwal | Hitesh Shah | | | Make RPC to have an option to timeout | Major | ipc | Hairong Kuang | John George | | | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran | | | Add Federation feature, configuration and tools documentation | Major | documentation | Suresh Srinivas | Suresh Srinivas | | | Ability for having user's classes take precedence over the system classes for tasks' classpath | Blocker | job submission, task, tasktracker | Devaraj Das | Krishna Ramachandran | | | Ensure AM Restart and Recovery-on-restart is complete | Major | mrv2 | Amol Kekre | Sharad Agarwal | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Update test-patch.sh to include failed test names and move

| Minor | test | Nigel Daley | Nigel Daley | | | Add test-patch.properties required by test-patch.sh | Minor | . | Nigel Daley | Nigel Daley | | | Fix a number of warnings | Minor | . | Eli Collins | Eli Collins | | | NameNode should validate fsimage before rolling | Major | namenode | Hairong Kuang | Hairong Kuang | | | Add listCorruptFileBlocks to FileSystem | Major | . | Patrick Kling | Patrick Kling | | | Improve checkpoint performance by avoiding unnecessary image downloads | Major | namenode | Hairong Kuang | Hairong Kuang | | | Add number of reader threads and queue length as configuration parameters in RPC.getServer | Major | ipc | Dmytro Molkov | Dmytro Molkov | | | TestReconfiguration should be junit v4 | Trivial | conf | Patrick Kling | Patrick Kling | | | Wrong description in FSNamesystem's javadoc | Minor | namenode | Jingguo Yao | Jingguo Yao | | | Implement getFileBlockLocations in HarFilesystem | Major | harchive | Dmytro Molkov | Dmytro Molkov | | | RaidNode should optionally dispatch map reduce jobs to fix corrupt blocks (instead of fixing locally) | Major | contrib/raid | Patrick Kling | Patrick Kling | | | Task Initialization should be delayed till when a job can be run | Major | contrib/fair-share | Ramkumar Vadali | Ramkumar Vadali | | | Raid-aware FSCK | Major | contrib/raid | Patrick Kling | Patrick Kling | | | Refactor fsimage loading code | Major | namenode | Hairong Kuang | Hairong Kuang | | | A more elegant FileSystem#listCorruptFileBlocks API | Major | fs | Hairong Kuang | Patrick Kling | | | Expose number of bytes in FSOutputSummer buffer to implementatins | Trivial | . | Todd Lipcon | Todd Lipcon | | | unprecise javadoc for CompressionCodec | Minor | io | Jingguo Yao | Jingguo Yao | | | BlockPlacement policy for RAID | Major | contrib/raid | Scott Chen | Scott Chen | | | Remove "unused" warning in native code | Major | native | Noah Watkins | Noah Watkins | | | listCorruptFileBlocks should be functional while the name node is still in safe mode | Major | namenode | Patrick Kling | Patrick Kling | | | Fix some incorrect logs in FSDirectory | Minor | namenode | Eli Collins | Eli Collins | | | Add better javadocs for RawComparator interface | Trivial | . | Todd Lipcon | Harsh J | | | Resync discarded directories in fs.name.dir during saveNamespace command | Major | namenode | dhruba borthakur | dhruba borthakur | | | Lower default minimum heartbeat interval for tasktracker \> Jobtracker | Major | jobtracker, performance, tasktracker | Scott Carey | Todd Lipcon | | | Configuration should trim whitespace around a lot of value types | Minor | conf | Todd Lipcon | Michele Catasta | | | prevent data loss when a cluster suffers a power loss | Major | datanode, hdfs-client, namenode | dhruba borthakur | dhruba borthakur | | | Task-cleanup task should not be scheduled on the node that the task just failed | Major | jobtracker | Scott Chen | Liyin Liang | | | DistributedRaidFileSystem should unraid only the corrupt block | Major | . | Ramkumar Vadali | Ramkumar Vadali | | | Improve decommission mechanism | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Add

to DFSConfigKeys and use constant in stead of hardcoded string | Major | . | Erik Steffl | Erik Steffl | | | Fix logging in raid code. | Trivial | contrib/raid | Ramkumar Vadali | Ramkumar Vadali | | | HDFS side of HADOOP-6904: first step towards inter-version communications between dfs client and NameNode | Major | hdfs-client, namenode | Hairong Kuang | Hairong Kuang | | | MapReduce side of HADOOP-6904 | Major | . | Hairong Kuang | Hairong Kuang | | | Remove auto-generated native build files | Major | . | Eli Collins | Roman Shaposhnik | | | Remove auto-generated native build files | Major | build | Roman Shaposhnik | Roman Shaposhnik | | | Remove auto-generated native build files | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik | | | JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters() | Major | . | Scott Chen | Joydeep Sen Sarma | | | Log RAID recoveries on HDFS | Major | contrib/raid | Rodrigo Schmidt | Scott Chen | | | Pipeline ACKs are sent as lots of tiny TCP packets | Major | datanode | Todd Lipcon | Todd Lipcon | | | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan | | | Proposed enhancements/tuning to hadoop-hdfs/build.xml | Minor | build | Steve Loughran | Steve Loughran | | | Wrong description of Block-Compressed SequenceFile Format in SequenceFile's javadoc | Minor | io | Jingguo Yao | Jingguo Yao | | | AccessControlException should display the full path | Minor | namenode | Ramya Sunil | John George | | | slaves file to have a header specifying the format of conf/slaves file | Minor | conf | Karthik K | Karthik K | | | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan | | | Wong javadoc for TaskRunner's appendJobJarClasspaths method | Trivial | . | Jingguo Yao | Jingguo Yao | | | Limit Job name on jobtracker.jsp to be 80 char long | Trivial | . | Zheng Shao | Harsh J | | | Issue a warning when GenericOptionsParser libjars are not on local filesystem | Major | conf, filecache | Tom White | Tom White | | | The task-cleanup tasks should be optional | Major | jobtracker | Scott Chen | Scott Chen | | | Make BLOCK\INVALIDATE\LIMIT configurable | Minor | namenode | Arun C Murthy | Tsz Wo Nicholas Sze | | | MultipleOutputs should not require the use of 'Writable' | Blocker | job submission | Harsh J | Harsh J | | | FsShell should dump all exceptions at DEBUG level | Minor | fs | Todd Lipcon | Todd Lipcon | | | Add static factory methods in GaloisField | Major | contrib/raid | Scott Chen | Scott Chen | | | mapred.job.tracker.history.completed.location should support an arbitrary filesystem URI | Major | . | Tom White | Tom White | | | BlockPlacementPolicyRaid should call getBlockLocations only when necessary | Major | contrib/raid | Scott Chen | Scott Chen | | | set() and toString Methods of the org.apache.hadoop.io.Text class does not include the root exception, in the wrapping

| Minor | io | Uma Maheswara Rao G | Uma Maheswara Rao G | | | RPC server should log the client hostname when read exception happened | Trivial | ipc | Scott Chen | Scott Chen | | | CLONE to COMMON - HDFS-1445 Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file | Major | util | Matt Foley | Matt Foley | | | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer | | | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon | | | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon | | | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon | | | Don't compile fuse-dfs by default | Major | fuse-dfs | Eli Collins | Eli Collins | | | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | documentation, namenode | Patrick Angeles | Harsh J | | | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J | | | Improve CommandFormat | Minor | fs | Daryn Sharp | Daryn Sharp | | | Replace hard-coded option strings with variables from DFSConfigKeys | Minor | . | Eli Collins | Eli Collins | | | Improve backup-node sync performance by wrapping RPC parameters | Major | namenode | Liyin Liang | Liyin Liang | | | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | MR-279: Improve job history event handling in AM to log to HDFS | Major | mrv2 | Mahadev konar | Krishna Ramachandran | | | Cleanup BlockReceiver and DataXceiver | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Make DataNode's block-to-device placement policy pluggable | Major | datanode | Jeff Hammerbacher | Harsh J | | | Refactor frequently used codes from DFSOutputStream, BlockReceiver and DataXceiver | Minor | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | MR-279: Use generic interfaces for protocols | Major | mrv2 | Arun C Murthy | Siddharth Seth | | | Improve Command base class | Major | . | Daryn Sharp | Daryn Sharp | | | MR-279: Implement uber-AppMaster (in-cluster LocalJobRunner for MRv2) | Major | mrv2 | Mahadev konar | Greg Roelofs | | | Split TestFiDataTransferProtocol.java into two files | Trivial | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Checksum fsedits | Major | namenode | Hairong Kuang | Hairong Kuang | | | Api to get delegation token in AbstractFileSystem | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Api to get delegation token in Hdfs | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | MR-279: Install sanitized poms for downstream sanity | Major | mrv2 | Luke Lu | Luke Lu | | | Refactor BlockReceiver | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | MR-279:

for uber-AppMaster (in-cluster LocalJobRunner for MRv2) | Major | mrv2 | Greg Roelofs | Greg Roelofs | | | Generalize CLITest structure and interfaces to facilitate upstream adoption (e.g. for web testing) | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | Generalize CLITest structure and interfaces to facilitate upstream adoption (e.g. for web testing) | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | Generalize CLITest structure and interfaces to facilitate upstream adoption (e.g. for web or system testing) | Major | . | Konstantin Boudnik | Konstantin Boudnik | | | Terminate LeaseChecker when all writing files are closed. | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Refactor FsShell's ls | Major | fs | Daryn Sharp | Daryn Sharp | | | fix typo of command 'hadoop fs -help tail' | Minor | fs, test | Wei Yongjun | Wei Yongjun | | | Rename dfs.datanode.max.xcievers and bump its default value | Major | datanode | Eli Collins | Eli Collins | | | Discover file not found early for file append | Minor | . | Bharath Mundlapudi | Bharath Mundlapudi | | | Refactor FsShell's tail | Major | . | Daryn Sharp | Daryn Sharp | | | Feature to instruct rumen-folder utility to skip jobs worth of specific duration | Major | tools/rumen | Rajesh Balamohan | Rajesh Balamohan | | | Bring in more job configuration properties in to the trace file | Major | tools/rumen | Ravi Gummadi | Rajesh Balamohan | | | Don't fill preallocated portion of edits log with 0x00 | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | Provide a minimal pom file to allow integration of HDFS into Sonar analysis | Major | build | Konstantin Boudnik | Konstantin Boudnik | | | MR 279: Write job conf along with JobHistory, other minor improvements | Minor | mrv2 | Siddharth Seth | Siddharth Seth | | | [Rumen] TraceBuilder should provide recursive input folder scanning | Major | tools/rumen | Amar Kamat | Ravi Gummadi | | | Refactor DFSClient.LeaseChecker | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists | Minor | namenode | Tanping Wang | Tanping Wang | | | Refactor FsShell's mkdir | Major | fs | Daryn Sharp | Daryn Sharp | | | Refactor FsShell's setrep | Major | fs | Daryn Sharp | Daryn Sharp | | | A few improvements on the

map | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add docs to the new API Partitioner on how to access Job Configuration data | Minor | documentation | Harsh J | Harsh J | | | Refactor FsShell's chmod/chown/chgrp | Major | fs | Daryn Sharp | Daryn Sharp | | | Refactor FsShell's getmerge | Major | fs | Daryn Sharp | Daryn Sharp | | | Keep track of relative paths | Major | fs | Daryn Sharp | Daryn Sharp | | | Refactor FsShell's cat & text | Major | fs | Daryn Sharp | Daryn Sharp | | | Share LeaseChecker thread among DFSClients | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove logging exception stack trace when one of the datanode targets to read from is not reachable | Minor | hdfs-client | Suresh Srinivas | Suresh Srinivas | | | MR 279: Improve history server | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #\_ for task attempt..." log messages | Trivial | jobtracker | Jeffrey Naisbitt | Jeffrey Naisbitt | | | Standardize error messages | Major | fs | Daryn Sharp | Daryn Sharp | | | Refactor FsShell's stat | Major | fs | Daryn Sharp | Daryn Sharp | | | Refactor FsShell's touchz | Major | fs | Daryn Sharp | Daryn Sharp | | | Refactor FsShell's rm/rmr/expunge | Major | fs | Daryn Sharp | Daryn Sharp | | | Need a separate metrics per garbage collector | Major | metrics | Bharath Mundlapudi | Luke Lu | | | Refactor FsShell's test | Major | fs | Daryn Sharp | Daryn Sharp | | | GenericTestUtils.formatNamenode is misplaced | Major | . | Todd Lipcon | Ted Yu | | | ivy: test conf should not extend common conf | Major | build | Tsz Wo Nicholas Sze | Eric Yang | | | LeaseChecker thread name trace not that useful | Trivial | hdfs-client | Todd Lipcon | Todd Lipcon | | | ivy: test conf should not extend common conf | Major | build | Tsz Wo Nicholas Sze | Eric Yang | | | When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded | Minor | namenode | Todd Lipcon | Ted Yu | | | automatically determine JAVA\_HOME on OS X | Trivial | . | Daryn Sharp | Daryn Sharp | | | JobTracker instrumentation not consistent about error handling | Major | . | Philip Zeyliger | Philip Zeyliger | | | FSDataInputStream should expose a getWrappedStream method | Major | . | Jonathan Hsieh | Jonathan Hsieh | | | Allow for command line arguments when performing "Run on Hadoop" action. | Minor | contrib/eclipse-plugin | Jeff Zemerick | Jeff Zemerick | | | Format confirmation prompt should be more lenient of its input | Major | namenode | Todd Lipcon | Todd Lipcon | | | Start metrics system even if config files are missing | Major | metrics | Luke Lu | Luke Lu | | | Cache HAR filesystem metadata | Major | harchive | Mac Yang | Mac Yang | | | Log blacklist debug count | Trivial | jobtracker | Jonathan Eagles | Jonathan Eagles | | | Better error message for missing namenode directory | Minor | . | Eli Collins | Eli Collins | | | [MAPREDUCE] The new MapReduce API should make available task's progress to the task | Major | task | Amar Kamat | Amar Kamat | | | The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason | Minor | distributed-cache | Robert Joseph Evans | Robert Joseph Evans | | | incomplete help message is displayed for df -h option | Minor | fs | XieXianshan | XieXianshan | | | Refactor FsShell's copy & move commands | Major |

| Daryn Sharp | Daryn Sharp | | | ivy: hdfs test jar should be independent to common test jar | Major | build | Tsz Wo Nicholas Sze | Eric Yang | | | Performance improvement in PureJavaCrc32 | Minor | performance, util | Eric Caspole | Eric Caspole | | | Annotate PureJavaCrc32 as a public API | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | MR 279: Implement JobSummaryLog | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | If dfs.name.dir points to an empty dir, namenode format shouldn't require confirmation | Minor | namenode | Todd Lipcon | Harsh J | | | Eclipse format HDFS Junit test hdfs/TestWriteRead.java | Trivial | test | CW Chung | CW Chung | | | Task counters should also report the total heap usage of the task | Major | task | Amar Kamat | Amar Kamat | | | Minor modification to both dfsclusterhealth and dfshealth pages for Web UI | Minor | . | Tanping Wang | Tanping Wang | | | Add public javadocs to FSDataInputStream and FSDataOutputStream | Major | documentation | Jonathan Hsieh | Eli Collins | | | Improve TestWriteRead | Trivial | test | Tsz Wo Nicholas Sze | John George | | | Only build libhdfs if a flag is passed | Minor | . | Eli Collins | Eli Collins | | | Separate FSEditLog reading logic from editLog memory state building logic | Major | . | Ivan Kelly | Ivan Kelly | | | MR 279: RM UI should redirect finished jobs to History UI | Minor | mrv2 | Siddharth Seth | Siddharth Seth | | | Update fetchdt usage | Minor | documentation, tools | Tanping Wang | Tanping Wang | | | Undocumented parameters in FilesSystem | Trivial | fs | Konstantin Shvachko | Frank Conrad | | | Document the job credentials and associated details to do with delegation tokens (on the client side) | Major | documentation | Devaraj Das | Devaraj Das | | | Add resolvePath method to FileContext | Major | . | Sanjay Radia | Sanjay Radia | | | Force entropy to come from non-true random for tests | Major | build, test | Todd Lipcon | Todd Lipcon | | | Emulate CPU Usage of Tasks in GridMix3 | Major | contrib/gridmix | Ranjit Mathew | Amar Kamat | | | Allow test-patch to be more flexible about patch format | Major | . | Todd Lipcon | Todd Lipcon | | | Simulate Load Incrementally and Adaptively in GridMix3 | Major | contrib/gridmix | Ranjit Mathew | Amar Kamat | | | Emulate Memory Usage of Tasks in GridMix3 | Major | contrib/gridmix | Ranjit Mathew | Amar Kamat | | | CPU/Memory emulation for GridMix3 | Minor | contrib/gridmix | Jaideep | | | | Port gridmix changes from hadoop-0.20.100 to trunk | Major |

| Arun C Murthy | | | | Add ability to include Protobufs in ObjectWritable | Major | io, ipc | Todd Lipcon | Todd Lipcon | | | Namenode is missing @Override annotations | Minor | namenode | Suresh Srinivas | Suresh Srinivas | | | RPC should have a way to pass Security information other than protocol annotations | Major | ipc, security | Sharad Agarwal | Sharad Agarwal | | | Fuse-dfs should cache fs handles | Major | fuse-dfs | Dima Brodsky | Brian Bockelman | | | Improve DataXceiver error logging | Minor | datanode | Todd Lipcon | Joey Echeverria | | | MR 279: Metrics, finishTimes, etc in JobHistory | Major | mrv2 | Siddharth Seth | | | | Implement capability of querying individual property of a mbean using JMXProxyServlet | Major | . | Tanping Wang | Tanping Wang | | | Some StreamFile and ByteRangeInputStream cleanup | Minor | namenode | Eli Collins | Eli Collins | | | Update RAID for HDFS-2107 | Major | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Couple dfs data dir improvements | Minor | datanode | Eli Collins | Eli Collins | | | MR-279: Attach sources in builds | Major | mrv2 | Luke Lu | Luke Lu | | | merge for MR-279: HttpServer /stacks servlet should use plain text content type | Major | . | Matt Foley | Matt Foley | | | merge for MR-279: Generalize StringUtils#join | Major | . | Matt Foley | Matt Foley | | | merge for MR-279: add Data(In,Out)putByteBuffer to work with ByteBuffer similar to Data(In,Out)putBuffer for byte[] | Major | . | Matt Foley | Matt Foley | | | Better to check the reflexive property of the object while overriding equals method of it | Major | . | Bhallamudi Venkata Siva Kamesh | Devaraj K | | | Gridmix should notify job failures | Major | benchmarks, contrib/gridmix | Arun C Murthy | Amar Kamat | | | Provide overwrite option (-overwrite/-f) in put and copyFromLocal command line options | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() | Minor | datanode | Kihwal Lee | Kihwal Lee | | | Improve error message when moving to trash fails due to quota issue | Minor | fs | Ravi Prakash | Ravi Prakash | | | Enhance job-client cli to show queue information for running jobs | Minor | . | Arun C Murthy | Arun C Murthy | | | MR-279: Merge MR-279 related minor patches into trunk | Trivial | . | Arun C Murthy | Arun C Murthy | | | Add a -classpath option to bin/mapred | Trivial | . | Arun C Murthy | Vinod Kumar Vavilapalli | | | Add Checksum API to verify and calculate checksums "in bulk" | Major | . | Todd Lipcon | Todd Lipcon | | | Eclipse project files are incomplete | Minor | build | Niels Basjes | Niels Basjes | | | Federation: we should link to the live nodes and dead nodes to cluster web console | Major | . | Ravi Prakash | Ravi Prakash | | | Display error when using "daemonlog -setlevel" with illegal level | Minor | . | | | | | Improve header comment in o.a.h.hdfs.server.namenode.NameNode | Major | documentation, namenode | Aaron T. Myers | Aaron T. Myers | | | Update ClusterMapReduceTestCase to use MiniDFSCluster.Builder | Minor | test | Jim Plush | Harsh J | | | Move utilities to DFSUtil | Minor | balancer & mover, datanode, hdfs-client, namenode, security | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add support for throwing UnknownHostException when a host doesn't resolve | Major |

| Jeffrey Naisbitt | Jeffrey Naisbitt | | | Small optimization to FSDataset | Minor | datanode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Support for pluggable Trash policies | Major | fs | dhruba borthakur | Usman Masood | | | When DataNode throws DiskOutOfSpaceException, it will be helpfull to the user if we log the available volume size and configured block size. | Minor | datanode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Cleanup TestStreamFile and TestByteRangeInputStream | Minor | test | Eli Collins | Plamen Jeliazkov | | | Adding a configuration parameter to SecurityInfo interface. | Minor | . | Mahadev konar | Mahadev konar | | | Using the hadoop-deamon.sh script to start nodes leads to a depricated warning | Major | . | Ravi Prakash | Ravi Prakash | | | Allow setting of end-of-record delimiter for TextInputFormat (for the old API) | Major | . | Ahmed Radwan | Ahmed Radwan | | | If SNN shuts down during initialization it does not log the cause | Major | namenode | Ravi Prakash | Ravi Prakash | | | Refactor NameNode HTTP server into new class | Major | . | Todd Lipcon | Todd Lipcon | | | MR 279: Implement JobCounters for MRv2 + Fix for Map Data Locality | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | Remove hardcoded configuration keys | Minor | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas | | | Refactor double-buffering code out of EditLogOutputStreams | Major | namenode | Todd Lipcon | Todd Lipcon | | | Refactor ClientCache out of WritableRpcEngine. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | ProtoOverHadoopRpcEngine without using TunnelProtocol over WritableRpc | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | hadoop command should respect HADOOP\_OPTS when given a class name | Major | scripts | Eli Collins | Eli Collins | | | Close all the file streams propely in a finally block to avoid their leakage. | Minor | jobtracker, tasktracker | Bhallamudi Venkata Siva Kamesh | Devaraj K | | | Make the distributed cache delete entires using LRU priority | Major | distributed-cache | Robert Joseph Evans | Robert Joseph Evans | | | HDFS-1580: Make EditLogInputStream act like an iterator over FSEditLogOps | Major | . | Ivan Kelly | Ivan Kelly | | | Implement bulk checksum verification using efficient native code | Major | native, util | Todd Lipcon | Todd Lipcon | | | Clean up counting of operations in FSEditLogLoader | Trivial | namenode | Todd Lipcon | Todd Lipcon | | | HDFS-2018 Part 1 : Refactor file management so its not in classes which should be generic | Major | . | Ivan Kelly | Ivan Kelly | | | NamenodeFsck.toString() uses StringBuilder with + operator | Minor | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | hdfs it not resolving the latest common test jars published post common mavenization | Major | build | Giridharan Kesavan | Giridharan Kesavan | | | HDFS-2018 Part 2 : getRemoteEditLogManifest should pull it's information from FileJournalManager | Major | . | Ivan Kelly | Ivan Kelly | | | RPC client should deal with the IP address changes | Minor | ipc | Kihwal Lee | Kihwal Lee | | | Remove implementing FSConstants interface just to access the constants defined in the interface | Major |

| Suresh Srinivas | Suresh Srinivas | | | Add servlet util methods for handling paths in requests | Major | util | Eli Collins | Eli Collins | | | Move Framework Counters into a TaskMetric structure | Major | task | Owen O'Malley | Luke Lu | | | Refactor BlockReader into an interface and implementation | Major | hdfs-client | Todd Lipcon | Todd Lipcon | | | Map-Reduce 2.0 | Major | mrv2 | Arun C Murthy | | | | Add a eclipse-generated files to .gitignore | Trivial | build | Aaron T. Myers | Aaron T. Myers | | | Update RAID for HDFS-2241 | Minor | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | MR-279: app/Job.java needs UGI for the user that launched it | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Upgrade avro to 1.5.2 | Major | . | Luke Lu | Luke Lu | | | Refactor BlockManager.recentInvalidateSets to a new class | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | DataXceiverServer logs AsynchronousCloseException at shutdown | Trivial | datanode | Todd Lipcon | Todd Lipcon | | | Removing duplicate service provider in hadoop-mapreduce-client-jobclient | Trivial | client | Liang-Chi Hsieh | Liang-Chi Hsieh | | | Upgrade dependency to Avro 1.5.3 | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause | Minor | fs | Eli Collins | Eli Collins | | | Rename HdfsConstants -\> HdfsServerConstants, FSConstants -\> HdfsConstants | Minor | . | Tsz Wo Nicholas Sze | Harsh J | | | Change test-patch to run tests for all nested modules | Major | build | Tom White | Tom White | | | Renaming of configuration property names in yarn | Major | jobhistoryserver, mrv2, nodemanager, resourcemanager | Robert Joseph Evans | Robert Joseph Evans | | | Finish up the cleanup of distributed cache file resources and related tests. | Major | mrv2 | Amol Kekre | Siddharth Seth | | | MR-279: JobHistory Server main page needs to be reformatted | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Refactor RPC call implementations out of NameNode class | Major | namenode | Todd Lipcon | Todd Lipcon | | | MR-279: JobHistory Job page needs reformatted | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Add ShutDown hooks for MRV2 processes | Major | applicationmaster, jobhistoryserver, nodemanager, resourcemanager | Abhijit Suresh Shingate | Abhijit Suresh Shingate | | | MR-279: JobHistory Server needs Analysis this job | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | MR-279: Add the jobFile to the web UI | Blocker | mrv2 | Jeffrey Naisbitt | Jeffrey Naisbitt | | | Generate state graph from the State Machine Definition | Major | mrv2 | Sharad Agarwal | Binglin Chang | | | Fix classpath construction for MRv2 | Blocker | mrv2 | Luke Lu | Arun C Murthy | | | Remove out-of-date Chinese language documentation | Blocker | documentation | Jakob Homan | Jakob Homan | | | Allow admins to set java options for map/reduce tasks | Blocker | client, mrv2 | Arun C Murthy | Arun C Murthy | | | Increase the default threadpool size for container launching in the application master. | Blocker | mrv2 | Mahadev konar | Vinod Kumar Vavilapalli | | | Health Report on Resource Manager UI is null if the NM's are all

| Blocker | mrv2 | Mahadev konar | Subroto Sanyal | | | Change MR AM to use ApplicationAttemptId rather than \<applicationId, startCount\> everywhere | Major | applicationmaster, mrv2 | Arun C Murthy | Arun C Murthy | | | Add a NetUtils method that can tell if an InetAddress belongs to local host | Minor | util | Suresh Srinivas | Steve Loughran | | | Federation: enable using the same configuration file across all the nodes in the cluster. | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Refactor BlockSender.java for better readability | Major | datanode | Suresh Srinivas | Suresh Srinivas | | | Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters. | Blocker | jobhistoryserver, mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | the scripts yarn-daemon.sh and yarn are not working properly | Minor | mrv2 | XieXianshan | XieXianshan | | | create a script to setup application in order to create root directories for application such hbase, hcat, hive etc | Major | . | Arpit Gupta | Arpit Gupta | | | improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off | Major | conf | Arpit Gupta | Arpit Gupta | | | improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs | Major | conf | Arpit Gupta | Arpit Gupta | | | Make MiniDFS easier to embed in other apps | Minor | test | Steve Loughran | Steve Loughran | | | Rename and invert logic of '-cbuild' profile to 'native' and off by default | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Set things up for a top level hadoop-tools module | Major | build | Vinod Kumar Vavilapalli | Alejandro Abdelnur | | | Download of commons-daemon TAR should not be under target | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | [MR-279] Jobhistory filenames should have jobID to help in better parsing | Critical | mrv2 | Ramya Sunil | Jonathan Eagles | | | Improve MetricsAsserts to give more understandable output on failure | Minor | metrics, test | Todd Lipcon | Todd Lipcon | | | Log message for failed connection to datanode is not followed by a success message. | Major | hdfs-client | Ravi Prakash | Ravi Prakash | | | Validate the Jobs Output Specification as the first statement in JobSubmitter.submitJobInternal(Job, Cluster) method | Major | client, mrv2 | Abhijit Suresh Shingate | Abhijit Suresh Shingate | | | Improve javadoc and fix some typos in MR2 code | Minor | mrv2 | Todd Lipcon | Todd Lipcon | | | create hadoop-dist module where TAR stitching would happen | Major | build | Alejandro Abdelnur | Tom White | | | normalize nodemanager native code compilation with common/hdfs native | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Running a set of methods in a Single Test Class | Major |

| Jonathan Eagles | Jonathan Eagles | | | Running a set of methods in a Single Test Class | Major | build | Jonathan Eagles | Jonathan Eagles | | | Running a set of methods in a Single Test Class | Major | build | Jonathan Eagles | Jonathan Eagles | | | normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Add Maven profile to create a full source tarball | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash | | | provide a small validation script that smoke tests the installed cluster | Major | . | Arpit Gupta | Arpit Gupta | | | Add names for various unnamed threads in MR2 | Minor | mrv2 | Todd Lipcon | Todd Lipcon | | | bin/yarn should barf early if HADOOP\COMMON\HOME or HADOOP\HDFS\HOME are not set | Major | mrv2 | Todd Lipcon | Todd Lipcon | | | Documentation for MRv2 | Blocker | documentation, mrv2 | Arun C Murthy | | | | Improvements to YARN apis | Blocker | mrv2 | Arun C Murthy | | | | Add link decoration back to MR2's CSS | Major | mrv2 | Todd Lipcon | Todd Lipcon | | | Separate application-init and container-init event types in NM's ApplicationImpl FSM | Minor | mrv2, nodemanager | Todd Lipcon | Todd Lipcon | | | Add NetUtils call which provides more help in exception messages | Minor | util | Todd Lipcon | Todd Lipcon | | | Class loading quirk prevents inner class method compilation | Minor | task | Eric Caspole | Eric Caspole | | | Use new createSocketAddr API in MRv2 to give better error messages on misconfig | Minor | mrv2 | Todd Lipcon | Todd Lipcon | | | Improve code layout and constants in UnderReplicatedBlocks | Trivial | datanode | Steve Loughran | Steve Loughran | | | javadoc the topology classes | Trivial | . | Steve Loughran | Steve Loughran | | | HA: Allow saveNamespace operations to be canceled | Major | namenode | Todd Lipcon | Todd Lipcon | | | Avoid file system operations in BPOfferService thread while processing deletes | Major | datanode | Todd Lipcon | Todd Lipcon | | | FsShell does not preserve relative paths with globs | Major | fs | Daryn Sharp | Kihwal Lee | | | Add HDFS support for fadvise readahead and drop-behind | Major | datanode, performance | Todd Lipcon | Todd Lipcon | | | Implement CRC32C native code using SSE4.2 instructions | Major | native, performance | Todd Lipcon | Todd Lipcon | | | Add top-level navigation to APT docs | Major | documentation | Tom White | Tom White | | | Add docs for WebAppProxy | Critical | documentation, mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Add textual error message to data transfer protocol responses | Major | datanode, hdfs-client | Todd Lipcon | Todd Lipcon | | | Create a better index.html for maven docs | Major | documentation, mrv2 | Arun C Murthy | Arun C Murthy | | | Move LocalJobRunner to hadoop-mapreduce-client-core module | Major | client | Tom White | Tom White | | | Remove custom checksum headers from data transfer protocol | Major | datanode, hdfs-client | Todd Lipcon | Todd Lipcon | | | Add equals, hashcode, toString to DataChecksum | Major | io, util | Todd Lipcon | Todd Lipcon | | | Minor edits to top-level site | Major | . | Arun C Murthy | Arun C Murthy | | |

complains of overriding final parameter even if the value with which its attempting to override is the same. | Minor | conf | Ravi Prakash | Ravi Prakash | | | The embedded web framework for MAPREDUCE-279 | Major | . | Arun C Murthy | Luke Lu | | | When a serializer class is missing, return null, not throw an NPE. | Major | io | Harsh J | Harsh J | | | Umbrella JIRA for improving DataTransferProtocol | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Edit log replay should track and report file offsets in case of errors | Major | namenode | Todd Lipcon | Colin P. McCabe | | | Extensions to FsShell | Major | . | Olga Natkovich | Daryn Sharp | | | WritableComparator must implement no-arg constructor | Major | io | Radim Kolar | Chris Douglas | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | RawLocalFileSystem#listStatus does not deal with a directory whose entries are changing ( e.g. in a multi-thread or multi-process environment) | Minor | . | Sanjay Radia | Sanjay Radia | | | test-patch.properties contains incorrect/version-dependent values of OK\FINDBUGS\WARNINGS and OK\RELEASEAUDIT\WARNINGS | Major | . | Patrick Kling | Nigel Daley | | | TestDU fails on systems with local file systems with extended attributes | Minor | fs | Eli Collins | Eli Collins | | | DataXceiver and BlockReader disagree on when to send/recv CHECKSUM\_OK | Minor | datanode | bc Wong | bc Wong | | | Append pipeline never succeeds with more than one replica | Blocker | datanode | Todd Lipcon | Todd Lipcon | | | build is broken 0.22 branch creation | Major | build | Konstantin Boudnik | Konstantin Boudnik | | | mvn-install is broken after 0.22 branch creation | Major | build | Konstantin Boudnik | Konstantin Boudnik | | | misspelling of threshold in conf/log4j.properties | Major | conf | Jingguo Yao | Jingguo Yao | | | wrong FSNamesystem Audit logging setting in conf/log4j.properties | Minor | conf | Jingguo Yao | Jingguo Yao | | | TestSaveNamespace fails | Minor | test | Eli Collins | Todd Lipcon | | | IOUtils.readFully and IOUtils.skipFully have typo in exception creation's message | Minor | util | Konstantin Boudnik | Konstantin Boudnik | | | Image loader should make sure to read every byte in image file | Blocker | namenode | Hairong Kuang | Hairong Kuang | | | TestLargeBlock is failing on trunk | Major | test | Konstantin Boudnik | Konstantin Boudnik | | | Inconsistent lock ordering in AbstractDelegationTokenSecretManager | Minor | . | Todd Lipcon | Todd Lipcon | | | TestBlockRecovery triggers NPE in assert | Minor | . | Eli Collins | Hairong Kuang | | | A more elegant FileSystem#listCorruptFileBlocks API (HDFS portion) | Major | hdfs-client | Patrick Kling | Patrick Kling | | | A more

FileSystem#listCorruptFileBlocks API (RAID changes) | Major | contrib/raid | Patrick Kling | Patrick Kling | | | contrib/index - test - TestIndexUpdater fails due to an additional presence of file \_SUCCESS in hdfs | Major | contrib/index | Karthik K | Karthik K | | | Quota bug for partial blocks allows quotas to be violated | Blocker | namenode | Eli Collins | Eli Collins | | | TestBlockRecovery should bind ephemeral ports | Minor | test | Todd Lipcon | Todd Lipcon | | | TestFiHFlush fails intermittently | Major | test | Tsz Wo Nicholas Sze | Konstantin Boudnik | | | 98 Release Audit warnings on trunk and branch-0.22 | Blocker | . | Nigel Daley | Jakob Homan | | | fix the pom template's version | Major | build | Giridharan Kesavan | Giridharan Kesavan | | | test-patch.sh has bad ps arg | Minor | build | Nigel Daley | Nigel Daley | | | Make Datanode handle errors to namenode.register call more elegantly | Major | datanode | dhruba borthakur | dhruba borthakur | | | accessTime updates should not occur in safeMode | Major | namenode | dhruba borthakur | dhruba borthakur | | | UserGroupInformation.getCurrentUser() fails when called from non-Hadoop JAAS context | Blocker | security | Todd Lipcon | Todd Lipcon | | | Fix link resolution logic in hadoop-config.sh | Minor | scripts | Eli Collins | Eli Collins | | | HDFS-1547 broke MR build | Blocker | test | Todd Lipcon | Todd Lipcon | | | 1 Findbugs warning on trunk and branch-0.22 | Blocker | security | Nigel Daley | Po Cheung | | | TestSetupTaskScheduling failing in trunk | Blocker | jobtracker | Todd Lipcon | Liyin Liang | | | 200 new Findbugs warnings | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | ListPathsServlet excludes .\*.crc files | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | TestTaskCommit missing getProtocolSignature override | Major | test | Eli Collins | Eli Collins | | | Potential deadlock in TestOverReplicatedBlocks | Major | test | Todd Lipcon | Ken Goodhope | | | editsStored.xml cause release audit warning | Major | build, test | Tsz Wo Nicholas Sze | Todd Lipcon | | | TestFairScheduler failing on trunk | Blocker | contrib/fair-share | Todd Lipcon | Scott Chen | | | NameNode storage failed replica restoration is broken | Major | namenode | Konstantin Boudnik | Boris Shkolnik | | | Document need for stable hashCode() in WritableComparable | Minor | . | Dmitriy V. Ryaboy | Dmitriy V. Ryaboy | | | HDFS Design Documentation is outdated | Minor | documentation | Joe Crobak | Joe Crobak | | | API: Reducer.reduce() method detail misstatement | Trivial | documentation | Glynn Durham | Harsh J | | | Task should fail when symlink creation fail | Minor | distributed-cache | Koji Noguchi | Priyo Mustafi | | | TestDataNodeMXBean fails if disk space usage changes during test run | Minor | test | Todd Lipcon | Tsz Wo Nicholas Sze | | | Job.monitorAndPrintJob() should print status of the job at completion | Minor | client | Amareshwari Sriramadasu | Harsh J | | | bin/hadoop job -events \<jobid\> \<from-event-#\> \<#-of-events\> help message is confusing | Minor | jobtracker | Iyappan Srinivasan | Harsh J | | | DefaultCodec.createOutputStream() leaks memory | Major | io | Aaron Kimball | Aaron Kimball | | | double static declaration in Configuration.addDefaultResource("hdfs-default.xml"); | Minor | tools | Alexey Diomin | Alexey Diomin | | | Chain APIs error misleading | Trivial | . | Amogh Vasekar | Harsh J | | | tasktracker property not set in conf/hadoop-env.sh | Major | conf | Bernd Fondermann | Bernd Fondermann | | | FsShell: call

twice | Minor | fs | Alexey Diomin | Alexey Diomin | | | Balancer sleeps inadequately | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | SecondaryNameNode.checkpointSize is in byte but not MB. | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Guard against NPE when calling UGI.isLoginKeytabBased() | Major | security | Kan Zhang | Kan Zhang | | | Balancer utilization classification is incomplete | Major | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Distributed cache sizing configurations are missing from mapred-default.xml | Major | distributed-cache, documentation | Todd Lipcon | Todd Lipcon | | | Add isEnabled() to Trash | Major | fs | Daryn Sharp | Daryn Sharp | | | fs -ls hftp://file not working | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | null is displayed in the console,if the src path is invalid while doing copyToLocal operation from commandLine | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Socket Leak in org.apache.hadoop.metrics.ganglia.GangliaContext | Major | metrics | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Potential Resource leak in IOUtils.java | Major | io | Devaraj K | Devaraj K | | | New findbugs warning introduced by HDFS-1120 | Major | . | Todd Lipcon | Todd Lipcon | | | jsvc executable delivered into wrong package... | Major | scripts | John George | John George | | | FSNamesystem.startFileInternal(..) throws NullPointerException | Major | namenode | John George | John George | | | Chown command is not working from FSShell. | Major | fs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Some logical issues need to address. | Minor | hdfs-client, namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Quota counts missed between clear quota and set quota | Major | namenode | Kang Xiao | John George | | | Exception thrown in Jobtracker logs, when the Scheduler configured is FairScheduler. | Minor | contrib/fair-share | Devaraj K | Devaraj K | | | TestBlockFixer timing out on trunk | Critical | contrib/raid | Todd Lipcon | Ramkumar Vadali | | | TestHDFSCLI is failing on trunk | Major | test | Aaron T. Myers | Aaron T. Myers | | | HADOOP-7202 broke TestDFSShell in HDFS | Major | test | Aaron T. Myers | Daryn Sharp | | | problems with getFullPathName | Major | namenode | Daryn Sharp | Daryn Sharp | | | FileContext.createSymlink with kerberos enabled sets wrong owner | Major | . | John George | John George | | | MR-279: Fix YarnRemoteException to give more details. | Major | mrv2 | Mahadev konar | Siddharth Seth | | | FileContext createFlag combinations during create are not clearly defined | Major | fs | Suresh Srinivas | Suresh Srinivas | | | Support UGI in FileContext API | Major | security | Owen O'Malley | Jitendra Nath Pandey | | | MR-279: Name clashes in TypeConverter | Major | mrv2 | Luke Lu | Luke Lu | | | Fix synopsis for -count | Major | util | Daryn Sharp | Daryn Sharp | | | delay instantiation of file system object until it is needed (linked to HADOOP-7207) | Major |

| Boris Shkolnik | Boris Shkolnik | | | fs member of FSShell is not really needed | Major | . | Boris Shkolnik | Boris Shkolnik | | | TestBlockReport.blockReport\08() and \09() are timing-dependent and likely to fail on fast servers | Major | datanode, namenode | Matt Foley | Matt Foley | | | symlink comes up as directory after namenode restart | Major | . | John George | John George | | | SecureIO should not check owner on non-secure clusters that have no native support | Critical | io, security | Todd Lipcon | Todd Lipcon | | | When the disk becomes full Namenode is getting shutdown and not able to recover | Major | namenode | Devaraj K | Aaron T. Myers | | | HadoopArchives throwing NullPointerException while creating hadoop archives (.har files) | Minor | harchive | Devaraj K | Devaraj K | | | start-dfs.sh script fails if HADOOP\_HOME is not set | Blocker | scripts | Tom White | Tom White | | | start-mapred.sh script fails if HADOOP\_HOME is not set | Blocker | . | Tom White | Tom White | | | TestBalancer waits forever, errs without giving information | Major | datanode, namenode | Matt Foley | Matt Foley | | | TestNodeCount waits forever, errs without giving information | Major | namenode | Matt Foley | Matt Foley | | | Editlog opcodes overlap between 20 security and later releases | Blocker | namenode | Suresh Srinivas | Suresh Srinivas | | | In Gridmix, in RoundRobinUserResolver mode, the testing/proxy users are not associated with unique users in a trace | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | MR-279: YARNApplicationConstants hard code app master jar version | Blocker | mrv2 | Luke Lu | Mahadev konar | | | MR-279: Rename sanitized pom.xml in build directory to work around IDE bug | Major | mrv2 | Luke Lu | Luke Lu | | | In Gridmix, in RoundRobinUserResolver, the list of groups for a user obtained from users-list-file is incorrect | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | Tests using MiniDFSCluster fail to compile due to HDFS-1052 changes | Major | test | Suresh Srinivas | Suresh Srinivas | | | TestFairSchedulerSystem failing on Hudson | Blocker | . | Todd Lipcon | Todd Lipcon | | | One MiniDFSCluster ignores numDataNodes parameter | Blocker | . | Todd Lipcon | Todd Lipcon | | | TestFileInputFormat.testLocality failing after federation merge | Blocker | . | Todd Lipcon | Todd Lipcon | | | MiniDFSCluster#corruptBlockOnDatanodes() access must be public for MapReduce contrib raid | Major | . | Suresh Srinivas | Suresh Srinivas | | | incorrect path in start/stop dfs script | Major | . | John George | John George | | | Tests failing on trunk due to use of NameNode.format | Critical | . | Todd Lipcon | Todd Lipcon | | | Disable IPV6 for junit tests | Major | test | Suresh Srinivas | Suresh Srinivas | | | Disable IPV6 for junit tests | Major | test | Suresh Srinivas | Suresh Srinivas | | | TestBlockReplacement waits forever, errs without giving information | Major | namenode | Matt Foley | Matt Foley | | | Log the reason string of healthcheck script | Trivial | jobtracker | Thomas Graves | Thomas Graves | | | FileContext.getLocalFSFileContext() behavior needs to be fixed

tokens | Major | fs, security | Devaraj Das | Jitendra Nath Pandey | | | MR-279: mr app should not depend on hard-coded version of shuffle | Major | mrv2 | Luke Lu | Luke Lu | | | DataTransferTestUtil$CountdownDoosAction.run(..) throws NullPointerException | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | HDFS-1052 changes break the raid contrib module in MapReduce | Major | contrib/raid | Suresh Srinivas | Suresh Srinivas | | | Update of commons logging libraries causes EventCounter to count logging events incorrectly | Major | metrics | Jingguo Yao | Jingguo Yao | | | Fix NullPointerException in Secondary NameNode | Major | namenode | Hairong Kuang | Hairong Kuang | | | Clean up duplication of dependent jar files | Major | build | Eric Yang | Eric Yang | | | Reference ivy-hdfs.classpath not found. | Minor | build | Tsz Wo Nicholas Sze | Eric Yang | | | DataNode.setNewStorageID pulls entropy from /dev/random | Major | datanode | John Carrino | John Carrino | | | Metrics 2 TestSinkQueue is racy | Minor | metrics | Luke Lu | Luke Lu | | | Federation: namenode storage directory must be configurable specific to a namenode | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Federation: after taking snapshot the current directory of datanode is empty | Major | datanode | Tanping Wang | Tanping Wang | | | getRemoteIp could return null in cases where the call is ongoing but the ip went away. | Major | ipc | John George | John George | | | missing spaces in error messages | Trivial | . | Robert Henry | Eli Collins | | | MR 279: PB factories are not thread safe | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | MR 279: race in JobHistoryEventHandler stop | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | MR-279: Fix NPE in UI for pending attempts | Major | mrv2 | Luke Lu | Luke Lu | | | saveNamespace appears to succeed even if all directories fail to save | Blocker | . | Todd Lipcon | Aaron T. Myers | | | audit logs could ignore certain xsactions and also could contain "ip=null" | Major | namenode | John George | John George | | | IFile reader closes stream and compressor in wrong order | Major | task | Todd Lipcon | Todd Lipcon | | | Change name node mxbean name in cluster web console | Minor | . | Tanping Wang | Tanping Wang | | | Clean up duplication of dependent jar files | Major | build | Eric Yang | Eric Yang | | | Improve the usability of namenode -format | Minor | namenode | Bharath Mundlapudi | Bharath Mundlapudi | | | One bad node can incorrectly flag many files as corrupt | Major | hdfs-client, namenode | Koji Noguchi | Tanping Wang | | | missing t flag in distcp help message '-p[rbugp]' | Major | distcp | Wei Yongjun | Wei Yongjun | | | ReinitTrackerAction class name misspelled RenitTrackerAction in task tracker log | Trivial | tasktracker | Jonathan Eagles | Jonathan Eagles | | | Save namespace can cause NN to be unable to come up on restart | Blocker | . | Aaron

Myers | Matt Foley | | | Incorrect values for metrics with CompositeContext | Major | metrics | Amareshwari Sriramadasu | Luke Lu | | | Configuration deprecation mechanism doesn't work properly for GenericOptionsParser/Tools | Blocker | conf | Todd Lipcon | Aaron T. Myers | | | contrib modules should include build.properties from parent. | Major | build | Owen O'Malley | Owen O'Malley | | | RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key | Blocker | security | Suresh Srinivas | Suresh Srinivas | | | Gzip codec should not return null decompressors | Major | . | Owen O'Malley | Owen O'Malley | | | MR-279: Fix CI breaking hard coded version in jobclient pom | Major | mrv2 | Luke Lu | Luke Lu | | | Receiving NPE occasionally on RunningJob.getCounters() call | Major | client | Aaron Baff | Robert Joseph Evans | | | Adding a util method in FileUtil for JDK File.listFiles | Minor | . | Bharath Mundlapudi | Bharath Mundlapudi | | | Incorrect HTML unescaping in DatanodeJspHelper.java | Major | . | Aaron T. Myers | Aaron T. Myers | | | Tests use deprecated configs | Major | test | Aaron T. Myers | Aaron T. Myers | | | Datanode startup doesn't honor volumes.tolerated | Major | . | Bharath Mundlapudi | Bharath Mundlapudi | | | Address the cleanup issues in TestHDFSCLI.java | Minor | test | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Mapping between Gridmix jobs and the corresponding original MR jobs is needed | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi | | | libhdfs does not build for ARM processors | Major | libhdfs | Trevor Robinson | Trevor Robinson | | | Hadoop native builds fail on ARM due to -m32 | Major | native | Trevor Robinson | Trevor Robinson | | | fsck command can display command usage if user passes any illegal argument | Minor | . | Uma Maheswara Rao G | sravankorumilli | | | equals() and hashCode() implementation need to change in StandardSocketFactory | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G | | | TestFileContextResolveAfs will fail with default test.build.data property. | Minor | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | MR 279: NPE when requesting attemptids for completed jobs | Minor | mrv2 | Siddharth Seth | Siddharth Seth | | | TestWriteRead failed with inconsistent visible length of a file | Major | datanode | CW Chung | John George | | | MR 279: NodeStatus.getNodeHealthStatus().setBlah broken | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | TestDFSUpgradeFromImage fails | Major | datanode, test | Suresh Srinivas | Suresh Srinivas | | | Updating the layout version from HDFS-1822 causes upgrade problems. | Blocker | namenode | Suresh Srinivas | Suresh Srinivas | | | ant binary should build libhdfs | Major | build | Eli Collins | Eric Yang | | | bin/hdfs no longer works from a source checkout | Critical | scripts | Todd Lipcon | Eric Yang | | | MR-279: The RM writes its log to yarn-mapred-resourcemanager-\<RM\_Host\>.out | Minor | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Add an option for user to return http or https ports regardless of security is on/off in DFSUtil.getInfoServer() | Minor | tools | Tanping Wang | Tanping Wang | | | Fix NullPointerException when

API returns null | Major | . | Bharath Mundlapudi | Bharath Mundlapudi | | | BlockMissingException upon concurrent read and write: reader was doing file position read while writer is doing write without hflush | Major | hdfs-client | CW Chung | John George | | | Trash and shell's rm does not work for viewfs | Major | viewfs | Sanjay Radia | Sanjay Radia | | | Add an utility API in FileUtil for JDK File.list | Minor | . | Bharath Mundlapudi | Bharath Mundlapudi | | | Fix all the places where Java method File.list is used with FileUtil.list API | Minor | datanode | Bharath Mundlapudi | Bharath Mundlapudi | | | Recognize Jetty bug 1342 and handle it | Major | tasktracker | Thomas Graves | Thomas Graves | | | Fix option parsing in CommandFormat | Major | fs | Daryn Sharp | Daryn Sharp | | | Rumen TraceBuilder Does Not Emit CPU/Memory Usage Details in Traces | Major | tools/rumen | Ranjit Mathew | Amar Kamat | | | Cleanup FsShell and prevent masking of RTE stacktraces | Major | fs | Daryn Sharp | Daryn Sharp | | | Infinite loop at creating splits using CombineFileInputFormat | Major | job submission | Hairong Kuang | Ramkumar Vadali | | | Lease reassignment is not persisted to edit log | Major | namenode | Todd Lipcon | Aaron T. Myers | | | make refresh-namodenodes.sh refreshing all namenodes | Minor | scripts | Tanping Wang | Tanping Wang | | | MiniDFSCluster hard-codes dfs.datanode.address to localhost | Major | test | Eric Payne | Eric Payne | | | ant binary fails due to missing c++ lib dir | Major | build | Eric Yang | Eric Yang | | | TestJobHistory fails if /tmp/\_logs is not writable to. Testcase should not depend on /tmp | Major | test | Ravi Gummadi | Ravi Gummadi | | | MR 279: YarnConfiguration should reloadConfiguration if instantiated with a non YarnConfiguration object | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | New findbugs warning after MAPREDUCE-2494 | Major | . | Todd Lipcon | Robert Joseph Evans | | | Fix the usability of namenode upgrade command | Minor | . | Bharath Mundlapudi | Bharath Mundlapudi | | | Spelling errors in log messages (MapTask) | Trivial | . | Dave Syer | Tim Sell | | | MR 279: Cleanup JobHistory event generation | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | Some mtimes and atimes are lost when edit logs are replayed | Major |

| Todd Lipcon | Todd Lipcon | | | Some cli test cases expect a "null" message | Minor | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | two minor bugs in BlockManager block report processing | Minor | namenode | Matt Foley | Matt Foley | | | Stream test TestStreamingExitStatus fails with Out of Memory | Minor | contrib/streaming | Steve Loughran | Amar Kamat | | | HDFS needs to export protobuf library dependency in pom | Blocker | build | Todd Lipcon | Todd Lipcon | | | Bump DATA\TRANSFER\VERSION in trunk for protobufs | Major | datanode, hdfs-client | Todd Lipcon | Tsz Wo Nicholas Sze | | | Raid is not compile after DataTransferProtocol refactoring | Major | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Use of TestingGroups by tests causes subsequent tests to fail | Major | test | Aaron T. Myers | Aaron T. Myers | | | MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | MR279: update yarn INSTALL doc | Minor | . | Thomas Graves | Thomas Graves | | | Fix command name handling affecting DFSAdmin | Major | fs | Daryn Sharp | Daryn Sharp | | | MR 279: miscellaneous UI, NPE fixes for JobHistory, UI | Minor | mrv2 | Siddharth Seth | Siddharth Seth | | | FSEditLog.open() appears to succeed even if all EDITS directories fail | Major | . | Matt Foley | Andrew | | | Typo in comment in SimulatorLaunchTaskAction.java | Trivial | . | Sherry Chen | Tim Sell | | | getDelegationToken in HftpFileSystem should renew TGT if needed. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | In secure mode, Datanode process doesn't exit when disks fail. | Major | datanode | Bharath Mundlapudi | Bharath Mundlapudi | | | 'Chunk size to view' option is not working in Name Node UI. | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | TestConfiguration doesn't clean up after itself | Trivial | test | Aaron T. Myers | Aaron T. Myers | | | Gridmix system tests are failing due to high ram emulation enable by default for normal mr jobs in the trace which exceeds the solt capacity. | Major | contrib/gridmix | Vinay Kumar Thota | Vinay Kumar Thota | | | MR 279: KillJob should go through AM whenever possible | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | If the include hosts list contains host name, after restarting namenode, datanodes registrant is denied | Major | namenode | Tanping Wang | Tanping Wang | | | Create a light inner conf class in DFSClient | Major | hdfs-client | Bharath Mundlapudi | Bharath Mundlapudi | | | Remove StringUtils.stringifyException(ie) in logger functions | Minor | . | Bharath Mundlapudi | Bharath Mundlapudi | | | SecondaryNameNode web interface doesn't show the right info | Major | . | Aaron T. Myers | Aaron T. Myers | | | If service port and main port are the same, there is no clear log message explaining the issue. | Minor | namenode | gary murry | Jim Plush | | | MR-279: 0 map, 0 reduce job fails with Null Pointer Exception | Major | mrv2 | Jeffrey Naisbitt | Jeffrey Naisbitt | | | MR-279: Add Node Manager Version to NM info page | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | IPC connection is orphaned with null 'out' member | Major | ipc | Todd Lipcon | Todd Lipcon | | | FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826 | Major | namenode | Matt Foley | Matt Foley | | | Removal and restoration of storage directories on checkpointing failure doesn't work properly | Major | namenode | Ravi Prakash | Ravi Prakash | | | Store uMask as member variable to DFSClient.Conf | Major | hdfs-client | Bharath Mundlapudi | Bharath Mundlapudi | | | IOUtils.copybytes will suppress the stream closure

| Major | io | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Resource leaks in HDFS | Minor | datanode | ramkrishna.s.vasudevan | Uma Maheswara Rao G | | | Possible resource leaks in hadoop core code | Major | fs/s3, io | Gokul | Uma Maheswara Rao G | | | HttpServer.getParameterValues throws NPE for missing parameters | Major | . | Todd Lipcon | Todd Lipcon | | | Docs in core-default.xml still reference deprecated config "topology.script.file.name" | Major | conf, documentation | Aaron T. Myers | Aaron T. Myers | | | new hadoop-config.sh doesn't manage classpath for HADOOP\CONF\DIR correctly | Major | . | Todd Lipcon | Bing Zheng | | | FileSystem.listStatus() throws NullPointerException instead of IOException upon access permission failure | Minor | fs | Matt Foley | Matt Foley | | | Update RAID for HDFS-2087 | Major | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | length in getBlockRange becomes -ve when reading only from currently being written blk | Minor | hdfs-client | John George | John George | | | MR-279: Add compiled on date to NM and RM info/about page | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Potential resource leak in EditLogFileOutputStream.close | Major | . | Aaron T. Myers | Aaron T. Myers | | | Ganglia plugins for metrics v2 | Blocker | metrics | Luke Lu | Priyo Mustafi | | | MR279: Fix RM version in the cluster-\>about page | Minor | . | Thomas Graves | Thomas Graves | | | MR-279: Refactoring StateMachineFactory inner classes | Minor | mrv2 | Ahmed Radwan | Ahmed Radwan | | | MR-279: minimum-user-limit-percent no longer honored | Major | capacity-sched | Jeffrey Naisbitt | Jeffrey Naisbitt | | | MR-279: refreshQueues leads to NPEs when used w/FifoScheduler | Minor | mrv2 | Josh Wills | Josh Wills | | | NodeManager fails to create containers when NM\LOG\DIR is not explicitly set in the Configuration | Major | mrv2 | Josh Wills | Josh Wills | | | Fixing spelling mistake in FairSchedulerServlet.java | Trivial | . | Eli Collins | Eli Collins | | | Add counters for FileInputFormat (BYTES\READ) and FileOutputFormat (BYTES\WRITTEN) | Major | . | Owen O'Malley | Siddharth Seth | | | DFSClientAdapter should be put under test | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | the saveVersion.sh script sometimes fails to extract SVN URL | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | MR-279: Accessing MapTaskImpl from TaskImpl | Minor | mrv2 | Ahmed Radwan | Ahmed Radwan | | | Update DFSClient.stringifyToken(..) in JobSubmitter.printTokens(..) for HDFS-2161 | Major | client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Several TFile tests failing when native libraries are present | Critical | io | Todd Lipcon | Aaron T. Myers | | | re-commission of a decommissioned node does not delete excess replica | Major | . | John George | John George | | | Distributed Cache does not differentiate between file /archive for files with the same path | Major | distributed-cache | Siddharth Seth | Siddharth Seth | | | rpm should only require the same major version as common | Major | . | Owen O'Malley | Eric Yang | | | TestMiniMRDFSCaching fails if

is set to something other than build/test | Major | test | Thomas Graves | Thomas Graves | | | MR279: mapred job -kill leaves application in RUNNING state | Major | mrv2 | Thomas Graves | Thomas Graves | | | Some tests using FSNamesystem.LOG cannot be compiled | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Job History files are not moving to done folder when job history location is hdfs location | Major | jobtracker | Devaraj K | Devaraj K | | | mapreduce trunk builds are failing on hudson | Major | build, pipes | Giridharan Kesavan | Bruno Mah | | | RPM packages broke bin/hadoop script for hadoop 0.20.205 | Blocker | . | Eric Yang | Eric Yang | | | HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parameters | Major | test | Jakob Homan | Jim Plush | | | FileSystem should have an option to control the .crc file creations at Local. | Major | fs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | MultipleOutputs in new API creates needless TaskAttemptContexts | Major | . | Todd Lipcon | Todd Lipcon | | | Bug in INodeDirectory#computeContentSummary warning | Minor | namenode | Michael Noll | Michael Noll | | | mapreduce.jobtracker.split.metainfo.maxsize typoed in mapred-default.xml | Minor | documentation | Todd Lipcon | Todd Lipcon | | | [MR-279] server.api.records.NodeHealthStatus renamed but not updated in client NodeHealthStatus.java | Minor | mrv2 | Thomas Graves | Thomas Graves | | | MR-279: mrv2 no longer compiles against trunk after common mavenization. | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | tasks localized and launched serially by TaskLauncher - causing other tasks to be delayed | Major | tasktracker | Thomas Graves | Thomas Graves | | | MR 279: Fix some of the yarn findbug warnings | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | hadoop-main fails to deploy | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Test org.apache.hadoop.fs.TestFilterFileSystem fails due to java.lang.NoSuchMethodException | Blocker | test | John Lee | John Lee | | | Some java files cannot be compiled | Major | contrib/raid, test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | InvalidStateTransisiton when AM is not assigned to a job | Major | mrv2 | Ramya Sunil | | | | MR-279: Submit jobs beyond the max jobs per queue limit no longer gets logged | Major | mrv2 | Jeffrey Naisbitt | Jeffrey Naisbitt | | | mr279 RM application finishtime not set | Minor | mrv2 | Thomas Graves | Thomas Graves | | | BlockManager.chooseTarget(..) throws NPE | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | pull MAPREDUCE-2797 into mr279 branch | Minor | mrv2 | Thomas Graves | Thomas Graves | | | Add method for doing a sanity check on hostnames in NetUtils | Major | util | Jeffrey Naisbitt | Jeffrey Naisbitt | | | Jobsplits with random hostnames can make the queue unusable | Major | jobtracker | Jeffrey Naisbitt | Jeffrey Naisbitt | | | hadoop.io.compress.TestCodec#main() should exit with non-zero exit code if test failed | Trivial | test | Philip Zeyliger | Philip Zeyliger | | | Deadlock in NameNode | Blocker | namenode | Vinod Kumar Vavilapalli | Tsz Wo Nicholas Sze | | | Token should not print the password in

| Major | security | Jitendra Nath Pandey | Eli Collins | | | Encode servlet paths | Major | namenode | Eli Collins | Eli Collins | | | DN volume failures on startup are not counted | Major | datanode | Eli Collins | Eli Collins | | | Possible deadlock between LeaseRenewer and its factory | Critical | hdfs-client | Todd Lipcon | Tsz Wo Nicholas Sze | | | Possible deadlock in metrics2 | Critical | metrics | Todd Lipcon | Luke Lu | | | DFSOutputStream does not close all the sockets | Blocker | hdfs-client | Raghu Angadi | Uma Maheswara Rao G | | | Bug in Concat code | Major | . | Dmytro Molkov | Bharath Mundlapudi | | | Race Condition in IndexCache(readIndexFileToCache,removeMap) causes value of totalMemoryUsed corrupt, which may cause TaskTracker continue throw Exception | Critical | tasktracker | Binglin Chang | Binglin Chang | | | MR Jobs fail on a secure cluster with viewfs | Major | . | Siddharth Seth | Siddharth Seth | | | MR-279: SleepJob throws divide by zero exception when count = 0 | Major | mrv2 | Jeffrey Naisbitt | Jeffrey Naisbitt | | | common -tests jar should not include properties and configs | Critical | build, test | Todd Lipcon | Todd Lipcon | | | Correct the dependency version regressions introduced in HADOOP-6671 | Major | build | Kihwal Lee | Alejandro Abdelnur | | | Race condition on FSNamesystem#recentInvalidateSets introduced by HADOOP-5124 | Major | namenode | Ramkumar Vadali | Eric Payne | | | update INSTALL with config necessary run mapred on yarn | Major | . | Thomas Graves | Thomas Graves | | | Fix log4j logging in the maven test cases. | Major | mrv2 | Mahadev konar | Mahadev konar | | | Remove Unused TestApplicaitonCleanup in resourcemanager/applicationsmanager. | Major | . | Mahadev konar | Mahadev konar | | | MR tests are failing webapps/hdfs not found in CLASSPATH | Major | . | Mahadev konar | Alejandro Abdelnur | | | MR279: Fate of finished Applications on RM | Major | mrv2 | Thomas Graves | Thomas Graves | | | ant build broken in hadoop-mapreduce dir | Major | build | Thomas Graves | Mahadev konar | | | DataXceiver thread name incorrect while waiting on op during keepalive | Trivial | datanode | Todd Lipcon | Todd Lipcon | | | All replicas of a block can end up on the same rack when some datanodes are decommissioning. | Major | namenode | T Meyarivan | Todd Lipcon | | | mapreduce trunk is broken with eclipse plugin contrib | Major | . | Giridharan Kesavan | Giridharan Kesavan | | | a small % of all tasks fail with DefaultTaskController | Blocker | task, task-controller, tasktracker | Allen Wittenauer | Owen O'Malley | | | hadoop-config.sh setup CLASSPATH, HADOOP\HDFS\HOME and HADOOP\MAPRED\HOME incorrectly | Major | scripts | Eric Yang | Eric Yang | | | Add missing Apache license header in some files in MR and also add the rat plugin to the poms. | Major | . | Mahadev konar | Mahadev konar | | | Change mrv2 version to be 0.23.0-SNAPSHOT | Major |

| Arun C Murthy | Arun C Murthy | | | [MR-279] Start time for all the apps is set to 0 | Major | mrv2 | Ramya Sunil | Devaraj K | | | Fix test-patch to be able to run on MR patches. | Major | . | Mahadev konar | Mahadev konar | | | The capacity-scheduler should assign multiple tasks per heartbeat | Critical | . | Arun C Murthy | Arun C Murthy | | | Check jvmid during task status report | Major | tasktracker | Arun C Murthy | Siddharth Seth | | | mapreduce ant compilation fails "java.lang.IllegalStateException: impossible to get artifacts" | Major | build | Giridharan Kesavan | Giridharan Kesavan | | | mapred-config.sh doesn't look for $HADOOP\COMMON\HOME/libexec/hadoop-config.sh | Blocker | . | Arun C Murthy | Arun C Murthy | | | bin/mapred no longer works from a source checkout | Blocker | build | Eric Yang | Eric Yang | | | jsvc isn't part of the artifact | Blocker | . | Arun C Murthy | Alejandro Abdelnur | | | Prefer mvn test -DskipTests over mvn compile in test-patch.sh | Major | build | Robert Joseph Evans | Robert Joseph Evans | | | HDFS jars added incorrectly to yarn classpath | Major | . | Sharad Agarwal | Sharad Agarwal | | | Update the progress of jobs on client side | Major | mrv2 | Ramya Sunil | Siddharth Seth | | | Fix Javadoc warnings in MapReduce. | Critical | mrv2 | Mahadev konar | Mahadev konar | | | Fix findbugs warnings in Hadoop Auth (Alfredo) | Major | security | Tom White | Tsz Wo Nicholas Sze | | | AssertionError in TestHttpServer.testMaxThreads() | Major | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | Ivy build for MRv1 fails with bad organization for common daemon. | Major | . | Mahadev konar | Mahadev konar | | | MR-279: Cannot run multiple NMs on a single node | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | JobControl can drop jobs if an error occurs | Minor | client, mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | MR279: finished applications should be added to an application summary log | Major | mrv2 | Thomas Graves | Thomas Graves | | | TestLeaseRecovery2 fails as lease hard limit is not reset to default | Major | namenode, test | Konstantin Shvachko | Konstantin Shvachko | | | Hadoop Auth examples pom in 0.23 point to 0.24 versions. | Critical | . | Mahadev konar | Mahadev konar | | | Upgrade Jackson to version 1.7.1 to match the version required by Jersey | Major | test | Aaron T. Myers | Alejandro Abdelnur | | | MR279: MRReliabilityTest job fails because of missing job-file. | Major | mrv2 | Jeffrey Naisbitt | Jeffrey Naisbitt | | | Enhance CS to cap concurrently running jobs | Major | mrv2 | Arun C Murthy | Arun C Murthy | | | Add a version of getLocalPathForWrite to LocalDirAllocator which doesn't create dirs | Major | . | Siddharth Seth | Siddharth Seth | | | MRV1 test compilation broken after HDFS-2197 | Major | test | Vinod Kumar Vavilapalli | Todd Lipcon | | | Non superusers unable to launch apps in both secure and non-secure cluster | Blocker | mrv2 | Ramya Sunil | Mahadev konar | | | Remove Linux task-controller from

branch | Blocker | security | Milind Bhandarkar | Milind Bhandarkar | | | Corner case in container reservations | Major | mrv2, resourcemanager | Arun C Murthy | Arun C Murthy | | | clockSplits, cpuUsages, vMemKbytes, physMemKbytes is set to -1 in jhist files | Major | mrv2 | Ramya Sunil | Siddharth Seth | | | [MR-279] Add a startup msg while starting RM/NM | Minor | mrv2 | Ramya Sunil | Venu Gopala Rao | | | TestLineRecordReader depends on ant jars | Minor | test | Todd Lipcon | Todd Lipcon | | | MR279: Audit logs for YARN | Major | mrv2 | Thomas Graves | Thomas Graves | | | Missing log stmt for app submission fail CS | Trivial | mrv2, scheduler | Arun C Murthy | Arun C Murthy | | | Hadoop streaming test failure, post MR-2767 | Major | contrib/streaming | Milind Bhandarkar | Mahadev konar | | | TestHDFSCLI fails on 0.22 branch | Blocker | test | Konstantin Shvachko | Plamen Jeliazkov | | | Fix findbugs warnings in Map Reduce. | Critical | mrv2 | Mahadev konar | Vinod Kumar Vavilapalli | | | Sort fails on YARN+MR with lots of task failures | Major | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | [MR-279] Incorrect node ID info | Trivial | mrv2 | Ramya Sunil | Ravi Teja Ch N V | | | MR-279: 404 error while accessing pages from history server | Major | mrv2 | Ramya Sunil | Robert Joseph Evans | | | smart-apply-patch.sh does not handle patching from a sub directory correctly. | Major | build | Robert Joseph Evans | Robert Joseph Evans | | | Construct the web page for default scheduler | Major | mrv2 | Ramya Sunil | Eric Payne | | | Errors in Application failures are not shown in the client trace. | Critical | mrv2 | Mahadev konar | Mahadev konar | | | JobClient fails due to a race in RM, removes staged files and in turn crashes MR AM | Major | mrv2, resourcemanager | Vinod Kumar Vavilapalli | Thomas Graves | | | mapred-default.xml not merged from mr279 | Critical | mrv2 | Thomas Graves | Arun C Murthy | | | TestMRJobs hangs waiting to connect to history server. | Critical | . | Mahadev konar | Siddharth Seth | | | TestBlockPlacementPolicyRaid cannot be compiled | Major | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Deadlock in NM with threads racing for ApplicationAttemptId | Critical | mrv2 | Vinod Kumar Vavilapalli | Siddharth Seth | | | ResourceManager Delegate is not getting initialized with yarn-site.xml as default configuration. | Blocker | . | Mahadev konar | Mahadev konar | | | ant build mapreduce fails protected access jc.displayJobList(jobs); | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | /etc/profile.d does not exist on Debian | Major | scripts | Eric Yang | Eric Yang | | | [MR-279] NM registers with RM even before it starts various servers | Major | mrv2 | Vinod Kumar Vavilapalli | Thomas Graves | | | Remove ClientProtocolProvider configuration under mapreduce-client-core | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | Contrib Raid compilation broken after HDFS-1620 | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | SequenceFile should not print into stdout | Major | io | Konstantin Shvachko | Plamen Jeliazkov | | | findbugs error in

| Major | mrv2 | Thomas Graves | Thomas Graves | | | ApplicationId printed in 2 different formats and has 2 different toString routines that are used | Major | mrv2 | Thomas Graves | Eric Payne | | | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang | | | Allow overwrite of HADOOP\CLASSPATH and HADOOP\OPTS | Major | scripts | Eric Yang | Eric Yang | | | start-dfs.sh script fails for tarball install | Major | . | Tom White | Tom White | | | MR AM crashes when a container-launch hangs on a faulty NM | Major | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | MR task fails before launch itself with an NPE in ContainerLauncher | Major | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | regression with MAPREDUCE-2289 - setPermission passed immutable FsPermission (rpc failure) | Major | . | Patrick Hunt | Todd Lipcon | | | NodeManager in a inconsistent state if a service startup fails. | Major | mrv2, nodemanager | Ravi Teja Ch N V | Ravi Teja Ch N V | | | MR app hangs because of a NPE in ResourceManager | Major | mrv2 | Vinod Kumar Vavilapalli | Arun C Murthy | | | queueinfo.jsp fails to show queue status if any Capacity scheduler queue name has dash/hiphen in it. | Major | scheduler | Priyo Mustafi | Priyo Mustafi | | | Hdfs compilation fails | Major | hdfs-client | Abhijit Suresh Shingate | Abhijit Suresh Shingate | | | HDFS-2284 introduced 2 findbugs warnings on trunk | Major | . | Ivan Kelly | Tsz Wo Nicholas Sze | | | Parse Error is coming for App ID when we click application link on the RM UI | Major | mrv2, resourcemanager | Devaraj K | Devaraj K | | | SnappyCodec check for Hadoop native lib is wrong | Major | io | Alejandro Abdelnur | Alejandro Abdelnur | | | Fair scheduler configuration file is not bundled in RPM | Major | build | Eric Yang | Eric Yang | | | RM UI display logged in user as null | Major | mrv2 | Thomas Graves | Thomas Graves | | | o.a.h.mapreduce.Job shouldn't make a copy of the JobConf | Major | client | Arun C Murthy | Arun C Murthy | | | In mapred-site.xml, stream.tmpdir is mapped to ${mapred.temp.dir} which is

| Major | conf | Ramya Sunil | Eric Yang | | | MapReduce AM exits prematurely before completely writing and closing the JobHistory file | Major | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Streamline hashCode(), equals(), compareTo() and toString() for all IDs | Blocker | mrv2 | Vinod Kumar Vavilapalli | Siddharth Seth | | | job -status \<JOB\_ID\> is giving continuously info message for completed jobs on the console | Major | mrv2 | Devaraj K | Devaraj K | | | RM is not processing heartbeat and continuously giving the message 'Node not found rebooting' | Blocker | mrv2, resourcemanager | Devaraj K | Devaraj K | | | YARN RM fails to start | Major | mrv2, resourcemanager | Chris Riccomini | Chris Riccomini | | | job history server not starting because conf() missing HsController | Blocker | mrv2 | Thomas Graves | Jeffrey Naisbitt | | | sort example fails in shuffle/reduce stage as it assumes a local job by default | Minor | mrv2 | Hitesh Shah | Hitesh Shah | | | The Web UI shows FINISHED for killed/successful/failed jobs. | Blocker | mrv2 | Mahadev konar | Mahadev konar | | | TestMRJobs, TestMRJobsWithHistoryService, TestMROldApiJobs fail | Major | mrv2 | Thomas Graves | Arun C Murthy | | | checkpointTxnCount's comment still saying about editlog size | Trivial | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | yarn ui not properly filtered in HttpServer | Major | . | Thomas Graves | Thomas Graves | | | Fix the TestOfflineEditsViewer test failure in 0.23 branch | Major | test | Uma Maheswara Rao G | Uma Maheswara Rao G | | | IllegalArgumentException while using the dist cache | Major | mrv2 | Ramya Sunil | | | | hadoop-metrics2.properties should have a property \*.period set to a default value foe metrics | Major | conf | Arpit Gupta | Eric Yang | | | log4j.properties should be added to the hadoop conf on deploy | Major | conf | Arpit Gupta | Eric Yang | | | Streaming jobs with -file option fail to run. | Blocker | mrv2 | Mahadev konar | Mahadev konar | | | Some of the Resource Manager memory metrics go negative. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Failing to contact Am/History for jobs: java.io.EOFException in DataInputStream | Critical | mrv2 | Jeffrey Naisbitt | Vinod Kumar Vavilapalli | | | Queue state is not being translated properly (is always assumed to be running) | Major | mrv2 | Ravi Prakash | Ravi Prakash | | | Null Pointer Exception while submitting a Job, If mapreduce.framework.name property is not set. | Major | job submission, mrv2 | Venu Gopala Rao | Venu Gopala Rao | | | Support fully qualified paths as part of LocalDirAllocator | Minor | fs | Jonathan Eagles | Jonathan Eagles | | | YARN NM/RM fail to start | Major | mrv2, nodemanager, resourcemanager | Chris Riccomini | Chris Riccomini | | | YARN NM fails to start | Major | mrv2, nodemanager | Chris Riccomini | Chris Riccomini | | | Pipes jobs stuck without making progress | Blocker | mrv2 | Ramya Sunil | Mahadev konar | | | Fix test-patch to run tests via "mvn clean install test" | Major | build | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | MR-279: AM logs are incorrectly going to stderr and error messages going incorrectly to stdout | Blocker | mrv2 | Ramya Sunil | Ravi Teja Ch N V | | | Build failure for MRv1 caused due to changes to MRConstants. | Blocker | . | Mahadev konar | Mahadev konar | | | Add license headers to hadoop-common/src/main/packages/templates/conf/ | Major | . | Ravi Prakash | Ravi Prakash | | | Simplify parameter passing to Application Master from Client. SImplify approach to pass info such appId, ClusterTimestamp and failcount required by App

| Minor | mrv2 | Hitesh Shah | Vinod Kumar Vavilapalli | | | Block with corrupt replica is not getting replicated | Major | namenode | Konstantin Shvachko | Benoy Antony | | | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal | | | YARN Protobuf RPC Failures in RM | Major | mrv2, resourcemanager | Chris Riccomini | Vinod Kumar Vavilapalli | | | Application failure diagnostics are not consumed in a couple of cases | Blocker | mrv2, resourcemanager | Vinod Kumar Vavilapalli | Arun C Murthy | | | MR-279: AM with same sized maps and reduces hangs in presence of failing maps | Critical | applicationmaster, mrv2 | Sharad Agarwal | Sharad Agarwal | | | Job Client goes into infinite loop when we kill AM | Blocker | mrv2 | Karam Singh | Siddharth Seth | | | Throwing NullPointerException when we open the container page | Minor | mrv2, nodemanager | Devaraj K | Devaraj K | | | app master configuration web UI link under the Job menu opens up application menu | Major | mrv2 | Thomas Graves | Thomas Graves | | | Container exit status not set properly to launched process's exit code on successful completion of process | Blocker | mrv2 | Hitesh Shah | Hitesh Shah | | | Remove JOB\ID\COMPARATOR usage in JobHistory.java | Minor | mrv2 | Devaraj K | Devaraj K | | | hadoop.http.filter.initializers not working properly on yarn UI | Critical | mrv2 | Thomas Graves | Thomas Graves | | | Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh | Major | contrib/vaidya | vitthal (Suhas) Gogate | | | | fairscheduler ivy including wrong version for hdfs | Major | mrv2 | John George | John George | | | Unable to kill submitted jobs | Blocker | mrv2 | Siddharth Seth | Mahadev konar | | | all yarn webapps use same base name of "yarn/" | Major | mrv2 | Thomas Graves | Thomas Graves | | | defaults created for web keytab and principal, these properties should not have defaults | Major | . | Arpit Gupta | Tsz Wo Nicholas Sze | | | hftp is broken | Critical | namenode | Rajit Saha | Jitendra Nath Pandey | | | [MR-279] Node entries on the RM UI are not sortable | Major | mrv2 | Ramya Sunil | Abhijit Suresh Shingate | | | TestRPC.testUnknownCall() is failing | Major | mrv2, test | Devaraj K | Vinod Kumar Vavilapalli | | | Application's progress isn't updated from AM to RM. | Blocker | applicationmaster, mrv2, resourcemanager | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | logs servlet should use pathspec of /\* | Major | . | Thomas Graves | Thomas Graves | | | Invalid ApplicationMaster URL in Applications Page | Major | mrv2 | Subroto Sanyal | Subroto Sanyal | | | 27 unit test failures with Invalid "mapreduce.jobtracker.address" configuration value for JobTracker: "local" | Blocker | . | Thomas Graves | Venu Gopala Rao | | | [MR-279] Missing/incorrect info on job -status CLI | Blocker | mrv2 | Ramya Sunil | Devaraj K | | | Log uberized information into JobHistory and use the same via CompletedJob | Blocker | jobhistoryserver, mrv2 | Vinod Kumar Vavilapalli | Jonathan Eagles | | | JobSplitWriter.java can't handle large job.split file | Major | job submission | Ming Ma | Ming Ma | | | YarnScheduler needs to expose Resource Usage Information | Blocker | mrv2, resourcemanager | Robert Joseph Evans | Robert Joseph Evans | | | hadoop deb pkg should take a diff group id | Major | . | Giridharan Kesavan | Eric Yang | | | Set default hdfs, mapred uid, and hadoop group gid for RPM packages | Major |

| Eric Yang | Eric Yang | | | to fix hadoop config template | Major | . | Giridharan Kesavan | Eric Yang | | | Allow for applications to deal with MAPREDUCE-954 | Blocker | client, mrv2 | Arun C Murthy | Owen O'Malley | | | jobhistory server and secondarynamenode should have init.d script | Major | scripts | Eric Yang | Eric Yang | | | Calling hadoop cli inside mapreduce job leads to errors | Major | contrib/streaming | Eric Yang | Eric Yang | | | see log4j Error when running mr jobs and certain dfs calls | Major | conf | Arpit Gupta | Eric Yang | | | Jobs are failing when those are submitted by other users | Blocker | applicationmaster, mrv2 | Devaraj K | Devaraj K | | | hadoop-env.sh generated from templates has duplicate info | Major | conf | Arpit Gupta | Arpit Gupta | | | log4j.properties is missing properties for security audit and hdfs audit should be changed to info | Minor | conf | Arpit Gupta | Arpit Gupta | | | config generator does not update the properties file if on exists already | Critical | conf | Arpit Gupta | Eric Yang | | | org.apache.hadoop.mapred.jobcontrol.getAssignedJobID throw class cast exception | Blocker | client | Robert Joseph Evans | Robert Joseph Evans | | | ResourceManager logs filled with [INFO] debug messages from org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue | Major | mrv2, resourcemanager | Ravi Prakash | Ravi Prakash | | | Missing cluster level stats on the RM UI | Blocker | mrv2 | Ramya Sunil | Robert Joseph Evans | | | TestMRJobs.testFailingMapper does not assert the correct thing. | Critical | mrv2, test | Robert Joseph Evans | Jonathan Eagles | | | \_HOST in dfs.web.authentication.kerberos.principal. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey | | | hadoop-setup-conf.sh should put proxy user info into the core-site.xml | Major | . | Giridharan Kesavan | Arpit Gupta | | | [MR-279] Incorrect metrics value for AvailableGB per queue per user | Blocker | mrv2 | Ramya Sunil | John George | | | mr279 job history handling after killing application | Critical | mrv2 | Thomas Graves | Eric Payne | | | [MR-279] Lot of local files left on NM after the app finish. | Blocker | mrv2 | Vinod Kumar Vavilapalli | Siddharth Seth | | | the build fails in Windows because commons-daemon TAR cannot be fetched | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Add backwards-compatibility layer for FSConstants | Blocker | . | Todd Lipcon | Todd Lipcon | | | TestDFSRollback fails intermittently | Critical | namenode, test | Robert Joseph Evans | Todd Lipcon | | | ContainerAllocationExpirer appears to use the incorrect configs | Critical | mrv2 | Robert Joseph Evans | Anupam Seth | | | TestFileOutputCommitter.testFailAbort() is failing on trunk on Jenkins | Major | mrv2, test | Vinod Kumar Vavilapalli | Mahadev konar | | | Symbolic links with special chars causing container/task.sh to fail | Blocker | mrv2 | Thomas Graves | Hitesh Shah | | | JobClient requires mapreduce.jobtracker.address config even when

is set to yarn | Blocker | job submission, mrv2 | Karam Singh | Hitesh Shah | | | Fix trunk build failures | Major | mrv2 | Hitesh Shah | Hitesh Shah | | | The NN should tolerate the same number of low-resource volumes as failed volumes | Major | namenode | Jeff Bean | Aaron T. Myers | | | container-executor is not being packaged with the assembly target. | Minor | mrv2 | Mahadev konar | Mahadev konar | | | Node link in reduce task attempt page is not working [Job History Page] | Major | jobhistoryserver | chackaravarthy | chackaravarthy | | | MR-279: APPLICATION\_STOP is never sent to AuxServices | Blocker | mrv2 | Robert Joseph Evans | Thomas Graves | | | mr job stuck because reducers using all slots and mapper isn't scheduled | Blocker | mrv2 | Thomas Graves | Arun C Murthy | | | Invalid JobHistory URL for failed applications | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Subroto Sanyal | | | app master web UI shows reduce task progress 100% even though reducers not complete and state running/scheduled | Critical | mrv2 | Thomas Graves | Hitesh Shah | | | Rumen TraceBuilder is skipping analyzing 0.20 history files | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | Make Rumen use job history api instead of relying on current history file name format | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | [MR:279] Update the scheduling info on CLI | Major | mrv2 | Ramya Sunil | Eric Payne | | | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash | | | hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header | Trivial | build | Hitesh Shah | Hitesh Shah | | | Trunk nightly commit builds are failing. | Critical | build, mrv1, mrv2 | Mahadev konar | Hitesh Shah | | | mapper failed with failed to load native libs | Blocker | mrv2 | Thomas Graves | John George | | | Fix renewal of dfs delegation tokens | Major | . | Daryn Sharp | Owen O'Malley | | | QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released | Blocker | mrv2 | Karam Singh | Devaraj K | | | Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB | Blocker | jobhistoryserver, mrv2 | Karam Singh | Eric Payne | | | Fix Javadoc warning in JobClient.java and Cluster.java | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | mr279 TestUberAM.testSleepJob test fails | Minor | mrv2 | Thomas Graves | Jonathan Eagles | | | JobHistory doesn't have error information from failed tasks | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Devaraj K | | | TestLinuxContainerExecutorWithMocks fails on Mac OSX | Major | mrv2 | Arun C Murthy | Arun C Murthy | | | Should set MALLOC\ARENA\MAX for all YARN daemons and AMs/Containers | Blocker | mrv2 | Vinod Kumar Vavilapalli | Chris Riccomini | | | TestMRClientService failing on building clean checkout of branch 0.23 | Major | mrv2 | Anupam Seth | Mahadev konar | | | [MR-279] - Cleanup staging dir after job completion | Blocker | mrv2 | Ramya Sunil | Mahadev konar | | | Ensure logging option is set on child command line | Blocker | applicationmaster, mrv2 | Arun C Murthy | Todd Lipcon | | | HftpFileSystem uses incorrect compare for finding delegation tokens | Major |

| Owen O'Malley | Owen O'Malley | | | Fix some javac warnings in MRAppMaster. | Major | mrv2 | Mahadev konar | Mahadev konar | | | Detect MapReduce PreCommit Trunk builds silently failing when running test-patch.sh | Blocker | build | Jonathan Eagles | Jonathan Eagles | | | Publish MR JARs to Maven snapshot repository | Major | build | Tom White | Alejandro Abdelnur | | | ant mapreduce tests are timing out | Blocker | mrv2, test | Ravi Prakash | Hitesh Shah | | | TestJobMonitorAndPrint is broken on trunk | Major | mrv2, test | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Terasort fails with Kerberos exception on secure cluster | Blocker | mrv2 | Anupam Seth | Arun C Murthy | | | Normalize requests in FifoScheduler.allocate to prevent NPEs later | Major | mrv2 | Ahmed Radwan | Ahmed Radwan | | | NPE in AM causes it to lose containers which are never returned back to RM | Critical | mrv2 | Amol Kekre | Hitesh Shah | | | NPE while flushing TaskLogAppender | Minor | mrv2 | liangzhaowang | liangzhaowang | | | Message displays while executing yarn command should be proper | Minor | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | Incorrect exit code for hadoop-core-test tests when exception thrown | Major | test | Jonathan Eagles | Jonathan Eagles | | | Incorrect exit code for hadoop-hdfs-test tests when exception thrown | Major | test | Jonathan Eagles | Jonathan Eagles | | | Incorrect exit code for hadoop-mapreduce-test tests when exception thrown | Major | mrv2, test | Jonathan Eagles | Jonathan Eagles | | | Lots of errors in logs when daemon startup fails | Major | mrv2 | Todd Lipcon | Todd Lipcon | | | mvn site:site fails on MapReduce | Major | build | Suresh Srinivas | Alejandro Abdelnur | | | Few reduce tasks hanging in a gridmix-run | Blocker | mrv2, task | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | OutOfMemoryError in DataXceiverServer takes down the DataNode | Major | datanode | Konstantin Shvachko | Uma Maheswara Rao G | | | JobClient spews errors when killing MR2 job | Blocker | job submission, mrv2 | Todd Lipcon | Mahadev konar | | | NM not able to register with RM after NM restart | Blocker | mrv2, nodemanager | Ravi Teja Ch N V | Devaraj K | | | Trunk compilation broken with bad interaction from MAPREDUCE-3070 and MAPREDUCE-3239. | Major | mrv2 | Mahadev konar | Mahadev konar | | | Sometimes task keeps on running while its Syslog says that it is shutdown | Critical | contrib/gridmix, mrv2 | Karam Singh | Vinod Kumar Vavilapalli | | | CLASSPATH not the same after MAPREDUCE-2880 | Critical | mrv2 | Ravi Prakash | Ravi Prakash | | | TestBalancer can fail when datanode utilization and avgUtilization is exactly same. | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Support job end notification in .next

| Blocker | mrv2 | Mohammad Kamrul Islam | Ravi Prakash | | | MR2: Map tasks rewrite data once even if output fits in sort buffer | Critical | mrv2, task | Todd Lipcon | Todd Lipcon | | | Log4j logs from unit tests are lost | Blocker | test | Arun C Murthy | Vinod Kumar Vavilapalli | | | DefaultContainerExecutor removes appcache dir on every localization | Blocker | mrv2 | Todd Lipcon | Todd Lipcon | | | [MR-279] Missing fields in job summary logs | Blocker | mrv2 | Ramya Sunil | Mahadev konar | | | AM unable to release containers | Major | applicationmaster | Chris Riccomini | | | | ContextFactory throw NoSuchFieldException | Blocker | mrv2 | Daniel Dai | Arun C Murthy | | | compile-mapred-test target fails | Blocker | build, mrv2 | Ramya Sunil | Hitesh Shah | | | Jobsummary logs not being moved to a separate file | Blocker | mrv2 | Ramya Sunil | Mahadev konar | | | Allow both ACL list and global path spec filters to HttpServer | Blocker | . | Jonathan Eagles | Jonathan Eagles | | | The auth to local mappings are not being respected, with webhdfs and security enabled. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | with webhdfs enabled in secure mode the auth to local mappings are not being respected. | Major | webhdfs | Arpit Gupta | Jitendra Nath Pandey | | | mkdirs should use the supplied permission for all of the created directories | Major | namenode | Daryn Sharp | Daryn Sharp | | | PreCommit-HADOOP-Build is failing on hadoop-auth-examples | Blocker | build | Jonathan Eagles | Tom White | | | Streaming jobs failing with PipeMapRunner ClassNotFoundException | Blocker | contrib/streaming, mrv2 | Ramya Sunil | Arun C Murthy | | | mapreduce.job.user.name needs to be set automatically | Blocker | mrv2 | Todd Lipcon | Arun C Murthy | | | TestJobHistoryParsing broken | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | ContainerLocalizer should get the proper java.library.path from LinuxContainerExecutor | Blocker | mrv2, nodemanager | Kihwal Lee | Kihwal Lee | | | NM should send a SIGKILL for completed containers also | Blocker | mrv2, nodemanager | Vinod Kumar Vavilapalli | Hitesh Shah | | | MR AM hangs when one node goes bad | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | TestLinuxContainerExecutorWithMocks failing on trunk. | Blocker | test | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | hadoop-setup-conf.sh should be modified to enable task memory manager | Major | conf | Ramya Sunil | Ramya Sunil | | | bin/mapred queue fails with JobQueueClient ClassNotFoundException | Major | mrv2 | Ramya Sunil | Arun C Murthy | | | FindBugs warning in Token.getKind() | Major | . | Tom White | Tom White | | | bin/mapred job -list throws exception | Critical | mrv2 | Ramya Sunil | Arun C Murthy | | | User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed. | Blocker | mrv2 | Ramgopal N | Eric Payne | | | Tests on

failing | Blocker | mrv2 | Arun C Murthy | Siddharth Seth | | | Jenkins reports 160 FindBugs warnings | Major | build, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Mapreduce 23 builds failing | Blocker | mrv2 | Ramya Sunil | Mahadev konar | | | Job counters missing from AM and history UI | Blocker | mrv2 | Siddharth Seth | Siddharth Seth | | | list-active-trackers throws NPE | Major | mrv2 | Ramya Sunil | Arun C Murthy | | | RM Web UI does not sort the columns in some cases. | Critical | mrv2 | Mahadev konar | Jonathan Eagles | | | In secure mode job submission fails with Provider org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier$Renewer not found. | Critical | mrv2 | Mahadev konar | Mahadev konar | | | Pending(9) findBugs warnings | Major | build | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | security audit logger is not on by default, fix the log4j properties to enable the logger | Minor | conf | Arpit Gupta | Arpit Gupta | | | [MR-279] Decommissioned node does not shutdown | Blocker | mrv2 | Ramya Sunil | Devaraj K | | | TestRMContainerAllocator#testBlackListedNodes fails intermittently | Major | mrv2, test | Ravi Prakash | Ravi Prakash | | | Cannot run apps after MAPREDUCE-2989 | Blocker | mrv2, nodemanager | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | TestAMAuthorization failing on branch 0.23. | Critical | . | Mahadev konar | | | | ViewFS getFileChecksum throws FileNotFoundException for files in /tmp and /user | Blocker | viewfs | Ravi Prakash | Ravi Prakash | | | FSNamesystem.setTimes(..) expects the path is a file. | Major | . | Arpit Gupta | Uma Maheswara Rao G | | | Race condition in MR App Master Preemtion can cause a dead lock | Blocker | applicationmaster, mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | TestResourceTrackerService failing in trunk some times | Blocker | mrv2, test | Ravi Gummadi | Hitesh Shah | | | Change mode for hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/mock-container-executor to 755 | Trivial | mrv2 | Hitesh Shah | Arun C Murthy | | | A few events are not handled by the NodeManager in failure scenarios | Critical | mrv2, nodemanager | Hitesh Shah | Hitesh Shah | | | (Rumen)TraceBuilder throws IllegalArgumentException | Major | . | Devaraj K | Amar Kamat | | | MR V2 jobhistory does not contain rack information | Critical | mrv2 | Karam Singh | chackaravarthy | | | Fix NPE in DFSClient.getFileChecksum | Major | . | Bharath Mundlapudi | Uma Maheswara Rao G | | | Disable some failing legacy tests for MRv2 builds to go through | Minor | mrv2 | Hitesh Shah | Hitesh Shah | | | NPE when running hdfs dfs -copyToLocal, -get etc | Blocker | . | John George | John George | | | Rebooted link is not working properly | Major | resourcemanager | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | Rumen TraceBuilder is emiting null as hostname | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | Aggregate project javadocs | Critical | build | Arun C Murthy | Tom White | | | Incorrect computation of needed blocks in getTurnOffTip() | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov | | | contrib/raid compile breaks due to changes

hdfs/protocol/datatransfer/Sender#writeBlock related to checksum handling | Trivial | contrib/raid | Hitesh Shah | Hitesh Shah | | | Complete aggregation of user-logs spit out by containers onto DFS | Major | mrv2, nodemanager | Vinod Kumar Vavilapalli | | | | Release artifacts need to be signed for Nexus | Blocker | build | Arun C Murthy | Doug Cutting | | | Fix the repository name to support pushing to the staging area of Nexus | Major | build | Owen O'Malley | Owen O'Malley | | | Missing license headers for some files | Blocker | mrv2 | Arun C Murthy | Arun C Murthy | | | fail to start datanode while start-dfs.sh is executed by root user | Blocker | scripts | Wei Yongjun | Matt Foley | | | TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods | Blocker | test | Uma Maheswara Rao G | Laxman | | | Redesign FsShell | Major | . | Daryn Sharp | Daryn Sharp | | | MetricsDynamicMBeanBase can cause high cpu load | Major | metrics | Nate Putnam | | | | MetricsDynamicMBeanBase throws IllegalArgumentException for empty attribute list | Major | metrics | Elias Ross | | | | Assertion failure in TestTaskTrackerMemoryManager | Major | tasktracker | Aaron Kimball | | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | unit test for HADOOP-6835 (concatenated gzip support) | Minor | test | Greg Roelofs | Greg Roelofs | | | Add coverage of task graph servlet to fair scheduler system test | Major | . | Todd Lipcon | Todd Lipcon | | | Revive TestFuseDFS | Major | fuse-dfs | Eli Collins | Eli Collins | | | TestFiRename fails due to invalid block size | Minor | . | Eli Collins | Eli Collins | | | Make TestFairSchedulerSystem fail with more verbose output | Trivial | contrib/fair-share | Todd Lipcon | Todd Lipcon | | | Move -fs usage tests from hdfs into common | Major | test | Daryn Sharp | Daryn Sharp | | | Move -fs usage tests from hdfs into common | Major | test | Daryn Sharp | Daryn Sharp | | | TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy() part 2 fails in two different ways | Major | test | Matt Foley | Matt Foley | | | Improve test reliability of HDFS-1594 | Major | test | Aaron T. Myers | Aaron T. Myers | | | Fix path display for setrep | Major | test | Daryn Sharp | Daryn Sharp | | | HDFS tests for viewfs | Major | . | Sanjay Radia | Sanjay Radia | | | Update tests for FsShell standardized error messages | Major | test | Daryn Sharp | Daryn Sharp | | | Fix path display for rm/rmr | Major | test | Daryn Sharp | Daryn Sharp | | | Fix path display for touchz | Major | test | Daryn Sharp | Daryn Sharp | | | Update tests for FsShell's "test" | Major | test | Daryn Sharp | Daryn Sharp | | | Update tests for du/dus/df | Major | . | Daryn Sharp | Daryn Sharp | | | Create a functional test for file read/write | Minor | test | CW Chung | CW Chung | | | Fix path display for copy & rm | Major | test | Daryn Sharp | Daryn Sharp | | | TestMRCLI broke due to change in usage output | Minor | test | Daryn Sharp | Daryn Sharp | | | Enhance TestWriteRead to support File Append and Position Read | Minor | test | CW Chung | CW Chung | | | [GridMix3] Implement functionality for get the list of job traces which has different

| Major | contrib/gridmix | Vinay Kumar Thota | Vinay Kumar Thota | | | Improve TestStorageRestore | Minor | test | Aaron T. Myers | Aaron T. Myers | | | Add tests for ensuring that the DN will start with a few bad data directories (Part 1 of testing DiskChecker) | Major | datanode, test | Harsh J | Harsh J | | | Tests for HADOOP-7361 | Major | test | Uma Maheswara Rao G | Uma Maheswara Rao G | | | TestDFSShell should use test dir | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add test utility for writing multi-threaded tests | Major | test | Todd Lipcon | Todd Lipcon | | | MR-279: Unit (mockito) tests for CS | Major | mrv2 | Arun C Murthy | Arun C Murthy | | | Add TestPath tests for URI conversion and reserved characters | Minor | fs | Eli Collins | Eli Collins | | | Add WebUI tests with URI reserved chars in the path and filename | Major | namenode | Eli Collins | Eli Collins | | | Add test for HADOOP-7629: using an immutable FsPermission as an IPC parameter | Major | test | Todd Lipcon | Todd Lipcon | | | Disable TestDfsOverAvroRpc in 0.23 | Minor | . | Suresh Srinivas | Suresh Srinivas | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | the first optimization: ZlibCompressor does not fully utilize the buffer | Minor | io | Kang Xiao | Kang Xiao | | | Refactor storage management into separate classes than fsimage file reading/writing | Major | namenode | Todd Lipcon | Todd Lipcon | | | Separate Storage from FSImage | Major | namenode | Ivan Kelly | Ivan Kelly | | | Add a method to BlockPlacementPolicy for not removing the chosen nodes | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file | Major | datanode | Matt Foley | Matt Foley | | | Not marking datanodes dead When namenode in safemode | Major | namenode | Hairong Kuang | Hairong Kuang | | | Namenode should ignore non-initial block reports from datanodes when in safemode during startup | Major | datanode | Matt Foley | Matt Foley | | | Speedup NameNode image loading and saving by storing local file names | Major | namenode | Hairong Kuang | Hairong Kuang | | | make failure message more useful in DFSTestUtil.waitReplication() | Major | test | Matt Foley | Matt Foley | | | TestDatanodeBlockScanner waits forever, errs without giving information | Major | test | Matt Foley | Matt Foley | | | HDFS federation: Upgrade and rolling back of Federation | Major | . | Tanping Wang | | | | Metrics2: metrics framework | Major | metrics | Luke Lu | Luke Lu | | | Removed unused internal methods from DistributedCache | Major | client | Tom White | Tom White | | | NameNode should save image to name directories in parallel during upgrade | Major | namenode | Hairong Kuang | Matt Foley | | | Recurring failures in TestBackupNode since HDFS-1052 | Major | test | Matt Foley | | | | Recurring failure in

since build 477 on May 11 | Major | test | Matt Foley | Luke Lu | | | TestBlocksWithNotEnoughRacks intermittently fails assert | Major | namenode | Matt Foley | Matt Foley | | | MR 279: Security for JobHistory service | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | Improve TestDFSStorageStateRecovery | Major | test | Matt Foley | Aaron T. Myers | | | Intermittent recurring failure in TestFiDataTransferProtocol2.pipeline\Fi\29 | Major | test | Matt Foley | Tsz Wo Nicholas Sze | | | Improve namenode restart times by short-circuiting the first block reports from datanodes | Major | namenode | dhruba borthakur | Matt Foley | | | Incorrect default trash interval value in the docs | Trivial | documentation | Ravi Phulari | Harsh J | | | Add client failover functionality to o.a.h.io.(ipc\|retry) | Major | ha, ipc | Aaron T. Myers | Aaron T. Myers | | | Move DecommissionManager to block management | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Move Host2NodesMap to block management | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Deprecate DistributedFileSystem.getClient() | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | A several tiny improvements for the LOG format | Trivial | fs, ipc | XieXianshan | XieXianshan | | | Move cluster network topology to block management | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove NameNode roles Active and Standby (they become states) | Major | ha, namenode | Suresh Srinivas | Suresh Srinivas | | | Move dnsToSwitchMapping and hostsReader from FSNamesystem to DatanodeManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Move ReplicationMonitor to block management | Major | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | Move EditLogOp serialization formats into FsEditLogOp implementations | Major | namenode | Ivan Kelly | Ivan Kelly | | | Move datanodeMap from FSNamesystem to DatanodeManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Set FSNamesystem.LOG to package private | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Move blockTokenSecretManager from FSNamesystem to BlockManager | Major | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | Fix the ExponentiallySmoothedTaskRuntimeEstimator and its unit test | Minor | mrv2 | Josh Wills | Josh Wills | | | To use maven for hadoop common builds | Major | build | Giridharan Kesavan | Alejandro Abdelnur | | | Use canonical (IDE friendly) generated-sources directory for generated sources | Major |

| Luke Lu | Luke Lu | | | publish Hadoop Common artifacts (post HADOOP-6671) to Apache SNAPSHOTs repo | Major | build | Alejandro Abdelnur | Tom White | | | compiled nativelib is in wrong directory and it is not picked up by surefire setup | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Move datanode heartbeat handling to BlockManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | test-patch reports the wrong number of javadoc warnings | Major | build | Tom White | Tom White | | | Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Maven build fails in Windows | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Make arguments to test-patch optional | Major | scripts | Tom White | Tom White | | | Reduce access levels of the fields and methods in FSNamesystem | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Change UnderReplicatedBlocks from public to package private | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Allow test-patch to be run from any subproject directory | Major | . | Tom White | Tom White | | | Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove legacy TAR layout creation | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | break Maven TAR & bintar profiles into just LAYOUT & TAR proper | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Add a Namesystem interface to avoid directly referring to FSNamesystem | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Make test-patch only run tests for changed modules | Major | . | Tom White | Tom White | | | Make hadoop-common a POM module with sub-modules (common & alfredo) | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | MR-279: AM restart does not work after RM refactor | Major | applicationmaster, mrv2, resourcemanager | Sharad Agarwal | Sharad Agarwal | | | Docs for core protocols in yarn-api - AMRMProtocol | Major | documentation, mrv2 | Arun C Murthy | Arun C Murthy | | | Docs for core protocols in yarn-api - ContainerManager | Major | documentation, mrv2 | Arun C Murthy | Arun C Murthy | | | Docs for core protocols in yarn-api - ClientRMProtocol | Major | documentation, mrv2 | Arun C Murthy | Arun C Murthy | | | Write Http access to HDFS | Major | . | Sanjay Radia | Tsz Wo Nicholas Sze | | | Change allocate call to return ContainerStatus for completed containers rather than Container | Blocker | applicationmaster, mrv2, nodemanager, resourcemanager | Arun C Murthy | Arun C Murthy | | | Remove all apis other than getters and setters in all org/apache/hadoop/yarn/api/records/\* | Major | mrv2 | Arun C Murthy | Arun C Murthy | | | Read access to HDFS using HTTP REST | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext | Major | mrv2, resourcemanager | Arun C Murthy | Arun C Murthy | | | JobClient cannot talk to JobHistory server in secure mode | Major | jobhistoryserver, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Configuration option to enable/disable

| Major | webhdfs | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Provide authentication to webhdfs using SPNEGO | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Docs for remaining records in yarn-api | Major | documentation, mrv2 | Arun C Murthy | Arun C Murthy | | | Support getFileBlockLocations and getDelegationToken in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | webhdfs: support case insensitive query parameter names | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | webhdfs throws a npe when ugi is null from getDelegationToken | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | Add docs for setting up a single node MRv2 cluster. | Major | . | Mahadev konar | Mahadev konar | | | Move datanodes size printing to BlockManager from FSNameSystem's metasave API | Minor | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Report Application status as well as ApplicationMaster status in GetApplicationReportResponse | Blocker | mrv2 | Hitesh Shah | Hitesh Shah | | | add a standard handler for socket connection problems which improves diagnostics | Minor | util | Steve Loughran | Steve Loughran | | | Support getContentSummary and getFileChecksum in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add docs for writing new application frameworks | Critical | documentation, mrv2 | Arun C Murthy | Hitesh Shah | | | Fix broken merge of MR-2719 to 0.23 branch for the distributed shell test case | Trivial | mrv2 | Hitesh Shah | Hitesh Shah | | | Add documentation for CapacityScheduler | Blocker | documentation, mrv2, scheduler | Arun C Murthy | Arun C Murthy | | | [MR-279] Replace IP addresses with hostnames | Blocker | mrv2, security | Ramya Sunil | Vinod Kumar Vavilapalli | | | Remove YarnConfiguration.YARN\SECURITY\INFO | Major | mrv2, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | [MR-279] OutputCommitter changes for MR Application Master recovery | Blocker | applicationmaster, mrv2 | Sharad Agarwal | Sharad Agarwal | | | webhdfs api's should return a root element in the json response | Critical | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | The renewer in NamenodeWebHdfsMethods.generateDelegationToken(..) is not used | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Yarn+MR secure mode is broken, uncovered after MAPREDUCE-3056 | Blocker | applicationmaster, mrv2, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | webhdfs liststatus json response is not correct | Major | webhdfs | Arpit Gupta | Suresh Srinivas | | | Reenable TestLinuxContainerExecutor reflecting the current NM

| Critical | mrv2, security, test | Eric Payne | Robert Joseph Evans | | | Port MAPREDUCE-2702 to old mapred api | Blocker | mrv2 | Arun C Murthy | Arun C Murthy | | | MR-279: Need to retrieve shuffle port number on ApplicationMaster restart | Blocker | mrv2 | Robert Joseph Evans | Jonathan Eagles | | | webhdfs returns two content-type headers | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | webhdfs api parameter validation should be better | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | webhdfs liststatus json does not convert to a valid xml document | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | webhdfs open an invalid path leads to a 500 which states a npe, we should return a 404 with appropriate error message | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | Add docs for setting up real-world MRv2 clusters | Blocker | documentation, mrv2 | Arun C Murthy | Arun C Murthy | | | Unable to restrict users based on resourcemanager.admin.acls value set | Blocker | mrv2, resourcemanager | Amol Kekre | Arun C Murthy | | | Augment JobHistory to include information needed for serving aggregated logs. | Critical | mrv2 | Vinod Kumar Vavilapalli | Siddharth Seth | | | tail using a webhdfs uri throws an error | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | Implement Application ACLs, Queue ACLs and their interaction | Blocker | mrv2, resourcemanager, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | webhdfs mkdirs api call creates path with 777 permission, we should default it to 755 | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | Remove test-patch SVN externals | Major | . | Tom White | Tom White | | | AM fails to restart when first AM is killed | Blocker | mrv2 | Karam Singh | Mahadev konar | | | [MR-279] Design and implement MR Application Master recovery | Blocker | applicationmaster, mrv2 | Sharad Agarwal | Sharad Agarwal | | | [MR-279] [Security] Cleanup LinuxContainerExecutor binary sources | Blocker | mrv2, nodemanager, security | Vinod Kumar Vavilapalli | Robert Joseph Evans | | | Recovery of MR AMs with reduces fails the subsequent generation of the job | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | [MR-279] [Security] Yarn servers can't communicate with each other with hadoop.security.authorization set to true | Blocker | mrv2, security | Vinod Kumar Vavilapalli | Arun C Murthy | | | ResourceManager needs to renew and cancel tokens associated with a job | Blocker | mrv2, resourcemanager, security | Owen O'Malley | Arun C Murthy | | | When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | add version prefix and root methods to webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | MRv2 WebApp Security | Blocker | applicationmaster, mrv2, security | Luke Lu | Robert Joseph Evans | | | [webhdfs] When Getting the file using OP=OPEN with DN http address, ESTABLISHED sockets are

| Major | webhdfs | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Yarn httpservers not created with access Control lists | Blocker | mrv2 | Thomas Graves | Jonathan Eagles | | | Authorization checks needed for AM-\>RM protocol | Blocker | applicationmaster, mrv2, resourcemanager, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Support fadvise and sync\data\range in NativeIO, add ReadaheadPool class | Major | io, native, performance | Todd Lipcon | Todd Lipcon | | | webhdfs setreplication api should return a 403 when called on a directory | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | JobHistory should link to task logs | Critical | mrv2 | Siddharth Seth | Siddharth Seth | | | Remove reference to FSNamesystem in blockmanagement classes | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Authorization checks needed for AM-\>NM protocol | Blocker | applicationmaster, mrv2, nodemanager, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | [MR-279] Set correct permissions for files in dist cache | Blocker | mrv2 | Ramya Sunil | Hitesh Shah | | | Add a MR specific command line to dump logs for a given TaskAttemptID | Critical | mrv2, nodemanager | Vinod Kumar Vavilapalli | Siddharth Seth | | | Container logs aren't getting cleaned up when LogAggregation is disabled | Major | mrv2, nodemanager | Arun C Murthy | Siddharth Seth | | | Support delegation token renewal in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | ant test TestCombineOutputCollector failing on trunk | Minor | mrv2, test | Hitesh Shah | Devaraj K | | | Implement Job ACLs for MRAppMaster | Blocker | mrv2, security | Vinod Kumar Vavilapalli | Mahadev konar | | | distcp with a webhdfs uri on a secure cluster fails | Major | webhdfs | Arpit Gupta | Jitendra Nath Pandey | | | Remove the use of Range header from webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | webhdfs rest call to a secure dn fails when a token is sent | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze | | | Change WebHdfsFileSystem to two-step create/append | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Support doAs and GETHOMEDIRECTORY in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Allow configuration changes without restarting configured nodes | Major | conf | Patrick Kling | Patrick Kling | | | Porting Gridmix v3 system tests into trunk branch. | Major | contrib/gridmix | Vinay Kumar Thota | Vinay Kumar Thota | | | Gridmix compression emulation system tests. | Major | contrib/gridmix | Vinay Kumar Thota | Vinay Kumar Thota | | | Gridmix distributed cache emulation system tests. | Major | contrib/gridmix | Vinay Kumar Thota | Yiting Wu | | | Gridmix high ram jobs emulation system tests. | Major | contrib/gridmix | Vinay Kumar Thota | Vinay Kumar Thota | | | [Herriot] Gridmix generate data tests with various submission policies and different user resolvers. | Major | contrib/gridmix | Vinay Kumar Thota | Vinay Kumar Thota | | | [Herriot] Test Gridmix file pool for