Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.0.23.1.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Modify the option of FsShell getmerge from [addnl] to [-nl] for consistency | Major | fs | XieXianshan | XieXianshan | | | Command line listJobs should not visit each AM | Major | client, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | move up to Jackson 1.8.8 | Minor | util | Steve Loughran | Enis Soztutar | | | ViewFileSystem does not honor setVerifyChecksum | Major | fs | Daryn Sharp | Daryn Sharp | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | [Rumen] Need a standalone JobHistory log anonymizer | Major | tools/rumen | Hong Tang | Amar Kamat | | | Port token service changes from 205 | Major | fs, security | Daryn Sharp | Daryn Sharp | | | DistCp Rewrite | Major | distcp, mrv2 | Mithun Radhakrishnan | Mithun Radhakrishnan | | | [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items | Major | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | DN should log a WARN, not an INFO when it detects a corruption during block transfer | Trivial | datanode | Harsh J | Harsh J | | | Remove duplicate call of Path#normalizePath during initialization. | Trivial | fs | Harsh J | Harsh J | | | Improve performance of raw comparisons | Major | io, performance, util | Todd Lipcon | Todd Lipcon | | | Log an error if the topology script doesn't handle multiple args | Major | . | Eli Collins | Uma Maheswara Rao G | | | Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManager | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Remove needless synchronization on FSDataSet.getBlockFile | Minor | datanode, performance | Todd Lipcon | Todd Lipcon | | | Speed up DFS read path by lessening checksum overhead | Major | hdfs-client, performance | Todd Lipcon | Todd Lipcon | | | Improvements to CapacityScheduler doc | Major | mrv2 | Thomas Graves | Thomas Graves | | | Enhance logging of initalized queue limit values | Major | mrv2 | Anupam Seth | Anupam Seth | | | Improvement to single node cluster setup documentation for

| Minor | mrv2 | Anupam Seth | Anupam Seth | | | Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2 | Major | mrv1, mrv2, test | Todd Lipcon | Ahmed Radwan | | | improve MiniMRYarnCluster & DistributedShell JAR resolution | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | | | Refactor BPOfferService to be a static inner class | Major | datanode | Todd Lipcon | Todd Lipcon | | | Refactor DN configuration variables out of DataNode class | Minor | datanode | Todd Lipcon | Todd Lipcon | | | Some cleanup in BPOfferService | Major | datanode | Todd Lipcon | Todd Lipcon | | | hdfs-default.xml should include dfs.name.dir.restore | Minor | documentation | Eli Collins | Harsh J | | | Use a set to manage child sockets in XceiverServer | Trivial | datanode | Harsh J | Harsh J | | | Move maxXceiverCount check to before starting the thread in dataXceiver | Minor | datanode | Uma Maheswara Rao G | Harsh J | | | Add descriptions for dfs.\*.https.address in hdfs-default.xml | Trivial | documentation | Eli Collins | Eli Collins | | | Run tests with non-secure random | Trivial | build | Todd Lipcon | Todd Lipcon | | | RunJar should provide more diags when it can't create a temp file | Minor | util | Steve Loughran | Jonathan Hsieh | | | Move BPOfferService to be a non-inner class | Minor | datanode | Todd Lipcon | Todd Lipcon | | | Remove unused imports | Trivial | namenode | Aaron T. Myers | Harsh J | | | Performance Upgrade for jQuery | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Reduce log level on MR2 IPC construction, etc | Blocker | mrv2 | Todd Lipcon | Arun C Murthy | | | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey | | | Drop some info logging to DEBUG level in IPC, metrics, and HTTP | Trivial | . | Todd Lipcon | Todd Lipcon | | | Review and improve the yarn-api javadocs. | Minor | documentation, mrv2 | Ravi Prakash | Ravi Prakash | | | Small cleanup in SchedulerApp | Trivial | mrv2 | Todd Lipcon | Todd Lipcon | | | enable hadoop config generator to set dfs.block.local-path-access.user to enable short circuit read | Major | conf | Arpit Gupta | Arpit Gupta | | | Implement a base class for DNSToSwitchMapping implementations that can offer extra topology information | Major | util | Steve Loughran | Steve Loughran | | | Add a log message to show if WebHDFS is enabled | Minor | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169 | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan | | | Handle leaf queues with the same name properly | Major | mrv2 | Ravi Prakash | Ravi Prakash | | | HttpFS - a read/write Hadoop file system proxy | Major |

| Alejandro Abdelnur | Alejandro Abdelnur | | | Make GlobFilter class public | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur | | | LocalFileSystem Needs createNonRecursive API | Minor | fs | Nicolas Spiegelberg | Nicolas Spiegelberg | | | Add dev script to generate HDFS protobufs | Minor | build | Todd Lipcon | Alejandro Abdelnur | | | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins | | | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins | | | Support web-services for RM & NM | Blocker | mrv2, nodemanager, resourcemanager | Arun C Murthy | Thomas Graves | | | Reduce verbosity when double-closing edit logs | Trivial | namenode | Todd Lipcon | Todd Lipcon | | | Add support for LZ4 compression | Major | . | Bert Sanders | Binglin Chang | | | DataNodeCluster and NNStorage always pull fresh entropy | Major | datanode, namenode | Eli Collins | Uma Maheswara Rao G | | | Redirect hadoop script's deprecation message to stderr | Trivial | scripts | Koji Noguchi | Koji Noguchi | | | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | Improvement for FSshell -stat | Trivial | fs | XieXianshan | XieXianshan | | | Support non-recursive create() in FileSystem & SequenceFile.Writer | Minor | fs, io | Nicolas Spiegelberg | Nicolas Spiegelberg | | | "Exception in createBlockOutputStream" shouldn't delete exception stack trace | Major | . | Michael Bieniosek | Harsh J | | | add configuration methods to handle human readable size values | Minor | conf | Sho Shimauchi | Sho Shimauchi | | | Update BlockManager's comments regarding the invalid block set | Minor | namenode | Harsh J | Harsh J | | | BlockInfo.ensureCapacity may get a speedup from System.arraycopy() | Minor | namenode | Steve Loughran | Harsh J | | | [Doc] Remove hadoop.logfile.\* properties. | Trivial | documentation | Harsh J | Harsh J | | | hadoop-metrics.properties missing some Ganglia31 options | Trivial | metrics | Eli Collins | Harsh J | | | Some parts in MR use old property dfs.block.size | Minor | . | Sho Shimauchi | Sho Shimauchi | | | Normalize dependencies versions across all modules | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur | | | conf.getBoolean must be case insensitive | Minor | . | Abhijit Bagri | Sho Shimauchi | | | Add AMInfo table to the AM job page | Minor | mrv2 | Siddharth Seth | Jonathan Eagles | | | HdfsServerConstants#DN\KEEPALIVE\TIMEOUT is dead code | Major | datanode | Eli Collins | Eli Collins | | | Adding logging to LeaseRenewer for better lease expiration triage. | Minor | namenode | Jimmy Xiang | Jimmy Xiang | | | Combine the two TestSafeMode test suites | Minor | test | Todd Lipcon | Todd Lipcon | | | Add test hook to turn off the writer preferring its local DN | Minor | namenode | Todd Lipcon | Todd Lipcon | | | Test case for HDFS-1476 (safemode can initialize repl queues before exiting) | Minor | namenode, test | Todd Lipcon | Todd Lipcon | | | Undeprecate SecondaryNameNode | Major | namenode | Todd Lipcon | Eli Collins | | | yarn-resourcemanager out and log files can get big | Blocker | mrv2 | Eli Collins | Eli Collins | | | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey | | | Provide information about lost nodes in the UI. | Critical | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | Add admin env to mapred-default.xml | Minor | mrv2 | Roman Shaposhnik | Roman Shaposhnik | | | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, conf, documentation, scripts | Roman Shaposhnik | Roman Shaposhnik | | | [Gridmix] Improve STRESS mode locking | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | | AM logs and others should not automatically refresh after every 1

| Major | mrv2 | Mahadev konar | Vinod Kumar Vavilapalli | | | Make single shuffle limit configurable | Major | mrv2 | Arun C Murthy | Hitesh Shah | | | Port MAPREDUCE-1735 to trunk/0.23 | Major | . | Arun C Murthy | Arun C Murthy | | | ChRootFileSystem should extend FilterFileSystem | Major | fs | Daryn Sharp | Daryn Sharp | | | NamenodeMXBean does not account for svn revision in the version information | Minor | . | Hitesh Shah | Hitesh Shah | | | Add number of active transfer threads to the DataNode status | Minor | datanode | Harsh J | Harsh J | | | Visiting /jmx on the daemon web interfaces may print unnecessary error in logs | Minor | metrics | Harsh J | Aaron T. Myers | | | Create hadoop-client and hadoop-minicluster artifacts for downstream projects | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Minor Datanode logging improvement | Minor | datanode | Eli Collins | Eli Collins | | | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, hdfs-client, scripts | Roman Shaposhnik | Roman Shaposhnik | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | [Gridmix] TestGridmixSummary fails with NPE when run in DEBUG mode. | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | | [Gridmix] TestUserResolve fails in trunk | Major | contrib/gridmix | Amar Kamat | Ravi Gummadi | | | Path.normalize should use StringUtils.replace in favor of String.replace | Minor | fs | Zheng Shao | Uma Maheswara Rao G | | | App fail to launch due to delegation token not found in cache | Blocker | mrv2 | Ramya Sunil | Robert Joseph Evans | | | o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator | Major | . | Brock Noland | Brock Noland | | | HADOOP\_PREFIX cannot be overriden | Major | build | Bruno Mah | Bruno Mah | | | Rumen LoggedTaskAttempt getHostName call returns hostname as null | Blocker | tools/rumen | Karam Singh | Amar Kamat | | | JobHistoryServer doesn't show job queue | Critical | jobhistoryserver, mrv2 | Thomas Graves | Jonathan Eagles | | | Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes | Major | mrv2, resourcemanager | Vinod Kumar Vavilapalli | Hitesh Shah | | | compile-mapred-test fails | Critical | build, mrv2 | Ramya Sunil | Hitesh Shah | | |

not public api - shouldn't be using it | Critical | mrv2 | Thomas Graves | Thomas Graves | | | MR AM for sort-job going out of memory | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | MR AM should not read the username from configuration | Major | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | LocalResourceTracker should not tracking deleted cache entries | Major | mrv2, nodemanager | Siddharth Seth | Siddharth Seth | | | MiniMRYarnCluster uses a hard coded path location for the MapReduce application jar | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan | | | test-patch +1 patches that introduce javadoc and findbugs warnings in some cases | Major | build, test | Jonathan Eagles | Jonathan Eagles | | | Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers | Critical | jobhistoryserver, mrv2, nodemanager | Jonathan Eagles | Jonathan Eagles | | | Invalid tracking URL for streaming jobs | Major | contrib/streaming, mrv2 | Ramya Sunil | Jonathan Eagles | | | TestUserGroupInformation#testGetServerSideGroups test fails in chroot | Major | security, test | Jonathan Eagles | Jonathan Eagles | | | AM scheduling hangs frequently with sort job on 350 nodes | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Wrong jar getting used in TestMR\Jobs\ for MiniMRYarnCluster | Minor | mrv2 | Hitesh Shah | Hitesh Shah | | | Make source tarball use conventional name. | Major | build | Bruno Mah | Bruno Mah | | | Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. | Major | . | Bruno Mah | Bruno Mah | | | Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. | Major | scripts | Bruno Mah | Bruno Mah | | | Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. | Major | . | Bruno Mah | Bruno Mah | | | HADOOP\_PREFIX cannot be overriden | Major | scripts | Bruno Mah | Bruno Mah | | | HADOOP\_PREFIX cannot be overriden | Major | . | Bruno Mah | Bruno Mah | | | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J | | | When 0 DNs are available, show a proper error when trying to browse DFS via web UI | Major | namenode | Harsh J | Harsh J | | | Branch 23 fails to build with Failure to find org.apache.hadoop:hadoop-project:pom:0.24.0-SNAPSHOT | Blocker | build, mrv2 | Jonathan Eagles | Jonathan Eagles | | | compilation failing because workDir not initialized in RunJar.java | Major | . | John George | John George | | | Nightly build broken | Blocker | mrv2 | Hitesh Shah | Hitesh Shah | | | DFSTestUtil may create empty files | Minor | test | Todd Lipcon | Todd Lipcon | | | mapreduce examples not working | Blocker | mrv2 | Thomas Graves | Mahadev konar | | | trunk/0.23 builds broken | Blocker | mrv2 | Hitesh Shah | Hitesh Shah | | | 'ant docs' is broken | Major | . | Amar Kamat | Amar Kamat | | | [Gridmix] TestDistCacheEmulation is broken | Major | contrib/gridmix | Amar Kamat | Hitesh Shah | | | yarn-daemon.sh unconditionnaly sets yarn.root.logger | Major | mrv2, nodemanager, resourcemanager | Bruno Mah | Bruno Mah | | | capacity schedule maximum-capacity allowed to be less then capacity | Blocker | mrv2 | Thomas Graves | Arun C Murthy | | | hdfs jsp pages missing DOCTYPE [post-split branches] | Trivial | scripts | Dave Vronay | Dave Vronay | | | mapreduce jsp pages missing DOCTYPE [post-split branches] | Trivial | . | Dave Vronay | Dave Vronay | | | Some links in WebHDFS forrest doc do not work | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | |

is failing an assert | Major | fs | Eli Collins | Eli Collins | | | RM web ui applications not sorted in any order by default | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | TestDirectoryScanner doesn't test parallel scans | Major | datanode, test | Eli Collins | Eli Collins | | | Elapsed time filter on jobhistory server displays incorrect table entries | Minor | jobhistoryserver, mrv2 | Ramya Sunil | Jonathan Eagles | | | org.apache.hadoop.yarn.util.TestLinuxResourceCalculatorPlugin fails on 0.23 | Minor | mrv2 | Hitesh Shah | Hitesh Shah | | | DFIP aka 'NodeManager should handle Disk-Failures In Place' | Blocker | mrv2, nodemanager | Vinod Kumar Vavilapalli | Ravi Gummadi | | | TestCombineOutputCollector javac unchecked warning on mocked generics | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Building mvn site with Maven \< 3.0.2 causes OOM errors | Major | build | Andrew Bayer | Andrew Bayer | | | webhdfs client filesystem impl must set the content-type header for create/append | Critical | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur | | | NM port info no longer available in JobHistory | Major | mr-am, mrv2 | Siddharth Seth | Siddharth Seth | | | multiple javax security configurations cause conflicts | Blocker | security | Daryn Sharp | Daryn Sharp | | | Hadoop site documentation cannot be built anymore on trunk and branch-0.23 | Major | documentation, mrv2 | Bruno Mah | Jonathan Eagles | | | Streaming jobs are failing because the main class isnt set in the pom files. | Blocker | mrv2 | Mahadev konar | Mahadev konar | | | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh | | | hadoop dist tarball is missing hdfs headers | Major | build | Bruno Mah | Alejandro Abdelnur | | | UGI getCurrentUser is not synchronized | Critical | security | Daryn Sharp | Daryn Sharp | | | Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job | Blocker | applicationmaster, mrv2 | Karam Singh | Siddharth Seth | | | fifoscheduler web ui page always shows 0% used for the queue | Major | mrv2 | Thomas Graves | Jonathan Eagles | | | Oozie jobs are running as oozie user even though they create the jobclient as doAs. | Blocker | mrv2 | Mahadev konar | Mahadev konar | | | MR AM can hang if containers are allocated on a node blacklisted by the AM | Blocker | mr-am, mrv2 | Siddharth Seth | Robert Joseph Evans | | | RM web ui application details page shows RM cluster about information | Major | mrv2 | Thomas Graves | Jonathan Eagles | | | JobClient#getJob cannot find local jobs | Major | client | Tom White | Tom White | | | MRJobConfig creates an LD\LIBRARY\PATH using the platform ARCH | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | | | $HADOOP\PREFIX/bin/yarn should set defaults for $HADOOP\\*\_HOME | Blocker | mrv2 | Eric Payne | Eric Payne | | | Fix findbugs warnings in hadoop-examples | Major | mrv2 | Arun C Murthy | Devaraj K | | | MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine | Critical | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | | | Yarn initializes ACL operations from capacity scheduler config in a non-deterministic order | Major | mrv2 | Jonathan Eagles | Jonathan Eagles | | | KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur | | | Fix javadoc warnings in

| Minor | security | Suresh Srinivas | Suresh Srinivas | | | RM web ui scheduler link doesn't show correct max value for queues | Critical | mrv2 | Thomas Graves | Anupam Seth | | | Capacity Scheduler web UI has a spelling mistake for Memory. | Trivial | mrv2 | Mahadev konar | chackaravarthy | | | Configuration.getClasses() never returns the default value. | Major | conf | Amar Kamat | Uma Maheswara Rao G | | | webhdfs HTTP API should implement getDelegationTokens() instead getDelegationToken() | Critical | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze | | | skipping name rules setting (if already set) should be done on UGI initialization only | Major | . | Tsz Wo Nicholas Sze | Alejandro Abdelnur | | | Regression HADOOP-7777 switch changes break HDFS tests when the isSingleSwitch() predicate is used | Minor | util | Steve Loughran | Steve Loughran | | | Fix minor API incompatibilities between 1.0 and 0.23 | Major | . | Tom White | Tom White | | | test-patch should run eclipse:eclipse to verify that it does not break again | Major | build | Robert Joseph Evans | Robert Joseph Evans | | | mapred queue -info \<queue\> -showJobs throws NPE | Critical | client, mrv2 | Jonathan Eagles | Jonathan Eagles | | | mapred queue -list output inconsistent and missing child queues | Critical | mrv2 | Thomas Graves | Ravi Prakash | | | Capacity Scheduler inherited ACLs not displayed by mapred queue -showacls | Major | capacity-sched, mrv2 | Jonathan Eagles | Jonathan Eagles | | | DefaultContainerExecutor has a race condn. with multiple concurrent containers | Blocker | . | Arun C Murthy | Arun C Murthy | | | duplicate declaration of hadoop-hdfs test-jar | Major | build | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | move hadoop archive to core from tools | Blocker | . | John George | John George | | | Support "FileSystemCounter" legacy counter group name for compatibility | Major | . | Tom White | Tom White | | | gridmix build is broken, requires hadoop-archives to be added as ivy dependency | Major | build, tools/rumen | Alejandro Abdelnur | Alejandro Abdelnur | | | Webhdfs: Support multiple namenodes in federation | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | eclipse:eclipse build fails for hadoop-hdfs-httpfs | Major | build | Jason Lowe | Jason Lowe | | | MR1 test fail to compile because of missing hadoop-archives dependency | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Log Aggregation broken in Secure Mode | Blocker | mrv2, nodemanager | Siddharth Seth | Siddharth Seth | | | Fix broken TestJobQueueClient test | Blocker | mrv2 | Ravi Prakash | Ravi Prakash | | | Sometimes NODE\_UPDATE to the scheduler throws an NPE causing the scheduling to stop | Blocker | mrv2, resourcemanager, scheduler | Karam Singh | Arun C Murthy | | | JobEndNotifier is getting interrupted before completing all its retries. | Major | mr-am, mrv2 | Ravi Prakash | Ravi Prakash | | | Sometimes

Invalid key to HMAC computation in NODE\_UPDATE also causing RM to stop scheduling | Blocker | mrv2, resourcemanager, scheduler | Karam Singh | Robert Joseph Evans | | | TestRMNodeTransitions is failing on trunk | Blocker | mrv2, resourcemanager, test | Vinod Kumar Vavilapalli | Siddharth Seth | | | compilation of protobuf files fails in windows/cygwin | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | jobhistory web ui task counters no longer links to singletakecounter page | Critical | mrv2 | Thomas Graves | Jason Lowe | | | TestStagingCleanup and TestJobEndNotifier are failing on trunk. | Blocker | mrv2 | Mahadev konar | Siddharth Seth | | | Counter display names are not being picked up | Major | mrv2 | Tom White | Jonathan Eagles | | | Mapreduce component should use consistent directory structure layout as HDFS/common | Major | mrv2 | Eric Yang | Eric Yang | | | A tracking URL of N/A before the app master is launched breaks oozie | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Javadoc generation hangs | Major | . | Tom White | Tom White | | | ConverterUtils should not include a port in a path for a URL with no port | Major | mrv2 | Aaron T. Myers | Aaron T. Myers | | | BlockPoolSliceScanner spinning in loop | Critical | datanode | Todd Lipcon | Uma Maheswara Rao G | | | HttpFS introduced 70 javadoc warnings | Major | . | Eli Collins | Alejandro Abdelnur | | | LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter | Major | mrv2 | Arun C Murthy | Arun C Murthy | | | Use configuration for blockInvalidateLimit if it is set | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | no NullAppender in the log4j config | Major | conf | Steve Loughran | Eli Collins | | | Old mapred API combiner uses NULL reporter | Major | mrv1, mrv2 | Robert Joseph Evans | Subroto Sanyal | | | Connecting to CM is logged as Connecting to RM | Minor | applicationmaster | Subroto Sanyal | Subroto Sanyal | | | Job is getting hanged indefinitely,if the child processes are killed on the NM. KILL\_CONTAINER eventtype is continuosly sent to the containers that are not existing | Blocker | mrv2 | Ramgopal N | Siddharth Seth | | | bin/yarn broken after MAPREDUCE-3366 | Blocker | . | Arun C Murthy | Arun C Murthy | | | Hadoop HttpFS introduced 4 findbug warnings. | Major | . | Uma Maheswara Rao G | Alejandro Abdelnur | | | TestHttpFSServer and TestServerWebApp are failing on trunk | Major | . | Eli Collins | Alejandro Abdelnur | | | No rack-name logged in JobHistory for unsuccessful tasks | Blocker | mrv2 | Vinod Kumar Vavilapalli | Amar Kamat | | | HttpFS server should check that upload requests have correct content-type | Major |

| Alejandro Abdelnur | Alejandro Abdelnur | | | Lots of AMs hanging around in PIG testing | Blocker | mr-am, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | HttpFS should read the hadoop-auth secret from a file instead inline from the configuration | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | Streaming's check for local mode is broken | Blocker | contrib/streaming | Arun C Murthy | Arun C Murthy | | | Hadoop Streaming ignores unknown parameters | Minor | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Capacity Scheduler ACLs not inherited by default | Major | mrv2 | Jonathan Eagles | Jonathan Eagles | | | MAPREDUCE-3522 commit causes compilation to fail | Major | mrv2 | Mahadev konar | Mahadev konar | | | HttpFs shouldn't be using an int for block size | Major | hdfs-client | Harsh J | Harsh J | | | Viewfs changes for MAPREDUCE-3529 | Critical | viewfs | Siddharth Seth | Siddharth Seth | | | Job submission failing in JUnit tests | Blocker | mrv2, test | Amar Kamat | Ravi Prakash | | | dfs.blocksize accepts only absolute value | Minor | . | Karim Saadah | Sho Shimauchi | | | RMContainerAllocator counts failed maps towards Reduce ramp up | Blocker | mr-am, mrv2 | Siddharth Seth | Sharad Agarwal | | | Shell scripts created by hadoop-dist/pom.xml to build tar do not properly propagate failure | Minor | build | Michajlo Matijkiw | Michajlo Matijkiw | | | DistributedCache creates its own FileSytem instance when adding a file/archive to the path | Major | . | Dick King | Dick King | | | TokenCache does not cache viewfs credentials correctly | Critical | mrv2 | Siddharth Seth | Siddharth Seth | | | Cannot build against ZooKeeper 3.4.0 | Minor | mrv2 | Andrew Bayer | Tom White | | | Updated maxIdleTime default in the code to match core-default.xml | Trivial | ipc | Eli Collins | Eli Collins | | | mapred ant test failures | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | HDFS part of MAPREDUCE-3529, HADOOP-7933 | Critical | . | Siddharth Seth | | | | RM web UI scheduler link not as useful as should be | Critical | mrv2 | Thomas Graves | Jason Lowe | | | Remove yarn default values for resource manager and nodemanager principal | Major | mrv2 | Jonathan Eagles | Jonathan Eagles | | | hadoop-tools JARs are not part of the distro | Blocker | build | Alejandro Abdelnur | Alejandro Abdelnur | | | There's a Hoop README in the root dir of the tarball | Major | build | Eli Collins | Alejandro Abdelnur | | | bin/yarn script adds jdk tools.jar to the classpath. | Major | mrv2 | Mahadev konar | Mahadev konar | | | test failures: TestViewFileSystemWithAuthorityLocalFileSystem and TestViewFileSystemLocalFileSystem | Blocker | . | Thomas Graves | Siddharth Seth | | | The task timeout check interval should be configurable independent of mapreduce.task.timeout | Major | mr-am, mrv2 | Siddharth Seth | Siddharth Seth | | | TokenCache likely broken for FileSystems which don't issue delegation tokens | Blocker | mrv2 | Siddharth Seth | Siddharth Seth | | | [Umbrella ticket] Make uber jobs functional | Major | mrv2 | Hitesh Shah | | | | Make MR AM not send a stopContainer w/o corresponding start container | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Network ACLs can prevent AMs to ping the Job-end notification URL | Critical | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Ravi Prakash | | | TestJobConf failing | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | TestQueueManagerRefresh fails | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | TestJobHistory fails | Blocker | mrv1 | Thomas Graves | Thomas Graves | | |

fails | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | CapacityScheduler web-ui display of queue's used capacity is broken | Critical | mrv2 | Arun C Murthy | Jason Lowe | | | Improve dfsadmin command line help | Minor | . | Ravi Phulari | Harsh J | | | Sort benchmark got hang after completion of 99% map phase | Blocker | applicationmaster, mrv2 | Ravi Prakash | Vinod Kumar Vavilapalli | | | Sort job on 350 scale is consistently failing with latest MRV2 code | Blocker | applicationmaster, mrv2, resourcemanager | Karam Singh | Siddharth Seth | | | When 0 is provided as port number in yarn.nodemanager.webapp.address, NMs webserver component picks up random port, NM keeps on Reporting 0 port to RM | Critical | mrv2, nodemanager | Karam Singh | Bhallamudi Venkata Siva Kamesh | | | Speculative Execution: speculative map tasks launched even if -Dmapreduce.map.speculative=false | Critical | job submission, mrv2 | patrick white | Eric Payne | | | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta | | | Add entry to XML defaults for new LZ4 codec | Minor | . | Harsh J | Harsh J | | | Job End notification gives an error on calling back. | Blocker | mrv2 | Mahadev konar | Ravi Prakash | | | State machine visualize build fails | Minor | build, mrv2 | Jason Lowe | Jason Lowe | | | HDFS Federation Documentation has incorrect configuration example | Minor | documentation | praveen sripati | Brandon Li | | | Calls from running tasks to TaskTracker methods sometimes fail and incur a 60s timeout | Major | . | Matei Zaharia | Rajesh Balamohan | | | hadoop \<job/queue/pipes\> removed - should be added back, but deprecated | Blocker | . | Thomas Graves | Prashant Sharma | | | Getting a lot of PriviledgedActionException / SaslException when running a job | Blocker | mrv2 | Thomas Graves | Mahadev konar | | | LocalDistributedCacheManager does not shut down its thread pool | Major | client | Tom White | Tom White | | | UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon | | | Leases not properly getting renewed by clients | Critical | hdfs-client | Todd Lipcon | Todd Lipcon | | | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon | | | Add config for History Server protocol in hadoop-policy for service level authorization. | Major | . | Mahadev konar | Mahadev konar | | | Move successfully passing MR1 tests to MR2 maven tree. | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan | | | Fix missing license header in hadoop-hdfs-project/hadoop-hdfs-httpfs/dev-support/findbugsExcludeFile.xml | Trivial | . | Hitesh Shah | Hitesh Shah | | | RM web UI doesn't handle newline in job name | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | Delete HadoopYarnRPC from 0.23 branch. | Major | mrv2 | Mahadev konar | Mahadev konar | | | write api documentation for web service apis for RM, NM, mapreduce app master, and job history server | Blocker | mrv2 | Thomas Graves | Thomas Graves | | | ant build fails on 0.23 branch | Blocker | mrv2 | Thomas Graves | Thomas Graves | | |

missing space between role and node name | Trivial | namenode | Todd Lipcon | Devaraj K | | | processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated | Major | ha, namenode | Todd Lipcon | Todd Lipcon | | | internal server error trying access application master via proxy with filter enabled | Critical | mrv2 | Thomas Graves | Thomas Graves | | | webservices add support to compress response | Critical | mrv2 | Thomas Graves | Thomas Graves | | | Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemaining | Major | io | Jonathan Eagles | Jonathan Eagles | | | Remove redundant URL info from "mapred job" output | Major | client, mrv2 | Ramya Sunil | Jonathan Eagles | | | capacity scheduler LeafQueues calculate used capacity wrong | Critical | mrv2 | Thomas Graves | Arun C Murthy | | | Deadlock in class init. | Blocker | security, util | Kihwal Lee | Daryn Sharp | | | dfsthroughput in test.jar throws NPE | Minor | test | Ramya Sunil | Harsh J | | | yarn APPLICATION\_CLASSPATH needs to be overridable | Major | mrv2 | Bruno Mah | Ahmed Radwan | | | last split generated by FileInputFormat.getSplits may not have the best locality | Major | mrv1, mrv2 | Siddharth Seth | Siddharth Seth | | | Reduce hangs in a corner case | Blocker | mrv2, task | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. | Blocker | mrv2 | Ravi Prakash | Mahadev konar | | | JobClient test jar has missing files to run all the test programs. | Blocker | mrv2 | Mahadev konar | Mahadev konar | | | Capacity scheduler LeafQueues maximum capacity calculation issues | Blocker | mrv2 | Thomas Graves | Arun C Murthy | | | "mapred mradmin" command is broken in mrv2 | Major | mrv2 | Siddharth Seth | Jason Lowe | | | Incorrect headroom reported to jobs | Blocker | mrv2, resourcemanager | Siddharth Seth | Arun C Murthy | | | Race in shuffle can cause it to hang | Blocker | mrv2 | Siddharth Seth | Siddharth Seth | | | Add Apache License Header to hadoop-distcp/pom.xml | Major | . | Mahadev konar | Mahadev konar | | | HttpFSServer still has 2 javadoc warnings in trunk | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | Add distcp jar to the distribution (tar) | Blocker | mrv2 | Mahadev konar | Mahadev konar | | | mvn javadoc:javadoc not seeing LimitedPrivate class | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | The Web Application Proxy's is not documented very well | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | Default RPC handlers are very low for YARN servers | Major | mrv2 | Vinod Kumar Vavilapalli | Hitesh Shah | | | Hadoop ignores old-style config options for enabling compressed output | Major | conf | Anupam Seth | Anupam Seth | | | "yarn logs" command fails with ClassNotFoundException | Blocker | mrv2 | Jason Lowe | Jason Lowe | | | CheckFileSystem does not correctly honor setVerifyChecksum | Major | fs | Daryn Sharp | Daryn Sharp | | | fetchdt command not available in bin/hadoop | Critical | . | Arpit Gupta | Arpit Gupta | | | TestHostnameFilter should work with localhost or

| Major | test | Eli Collins | Alejandro Abdelnur | | | If block report races with closing of file, replica is incorrectly marked corrupt | Major | datanode, namenode | Todd Lipcon | Todd Lipcon | | | CS should only use 'activeUsers with pending requests' for computing user-limits | Blocker | mrv2, resourcemanager, scheduler | Arun C Murthy | Arun C Murthy | | | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | SecurityUtil acquired token message should be a debug rather than info | Major | . | Arpit Gupta | Arpit Gupta | | | "hadoop archive" fails with ClassNotFoundException | Critical | scripts | Jason Lowe | Jason Lowe | | | ResourceManager should provide node lists in JMX output | Critical | mrv2, resourcemanager | Eric Payne | Eric Payne | | | java.io.File.createTempFile fails in map/reduce tasks | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles | | | Move CS related nodeUpdate log messages to DEBUG | Minor | mrv2 | Ramya Sunil | Ramya Sunil | | | AllocatedGB etc metrics incorrect if min-allocation-mb isn't a multiple of 1GB | Critical | mrv2 | Siddharth Seth | Arun C Murthy | | | ConcurrentModificationException in counter groups | Blocker | mrv2 | Tom White | Tom White | | | Fix org.apache.hadoop.hdfs.tools.GetConf$Command Findbug issue | Major | tools | Robert Joseph Evans | Robert Joseph Evans | | | TestFSInputChecker is failing in trunk. | Major | fs | Uma Maheswara Rao G | Daryn Sharp | | | RM webapp should have pages filtered based on App-state | Major | mrv2, webapps | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Resource Manager fails to come up with default capacity scheduler configs. | Critical | mrv2 | Mahadev konar | Mahadev konar | | | New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work | Blocker | mrv2, test | Alejandro Abdelnur | John George | | | yarn-default.xml should be moved to hadoop-yarn-common. | Major | mrv2 | Mahadev konar | Mahadev konar | | | MR job via oozie does not work on hadoop 23 | Blocker | mrv2 | John George | John George | | | streaming tests fail with MR2 | Blocker | contrib/streaming, mrv2 | Alejandro Abdelnur | Hitesh Shah | | | Headroom should be capped by queue max-cap | Blocker | mrv2 | Arun C Murthy | Arun C Murthy | | | Unable to retrieve application logs via "yarn logs" or "mapred job -logs" | Blocker | mrv2 | Jason Lowe | Jason Lowe | | | RM assigns containers to killed applications | Blocker | mrv2 | Ramya Sunil | Hitesh Shah | | | Cannot save namespace after renaming a directory above a file with an open lease | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | ChecksumFileSystem's rename doesn't correctly handle checksum files | Major | fs | Daryn Sharp | Daryn Sharp | | | Metrics: Incorrect Apps Submitted Count | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | maxActiveApplications(\|PerUser) per queue is too low for small clusters | Major | mrv2 | Ramya Sunil | Arun C Murthy | | | Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL:

| Major | build, test | Matt Foley | Jonathan Eagles | | | getNumCurrentReplicas is package private but should be public on 0.23 (see HDFS-2408) | Major | hdfs-client | Gregory Chanan | Gregory Chanan | | | Blacklisted NMs should not appear in Active nodes list | Major | mrv2 | Ramya Sunil | Vinod Kumar Vavilapalli | | | job access controls not working app master and job history UI's | Blocker | mrv2 | Thomas Graves | Jonathan Eagles | | | can't build site in hadoop-yarn-server-common | Major | documentation, mrv2 | Roman Shaposhnik | Mahadev konar | | | TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests | Major | mrv2, test, webapps | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh | | | "job -status" command line output is malformed | Major | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes | Major | mrv2 | Ramya Sunil | Vinod Kumar Vavilapalli | | | Change MiniYarnCluster to escape special chars in testname | Minor | mrv2 | Hitesh Shah | Hitesh Shah | | | FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting | Minor | mrv2 | Hitesh Shah | Hitesh Shah | | | Memory Total is not refreshed until an app is launched | Major | mrv2 | Ramya Sunil | Arun C Murthy | | | The start/stop scripts don't start/stop the 2NN when using the default configuration | Minor | . | Eli Collins | Eli Collins | | | MR1 compile fails | Major | mrv1, mrv2 | Arun C Murthy | Arun C Murthy | | | NPE in FileOutputCommitter when running a 0 reduce job | Blocker | mrv2 | Siddharth Seth | Robert Joseph Evans | | | yarn webapp interface vulnerable to cross scripting attacks | Major | jobhistoryserver, mrv2, resourcemanager | Dave Thompson | Dave Thompson | | | JobHistoryServer should be started by bin/mapred and not by bin/yarn | Blocker | jobhistoryserver, mrv2 | Vinod Kumar Vavilapalli | Jonathan Eagles | | | Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility | Major | mrv2 | Tom White | Tom White | | | Hadoop Counters API limits Oozie's working across different hadoop versions | Blocker | mrv2 | John George | Mahadev konar | | | bin/mapred command cannot run distcp and archive jobs | Major | mrv2 | Arpit Gupta | Arpit Gupta | | | TestDistributedShell is failing | Major | mrv2, test | Eli Collins | Hitesh Shah | | | JobHistory webapp address should use the host from the jobhistory address | Major | mrv2, webapps | Bruno Mah | Ahmed Radwan | | | Capacity scheduler queue refresh doesn't recompute queue capacities properly | Major | mrv2 | Jason Lowe | Jason Lowe | | | RM UI when loaded throws a message stating Data Tables warning and then the column sorting stops working | Major | mrv2 | Arpit Gupta | Jonathan Eagles | | | TestJobCounters is failing intermittently on trunk and 0.23. | Critical | mrv2 | Mahadev konar | Mahadev konar | | | If multiple hosts for a split belong to the same rack, the rack is added multiple times in the AM request table | Critical | mr-am, mrv2 | Siddharth Seth | Siddharth Seth | | | TestViewFsTrash incorrectly determines the user's home directory | Major | fs, test | Eli Collins | Harsh J | | | hadoop-daemon.sh and

are trying to mkdir and chow log/pid dirs which can fail | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik | | | Broken urls: AM tracking url and jobhistory url in a single node setup. | Major | mrv2 | Ahmed Radwan | Siddharth Seth | | | [Rumen] Zombie.getJobConf() results into NPE | Critical | tools/rumen | Amar Kamat | Amar Kamat | | | Namenode IPC handler count uses the wrong configuration key | Critical | namenode | Todd Lipcon | Todd Lipcon | | | JobEndNotifier doesn't use the proxyToUse during connecting | Blocker | mrv2 | Ravi Prakash | Ravi Prakash | | | Job summary log file found missing on the RM host | Critical | jobhistoryserver, mrv2 | Anupam Seth | Anupam Seth | | | Distribution tar.gz does not contain etc/hadoop/core-site.xml | Major | build | Eric Charles | Harsh J | | | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J | | | Hadoop Metrics2 should emit Float.MAX\VALUE (instead of Double.MAX\VALUE) to avoid making Ganglia's gmetad core | Major | metrics | Varun Kapoor | Varun Kapoor | | | Task attempt failure during commit results in task never completing | Critical | mrv2 | Tom White | Tom White | | | Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. | Critical | mrv2 | Eric Payne | Eric Payne | | | NPE with FilterFileSystem | Critical | fs | Amareshwari Sriramadasu | Daryn Sharp | | | Allow for 32-bit container-executor | Blocker | build, mrv2 | Arun C Murthy | Arun C Murthy | | | jobtoken location property in jobconf refers to wrong jobtoken file | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add missing TestCounters#testCounterValue test from branch 1 to 0.23 | Major | test | Tom White | Tom White | | | HDFS-2864 broke ant compilation | Major | build | Ravi Prakash | Ravi Prakash | | | Reinstate environment variable tests in TestMiniMRChildTask | Major | mrv2 | Tom White | Tom White | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Switch default checksum to CRC32C | Major | hdfs-client | Todd Lipcon | Todd Lipcon | | | Simplify BlockReader to not inherit from FSInputChecker | Major | hdfs-client, performance | Todd Lipcon | Todd Lipcon | | | ant test TestSubmitJob failing on trunk | Minor | mrv2, test | Hitesh Shah | Devaraj K | | | org.apache.hadoop.mapreduce.TestNoJobSetupCleanup failing on trunk | Minor | mrv2 | Hitesh Shah | Hitesh Shah | | | ant test TestDelegationToken failing on trunk | Minor | mrv2, test | Hitesh Shah | Hitesh Shah | | | ant test TestAuditLogger fails on trunk | Minor | mrv2, test | Hitesh Shah | Devaraj K | | | Cluster.getDelegationToken() throws NPE if client.getDelegationToken() returns null. | Blocker |

| John George | John George | | | NodeManager should fail fast with wrong configuration or permissions for LinuxContainerExecutor | Major | mrv2, security | Vinod Kumar Vavilapalli | Hitesh Shah | | | Mavenize streaming and MR examples | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Finding counters by legacy group name returns empty counters | Major | client, mrv2 | Tom White | Tom White | | | DISKS\FAILED -101 error code should be defined in same location as ABORTED\CONTAINER\EXIT\STATUS | Major | mrv2 | Hitesh Shah | Ravi Gummadi | | | Deadlock in LocalDirsHandlerService and ShuffleHandler | Blocker | mrv2, nodemanager | Ravi Gummadi | Ravi Gummadi | | | uber-jobs tried to write outputs into wrong dir | Blocker | mrv2 | Hitesh Shah | Hitesh Shah | | | Extraneous JobConf objects in AM heap | Major | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | ContainerLocalizer should request new resources after completing the current one | Blocker | mrv2, nodemanager | Siddharth Seth | Siddharth Seth | | | Optimize Job's progress calculations in MR AM | Critical | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | finish unit tests for web services for RM and NM | Critical | mrv2 | Thomas Graves | Thomas Graves | | | MR AM slows down due to repeatedly constructing ContainerLaunchContext | Critical | mr-am, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | MR AM's dispatcher is blocked by heartbeats to ResourceManager | Critical | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | TaskAttemptListener holds a global lock for all task-updates | Critical | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | write unit tests for web services for mapreduce app master and job history server | Critical | mrv2 | Thomas Graves | Thomas Graves | | | Counters occupy a good part of AM heap | Blocker | mr-am, mrv2 | Siddharth Seth | Vinod Kumar Vavilapalli | | | Thread pool for launching containers in MR AM not expanding as expected | Major | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | AMScalability test of Sleep job with 100K 1-sec maps regressed into running very slowly | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Token infrastructure for running clients which are not kerberos authenticated | Blocker | mr-am, mrv2 | Alejandro Abdelnur | Mahadev konar | | | TaskHeartbeatHandler holds a global lock for all task-updates | Major | mrv2, performance | Siddharth Seth | Siddharth Seth | | | Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON | Minor | mrv2 | Thomas Graves | Thomas Graves | | | Batch jobHistory disk flushes | Blocker | mr-am, mrv2 | Siddharth Seth | Siddharth Seth | | | CapacityScheduler should be more conservative assigning off-switch requests | Blocker | mrv2, scheduler | Arun C Murthy | Arun C Murthy | | | Client cannot talk to the history server in secure mode | Blocker | mrv2 | Siddharth Seth | Mahadev konar | | | Shuffle benchmark is nearly 1.5x slower in 0.23 | Blocker | mrv2 | Karam Singh | Vinod Kumar Vavilapalli | | | Compression benchmark run-time increased by 13% in

| Blocker | mrv2 | Vinay Kumar Thota | Vinod Kumar Vavilapalli | | | Default AM heartbeat interval should be one second | Major | mrv2, performance | Vinod Kumar Vavilapalli | Hitesh Shah | | | Remove redundant methods and a constant from FSDataset | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | AMRecovery should pick completed task form partial JobHistory files | Blocker | mrv2 | Siddharth Seth | Arun C Murthy | | | Change FSDataset to package private | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | AppMaster recovery for Medium to large jobs take long time | Blocker | mrv2 | Siddharth Seth | Robert Joseph Evans | | | Update hftp and hdfs for host-based token support | Major | hdfs-client, namenode, security | Daryn Sharp | Kihwal Lee | | | Update webhdfs and httpfs for host-based token support | Major | webhdfs | Daryn Sharp | Robert Joseph Evans | | | MR AM's ContainerAllocator is assigning the allocated containers very slowly | Blocker | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | RackResolver should maintain a cache to avoid repetitive lookups. | Major | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Tasks may take upto 3 seconds to exit after completion | Blocker | mrv2 | Siddharth Seth | Siddharth Seth | | | Data Locality suffers if the AM asks for containers using IPs instead of hostnames | Critical | mrv2 | Siddharth Seth | Siddharth Seth | | | Counters are getting calculated twice at job-finish and delaying clients. | Major | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Counters aggregation slowed down significantly after MAPREDUCE-3749 | Blocker | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Fix host-based token incompatibilities in DFSUtil | Major | namenode, security | Daryn Sharp | Kihwal Lee | | | Restarted+Recovered AM hangs in some corner cases | Critical | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | If an MR AM dies twice it looks like the process freezes | Critical | applicationmaster, mrv2 | Robert Joseph Evans | Vinod Kumar Vavilapalli | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Move Log Related components from yarn-server-nodemanager to yarn-common | Major | mrv2 | Siddharth Seth | Siddharth Seth | | | Gridmix v3 cpu emulation system tests. | Major | . | Vinay Kumar Thota | Vinay Kumar Thota | | | Memory Emulation system tests. | Major | . | Vinay Kumar Thota | Vinay Kumar Thota | | | Add WebHdfs Forrest doc | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add WebHDFS apt doc | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Change version to 0.23.1 for ant builds on the 23 branch | Major | . | Siddharth Seth | Siddharth Seth | | | Federation: update Balancer documentation | Major | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | remove references to deprecated properties in hdfs-site.xml template and hdfs-default.xml | Trivial | documentation | Joe Crobak | Joe Crobak | | | Network ACLs can prevent some clients to talk to MR ApplicationMaster