Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.0.3-alpha.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | ./mapred groups gives NoClassDefFoundError | Critical | mrv2 | Nishan Shetty | Devaraj K | | | Cleanup HDFS logs and reduce the size of logged messages | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas | | | dfs -test should work like /bin/test | Minor | tools | Allen Wittenauer | Andy Isaacson | | | Add a separate logger for block state change logs to enable turning off those logs | Major | namenode | Kihwal Lee | Kihwal Lee | | | SASL negotiation is flawed | Major | ipc | Daryn Sharp | Daryn Sharp | | | GetDelegationTokenResponseProto does not handle null token | Critical | . | Suresh Srinivas | Suresh Srinivas | | | GetDataEncryptionKeyResponseProto does not handle null response | Blocker | namenode | Suresh Srinivas | Suresh Srinivas | | | GetLinkTargetResponseProto does not handle null path | Blocker | . | Suresh Srinivas | Suresh Srinivas | | | GetBlockKeysResponseProto does not handle null response | Blocker | namenode | Suresh Srinivas | Suresh Srinivas | | | Use token request messages defined in hadoop common | Major | applicationmaster, security | Suresh Srinivas | Suresh Srinivas | | | hdfs balancer command returns exit code 1 on success instead of 0 | Major | balancer & mover | Joshua Blatt | | | | Make enabling of stale marking on read and write paths independent | Major | . | Andrew Wang | Andrew Wang | | | Kerberos SASL server cannot find kerberos key | Blocker | ipc | Daryn Sharp | Daryn Sharp | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | FsShell's Text command should be able to read avro data files | Major | fs | Harsh J | Ivan Vladimirov Ivanov | | | The Map tasks logs should have the value of input split it processed | Major | mrv1, mrv2 | Bejoy KS | Harsh J | | | Add a Web UI to the fair share scheduler | Major | resourcemanager | Sandy Ryza | Sandy Ryza | | | Add hierarchical queues to the fair scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza | | | When the client calls hsync, allows the client to update the file length in the NameNode | Major | hdfs-client, namenode | Jing Zhao | Jing Zhao | | | Support on-demand publish of metrics | Minor | metrics | Mostafa Elhemali | Mostafa Elhemali | | | During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt | Minor | namenode | Colin P. McCabe | Colin P. McCabe | | | Quorum-based protocol for reading and writing edit logs | Major | ha, namenode | Todd Lipcon | Todd Lipcon | | | Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers | Major | security | Robert Kanter | Robert Kanter | | | Allow external sorter plugin for MR | Minor |

| Mariappan Asokan | Mariappan Asokan | | | Add a YARN ApplicationClassLoader | Major | applications | Tom White | Tom White | | | Enhance CS to schedule accounting for both memory and cpu cores | Major | capacityscheduler, scheduler | Arun C Murthy | Arun C Murthy | | | Add experimental support for MR AM to schedule CPUs along-with memory | Major | . | Arun C Murthy | Arun C Murthy | | | Plugable block id generation | Major | namenode | Dmytro Molkov | Konstantin Shvachko | | | Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations | Major | . | Arun C Murthy | Mariappan Asokan | | | WebHDFS: support file concat | Major | webhdfs | Tsz Wo Nicholas Sze | Plamen Jeliazkov | | | Add concat to HttpFS and WebHDFS REST API docs | Major | webhdfs | Tsz Wo Nicholas Sze | Plamen Jeliazkov | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari | | | Add Builder for building an RPC server | Major | ipc | Brandon Li | Brandon Li | | | Plugable process tree | Major | nodemanager | Radim Kolar | Radim Kolar | | | Implement a pure c client based on webhdfs | Major | webhdfs | Zhanwei Wang | Jing Zhao | | | Tests setLevel(Level.OFF) should be Level.ERROR | Minor | test | Andy Isaacson | Andy Isaacson | | | Prettify PipelineAck#toString() for printing to a log | Minor | . | Andrew Wang | Andrew Wang | | | Print thread dump when tests fail due to timeout | Major | test | Andrey Klochkov | Andrey Klochkov | | | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao | | | When a servlet filter throws an exception in init(..), the Jetty server failed silently. | Major | . | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | | libhadoop.so: dlopen should be better at locating libsnappy.so, etc. | Minor | build | Colin P. McCabe | Colin P. McCabe | | | ExitUtil#terminate should print Exception#toString | Minor | . | Eli Collins | Eli Collins | | | NN RPC address cleanup | Minor | namenode | Eli Collins | Eli Collins | | | Change MutableQuantiles to use a shared thread for rolling over metrics | Minor | . | Andrew Wang | Andrew Wang | | | Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml | Minor | . | Jeff Lord | Jeff Lord | | | SampleQuantiles#query is O(N^2) instead of O(N) | Minor | . | Andrew Wang | Andrew Wang | | | Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests | Minor | test | Ivan A. Veselovsky | Ivan A. Veselovsky | | | TestParallelLocalRead fails with "input ByteBuffers must be direct buffers" | Major | . | Eli Collins | Colin P. McCabe | | | DFSTestUtil#waitReplication should timeout | Minor | test | Eli Collins | Eli Collins | | |

FSQueueSchedulable#updateDemand() - potential redundant aggregation | Major | scheduler | Karthik Kambatla | Karthik Kambatla | | | Log error message if security and WebHDFS are enabled but principal/keytab are not configured | Major | security, webhdfs | Stephen Chu | Stephen Chu | | | Better error message when hdfs fsck is run against a ViewFS config | Major | . | Stephen Chu | Stephen Fritz | | | Upgrade to Surefire 2.12.3 | Major | build, test | Todd Lipcon | Todd Lipcon | | | MiniDFSCluster#init should provide more info when it fails | Minor | test | Eli Collins | Todd Lipcon | | | TestBalancerWithEncryptedTransfer needs a timeout | Minor | test | Eli Collins | Eli Collins | | | Improve Web UIs when the wildcard address is used | Minor | . | Eli Collins | Senthil V Kumar | | | GenericTestUtils.waitFor should dump thread stacks on timeout | Major | . | Todd Lipcon | Todd Lipcon | | | Improvement to MultipleOutputs javadocs | Minor | documentation | Tony Burton | Tony Burton | | | Hadoop Common Maven protoc calls must not depend on external sh script | Major | build | Chris Nauroth | Chris Nauroth | | | Hadoop HDFS Maven protoc calls must not depend on external sh script | Major | build | Chris Nauroth | Chris Nauroth | | | Rename the getReplication() method in BlockCollection to getBlockReplication() | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | HA: Put a cap on the number of completed edits files retained by the NN | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers | | | DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order | Major | datanode | Eli Collins | Eli Collins | | | Add toString, other improvements for SampleQuantiles | Major | metrics | Todd Lipcon | Todd Lipcon | | | JNI-based user-group mapping modules can be too chatty on lookup failures | Major | security | Kihwal Lee | Kihwal Lee | | | Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard | Trivial | metrics | Damien Hardy | Damien Hardy | | | hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data | Major | util | Gopal V | Gopal V | | | Add Java version to startup message | Trivial |

| Eli Collins | Eli Collins | | | Cumulative code coverage calculation | Major | test | Andrey Klochkov | Andrey Klochkov | | | DatanodeID and DatanodeInfo member should be private | Minor | datanode | Eli Collins | Eli Collins | | | Two minor improvements to FSDirectory | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao | | | Remove empty constructors for INode | Trivial | namenode | Brandon Li | Brandon Li | | | Remove the packaging | Minor | build | Eli Collins | Eli Collins | | | Remove obsolete option [-rootDir] from TestDFSIO | Trivial | test | Brandon Li | Brandon Li | | | Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | RunJar to fail with user-comprehensible error message if jar missing | Minor | util | Steve Loughran | Steve Loughran | | | Counter names' memory usage can be decreased by interning | Major | jobtracker | Todd Lipcon | Miomir Boljanovic | | | Add namespace declarations in hdfs .proto files for languages other than java | Minor | . | Binglin Chang | Binglin Chang | | | Add namespace declarations in .proto files for languages other than java | Minor | ha, ipc | Binglin Chang | Binglin Chang | | | Reduce MR AM memory usage through String Interning | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | RM should point tracking URL to RM web page for app when AM fails | Blocker | resourcemanager | Jason Lowe | Jason Lowe | | | repair test org.apache.hadoop.mapreduce.security.TestUmbilicalProtocolWithJobToken | Minor | . | Ivan A. Veselovsky | | | | Change INodeFile.blocks to private | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | libhdfs implementation of hsync API | Major | libhdfs | Liang Xie | Liang Xie | | | Add START\MSG/SHUTDOWN\MSG for JournalNode | Major | journal-node | Liang Xie | Liang Xie | | | In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec | Minor | . | Sandy Ryza | Sandy Ryza | | | Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter | Minor | nodemanager | Anthony Rojas | Anthony Rojas | | | Use ERROR instead of INFO for volume failure logs | Major | . | Stephen Chu | Stephen Chu | | | Clean up fair scheduler code | Minor | scheduler | Sandy Ryza | Sandy Ryza | | | JVM metrics for history server | Minor | jobhistoryserver | Jason Lowe | Jason Lowe | | | Too many INFO messages written out during AM to RM heartbeat | Minor | applicationmaster | James Kinley | Jason Lowe | | | set Cache-Control no-cache header on all dynamic content | Minor | . | Andy Isaacson | Alejandro Abdelnur | | | Remove jquery theming support | Major | . | Todd Lipcon | Robert Joseph Evans | | | Fix warnings found by findbugs 2 | Major | . | Sandy Ryza | Sandy Ryza | | | Takes a long time to load the task list on the AM for large jobs | Major | mr-am, mrv2, webapps | Ravi Prakash | Ravi Prakash | | | Remove unnecessary locking in fair scheduler, and address findbugs excludes. | Major | . | Sandy Ryza | Sandy Ryza | | | Simplify classpath construction for mini YARN tests | Major | client | Tom White | Tom White | | | JobHistoryServer should show when it was started in WebUI About page | Minor | jobhistoryserver, mrv2 | Ravi Prakash | Ravi Prakash | | | repair test org.apache.hadoop.mapreduce.security.TestBinaryTokenFile | Major | . | Ivan A. Veselovsky | | | | Enhance unit-test coverage of class HarFileSystem | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | Move all the Exception in PathExceptions to o.a.h.fs package | Major | . | Suresh Srinivas | Suresh Srinivas | | | OfflineEditsViewer should print out the offset at which it encountered an error | Trivial | tools | Colin P. McCabe | Colin

McCabe | | | Fair scheduler should create queue for each user by default | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | Introduce HAState for BackupNode | Major | ha, namenode | Konstantin Shvachko | Konstantin Shvachko | | | Refine JNStorage log | Trivial | journal-node | Liang Xie | Liang Xie | | | Allow customized audit logging in HDFS FSNamesystem | Minor | namenode | Marcelo Vanzin | Marcelo Vanzin | | | Update documentation for ZooKeeper Failover Controller | Major | documentation | Daisuke Kobayashi | Daisuke Kobayashi | | | Introduce HADOOP\PROXY\USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao | | | Allow security unit tests to use external KDC | Major | security, test | Stephen Chu | Stephen Chu | | | Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan | | | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen | | | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza | | | Update fair scheduler web UI for hierarchical queues | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | Support createNonRecursive in ViewFileSystem | Major | viewfs | Sandy Ryza | Sandy Ryza | | | RM should be able to provide a tracking link for apps that have already been purged | Major | . | Derek Dagit | Derek Dagit | | | Add utility to check native library availability | Minor | native | Binglin Chang | Binglin Chang | | | Use security token protobuf definition from hadoop common | Major | . | Suresh Srinivas | Suresh Srinivas | | | Provide a plugin to the Yarn Web App Proxy to generate tracking links for M/R appllications given the ID | Major | . | Derek Dagit | Derek Dagit | | | Add admin command options for ApplicationMaster | Minor | applicationmaster | Jason Lowe | Haifeng Chen | | | FileSystemContractBaseTest test data for read/write isn't rigorous enough | Trivial | test | Steve Loughran | | | | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza | | | Document fsimage format details in FSImageFormat class javadoc | Major | namenode | Jing Zhao | Jing Zhao | | | Move token related request/response messages to common | Major | security | Suresh Srinivas | Suresh Srinivas | | | Use token request messages defined in hadoop common | Major | resourcemanager | Suresh Srinivas | Suresh Srinivas | | | Use token request messages defined in hadoop common | Major | namenode, security | Suresh Srinivas | Suresh Srinivas | | | Use NetUtils#getFreeSocketPort in MiniDFSCluster | Trivial | test | Andrew Purtell | Andrew Purtell | | | Change default hadoop.security.group.mapping | Minor | security | Robert Parker | Robert Parker | | | Allow configuration of IPC connect timeout | Major | ipc | Todd Lipcon | Robert Parker | | | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa | | | Empty request and responses in protocol translators can be static final members | Minor | . | Brandon Li | Brandon Li | |

FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | Fill in missing fair scheduler documentation | Major | scheduler | Sandy Ryza | Sandy Ryza | | | Warn if java.library.path is used for AM or Task | Major | mrv2 | Robert Joseph Evans | Robert Parker | | | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza | | | Use AMRMClient in DistributedShell to exemplify the approach | Major | . | Bikas Saha | Bikas Saha | | | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | Improve pipeline DN replacement failure message | Minor | hdfs-client | Harsh J | Harsh J | | | Add extra info to JH files | Major | . | Arun C Murthy | Zhijie Shen | | | Minor extensibility enhancements | Minor | . | Arun C Murthy | Arun C Murthy | | | Allow BoundedByteArrayOutputStream to be resettable | Minor | . | Arun C Murthy | Arun C Murthy | | | Documentation for pluggable shuffle and pluggable sort | Major | documentation | Alejandro Abdelnur | Alejandro Abdelnur | | | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong | | | Fix warnings found by findbugs2 | Major | . | Eli Collins | Eli Collins | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Improve FSEditLog pre-allocation | Major | . | Colin P. McCabe | Colin P. McCabe | | | Fix TestBackupNode by properly initializing edit log | Blocker | ha | Eli Collins | Junping Du | | | Edit log files are never being purged from 2NN | Critical | namenode | Todd Lipcon | Aaron T. Myers | | | Deadlock between WritableComparator and WritableComparable | Minor | io | Hiroshi Ikeda | Jing Zhao | | | Race condition in ReduceTask completion can result in Task being incorrectly failed | Major | . | Bikas Saha | Bikas Saha | | | Change UnmanagedAMLauncher to use YarnClientImpl | Major | applications | Bikas Saha | Bikas Saha | | | MiniDFSCluster:waitClusterUp can hang forever | Minor | test | Andy Isaacson | Andy Isaacson | | | Diagnostics missing from applications that have finished but failed | Major | resourcemanager | Jason Lowe | Jason Lowe | | | BASH tab completion doesn't look in PATH, assumes path to executable is specified | Minor | scripts | Sean Mackrory | Sean Mackrory | | | Multi-byte id in HdfsVolumeId | Major | hdfs-client | Andrew Wang | Andrew Wang | | | Update DeprecatedProperties apt file | Major | . | Ahmed Radwan | Ahmed Radwan | | | remove current limitations from HttpFS docs | Major | documentation | Alejandro Abdelnur | Alejandro Abdelnur | | | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li | | | HttpServer continues to start even if AuthenticationFilter fails to init | Major |

| Todd Lipcon | Todd Lipcon | | | TestCompositeService fails on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | MiniDFSCluster shutdown races with BlocksMap usage | Major | . | Eli Collins | Eli Collins | | | datanode web ui does not work over HTTPS when datanode is started in secure mode | Major | datanode, security | Alejandro Abdelnur | Alejandro Abdelnur | | | NameNodeRpcServer#join should join on both client and server RPC servers | Minor | namenode | Eli Collins | Eli Collins | | | NameNode Web UI broken if the rpc-address is set to the wildcard | Major | . | Eli Collins | Eli Collins | | | Make NN log of fs.defaultFS debug rather than info | Minor | namenode | Eli Collins | Eli Collins | | | YARN local-dirs defaults to /tmp/nm-local-dir | Minor | nodemanager | Andy Isaacson | Hemanth Yamijala | | | Hadoop examples secondarysort has a typo "secondarysrot" in the usage | Minor | . | Robert Justice | Robert Justice | | | fs -text should make sure to call inputstream.seek(0) before using input stream | Major | fs | Harsh J | Harsh J | | | Add protocol to YARN to support GetGroups | Major | resourcemanager | Alejandro Abdelnur | Bo Wang | | | rm "Only deletes non empty directory and files." | Major | documentation | Bertrand Dechoux | Jing Zhao | | | relnotes.py was deleted post mavenization | Major | . | Robert Joseph Evans | Robert Joseph Evans | | | Old trash directories are never deleted on upgrade from 1.x | Critical | . | Robert Joseph Evans | Jason Lowe | | | TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken | Minor | test | Eli Collins | Andy Isaacson | | | SSL-based image transfer does not work when Kerberos is disabled | Minor | security | Todd Lipcon | Todd Lipcon | | | Failure to renew tokens due to test-sources left in classpath | Critical | security | Jason Lowe | Jason Lowe | | | FileContext HDFS implementation can leak socket caches | Major | hdfs-client | Todd Lipcon | John George | | | Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | RM is missing ability to add include/exclude files without a restart | Major | resourcemanager | xieguiming | xieguiming | | | HDFS-3910 broke MR tests | Major | . | Arun C Murthy | Arun C Murthy | | | ViewFS configuration requires a trailing slash | Major | viewfs | Eli Collins | Sandy Ryza | | | Tests don't run with native libraries | Major | build, test | Eli Collins | Colin P. McCabe | | | Fix SEGV when libsnappy is in java.library.path but not LD\LIBRARY\PATH | Minor | native | Colin P. McCabe | Colin P. McCabe | | | Incorrect ACL properties in capacity scheduler documentation | Major | capacityscheduler | Ahmed Radwan | Ahmed Radwan | | | Move the apache licence header to the top of the file in MemStore.java | Trivial | resourcemanager | Devaraj K | Devaraj K | | | Add debug log removed in HDFS-3873 back | Minor |

| Eli Collins | Eli Collins | | | libwebhdfs (C client) code cleanups | Major | webhdfs | Colin P. McCabe | Colin P. McCabe | | | FileBasedKeyStoresFactory initialization logging should be debug not info | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | HttpFS OPEN operation expects len parameter, it should be length | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | TestHftpURLTimeouts fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit | Major | namenode | Eli Collins | Todd Lipcon | | | mr-jobhistory-daemon.sh doesn't accept --config | Major | jobhistoryserver | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Job Credentials are not transmitted if security is turned off | Major | job submission, security | Benoy Antony | Benoy Antony | | | Move RMAdmin tool to the client package | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Provide support for missing yarn commands | Major | client | Devaraj K | Devaraj K | | | TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup | Minor | . | Eli Collins | Eli Collins | | | LocalDirsHandler should validate the configured local and log dirs | Major | nodemanager | Mayank Bansal | Mayank Bansal | | | Historyserver links expire before the history data does | Critical | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe | | | TestDistCp is @ignored | Critical | test | Colin P. McCabe | Sandy Ryza | | | DistributedShell jar should point to Client as the main class by default | Major | applications/distributed-shell | Vinod Kumar Vavilapalli | Hitesh Shah | | | TestNMWebServicesApps, TestRMWebServicesApps and TestRMWebServicesNodes fail on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | AppRejectedTransition does not unregister app from master service and scheduler | Major | . | Bikas Saha | Bikas Saha | | | TestHftpDelegationToken fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | TestRBWBlockInvalidation may time out | Major | . | Eli Collins | Eli Collins | | | Bug in check for DN re-registration with different storage ID | Minor | . | Eli Collins | Jason Lowe | | | Misleading error message when resources are low on the NameNode | Minor | namenode | Colin P. McCabe | Christopher Conner | | | hadoop-metrics2.properties should give units in comment for sampling period | Minor | metrics | Sandy Ryza | Sandy Ryza | | | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta | | | CRLF characters in source and text files | Major | build | Raja Aluri | Raja Aluri | | | adding .gitattributes file to prevent CRLF and LF mismatches for source and text files | Major | build | Raja Aluri | Raja Aluri | | | Duplicate ChecksumType definition in HDFS .proto files | Major | datanode | Binglin Chang | Binglin Chang | | | paths with multiple globs are unreliable | Critical | fs | Daryn Sharp | Daryn Sharp | | |

should not throw UnresolvedLinkException | Major | namenode | Tsz Wo Nicholas Sze | Jing Zhao | | | hflush performance regression due to nagling delays | Critical | datanode, performance | Todd Lipcon | Todd Lipcon | | | Add timeouts to TestMulitipleNNDataBlockScanner | Major | test | Eli Collins | | | | Anonymous fallback in KerberosAuthenticator is broken | Major | . | Robert Kanter | Robert Kanter | | | mapreduce.user.classpath.first incompatibility with 0.20/1.x | Major | mrv2 | Jason Lowe | Ravi Prakash | | | TestBalancer and TestUnderReplicatedBlocks need timeouts | Major | . | Eli Collins | Eli Collins | | | Yarn Common has multiple compiler warnings for unchecked operations | Major | api | Chris Nauroth | Chris Nauroth | | | OfflineImageViewer incorrectly passes value of imageVersion when visiting IS\_COMPRESSED element | Trivial | namenode | Mithun Radhakrishnan | Mithun Radhakrishnan | | | TestResourceTrackerService fail intermittently on jdk7 | Major | . | Thomas Graves | Thomas Graves | | | TestAuditLogs is flaky | Major | . | Binglin Chang | Binglin Chang | | | Task startup time in JHS is same as job startup time. | Major | jobhistoryserver | Ravi Prakash | Ravi Prakash | | | TestApplicationTokens fails intermintently on jdk7 | Major | . | Thomas Graves | Vinod Kumar Vavilapalli | | | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao | | | Retrieving container log via NM webapp can hang with multibyte characters in log | Major | nodemanager | Jason Lowe | Jason Lowe | | | Fix parameter order in assertEquals() in TestCombineInputFileFormat.java | Major | test | Mariappan Asokan | Mariappan Asokan | | | Reducer can fail to make progress during shuffle if too many reducers complete consecutively | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe | | | Make ClientTokenSecretManager part of RMContext | Major | resourcemanager | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | TestFileUtil.testGetDU fails on Windows due to incorrect assumption of line separator | Major | test | Chris Nauroth | Chris Nauroth | | | Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler. | Major | capacityscheduler | Ahmed Radwan | Ahmed Radwan | | | Replication not happening for appended block | Blocker | . | suja s | Vinayakumar B | | | Clean up replication code and add more javadoc | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | only .jars can be added to the Distributed Cache classpath | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size | Major | . | Slavik Krassovsky | Andy Isaacson | | | getFileChecksum() result incompatible when called against zero-byte files. | Critical | hdfs-client | Kihwal Lee | Kihwal Lee | | | RawLocalFileSystem.listStatus fails when a child filename contains a colon | Critical | fs | Jason Lowe | Jason Lowe | | | Compile hadoop native library in FreeBSD | Critical | native | Radim Kolar | Radim Kolar | | | GZip and Snappy support may not work without unversioned libraries | Minor | native | Colin P. McCabe | Colin

McCabe | | | Killing an unassigned task attempt causes the job to fail | Major | mrv2 | Tom White | Mayank Bansal | | | Bunch of test failures on trunk | Blocker | capacityscheduler | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | capacity-scheduler.xml move breaks Eclipse import | Critical | resourcemanager | Siddharth Seth | Siddharth Seth | | | CapacityScheduler - adding a queue while the RM is running has wacky results | Critical | capacityscheduler | Thomas Graves | Arun C Murthy | | | Fix custom ProcessTree instance creation | Critical | . | Radim Kolar | Radim Kolar | | | Capacity scheduler - containers that get reserved create container token to early | Critical | capacityscheduler | Thomas Graves | Arun C Murthy | | | Interrupted Exception within AsyncDispatcher leads to user confusion | Major | api | Nathan Roberts | Vinod Kumar Vavilapalli | | | WARN and ERROR messages logged during normal AM shutdown | Minor | applicationmaster, mrv2 | Jason Lowe | Vinod Kumar Vavilapalli | | | AM crashes due to OOM while serving up map task completion events | Blocker | applicationmaster, mrv2 | Jason Lowe | Jason Lowe | | | Add utility methods to cast INode to INodeFile and INodeFileUnderConstruction | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | TestWebHDFS#testNamenodeRestart occasionally fails | Minor | test | Eli Collins | Jing Zhao | | | A few improvements on INodeDirectory | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown | Major | datanode | Uma Maheswara Rao G | Jing Zhao | | | TestRPCCompatibility fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | Invalid event: T\ATTEMPT\SUCCEEDED at SUCCEEDED | Blocker | mrv2 | Robert Joseph Evans | Jason Lowe | | | BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile | Minor | namenode, test | Jing Zhao | Jing Zhao | | | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov | | | Log message is not correct in case of short of replica | Minor | namenode | Junping Du | Junping Du | | | TestDFSShell creates file named "noFileHere", making further tests hard to understand | Minor | test | Andy Isaacson | Andy Isaacson | | | Server$Call object is never released after it is sent | Critical | ipc | Robert Joseph Evans | Robert Joseph Evans | | | RM web ui applications page should be sorted to display last app first | Major | resourcemanager | Thomas Graves | Thomas Graves | | | capacity scheduler doesn't allow capacity \<

| Major | capacityscheduler | Thomas Graves | Thomas Graves | | | job history web ui applications page should be sorted to display last app first | Major | jobhistoryserver | Thomas Graves | Thomas Graves | | | deadlock in RM - AMResponse object | Blocker | resourcemanager | Thomas Graves | Thomas Graves | | | The MR Application Master does not have a config to set environment variables | Major | applicationmaster | Robert Parker | Robert Parker | | | job history UI not showing all job attempts | Major | jobhistoryserver | Thomas Graves | Vinod Kumar Vavilapalli | | | TestHftpFileSystem fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson | | | when libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory | Major | libhdfs | Colin P. McCabe | Colin P. McCabe | | | KeyFieldBasedPartitioner not partitioning properly when configured | Major | mrv2 | Jason Lowe | Jason Lowe | | | ChecksumTypeProto use NULL as enum value which is illegal in C/C++ | Minor | datanode, namenode | Binglin Chang | Binglin Chang | | | Reduce recommissioning overhead | Critical | namenode | Kihwal Lee | Kihwal Lee | | | Fix hsync semantics | Major | datanode | Lars Hofhansl | Lars Hofhansl | | | CapacityScheduler can take a very long time to schedule containers if requests are off cluster | Critical | capacityscheduler | Jason Lowe | Jason Lowe | | | ViewFs tests fail when tests and home dirs are nested | Major | fs, test | Andrey Klochkov | Sanjay Radia | | | Fetch failures can take way too long for a map to be restarted | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans | | | NN's health report has severe performance problems | Critical | namenode | Daryn Sharp | Daryn Sharp | | | NLineInputFormat skips first line of last InputSplit | Blocker | client | Mark Fuhs | Mark Fuhs | | | Some malformed and unquoted HTML strings are returned from datanode web ui | Minor | datanode | Derek Dagit | Derek Dagit | | | Add a cache for getpwuid\r and getpwgid\r calls | Major | . | Arun C Murthy | Alejandro Abdelnur | | | JobImpl does not handle asynchronous task events in FAILED state | Major | applicationmaster, mrv2 | Ivan A. Veselovsky | Jason Lowe | | | TestApplicationCleanup.testContainerCleanup occasionally fails | Major | resourcemanager | Jason Lowe | Jason Lowe | | | AM stuck in KILL\_WAIT for days | Major | . | Ravi Prakash | Vinod Kumar Vavilapalli | | | TestJobMonitorAndPrint is broken | Major | test | Ravi Prakash | Robert Parker | | | namenode does not URI-encode parameters when building URI for datanode request | Minor | namenode | Derek Dagit | Derek Dagit | | | Speculation + Fetch failures can lead to a hung job | Critical | mrv2 | Siddharth Seth | Jason Lowe | | | Job End Notification retry interval is 5 milliseconds by default | Major | mrv2 | Ravi Prakash | Ravi Prakash | | | fuse\_dfs: add -lrt to the compiler command line on Linux | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe | | | Hadoop distcp tool fails to copy file if -m 0 specified | Major | . | Haiyang Jiang | Jonathan Eagles | | | Document umask in DistributedFileSystem#mkdirs javadocs | Major | . | Ravi Gummadi | Colin P. McCabe | | | NN will prematurely consider blocks missing when entering active state while still in safe mode | Major | . | Stephen Chu | Aaron T. Myers | | | org.apache.hadoop.tools.TestCopyListing failing | Major |

| Robert Joseph Evans | Jonathan Eagles | | | LeaseManager tries to double remove and prints extra messages | Critical | namenode | Kihwal Lee | Kihwal Lee | | | NM state machine ignores an APPLICATION\CONTAINER\FINISHED event when it shouldn't | Blocker | nodemanager | Nathan Roberts | Nathan Roberts | | | fuse-dfs RO mode still allows file truncation | Major | fuse-dfs | Andy Isaacson | Colin P. McCabe | | | SecondaryNameNode leaks NameCache entries | Critical | namenode | Todd Lipcon | Robert Joseph Evans | | | LocalContainerAllocator can loop forever trying to contact the RM | Major | applicationmaster | Jason Lowe | Jason Lowe | | | Browser thinks History Server main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash | | | dfs -test -d prints inappropriate error on nonexistent directory | Minor | . | Andy Isaacson | Andy Isaacson | | | Add different variants of non caching HTTP headers | Minor | io | Steve Loughran | Alejandro Abdelnur | | | logSync() is called with the write lock held while releasing lease | Critical | namenode | Kihwal Lee | Kihwal Lee | | | ShuffleHandler can generate large logs due to prematurely closed channels | Critical | . | Jason Lowe | Jason Lowe | | | RMContainerImpl does not handle event EXPIRE at state RUNNING | Major | resourcemanager | Jason Lowe | Jonathan Eagles | | | Browser thinks RM main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash | | | DFS#isInSafeMode needs to execute only on Active NameNode | Critical | ha | Vinayakumar B | Vinayakumar B | | | the SPNEGO user for secondary namenode should use the web keytab | Major | . | Arpit Gupta | Arpit Gupta | | | Seeking to a negative position should throw an IOE | Major | . | Eli Collins | Eli Reisman | | | WebHDFS and HttpFs should accept only valid Unix user names | Major | . | Harsh J | Alejandro Abdelnur | | | shell scripts should not close stderr | Major | scripts | Andy Isaacson | Andy Isaacson | | | BackupNode: allow reads, fix checkpointing, safeMode | Major | namenode | Konstantin Shvachko | Konstantin Shvachko | | | Hadoop-Common-0.23-Build Fails to build in Jenkins | Major | . | Robert Parker | Robert Parker | | | DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. | Major | security | Karthik Kambatla | Karthik Kambatla | | | Adding symlink should not ignore QuotaExceededException | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Augment DelegationTokenRenewer API to cancel the tokens on calls to removeRenewAction | Major | security | Karthik Kambatla | Karthik Kambatla | | | Fair scheduler logs too many nodeUpdate INFO messages | Major | . | Sandy Ryza | Sandy Ryza | | | Fair scheduler event log is only written if directory exists on HDFS | Major | jobtracker, scheduler | Sandy Ryza | Sandy Ryza | | | JobImpl.finished doesn't expect ERROR as a final job state | Major | mr-am | Jason Lowe | Jason Lowe | | | Hardcoded task ping timeout kills tasks localizing large amounts of data | Critical | applicationmaster, mr-am | Jason Lowe | Thomas Graves | | |

is incorrectly used in LeaseManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Proxy URI generation fails for blank tracking URIs | Major | resourcemanager | Tom White | Tom White | | | Elapsed time for running tasks on AM web UI tasks page is 0 | Major | . | Ravi Prakash | Ravi Prakash | | | NM should handle cleaning up containers when it shuts down | Major | nodemanager | Hitesh Shah | Sandy Ryza | | | Creating file with invalid path can corrupt edit log | Blocker | namenode | Todd Lipcon | Todd Lipcon | | | UTF8 class does not properly decode Unicode characters outside the basic multilingual plane | Major | io | yixiaohua | Todd Lipcon | | | [HA] Standby namenode should not do purging of shared storage edits. | Major | ha | Vinayakumar B | Todd Lipcon | | | Remove redundant enum NNHAStatusHeartbeat.State | Major | namenode | Konstantin Shvachko | Konstantin Shvachko | | | RM web page UI shows Invalid Date for start and finish times | Major | resourcemanager | Ravi Prakash | Ravi Prakash | | | TestEditLog.testFuzzSequences FAILED in all pre-commit test | Major | namenode, test | Junping Du | Todd Lipcon | | | Regression: HDFS-4171 puts artificial limit on username length | Blocker | . | Allen Wittenauer | Alejandro Abdelnur | | | NameNode does not initialize generic conf keys when started with -recover | Minor | namenode | Colin P. McCabe | Colin P. McCabe | | | edit log unit tests leave stray test\edit\log\_file around | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Sanity check not correct in RemoteBlockReader2.newBlockReader | Minor | . | Binglin Chang | Binglin Chang | | | exception while doing RPC I/O closes channel | Critical | . | sam rash | sam rash | | | Using port 1023 should be valid when starting Secure DataNode | Major | security | Stephen Chu | Stephen Chu | | | Backwards compatibility is not maintained for TestVolumeId | Major | . | Robert Parker | Robert Parker | | | NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | RM and JHS Web UIs are blank because AppsBlock is not escaping string properly | Critical | resourcemanager | Ravi Prakash | Ravi Prakash | | | Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal | Major | . | Karthik Kambatla | Karthik Kambatla | | | o.a.h.fs.TestDelegationTokenRenewer is failing intermittently | Major | security, test | Karthik Kambatla | Karthik Kambatla | | | TestJobOutputCommitter uses same directory as TestJobCleanup | Major | test | Sandy Ryza | Sandy Ryza | | | Fix fair scheduler web UI | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback | Trivial | security | Colin P. McCabe | Colin P. McCabe | | | SocketCache should use monotonic time | Minor | . | Colin P. McCabe | Colin P. McCabe | | | y.s.rm.DelegationTokenRenewer attempts to renew token even after removing an app | Major |

| Karthik Kambatla | Karthik Kambatla | | | BlockPoolSliceScanner does not close verification log during shutdown | Minor | datanode | Chris Nauroth | Chris Nauroth | | | FileSystem initialization can go into infinite loop | Critical | fs | Radim Kolar | Radim Kolar | | | DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access | Major | datanode | Aaron T. Myers | Aaron T. Myers | | | TestMetricsSystemImpl fails on Windows | Major | metrics | Chris Nauroth | Xuan Gong | | | fuse-dfs handles open(O\_TRUNC) poorly | Major | fuse-dfs | Andy Isaacson | Colin P. McCabe | | | NN fails to write a fsimage with stale leases | Blocker | namenode | Daryn Sharp | Daryn Sharp | | | HDFS can report negative DFS Used on clusters with very small amounts of data | Minor | fs | Brock Noland | Brock Noland | | | Change processTree interface to work better with native code | Critical | . | Radim Kolar | Radim Kolar | | | Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators | Major | . | Dennis Y | Dennis Y | | | FsShell -moveFromLocal erroneously fails | Major | fs | Daryn Sharp | Daryn Sharp | | | Fair scheduler hits IllegalStateException trying to reserve different apps on same node | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | Fair scheduler log messages try to print objects without overridden toString methods | Major | scheduler | Sandy Ryza | Sandy Ryza | | | Fair scheduler maxRunningApps config causes no apps to make progress | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | Fair scheduler web UI double counts Apps Submitted | Major | . | Sandy Ryza | Sandy Ryza | | | Fair scheduler fails to get queue info without root prefix | Major | scheduler | Sandy Ryza | Sandy Ryza | | | Shuffle race can hang reducer | Blocker | mrv2 | Jason Lowe | Mariappan Asokan | | | Task can get stuck in FAIL\CONTAINER\CLEANUP | Critical | applicationmaster, mrv2 | Robert Joseph Evans | Robert Parker | | | Invalid TaskImpl state transitions when task fails while speculating | Critical | mr-am | Jason Lowe | Jason Lowe | | | Fix typo "receievd" should be "received" in log output | Trivial | . | Albert Chu | Albert Chu | | | Proxy Link in RM UI thows NPE in Secure mode | Critical | resourcemanager | Devaraj K | Devaraj K | | | AM timing out during job commit | Critical | applicationmaster | Jason Lowe | Jason Lowe | | | addBlock() should persist file blocks once | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov | | | TestBackupNode can go into infinite loop "Waiting checkpoint to complete." | Major | namenode, test | Konstantin Shvachko | Plamen Jeliazkov | | | streaming tests fail to start MiniMRCluster due to "Queue configuration missing child queue names for root" | Major | contrib/streaming, test | Chris Nauroth | Chris Nauroth | | | Node Manager leaks LocalizerRunner object for every Container | Critical | nodemanager | Devaraj K | Robert Joseph Evans | | | Fair scheduler queue doesn't accept any jobs when ACLs are

| Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | After YARN-271, fair scheduler can infinite loop and not schedule any application. | Major | resourcemanager, scheduler | Hong Shen | Sandy Ryza | | | Fair scheduler throws ConcurrentModificationException when iterating over app's priorities | Major | resourcemanager, scheduler | Hong Shen | Hong Shen | | | getClusterStatus() fails with null pointer exception when running jobs in local mode | Major | jobtracker | Rahul Jain | Devaraj K | | | Precondition in EditLogFileInputStream's length() method is checked too early in NameNode startup, causing fatal exception | Major | ha, namenode | Eugene Koontz | Eugene Koontz | | | Replications of the highest priority should be allowed to choose a source datanode that has reached its max replication limit | Minor | namenode | Derek Dagit | Derek Dagit | | | SortedRanges.Range#compareTo is not spec compliant | Major | task | Luke Lu | Yu Gao | | | MR AM can get in a split brain situation | Critical | applicationmaster | Robert Joseph Evans | Jason Lowe | | | Add security token protobuf definition to common and use it in hdfs | Major | . | Suresh Srinivas | Suresh Srinivas | | | Renewal / cancellation of JobHistory tokens | Blocker | jobhistoryserver, mrv2 | Siddharth Seth | Siddharth Seth | | | AM can rerun job after reporting final job status to the client | Blocker | mr-am | Jason Lowe | Bikas Saha | | | TestMRAppMaster#testMRAppMasterMissingStaging occasionally exits | Major | mr-am | Jason Lowe | Jason Lowe | | | Fix BlockPlacementPolicyDefault#chooseTarget when avoiding stale nodes | Major | namenode | Andrew Wang | Andrew Wang | | | yarn rmadmin commands fail in secure cluster | Blocker | resourcemanager | Devaraj K | Devaraj K | | | Use security token protobuf definition from hadoop common | Major | . | Vinod Kumar Vavilapalli | Suresh Srinivas | | | NodeManager stop() gets called twice on shutdown | Major | nodemanager | Sandy Ryza | Sandy Ryza | | | Set daemon flag for HttpServer's QueuedThreadPool | Major | . | Liang Xie | Liang Xie | | | BlockPoolSliceStorage#doRollback(..) should use BlockPoolSliceStorage instead of DataStorage to read prev version file. | Major | datanode | Vinayakumar B | Vinayakumar B | | | Container launch may fail if no files were localized | Critical | nodemanager | Tom White | Tom White | | | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza | | | Hftp proxy tokens are broken | Blocker | . | Daryn Sharp | Daryn Sharp | | | User supplied dependencies may conflict with MapReduce system JARs | Major | task | Tom White | Tom White | | | RM should always be able to renew its own tokens | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | | | RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing | Blocker | capacityscheduler | Jason Lowe | Arun C Murthy | | | Combine PBHelper and HdfsProtoUtil and remove redundant methods | Major | . | Suresh Srinivas | Suresh Srinivas | | | PBHelper.convertLocatedBlock miss convert BlockToken | Major |

| Binglin Chang | Binglin Chang | | | TaskAttemptContext cast error during AM recovery | Major | mr-am | Jason Lowe | Haifeng Chen | | | FsPermission should have different default value, 777 for directory and 666 for file | Minor | . | Binglin Chang | Binglin Chang | | | Potential deadlock in ActiveStandbyElector | Major | ha | Tom White | Tom White | | | Some trivial DN comment cleanup | Trivial | . | Eli Collins | Eli Collins | | | test\libhdfs\threaded gets SEGV if JNIEnv cannot be initialized | Minor | libhdfs | Colin P. McCabe | Colin P. McCabe | | | Maven RAT plugin is not checking all source files | Critical | build | Tom White | Thomas Graves | | | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves | | | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves | | | Maven RAT plugin is not checking all source files | Critical | . | Thomas Graves | Thomas Graves | | | DataNode reads checksums even if client does not need them | Major | datanode, performance | Todd Lipcon | Todd Lipcon | | | Flakey test: TestNodeManagerShutdown#testKillContainersOnShutdown | Major | nodemanager | Hitesh Shah | Sandy Ryza | | | RPCCallBenchmark should find a random available port | Trivial | ipc, test | Andrew Purtell | Andrew Purtell | | | src/main/conf is missing hadoop-policy.xml | Minor | . | Sandy Ryza | Sandy Ryza | | | Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException | Minor | examples | Chris McConnell | Chris McConnell | | | The pentomino option parser may be buggy | Major | examples | Karthik Kambatla | Karthik Kambatla | | | JobImpl uber checks for cpu are wrong | Critical | mrv2 | Daryn Sharp | Arun C Murthy | | | JobClient should acquire HS token with RM principal | Blocker | client | Daryn Sharp | Daryn Sharp | | | Fair scheduler FIFO scheduling within a queue only allows 1 app at a time | Major | scheduler | Sandy Ryza | Sandy Ryza | | | HTTP Error 413 full HEAD if using kerberos authentication | Major | net | Moritz Moeller | Moritz Moeller | | | flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR | Trivial | mrv1 | Robert Kanter | Robert Kanter | | | Potential deadlock in FileSystem.Cache/IPC/UGI | Major | fs | Tom White | Tom White | | | hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script | Minor | scripts | Jason Lowe | Andy Isaacson | | | when using cmake-2.6, libhadoop.so doesn't get created (only libhadoop.so.1.0.0) | Blocker | . | Thomas Graves | Colin P. McCabe | | | HostnameFilter should handle hostname resolution failures and continue processing | Major | . | Robert Kanter | Robert Kanter | | | Add toString method to TaggedInputSplit | Minor | mrv1, mrv2, task | Sandy Ryza | Sandy Ryza | | | Fair scheduler assignmultiple should default to false | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza | | | remove an unnecessary synchronized keyword in BPOfferService.java | Major | datanode | Liang Xie | Liang Xie | | |

failed on trunk | Critical | client | Junping Du | Junping Du | | | DFSClient can infer checksum type when not provided by reading first byte | Minor | hdfs-client | Todd Lipcon | Todd Lipcon | | | Type conversion of map completion events leads to performance problems with large jobs | Critical | mr-am | Jason Lowe | Jason Lowe | | | Parametrize staging URL for the uniformity of distributionManagement | Major | build | Konstantin Boudnik | Konstantin Boudnik | | | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal | | | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie | | | Remove trailing '\`' character from HDFS nodelist jsp | Trivial | namenode | Christian Rohling | Christian Rohling | | | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu | | | relnotes.py missing last jira | Critical | scripts | Thomas Graves | Thomas Graves | | | update web services docs for RM clusterMetrics | Major | resourcemanager | Thomas Graves | Ravi Prakash | | | packaging docs is broken | Major | documentation | Thomas Graves | Andy Isaacson | | | Job status exceeds 100% in some cases | Major | jobtracker | Adam Kramer | Devaraj K | | | NN accepts incremental BR as IBR in safemode | Critical | namenode | Daryn Sharp | Daryn Sharp | | | Convert remaining xdocs to APT | Major | . | Andy Isaacson | Andy Isaacson | | | Capacity Scheduler maximum-capacity value -1 is invalid | Major | capacityscheduler | Thomas Graves | Xuan Gong | | | MR AppMaster can do sub-optimal assignment of containers to map tasks leading to poor node locality | Major | applicationmaster | Bikas Saha | Bikas Saha | | | FsDatasetImpl should disclose what the error is when a rename fails | Minor | . | Colin P. McCabe | Colin P. McCabe | | | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal | | | Fix UGI for IBM JDK running on Windows | Major | security | Luke Lu | Yu Gao | | | AggregatedLogDeletionService can take too long to delete logs | Major | . | Jason Lowe | Jason Lowe | | | getAdditionalBlock() can create multiple blocks if the client times out and retries. | Critical | namenode | Konstantin Shvachko | Konstantin Shvachko | | | 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | StringUtils.humanReadableInt(..) has a race condition | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Allow apps to concurrently register tokens for renewal | Critical | . | Daryn Sharp | Daryn Sharp | | | Create file failure when the machine of first attempted NameNode is down | Critical | ha, hdfs-client | liaowenrui | Todd Lipcon | | | dfshealth.jsp throws NumberFormatException when

includes port number | Major | namenode | tamtam180 | Andy Isaacson | | | HadoopPipes misuses fprintf | Major | pipes | Andy Isaacson | Andy Isaacson | | | Hadoop version may be not correct when starting name node or data node | Critical | . | Haifeng Chen | Chris Nauroth | | | HarFileSystem may leak file handle | Major | fs | Chris Nauroth | Chris Nauroth | | | Fix TestHDFSCLI and TestQuota for HADOOP-9252 | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | App submission should not be synchronized | Major | resourcemanager | Daryn Sharp | Daryn Sharp | | | RM app submission jams under load | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | | | FsShell rm -f fails for non-matching globs | Blocker | fs | Daryn Sharp | Daryn Sharp | | | start balancer failed with "Failed to create file [/system/balancer.id]" if configure IP on fs.defaultFS | Major | balancer & mover | Wenwu Peng | Binglin Chang | | | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani | | | FileUtil uses wrong stat command for FreeBSD | Major | fs | Vitalii Tymchyshyn | | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/ | Minor | test | Colin P. McCabe | Colin P. McCabe | | | Add unit tests for computing fair share in the fair scheduler | Major | resourcemanager | Sandy Ryza | Sandy Ryza | | | Add a test for umask in FileSystemContractBaseTest | Minor | . | Colin P. McCabe | Colin P. McCabe | | | provide unit-test coverage of class org.apache.hadoop.fs.LocalDirAllocator.AllocatorPerContext.PathIterator | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | Provide test for HdfsVolumeId | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | Test reading files from BackupNode | Major | namenode, test | Konstantin Shvachko | Konstantin Shvachko | | | Add test to FileSystemContractBaseTest to verify integrity of overwritten files | Minor | fs, test | Steve Loughran | Steve Loughran | | | Print thread dumps when hadoop-common tests fail | Major | test | Andrey Klochkov | Andrey Klochkov | | | Duplicate copies of TestIndexCache.java | Minor | test | Mariappan Asokan | Mariappan Asokan | | | provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long) | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | | test org.apache.hadoop.mapred.pipes | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Add apache license header for StorageReport.java | Minor | . | Suresh Srinivas | Brandon Li | | | Supply NamespaceInfo when instantiating JournalManagers | Minor | namenode | Todd Lipcon | Todd Lipcon | | | Genericize format() to non-file JournalManagers | Major | ha, namenode | Todd Lipcon | Todd Lipcon | | | JournalManager#format() should be able to throw IOException | Major | ha, namenode | Ivan Kelly | Ivan Kelly | | | Improve RPC.Server's digest auth | Major | ipc, security | Daryn Sharp | Daryn Sharp | | | ClientToAMSecretManager creates keys without checking for validity of the appID | Major |

| Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Improve IPC.Client's token use | Major | ipc, security | Daryn Sharp | Daryn Sharp | | | Add number of stale DataNodes to metrics | Minor | datanode, namenode | Jing Zhao | Jing Zhao | | | Detecting and avoiding stale datanodes for writing | Major | . | Jing Zhao | Jing Zhao | | | GenerationStamp should use an AtomicLong | Major | namenode | Eli Collins | Eli Collins | | | libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors | Major | . | Jing Zhao | Jing Zhao | | | Make BKJM use protobufs for all serialization with ZK | Major | namenode | Ivan Kelly | Ivan Kelly | | | libwebhdfs testing code cleanup | Major | . | Jing Zhao | Jing Zhao | | | Map UGI authenticationMethod to RPC authMethod | Major | fs, security | Daryn Sharp | Daryn Sharp | | | Add SecurityUtil methods to get/set authentication method | Major | fs, security | Daryn Sharp | Daryn Sharp | | | IPC Client sends wrong connection context | Major | ipc | Daryn Sharp | Daryn Sharp | | | Log Aggregation generates a storm of fsync() for namenode | Critical | . | Kihwal Lee | Kihwal Lee | | | UGI should not hardcode loginUser's authenticationType | Major | fs, security | Daryn Sharp | Daryn Sharp | | | Standardize creation of SaslRpcClients | Major | ipc | Daryn Sharp | Daryn Sharp | | | Standardize creation of SaslRpcServers | Major | ipc | Daryn Sharp | Daryn Sharp | | | Coverage fixing LinuxContainerExecutor | Major | resourcemanager, scheduler | Aleksey Gorshkov | Aleksey Gorshkov | | | Implement format() for BKJM | Major | . | Ivan Kelly | Ivan Kelly | | | Add a SASL PLAIN server | Major | ipc, security | Daryn Sharp | Daryn Sharp | | | Enforce configured SASL method on the server | Major | ipc, security | Daryn Sharp | Daryn Sharp | | | Override toString() for BookKeeperEditLogInputStream | Minor | ha | Vinayakumar B | Vinayakumar B | | | Coverage fixing for CapacityScheduler | Major | capacityscheduler | Aleksey Gorshkov | Aleksey Gorshkov | | | BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Generalize setup of LoginContext | Major | security | Daryn Sharp | Daryn Sharp | | | QJM: Add JournalNode to the start / stop scripts | Major | . | Eli Collins | Andy Isaacson | | | NM should aggregate logs when application finishes. | Critical | nodemanager | Robert Joseph Evans | Robert Joseph Evans | | | test coverage for org.apache.hadoop.tools | Major | applications | Aleksey Gorshkov | Aleksey Gorshkov | | | Change visibility of classes for pluggable sort changes | Major | . | Arun C Murthy | Mariappan Asokan | | | Remove old code for restart | Major | resourcemanager | Bikas Saha | Bikas Saha | | | Allow MapOutputBuffer to be pluggable | Major |

| Arun C Murthy | Mariappan Asokan | | | saveNamespace should be tolerant of dangling lease | Blocker | namenode | Daryn Sharp | Daryn Sharp | | | Renames may remove file leases | Blocker | namenode | Daryn Sharp | Daryn Sharp | | | Allow EditLogFileInputStream to read from a remote URL | Major | ha, namenode | Todd Lipcon | Todd Lipcon | | | BKJM: The reading for editlog at NN starting using bkjm is not efficient | Major | ha, performance | Han Xiao | Han Xiao | | | plugin for generic shuffle service | Major | performance, task, tasktracker | Avner BenHanoch | Avner BenHanoch | | | Add support for CPU isolation/monitoring of containers | Major | . | Arun C Murthy | Andrew Ferguson | | | Make changes for RM restart phase 1 | Major | resourcemanager | Bikas Saha | Bikas Saha | | | RM does not reject app submission with invalid tokens | Major | resourcemanager | Daryn Sharp | Daryn Sharp | | | Add a yarn AM - RM client module | Major | . | Bikas Saha | Bikas Saha | | | Implement renewal / cancellation of Delegation Tokens | Blocker | . | Siddharth Seth | Siddharth Seth | | | Fix all findbug security warings | Major | datanode, journal-node, security | Liang Xie | Liang Xie | | | BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs | Major | namenode | Eli Collins | Eli Collins | | | Update findbugsExcludeFile.xml to include findbugs 2 exclusions | Major | namenode | Eli Collins | Eli Collins | | | Miscellaneous findbugs 2 fixes | Major | . | Eli Collins | Eli Collins | | | Remove redundant null checks | Major | . | Eli Collins | Eli Collins | | | LightWeightGSet and LightWeightHashSet increment a volatile without synchronization | Major | . | Eli Collins | Eli Collins | | | Specify the charset explicitly rather than rely on the default | Major | . | Eli Collins | Eli Collins | | | ClientTokens should be per app-attempt and be unregistered on App-finish. | Major | resourcemanager | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | | | Add FS-based persistent store implementation for RMStateStore | Major | resourcemanager | Bikas Saha | Bikas Saha | | | All BKJM ledgers are not checked while tailing, So failover will fail. | Blocker | . | Vinayakumar B | Vinayakumar B | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Httpfs resolveAuthority() is not resolving host correctly | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | Split StateMachine state from states seen by MRClientProtocol (for Job, Task, TaskAttempt) | Major | applicationmaster, mrv2 | Siddharth Seth | Siddharth Seth | | | remove Ant remnants from MR | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Split MapReduce and YARN sections in documentation navigation | Major | documentation | Tom White | Tom White | | | Convert Forrest docs to APT, incremental | Major | documentation | Eli Collins | Andy Isaacson | | | bump up Tomcat version for HttpFS to 6.0.36 | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | Move InlineDispatcher from hadoop-yarn-server-resourcemanager to hadoop-yarn-common | Minor | . | Siddharth Seth | Siddharth Seth |