Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.2.0.0-alpha.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | DFS Scalability: Incremental block reports | Major | datanode, namenode | dhruba borthakur | Tomasz Nykiel | | | Change RPC to allow multiple protocols including multiple versions of the same protocol | Major | ipc | Sanjay Radia | Sanjay Radia | | | Unbundle jsvc | Major | build, scripts | Roman Shaposhnik | Mingjie Lai | | | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin P. McCabe | | | DNS#getIPs shouldn't silently return the local host IP for bogus interface names | Major | conf | Eli Collins | Eli Collins | | | ProtoBuf RPC engine does not need it own reply packet - it can use the IPC layer reply packet. | Major | ipc | Sanjay Radia | Sanjay Radia | | | cap space usage of default log4j rolling policy | Major | conf | Patrick Hunt | Patrick Hunt | | | Bump LAST\UPGRADABLE\LAYOUT\_VERSION to -16 | Major | namenode | Eli Collins | Eli Collins | | | Move DatanodeInfo#ipcPort to DatanodeID | Major | . | Eli Collins | Eli Collins | | | Move DatanodeInfo#hostName to DatanodeID | Major | datanode | Eli Collins | Eli Collins | | | Refactor DatanodeID#getName by use | Major | datanode | Eli Collins | Eli Collins | | | hadoop-daemon.sh stop action should return 0 for an already stopped service | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik | | | HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | When the threshold value for balancer is 0(zero) ,unexpected output is displayed | Major | balancer & mover | J.Andreina | Ashish Singhi | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Allow access to BlockKey/DelegationKey encoded key for RPC over protobuf | Major | ipc | Suresh Srinivas | Suresh Srinivas | | | The number of failed or low-resource volumes the NN can tolerate should be configurable | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | Common side of High Availability Framework (HDFS-1623) | Major | . | Aaron T. Myers | | | | High Availability Framework for HDFS NN | Major | . | Sanjay Radia | | | | HA: Autopopulate standby name dirs if they're empty | Major | ha | Aaron T. Myers | Todd Lipcon | | | Active Directory Group Mapping Service | Major | security | Jonathan Natkins | Jonathan Natkins | | | Support binding to sub-interfaces | Major | util | Harsh J | Harsh J | | | Add TableMapping topology implementation to read host to rack mapping from a file | Major | . | Patrick Angeles | Tom White | | | Add an administrative command to download a copy of the fsimage from the NN | Major | hdfs-client, namenode | Aaron T. Myers | Aaron

Myers | | | Common portion of ZK-based failover controller | Major | ha | Todd Lipcon | Todd Lipcon | | | CLI-based driver for MiniDFSCluster | Minor | test | Henry Robinson | Henry Robinson | | | The client should be able to use multiple local interfaces for data transfer | Major | hdfs-client, performance | Eli Collins | Eli Collins | | | Add a public API for setting quotas | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers | | | Add CLI tool to initialize the shared-edits dir | Major | ha, namenode | Todd Lipcon | Aaron T. Myers | | | Implement Recovery Mode | Major | tools | Colin P. McCabe | Colin P. McCabe | | | Allow configuration of authorization for JmxJsonServlet and MetricsServlet | Major | util | Philip Zeyliger | Alejandro Abdelnur | | | Integration with BookKeeper logging system | Major | . | Luca Telloli | Ivan Kelly | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | MR changes to match HADOOP-7524 (multiple RPC protocols) | Major | . | Sanjay Radia | Sanjay Radia | | | Untangle depencencies between NN components | Major | namenode | Todd Lipcon | Todd Lipcon | | | MR portion of HADOOP-7607 - Simplify the RPC proxy cleanup process | Major | mrv2 | Aaron T. Myers | Aaron T. Myers | | | Simplify the RPC proxy cleanup process | Major | ipc | Aaron T. Myers | Aaron T. Myers | | | RetryInvocationHandler should release underlying resources on close | Major | ipc | Aaron T. Myers | Aaron T. Myers | | | DFSClient shouldn't keep multiple RPC proxy references | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers | | | Change Namenode and Datanode to register each of their protocols seperately | Major | . | Sanjay Radia | Sanjay Radia | | | Make getProtocolSignature public | Minor | . | Sanjay Radia | Sanjay Radia | | | RPC protocol registration on SS does not log the protocol name (only the class which may be different) | Minor | . | Sanjay Radia | Sanjay Radia | | | Move handling of concurrent client fail-overs to RetryInvocationHandler | Major | ipc | Aaron T. Myers | Aaron T. Myers | | | fix some typos and tabs in CHANGES.TXT | Trivial | build | Steve Loughran | Steve Loughran | | | Send back valid HTTP response if user hits IPC port with HTTP GET | Major | ipc | Todd Lipcon | Todd Lipcon | | | HDFS-1580: Make FSEditLog create its journals from a list of URIs rather than NNStorage | Major | . | Ivan Kelly | Ivan Kelly | | | Separate datatypes for DatanodeProtocol | Major |

| Suresh Srinivas | Suresh Srinivas | | | Cleanup unnecessary exceptions thrown and unnecessary casts | Minor | datanode, hdfs-client, namenode | Hari Mankude | Hari Mankude | | | Further clean up hard-coded configuration keys | Minor | datanode, namenode, test | Suresh Srinivas | Suresh Srinivas | | | Add helper class to unwrap RemoteException from ServiceException thrown on protobuf based RPC | Major | ipc | Suresh Srinivas | Suresh Srinivas | | | Add interface for generic Write Ahead Logging mechanisms | Major | namenode | Ivan Kelly | Jitendra Nath Pandey | | | Replace @inheritDoc with @Override | Minor | . | Hari Mankude | Hari Mankude | | | Classes deriving GetGroupsBase should be able to override proxy creation. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey | | | Remove Writable wire protocol related code that is no longer necessary | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas | | | Add standalone benchmark of protobuf IPC | Major | benchmarks, ipc | Todd Lipcon | Todd Lipcon | | | Protobuf RPC engine can be optimized to not do copying for the RPC request/response | Major | ipc | Devaraj Das | Devaraj Das | | | Add RPC metrics to ProtobufRpcEngine | Major | ipc, metrics | Suresh Srinivas | Hari Mankude | | | Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString() | Trivial | namenode | Brandon Li | Brandon Li | | | javadoc the Service interfaces | Trivial | mrv2 | Steve Loughran | Steve Loughran | | | Generate proto java files as part of the build | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | | Correction to BUILDING.txt: HDFS needs ProtocolBuffer, too (not just MapReduce) | Trivial | documentation | Eugene Koontz | Eugene Koontz | | | fix RPC.Server#addProtocol to work in AvroRpcEngine | Major | ipc | Doug Cutting | Doug Cutting | | | KerberosAuthenticatorHandler should use \_HOST replacement to resolve principal name | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | Print the stack trace of InstanceAlreadyExistsException in trace level | Minor | metrics | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Apply the fix similar to HADOOP-8084 | Major | mrv2 | Devaraj Das | Devaraj Das | | | Remove getProtocolVersion and getProtocolSignature from translators | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Use generic type to declare FSDatasetInterface | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Remove unused method DFSUtil#isDefaultNamenodeAddress | Trivial | namenode | Aaron T. Myers | Aaron T. Myers | | | FSEditLogOp and its subclasses should have toString() method | Major | namenode | Sho Shimauchi | Sho Shimauchi | | | Streaming FAQ has some wrong instructions about input files splitting | Trivial | documentation | Harsh J | Harsh J | | | Add an interface for DataBlockScanner logging | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Stop using "mapred.used.genericoptionsparser" to avoid unnecessary warnings | Minor | util | Harsh J | Harsh J | | | Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. | Major | datanode, hdfs-client, namenode | Uma Maheswara Rao G | Tsz Wo Nicholas Sze | | | FSEditLog should log progress during replay | Major |

| Todd Lipcon | Sho Shimauchi | | | Remove HADOOP\[JOBTRACKER\|TASKTRACKER]\OPTS | Minor | conf | Eli Collins | Eli Collins | | | haadmin failover command does not provide enough detail for when target NN is not ready to be active | Major | ha | Philip Zeyliger | Todd Lipcon | | | Improve ActiveStandbyElector to provide hooks for fencing old active | Major | ha | Todd Lipcon | Todd Lipcon | | | Refactor FailoverController/HAAdmin code to add an abstract class for "target" services | Major | ha | Todd Lipcon | Todd Lipcon | | | Add public APIs for safemode | Major | hdfs-client | Todd Lipcon | Harsh J | | | LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | Replace ProtoOverHadoopRpcEngine with ProtobufRpcEngine. | Blocker | mrv2 | Jitendra Nath Pandey | Jitendra Nath Pandey | | | dfs.upgrade.permission is dead code | Trivial | namenode | Eli Collins | Eli Collins | | | The DatanodeID "name" field is overloaded | Major | datanode | Eli Collins | Eli Collins | | | haadmin should have configurable timeouts for failover commands | Major | ha | Philip Zeyliger | Todd Lipcon | | | Enable hsync and hflush by default | Major | . | Eli Collins | Eli Collins | | | HA: use substitution token for fencing argument | Major | ha | Aaron T. Myers | Todd Lipcon | | | FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port | Major | ha | Philip Zeyliger | Todd Lipcon | | | Fix HA docs for changes to shell command fencer args | Major | documentation | Todd Lipcon | Todd Lipcon | | | rework OEV to share more code with the NameNode | Minor | namenode | Colin P. McCabe | Colin P. McCabe | | | HA: fencing method should be able to be configured on a per-NN or per-NS basis | Major | ha | Todd Lipcon | Todd Lipcon | | | KerberosName silently sets defaultRealm to "" if the Kerberos config is not found, it should log a WARN | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur | | | Minor modification to JournalProtocol.proto to make it generic | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Allow GetConf tool to print arbitrary keys | Major | tools | Todd Lipcon | Todd Lipcon | | | Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG | Trivial | datanode | Todd Lipcon | Todd Lipcon | | | ServerCommand and friends don't need to be writables | Major | . | Eli Collins | Eli Collins | | | Remove dead writable code from hdfs/protocol | Major | . | Eli Collins | Eli Collins | | | Improve bootstrapStandby behavior when original NN is not active | Minor | ha | Todd Lipcon | Todd Lipcon | | | Use ToolRunner.confirmPrompt in NameNode | Trivial | namenode | Todd Lipcon | Todd Lipcon | | | Improve the error message: DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster | Major | hdfs-client | Zhanwei Wang | Tsz Wo Nicholas Sze | | | Relax the build version check to permit rolling upgrades within a release | Major | . | Eli Collins | Aaron T. Myers | |

NameNode#initializeSharedEdits should populate shared edits dir with edit log segments | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers | | | Stats for the # of blocks per DN | Minor | datanode, namenode | Eli Collins | Aaron T. Myers | | | One of the FSEditLog constructors should be moved to TestEditLog | Minor | namenode | Tsz Wo Nicholas Sze | Arpit Gupta | | | Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. | Major | test, util | Ahmed Radwan | Ahmed Radwan | | | Fix indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods | Trivial | datanode, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | HttpFS should read HDFS config from Hadoop site.xml files | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | Upgrade test build to Surefire 2.12 | Trivial | build, test | Todd Lipcon | Todd Lipcon | | | TestFsck should test multiple -move operations in a row | Minor | test | Colin P. McCabe | Colin P. McCabe | | | Use ServiceLoader to discover compression codec classes | Major | conf, io | Tom White | Tom White | | | Improve RM WebApp start up when proxy address is not set | Major | mrv2 | Devaraj K | Devaraj K | | | Miscellaneous xml cleanups for OEV | Minor | tools | Colin P. McCabe | Colin P. McCabe | | | Use ProtoBuf for RpcPayLoadHeader | Major | ipc | Sanjay Radia | Sanjay Radia | | | Expand public APIs for security library classes | Major | security | Aaron T. Myers | Aaron T. Myers | | | Use JDK ServiceLoader mechanism to find FileSystem implementations | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur | | | DFSOutputStream should not start a thread in constructors | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta | | | Reduce memory usage of counters due to non-static nested classes | Major | . | Tom White | Tom White | | | Document yarn.nodemanager.delete.debug-delay-sec configuration property | Minor | documentation, mrv2 | Eugene Koontz | Eugene Koontz | | | Update namenode -format documentation and add -nonInteractive and -force | Major | documentation | Arpit Gupta | Arpit Gupta | | | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik | | | make default container-executor.conf.dir be a path relative to the container-executor binary | Major | security | Roman Shaposhnik | Roman Shaposhnik | | | Improve NetUtils.getInputStream to return a stream which has a tunable timeout | Major | util | Todd Lipcon | Todd Lipcon | | | FileSystem service loading mechanism should print the FileSystem impl it is failing to load | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur | | | Enable users to disable socket caching in DFS client configuration | Minor | hdfs-client | Todd Lipcon | Todd Lipcon | | | Put client name in DataXceiver thread name for readBlock and keepalive | Trivial | datanode | Todd Lipcon | Todd Lipcon | | | Remove DFS\NAMENODE\SECONDARY\HTTPS\PORT\_KEY and DEFAULT | Trivial |

| Eli Collins | Eli Collins | | | hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop | Major | scripts | Roman Shaposhnik | Roman Shaposhnik | | | Use ProtoBuf for RpcResponseHeader | Blocker | . | Sanjay Radia | Sanjay Radia | | | Rename BlockWithLocationsProto datanodeIDs field to storageIDs | Minor | . | Eli Collins | Eli Collins | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestNMAuditLogger.testNMAuditLoggerWithIP failing | Critical | . | Vinod Kumar Vavilapalli | Thomas Graves | | | Fix newly introduced release audit warning. | Minor | . | Uma Maheswara Rao G | Uma Maheswara Rao G | | | JsonFactory can be created only once and used for every next request to create JsonGenerator inside JMXJsonServlet | Minor | . | Devaraj K | Devaraj K | | | RPC.stopProxy can throw unintended exception while logging error | Major | ipc | Aaron T. Myers | Aaron T. Myers | | | hadoop dfs command with webhdfs fails on secure hadoop | Critical | webhdfs | Arpit Gupta | Jitendra Nath Pandey | | | Fix TestBackupNode failure | Major | . | Suresh Srinivas | Suresh Srinivas | | | (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry | Major | hdfs-client, namenode | Aaron T. Myers | Aaron T. Myers | | | Inner classes of org.apache.hadoop.ipc.protobuf.HadoopRpcProtos generates findbugs warnings which results in -1 for findbugs | Major | ipc | John Lee | John Lee | | | TestDfsOverAvroRpc timing out in trunk | Critical | test | Todd Lipcon | Uma Maheswara Rao G | | | Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol | Major | . | Tsz Wo Nicholas Sze | Sanjay Radia | | | TestFailoverProxy fails intermittently on trunk | Major | test | Jason Lowe | Jason Lowe | | | ProtobufRPCEngine client side exception mechanism is not consistent with WritableRpcEngine | Major | ipc | Suresh Srinivas | Suresh Srinivas | | | IPC logs too verbose after "RpcKind" introduction | Trivial | ipc | Todd Lipcon | Todd Lipcon | | | Remove Avro RPC | Major | . | Suresh Srinivas | Suresh Srinivas | | | Remove Avro RPC | Major | . | Suresh Srinivas | Suresh Srinivas | | | o.a.h.ipc.WritableRpcEngine should have a way to force initialization | Major | ipc | Aaron T. Myers | Aaron T. Myers | | | Removal of Avro broke non-PB NN services | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | TestDataNodeMultipleRegistrations is failing in trunk | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G | | | SecondaryNameNode doesn't start up | Critical | . | Sho Shimauchi | Jitendra Nath Pandey | | | Remove Avro RPC | Major | ipc | Suresh Srinivas | Suresh Srinivas | | | Errant println left in RPC.getHighestSupportedProtocol | Minor | ipc | Todd Lipcon | Sho Shimauchi | | | Mapreduce Trunk compilation fails | Blocker | mrv2 | Devaraj K | Devaraj K | | | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Trunk MRV1 compilation is

| Blocker | build, test | Vinod Kumar Vavilapalli | Suresh Srinivas | | | TestBlockRecovery does not compile | Blocker | test | Eli Collins | Todd Lipcon | | | Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery | Blocker | datanode, namenode | Todd Lipcon | Todd Lipcon | | | method clear() in org.apache.hadoop.io.Text does not work | Major | io | Aaron, | Csaba Miklos | | | Failures because MALLOC\ARENA\MAX is not set | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan | | | Auto-logSync based on edit log buffer size broken | Critical | namenode | Todd Lipcon | Todd Lipcon | | | Fix javac warnings in TestAuthenticationFilter | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add FSEditLog.metrics to findbugs exclude list | Trivial | . | Todd Lipcon | Todd Lipcon | | | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh | | | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G | | | starting nodemanager as 'root' gives "Unknown -jvm option" | Major | nodemanager | Gilad Wolff | Tom White | | | LocalDirAllocator confChanged() accesses conf.get() twice | Major | fs | Ravi Gummadi | Ravi Gummadi | | | TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge | Blocker | . | Arun C Murthy | Aaron T. Myers | | | javadoc generation fails with java.lang.OutOfMemoryError: Java heap space | Critical | build | Thomas Graves | Thomas Graves | | | httpfs and hdfs launcher scripts should honor CATALINA\HOME and HADOOP\LIBEXEC\_DIR | Major | scripts | Roman Shaposhnik | Roman Shaposhnik | | | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | | | TestAllowFormat is trying to be interactive | Critical | . | Todd Lipcon | Todd Lipcon | | | ConcurrentModificationException in FSDataset$FSVolume.getDfsUsed(..) | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | SecondaryNameNode does not properly initialize metrics system | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | Fail to submit mapred job on a secured-HA-HDFS: logic URI cannot be picked up by job submission. | Critical | ha, security | Mingjie Lai | Mingjie Lai | | | NPE in Resource Manager shutdown | Minor | resourcemanager | Steve Loughran | Steve Loughran | | | Build fails with non-Sun JREs due to different pathing to the operating system architecture shared libraries | Major | . | Stephen Watt | Devaraj Das | | | LdapGroupsMapping shouldn't throw away IOException | Major | security | Jonathan Natkins | Jonathan Natkins | | | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das | | | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan | | | Cannot run an MR job with HA and security enabled when second-listed NN active | Critical | ha, security | Mingjie Lai | Aaron

Myers | | | SshFenceByTcpPort uses netcat incorrectly | Major | ha | Philip Zeyliger | Todd Lipcon | | | failed to append data | Major | datanode | Zhanwei Wang | Brandon Li | | | Findbugs warning on HDFS trunk | Minor | namenode | Todd Lipcon | Todd Lipcon | | | TestHealthMonitor fails occasionally | Major | . | Tom White | Todd Lipcon | | | Need a RM-\>AM channel to inform AMs about faulty/unhealthy/lost nodes | Major | applicationmaster, mrv2, resourcemanager | Vinod Kumar Vavilapalli | Bikas Saha | | | To get "yarn.app.mapreduce.am.staging-dir" value, should set the default value | Minor | job submission, mrv2 | xieguiming | xieguiming | | | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin P. McCabe | Colin P. McCabe | | | stopproxy() is not closing the proxies correctly | Minor | ipc | Hari Mankude | Hari Mankude | | | RPC.closeProxy shouldn't throw error when closing a mock | Critical | ipc, test | Todd Lipcon | Todd Lipcon | | | TestDFSHAAdmin is failing post HADOOP-8202 | Major | test | Aaron T. Myers | Aaron T. Myers | | | TestGetBlocks.testGetBlocks is failing | Major | test | Eli Collins | Arpit Gupta | | | Compatibility issue with 0.20.203. | Major | . | Jane Chen | Jane Chen | | | TestMROutputFormat.java does not compile | Blocker | build, mrv2 | Jason Lowe | Jason Lowe | | | TestHDFSCLI.testAll is failing | Blocker | test | Eli Collins | Brandon Li | | | various issues with running yarn proxyserver | Critical | mrv2, resourcemanager, webapps | Roman Shaposhnik | Devaraj K | | | HDFS balancer doesn't ensure that hdfs-site.xml is loaded | Major | balancer & mover | Stephen Chu | Aaron T. Myers | | | Fix issues in start-all.sh and stop-all.sh | Major | . | Nishan Shetty | Devaraj K | | | NetUtils#getHostNameOfIP blows up if given ip:port string w/o port | Major | . | Eli Collins | Eli Collins | | | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin P. McCabe | | | Security support broken in CLI (manual) failover controller | Critical | ha, security | Todd Lipcon | Todd Lipcon | | | TestMRApps testSetClasspath fails | Major | test | Alejandro Abdelnur | Alejandro Abdelnur | | | TestValidateConfigurationSettings is failing | Major | . | Eli Collins | Todd Lipcon | | | NamespaceInfo PB translation drops build version | Major | datanode | Aaron T. Myers | Aaron T. Myers | | | Remove hsqldb exclusions from pom.xml | Major | . | Ravi Prakash | Ravi Prakash | | | JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name" | Major | . | Eli Collins | Eli Collins | | | Bogus entries in hosts files are incorrectly displayed in the report | Major | namenode | Eli Collins | Eli Collins | | | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon | | | InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery | Blocker | datanode | Todd Lipcon | Todd Lipcon | | | Har file system doesn't deal with FS URIs with a host but no port | Major | fs | Aaron

Myers | Aaron T. Myers | | | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi | | | start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured | Major | scripts | Todd Lipcon | Eli Collins | | | Yarn RackResolver ignores rack configurations | Major | mrv2 | Ahmed Radwan | Ahmed Radwan | | | Distributed shell application fails with NoClassDefFoundError | Blocker | mrv2 | Devaraj K | Devaraj K | | | Accidentally left log message in GetConf after HDFS-3226 | Trivial | tools | Todd Lipcon | Todd Lipcon | | | Stringification of IPC calls not useful | Minor | ipc | Todd Lipcon | Todd Lipcon | | | NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir | Minor | ha, namenode | Aaron T. Myers | Aaron T. Myers | | | BackupNode stop can not close proxy connections because it is not a proxy instance. | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Remove irritating double double quotes in front of hostname | Trivial | . | Bernd Fondermann | Bernd Fondermann | | | Compilation error in RAID | Major | contrib/raid | Tsz Wo Nicholas Sze | Devaraj K | | | Stream job fails with ZipException when use yarn jar command | Blocker | mrv2 | Devaraj K | Devaraj K | | | bootstrapstanby repeated twice in hdfs namenode usage message | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Fix the fuse-fds build | Major | build, fuse-dfs | Petru Dimulescu | Bruno Mah | | | Branch-2 build broken due to wrong version number in fuse-dfs' pom.xml | Major | fuse-dfs | Anupam Seth | Anupam Seth | | | TestDatanodeRegistration should set minimum DN version in addition to minimum NN version | Major | . | Aaron T. Myers | Aaron T. Myers | | | HA DFS returns wrong token service | Critical | ha, hdfs-client | Daryn Sharp | Daryn Sharp | | | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers | | | YARN should not have a compile-time dependency on HDFS | Major | . | Tom White | Tom White | | | Trim fs.checkpoint.dir values | Major | namenode | Eli Collins | amith | | | TestNameEditsConfigs is incorrectly swallowing IOE | Major | test | Aaron T. Myers | Aaron T. Myers | | | DFSOutputStream.sync should not be synchronized | Critical | hdfs-client | Todd Lipcon | Todd Lipcon | | | ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists | Major | mrv2, scheduler | Devaraj K | Devaraj K | | | Hdfs mishandles token service & incompatible with HA | Critical | ha, hdfs-client | Daryn Sharp | Daryn Sharp | | | bootstrapStandby fails in secure cluster | Minor | ha, security | Todd Lipcon | Todd Lipcon | | | start-all.sh refers incorrectly start-dfs.sh existence for starting

| Minor | scripts | Devaraj K | Devaraj K | | | DataNode no longer needs to check for dfs.network.script | Minor | datanode | Steve Loughran | Harsh J | | | MiniMRYarn/MiniYarn uses fixed ports | Major | test | Alejandro Abdelnur | Alejandro Abdelnur | | | GetImageServlet should consider SBN a valid requestor in a secure HA setup | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers | | | Pseudo & Kerberos AuthenticationHandler should use getType() to create token | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | HttpFS operation for getHomeDirectory is incorrect | Major | . | Alejandro Abdelnur | Alejandro Abdelnur | | | broken doc link for yarn-default.xml in site.xml | Major | documentation | Patrick Hunt | Patrick Hunt | | | hadoop/yarn daemonlog usage wrong | Minor | . | Thomas Graves | Devaraj K | | | FileContext#checkPath should handle URIs with no port | Major | fs | Aaron T. Myers | Aaron T. Myers | | | DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. | Major | hdfs-client | Uma Maheswara Rao G | Uma Maheswara Rao G | | | testHardLeaseRecoveryAfterNameNodeRestart fails when length before restart is 1 byte less than CRC chunk size | Minor | test | Colin P. McCabe | Tsz Wo Nicholas Sze | | | HttpFS (Hoop) chmod not supporting octal and sticky bit permissions | Major | . | Romain Rigaux | Alejandro Abdelnur | | | Append enabled log message uses the wrong variable | Trivial | namenode | J.Andreina | Matthew Jacobs | | | TestYarnClientProtocolProvider is broken | Major | test | Daryn Sharp | Daryn Sharp | | | Range check DelegationKey length | Minor | . | Colin P. McCabe | Colin P. McCabe | | | MRV2 UI doesn't work properly without internet | Critical | mrv2 | Devaraj K | Devaraj K | | | hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik | | | NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | Hadoop Common logs misspell 'successful' | Major | security | Philip Zeyliger | Philip Zeyliger | | | NullPointerException in DN when directoryscanner is trying to report bad blocks | Major | datanode | amith | amith | | | findbugs warning: INodeFileUnderConstruction doesn't override INodeFile.equals(Object) | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | SPNEGO filter throws/logs exception when authentication fails | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur | | | RM: Remove RMNodeState and replace it with NodeState | Major | mrv2 | Bikas Saha | Bikas Saha | | | DataXceiver reads from client socket with incorrect/no timeout | Critical | datanode | Todd Lipcon | Todd Lipcon | | | RemoteEditLogManifest doesn't need to implements Writable | Minor | namenode | Brandon Li | Brandon Li | | | ViewFS doesn't work when the root of a file system is mounted | Major | viewfs | Aaron T. Myers | Aaron

Myers | | | DFSClient fails to make connection to DN if there are many unusable cached sockets | Critical | hdfs-client | Todd Lipcon | Todd Lipcon | | | Update RAID to not to use FSInodeInfo | Major | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | NPE in DataNode.getIpcPort | Minor | datanode | Uma Maheswara Rao G | Eli Collins | | | FUSE build fails on Ubuntu 12.04 | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe | | | NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0 | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | HA: Handle failure during HA state transition | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers | | | If GetImageServlet throws an Error or RTE, response has HTTP "OK" status | Critical | namenode | Todd Lipcon | Todd Lipcon | | | jsp pages missing DOCTYPE | Trivial | . | Dave Vronay | Dave Vronay | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE | Major | . | Eli Collins | Todd Lipcon | | | NetworkTopology: add test that getLeaf should check for invalid topologies | Minor | . | Colin P. McCabe | Colin P. McCabe | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | 1073: Move all journal stream management code into one place | Major | . | Ivan Kelly | Ivan Kelly | | | Add JournalSet to manage the set of journals. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Separate HDFS Client wire protocol data types | Major | . | Sanjay Radia | Sanjay Radia | | | Separate datatypes for Journal protocol | Major | . | Suresh Srinivas | Suresh Srinivas | | | Separate datatypes for NamenodeProtocol | Major | . | Suresh Srinivas | Suresh Srinivas | | | Move commands Finalize and Register out of DatanodeCommand class. | Major | . | Suresh Srinivas | Suresh Srinivas | | | Separate datatypes for InterDatanodeProtocol | Major | datanode | Suresh Srinivas | Suresh Srinivas | | | HDFS Client Data Types in Protocol Buffers | Major | . | Sanjay Radia | Sanjay Radia | | | Add support for protocol buffer based RPC engine | Major | ipc | Suresh Srinivas | Suresh Srinivas | | | Fix RPC client creation bug from HDFS-2459 | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Add Closeable to JournalManager | Major | namenode | Ivan Kelly | Ivan Kelly | | | Optimize computing the diff between a block report and the namenode

| Major | namenode | Tomasz Nykiel | Tomasz Nykiel | | | Make the Ipc-Header in a RPC-Payload an explicit header | Major | ipc | Sanjay Radia | Sanjay Radia | | | Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | | | More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | | | Protobuf - Add protocol service for JournalProtocol | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Protobuf - Add protobuf service for NamenodeProtocol | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Protobuf - Add protobuf service for InterDatanodeProtocol | Major | datanode | Suresh Srinivas | Suresh Srinivas | | | Protobuf - Add protobuf service for DatanodeProtocol | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas | | | Implement protobuf service for JournalProtocol | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Implement protobuf service for NamenodeProtocol | Major | namenode | Suresh Srinivas | Suresh Srinivas | | | Implement protobuf service for InterDatanodeProtocol | Major | datanode | Suresh Srinivas | Suresh Srinivas | | | Implement protobuf service for ClientDatanodeProtocol | Major | . | Suresh Srinivas | Suresh Srinivas | | | ClientNameNodeProtocol in Protocol Buffers | Major | . | Sanjay Radia | Sanjay Radia | | | Protobuf translators for DatanodeProtocol | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Enable protobuf RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol and NamenodeProtocol | Major | balancer & mover, datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas | | | ClientNameNodeProtocol Translators for Protocol Buffers | Major | . | Sanjay Radia | Sanjay Radia | | | Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it | Major | ipc | Sanjay Radia | Sanjay Radia | | | Fix bug in ProtoBufRpcEngine - | Major | ipc | Sanjay Radia | Sanjay Radia | | | TestBackupNode fails | Major | test | Suresh Srinivas | Suresh Srinivas | | | Enable protobuf RPC for DatanodeProtocol | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Enable protobuf rpc for ClientNamenodeProtocol | Major | . | Sanjay Radia | Sanjay Radia | | | Tests are failing with ClassCastException, due to new protocol changes | Major | test | Uma Maheswara Rao G | Suresh Srinivas | | | Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffers | Major | . | Suresh Srinivas | Jitendra Nath Pandey | | | Support for protocol version and signature in PB | Major | ipc | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Provide a method in client side translators to check for a methods supported in underlying protocol. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | Protocol buffer changes to add support multiple storages | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas | | | Service protocol change to support multiple storages added in HDFS-2880 | Major | . | Suresh Srinivas | Suresh Srinivas | | | Optional parameters are not handled correctly | Major | . | Suresh Srinivas | Suresh Srinivas | | | Make IPC header be extensible | Major | . | Sanjay Radia | Sanjay Radia | | | Remove getProtocolVersion and getProtocolSignature from the client side translator and server side implementation | Major |

| Jitendra Nath Pandey | Jitendra Nath Pandey | | | Clean up FSDatasetInterface | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Move FSDatasetInterface inner classes to a package | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Add DatanodeStorage information to block recovery | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Change Datanode not to send storage list in registration - it will be sent in block report | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Move FSDatasetInterface and other related classes/interfaces to a package | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Clean up FSDataset implemenation related code. | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Update commons-net version to 3.1 | Major | io, performance | Eli Collins | Eli Collins | | | Move FSDataset implemenation to a package | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Common side of HDFS-3148 | Major | io, performance | Eli Collins | Eli Collins | | | Journal stream from the namenode to backup needs to have a timeout | Major | ha, namenode | Hari Mankude | Hari Mankude | | | Upgrade guava to 11.0.2 | Minor | build | Todd Lipcon | Todd Lipcon | | | Fix tests org.apache.hadoop.mapred.TestClusterMRNotification | Major | mrv2, test | Devaraj K | Devaraj K | | | Fix tests org.apache.hadoop.mapred.TestClusterMapReduceTestCase | Major | mrv2, test | Devaraj K | Devaraj K | | | Fix tests in org.apache.hadoop.mapred.TestJobName | Major | mrv2, test | Devaraj K | Devaraj K | | | Fix tests in org.apache.hadoop.mapred.TestMiniMRClasspath & org.apache.hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers | Major | mrv2, test | Devaraj K | Devaraj K | | | JournalProtocol changes required for introducing epoch and fencing | Major | ha, namenode | Suresh Srinivas | Suresh Srinivas | | | Fix tests in org.apache.hadoop.util.TestRunJar | Major | mrv2 | Devaraj K | Devaraj K | | | Fix tests in org.apache.hadoop.ipc.TestSocketFactory | Major | mrv2 | Devaraj K | Devaraj K | | | Add HdfsDataInputStream as a public API | Major | hdfs-client | Uma Maheswara Rao G | Uma Maheswara Rao G | | | Add HdfsDataOutputStream as a public API | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Update file context to use HdfsDataInputStream and HdfsDataOutputStream | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | change INode to package private | Minor | namenode | John George | John George | | | blockmanagement should stop using INodeFile & INodeFileUC | Minor | namenode | John George | John George | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | fuse-dfs truncate behavior causes issues with scp | Minor | fuse-dfs | Brian Bockelman | Brian Bockelman | | | Update versions from 0.23.2 to 0.23.3 | Major | build | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Missing license headers in trunk | Trivial | . | Todd Lipcon | Uma Maheswara Rao G | | | Clear up javadoc warnings in hadoop-common-project | Trivial | conf | Harsh J |