Project: Apache Hadoop (App Definition and Development / Database)
File: CHANGELOG.1.1.0.md

<! --> | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | DFSClient does not treat write timeout of 0 properly | Major | . | Raghu Angadi | Raghu Angadi | | | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin P. McCabe | | | DNS#getIPs shouldn't silently return the local host IP for bogus interface names | Major | conf | Eli Collins | Eli Collins | | | HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | | Enable sync by default and disable append | Major | . | Eli Collins | Eli Collins | | | If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations | Major | namenode | Brandon Li | Brandon Li | | | Add flag to disable durable sync | Blocker | . | Eli Collins | Eli Collins | | | Conflict: Same security.log.file for multiple users. | Major | conf, security | Karthik Kambatla | Karthik Kambatla | | | Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution | Major | security | Jakob Homan | Jakob Homan | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch | Major | contrib/gridmix, tools/rumen | Ravi Gummadi | Ravi Gummadi | | | Support binding to sub-interfaces | Major | util | Harsh J | Harsh J | | | The client should be able to use multiple local interfaces for data transfer | Major | hdfs-client, performance | Eli Collins | Eli Collins | | | Implement recovery mode for branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Job tracker is not able to recover job in case of crash and after that no user can submit job. | Major | . | Mayank Bansal | Mayank Bansal | | | port HADOOP-4012 to branch-1 (splitting support for bzip2) | Major |

| Tim Broberg | Andrew Purtell | | | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Use PureJavaCrc32 in mapreduce spills | Minor | performance | Todd Lipcon | Todd Lipcon | | | Use PureJavaCrc32 in HDFS | Minor | datanode, hdfs-client, performance | Todd Lipcon | Todd Lipcon | | | Lower default minimum heartbeat interval for tasktracker \> Jobtracker | Major | jobtracker, performance, tasktracker | Scott Carey | Todd Lipcon | | | Allow wildcards to be used in ProxyUsers configurations | Minor | security | Todd Lipcon | Todd Lipcon | | | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon | | | Provide option to fail jobs when submitted to non-existent pools. | Minor | contrib/fair-share | Jeff Bean | Ahmed Radwan | | | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash | | | Add HDFS support for fadvise readahead and drop-behind | Major | datanode, performance | Todd Lipcon | Todd Lipcon | | | 0.20: avoid a busy-loop in ReduceTask scheduling | Major | mrv1, performance, task | Todd Lipcon | Todd Lipcon | | | Uncomment eventlog settings from the documentation | Trivial | contrib/fair-share | Sho Shimauchi | Sho Shimauchi | | | Add mapred.disk.healthChecker.interval to mapred-default.xml | Trivial | documentation | Eli Collins | Eli Collins | | | Add log guard for a debug message in ReduceTask | Trivial | task | Todd Lipcon | Todd Lipcon | | | Improve a block recovery log | Minor | namenode | Eli Collins | Eli Collins | | | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins | | | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins | | | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | | The JT web UI should show job start times | Minor | jobtracker | Eli Collins | Harsh J | | | Add sanity checks during edits loading that generation stamps are non-decreasing | Major | namenode | Todd Lipcon | Colin P. McCabe | | | Improve MAPREDUCE-3789's fix logic by looking at job's slot demands instead | Minor | capacity-sched | Harsh J | Harsh J | | | Make per-job counter limits configurable | Major | . | Tom White | Tom White | | | Improve TestStorageRestore | Minor | . | Tsz Wo Nicholas Sze | Brandon Li | | | Edit log replay should track and report file offsets in case of errors | Major | namenode | Todd Lipcon | Colin P. McCabe | | | Add option to relax build-version check for branch-1 | Major | . | Eli Collins | Eli Collins | | | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta | | | Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 | Major | . | Eli Collins | Eli Collins | | | Configurable retry in DFSClient | Major | hdfs-client | Siddharth Seth | Tsz Wo Nicholas Sze | | | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe | | | Port HDFS-96 to branch-1 (support blocks greater than 2GB) | Major |

| Matt Foley | Harsh J | | | Add retry support to WebHdfsFileSystem | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | Make use of fadvise in the NM's shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon | | | backport forced daemon shutdown of HADOOP-8353 into branch-1 | Minor | bin | Steve Loughran | Roman Shaposhnik | | | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan | | | Make the replication monitor multipliers configurable in 1.x | Major | namenode | Suresh Srinivas | Jing Zhao | | | Add the option to quiesce the JobTracker | Major | mrv1 | Arun C Murthy | Arun C Murthy | | | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy | | | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy | | | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao | | | Allow JobClient to retry job-submission when JT is in safemode | Major | . | Arun C Murthy | Arun C Murthy | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | Bug in S3N handling of directory markers using an object with a trailing "/" causes jobs to fail | Major | fs/s3 | Ian Nowland | Ian Nowland | | | BloomMapFile can return false negatives | Major | io | Clark Jefcoat | Clark Jefcoat | | | Kerberos relogin should set refreshKrb5Config to true | Major | security | Todd Lipcon | Todd Lipcon | | | Running multiple 2NNs can result in corrupt file system | Major | namenode | Aaron T. Myers | Aaron T. Myers | | | regression with MAPREDUCE-2289 - setPermission passed immutable FsPermission (rpc failure) | Major | . | Patrick Hunt | Todd Lipcon | | | Cluster setup docs specify wrong owner for task-controller.cfg | Minor | documentation, security | Eli Collins | Eli Collins | | | branch-0.20-security doesn't include SPNEGO settings in core-default.xml | Major | security | Aaron T. Myers | Aaron T. Myers | | | branch-0.20-security doesn't include o.a.h.security.TestAuthenticationFilter | Major | security | Aaron T. Myers | Aaron T. Myers | | | alfredo config should be in a file not readable by users | Critical | security | Alejandro Abdelnur | Aaron T. Myers | | | tarball doesn't include .eclipse.templates | Minor | build | Jonathan Natkins | Jonathan Natkins | | | Missing instrumentation plugin class shouldn't crash the TT startup per design | Trivial | tasktracker | Harsh J | Harsh J | | | I switched variable names in HADOOP-7509 | Major |

| Ravi Prakash | Ravi Prakash | | | MAPREDUCE-3015 broke compilation of contrib scheduler tests | Critical | capacity-sched, contrib/fair-share | Todd Lipcon | Todd Lipcon | | | Don't mark exited TT threads as dead in MiniMRCluster | Major | tasktracker, test | Eli Collins | Eli Collins | | | Error in the documentation regarding Checkpoint/Backup Node | Trivial | documentation | arnaud p | Harsh J | | | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J | | | CapBasedLoadManager incorrectly allows assignment when assignMultiple is true (was: assignmultiple per job) | Major | contrib/fair-share | Jeff Bean | Jeff Bean | | | [Gridmix] Load job fails with timeout errors when resource emulation is turned on | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh | | | DistributedFileSystem#createNonRecursive should also incrementWriteOps statistics. | Trivial | . | Jonathan Hsieh | Jonathan Hsieh | | | The rpc timeout for block recovery is too low | Major | hdfs-client | Eli Collins | Eli Collins | | | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas | | | Fix three javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins | | | ReplicationTargetChooser has incorrect block placement comments | Trivial | namenode | Harsh J | Harsh J | | | Remove dfsadmin -printTopology from branch-1 docs since it does not exist | Minor | namenode | Harsh J | Harsh J | | | dfs.datanode.max.xcievers missing in 0.20.205.0 | Minor | . | Markus Jelsma | | | | when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time | Minor | namenode | Gokul | | | | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta | | | UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon | | | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon | | | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | | | If locking of a storage dir fails, it will remove the other NN's lock file on exit | Major | namenode | Todd Lipcon | Todd Lipcon | | | CapacityTaskScheduler may perform unnecessary reservations in heterogenous tracker environments | Critical | capacity-sched, scheduler | Harsh J | Harsh J | | | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J | | | Negative caching of local addrs doesn't work | Major | hdfs-client | Eli Collins | Eli Collins | | | 2NN https port setting is broken | Major |

| Eli Collins | Eli Collins | | | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan | | | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin P. McCabe | Colin P. McCabe | | | [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases | Major | . | Ravi Gummadi | Ravi Gummadi | | | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin P. McCabe | | | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee | | | Fix some javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins | | | If invoked with no queueName request param, jobqueue\_details.jsp injects a null queue name into schedulers. | Critical | jobtracker | Harsh J | Harsh J | | | Task stuck in JobLocalizer prevented other tasks on the same node from committing | Critical | mrv1 | Ravi Prakash | Ravi Prakash | | | Pipes examples do not compile on Ubuntu 12.04 | Major | build, examples | Andrew Bayer | Andrew Bayer | | | If GetImageServlet throws an Error or RTE, response has HTTP "OK" status | Critical | namenode | Todd Lipcon | Todd Lipcon | | | Build fails with Java 7 | Major | build | Kumar Ravi | Eli Collins | | | HDFS does not use ClientProtocol in a backward-compatible way | Major | hdfs-client | Kihwal Lee | Kihwal Lee | | | Token should not print the password in toString | Major | security | Ravi Prakash | Ravi Prakash | | | task-controller fails to parse configuration if it doesn't end in \\n | Major | task-controller | Todd Lipcon | Benoy Antony | | | Provide API to check HDFS operational state | Major | hdfs-client | Bikas Saha | Tsz Wo Nicholas Sze | | | WebHDFS CREATE does not use client location for redirection | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | | UserGroupInformation::createUserForTesting clobbers already defined group mappings | Major | security | Jakob Homan | Ivan Mitic | | | Job may hang if mapreduce.job.committer.setup.cleanup.needed=false and mapreduce.map/reduce.failures.maxpercent\>0 | Major | jobtracker | Kang Xiao | Subroto Sanyal | | | HADOOP-6963 didn't update hadoop-core-pom-template.xml | Major | . | Ted Yu | Ted Yu | | | Remove JDK5 dependency from Hadoop

line | Major | build | Konstantin Boudnik | Konstantin Boudnik | | | Map Tasks graph is throwing XML Parse error when Job is executed with 0 maps | Major | jobtracker | Devaraj K | Devaraj K | | | backport pure Java CRC32 calculator changes to branch-1 | Major | performance | Brandon Li | Brandon Li | | | Fix performance regression for small jobs/workflows | Major | performance, task | Luke Lu | Luke Lu | | | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze | | | TestJobTrackerSafeMode is failing | Major | . | Siddharth Seth | Siddharth Seth | | | The SPNEGO filter for the NameNode should come out of the web keytab file | Major | namenode, security | Owen O'Malley | Owen O'Malley | | | For branch-1, TestFileCreation should use JUnit4 to make assumeTrue work | Minor | . | Jing Zhao | Jing Zhao | | | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers | | | make TestRawHistoryFile and TestJobHistoryServer more robust | Major | test | Arpit Gupta | Arpit Gupta | | | TestKillSubProcesses fails as the process is still alive after the job is done | Major | test | Arpit Gupta | Bikas Saha | | | HDFS may miss the final block when reading a file opened for writing if one of the datanode is dead | Critical | hdfs-client | Nicolas Liochon | Nicolas Liochon | | | TestJobHistoryConfig throws Exception in testJobHistoryLogging | Minor | . | Gopal V | Gopal V | | | HFTP should use the same port & protocol for getting the delegation token | Major | . | Owen O'Malley | Owen O'Malley | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | TestTrackerDistributedCacheManager should be up-front about requirements on build environment | Trivial | distributed-cache, test | Todd Lipcon | Todd Lipcon | | | Add test for HADOOP-7629: using an immutable FsPermission as an IPC parameter | Major | test | Todd Lipcon | Todd Lipcon | | | NetworkTopology: add test that getLeaf should check for invalid topologies | Minor | . | Colin P. McCabe | Colin P. McCabe | | | enabling clover coverage reports fails hadoop unit test compilation | Major | . | Giridharan Kesavan | Jitendra Nath Pandey | | JIRA | Summary | Priority | Component | Reporter | Contributor | |:- |:- | : |:- |:- |:- | | | [Gridmix] Improve cumulative CPU usage emulation for short running tasks | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | | The TT should not re-init if it has no good local dirs | Major | tasktracker | Eli Collins | Eli Collins | | | Support fadvise and sync\data\range in NativeIO, add ReadaheadPool class | Major | io, native, performance | Todd Lipcon | Todd Lipcon | | | Add test for TaskTracker disk failure handling (MR-2413) | Major | tasktracker | Eli Collins | Ravi Gummadi | | | Add local dir failure info to metrics and the web UI | Major | tasktracker | Eli Collins | Eli Collins | | | Some LinuxTaskController cleanup | Minor | tasktracker | Eli Collins | Eli Collins | | JIRA | Summary | Priority |