HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option.  Contributed by szetszwo.
(cherry picked from commit 727331becc3902cb4e60ee04741e79703238e782)