java procedure of de-duplicate for flume, first unfinished version.
add debug log for test linenum.
Merge branch 'cosmos-flume-1.3.1' of https://github.com/cltlfcjin/flume into cosmos-flume-1.3.1
change some log level from debug to trace
de-duplicate procedure: 1.Get rid of FileWatcher but not delete; 2.Add a buf status between tmp and normal; 3.Changing conf file more or less; 4.Add hdfs access security into codes
Merge branch 'cosmos-flume-1.3.1' of ssh://github.com/cltlfcjin/flume into cosmos-flume-1.3.1
compat log format without hours
Merge branch 'cosmos-flume-1.3.1' of https://github.com/cltlfcjin/flume into cosmos-flume-1.3.1
	modified:   DPflume-de-duplicate/deduplicate.conf
	modified:   DPflume-de-duplicate/src/main/java/com/dianping/duplicate/DuplicateChecker.java
	modified:   DPflume-de-duplicate/src/main/java/com/dianping/duplicate/HDFSOperater.java
	modified:   DPflume-de-duplicate/src/main/java/com/dianping/duplicate/alarm/AlarmOperator.java
	modified:   DPflume-de-duplicate/src/main/java/com/dianping/duplicate/configurate/BasicConfigurationConstants.java
	modified:   DPflume-de-duplicate/src/main/java/core-site.xml
	modified:   DPflume-de-duplicate/src/test/java/com/dianping/duplicate/TestDuplicateChecker.java
	modified:   DPflume-de-duplicate/src/test/java/com/dianping/duplicate/TestHDFSOpeartor.java
	deleted:    DPflume-de-duplicate/src/main/java/hdfs-site.xml

1. add HDFS access security using kerbores.
2. fix some bug in functions "handleTmpFile() and "cleanUpStaleFile()".
3. fix some bug in dealing with startHourStr reloading.
4. fix some bug in deleteing operation of HDFS.
5. fix some bug in exception process.
delete hdfs-site.xml
Merge branch 'cosmos-flume-1.3.1' of ssh://github.com/cltlfcjin/flume into cosmos-flume-1.3.1
fix bug of close URLconnection
1.modify alarm with tolerate time; 2.fix the bug the stream close without judged null; 3.fix the bug discard without delete tmp file;4.fix the bug read file begin the line number of tmp file
Merge pull request #4 from cltlfcjin/cosmos-flume-1.3.1

version 1.0