Force version of sfl4j to 1.6 to ensure byte compatability in production

2014-07-10 05:49:49,436 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.NoSuchMethodError: org.slf4j.helpers.MessageFormatter.format(Ljava/lang/String;Ljava/lang/Object;Ljava/lang/Object;)Lorg/slf4j/helpers/FormattingTuple;
	at org.slf4j.impl.Log4jLoggerAdapter.info(Log4jLoggerAdapter.java:345)
	at amazon.emr.metrics.MetricsSaver.<init>(MetricsSaver.java:202)
	at amazon.emr.metrics.MetricsSaver.ensureSingleton(MetricsSaver.java:403)
	at amazon.emr.metrics.MetricsSaver.addInternal(MetricsSaver.java:228)
	at amazon.emr.metrics.MetricsSaver.addValueWithError(MetricsSaver.java:163)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:211)
	at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
	at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:651)
	at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1679)
	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1106)
	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102)
	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1399)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:280)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1445)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1442)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1375)
Merge pull request #96 from ambiata/cofarrell/slfj4-version-fix

Force version of sfl4j to 1.6 to ensure byte compatability in production
Fix IllegalAccessError in MrContext when running in local mode

[WARN] LocalJobRunner - job_local1120324947_0001 <java.lang.Exception: java.lang.IllegalAccessError: tried to access class org.apache.hadoop.mapreduce.lib.input.TaggedInputSplit from class org.apache.hadoop.mapreduce.lib.input.ProxiedInpu
tSplit$>java.lang.Exception: java.lang.IllegalAccessError: tried to access class org.apache.hadoop.mapreduce.lib.input.TaggedInputSplit from class org.apache.hadoop.mapreduce.lib.input.ProxiedInputSplit$
        at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.IllegalAccessError: tried to access class org.apache.hadoop.mapreduce.lib.input.TaggedInputSplit from class org.apache.hadoop.mapreduce.lib.input.ProxiedInputSplit$
        at org.apache.hadoop.mapreduce.lib.input.ProxiedInputSplit$.fromInputSplit(ProxyTaggedInputSplit.scala:24)
        at com.ambiata.ivory.mr.MrContext$.getSplitPath(Context.scala:62)
        at com.ambiata.ivory.ingest.IngestMapper.setup(mr.scala:206)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
Merge pull request #97 from ambiata/cofarrell/mr-split-reflect

Fix IllegalAccessError in MrContext when running in local mode
Some examples of features Ivory should generate.
Split docs into design and user facing.

Goal here is simply to make it easy for external
people to identify the relevant docs.
Merge pull request #98 from ambiata/topic/doc-cleanup

Split docs into design and user facing.
Cleanup snapshot mr jobs

- Rename PrioritizedFactBytes to PriorityTag
- Move all thrift structs to a single .thrift file
- Move all mutations to MutableState
Fixes from comments. Also fixed mr jobs clashing and causing builds to break when run in test