Added apache tokenisation support, updated api docs and added api docs generator.