Issue 1:
Our Analyze API accepts a token_filters parameter as the official way of adding token filters to the chain (we also support filter which is depracated):

GET _analyze
{
"text": "An apple",
"tokenizer": "whitespace",
"token_filters": [
"lowercase", "stop"
]
}

However, creating an analyzer using indexing setting only accept filter (no S) which is confusing. I think the following should be accepted (if not the only default):

PUT index
{
"settings": {
"analysis": {
"analyzer": {
"my_analyzer": {
"tokenizer": "whitespace",
"token_filters": [ <--- broken (expects "filter")
"lowercase",
"stop"
]
}
}
}
}
}

It's very easy to change the code to accept both filter, filters and token_filters but I tend to think that we should go strict here and say we only accept token_filters and automatically upgrade existing setting when we recover. This will require (some) more work as that infra is not there yet.

Issue 2:
I took 2 snapshots for read-only indices with curator and some indices were snapshotted again even though they didn't have any changes.

Look at the first backup (50 oldest indices):

51G s3://backups-es-statistics/indices/statistics-20131004/
27G s3://backups-es-statistics/indices/statistics-20131005/
24G s3://backups-es-statistics/indices/statistics-20131006/
39G s3://backups-es-statistics/indices/statistics-20131007/
25G s3://backups-es-statistics/indices/statistics-20131008/
30G s3://backups-es-statistics/indices/statistics-20131009/
37G s3://backups-es-statistics/indices/statistics-20131010/
28G s3://backups-es-statistics/indices/statistics-20131011/
27G s3://backups-es-statistics/indices/statistics-20131012/
28G s3://backups-es-statistics/indices/statistics-20131013/
32G s3://backups-es-statistics/indices/statistics-20131014/
41G s3://backups-es-statistics/indices/statistics-20131015/
42G s3://backups-es-statistics/indices/statistics-20131016/
33G s3://backups-es-statistics/indices/statistics-20131017/
29G s3://backups-es-statistics/indices/statistics-20131018/
29G s3://backups-es-statistics/indices/statistics-20131019/
30G s3://backups-es-statistics/indices/statistics-20131020/
32G s3://backups-es-statistics/indices/statistics-20131021/
33G s3://backups-es-statistics/indices/statistics-20131022/
29G s3://backups-es-statistics/indices/statistics-20131023/
36G s3://backups-es-statistics/indices/statistics-20131024/
32G s3://backups-es-statistics/indices/statistics-20131025/
32G s3://backups-es-statistics/indices/statistics-20131026/
34G s3://backups-es-statistics/indices/statistics-20131027/
31G s3://backups-es-statistics/indices/statistics-20131028/
40G s3://backups-es-statistics/indices/statistics-20131029/
29G s3://backups-es-statistics/indices/statistics-20131030/
35G s3://backups-es-statistics/indices/statistics-20131031/
7G s3://backups-es-statistics/indices/statistics-20131101/
6G s3://backups-es-statistics/indices/statistics-20131102/
7G s3://backups-es-statistics/indices/statistics-20131103/
7G s3://backups-es-statistics/indices/statistics-20131104/
7G s3://backups-es-statistics/indices/statistics-20131105/
7G s3://backups-es-statistics/indices/statistics-20131106/
7G s3://backups-es-statistics/indices/statistics-20131107/
7G s3://backups-es-statistics/indices/statistics-20131108/
7G s3://backups-es-statistics/indices/statistics-20131109/
7G s3://backups-es-statistics/indices/statistics-20131110/
7G s3://backups-es-statistics/indices/statistics-20131111/
7G s3://backups-es-statistics/indices/statistics-20131112/

And the subsequent backup, same indices:

57G s3://backups-es-statistics/indices/statistics-20131004/
30G s3://backups-es-statistics/indices/statistics-20131005/
27G s3://backups-es-statistics/indices/statistics-20131006/
44G s3://backups-es-statistics/indices/statistics-20131007/
28G s3://backups-es-statistics/indices/statistics-20131008/
33G s3://backups-es-statistics/indices/statistics-20131009/
41G s3://backups-es-statistics/indices/statistics-20131010/
31G s3://backups-es-statistics/indices/statistics-20131011/
30G s3://backups-es-statistics/indices/statistics-20131012/
31G s3://backups-es-statistics/indices/statistics-20131013/
35G s3://backups-es-statistics/indices/statistics-20131014/
46G s3://backups-es-statistics/indices/statistics-20131015/
47G s3://backups-es-statistics/indices/statistics-20131016/
37G s3://backups-es-statistics/indices/statistics-20131017/
33G s3://backups-es-statistics/indices/statistics-20131018/
33G s3://backups-es-statistics/indices/statistics-20131019/
34G s3://backups-es-statistics/indices/statistics-20131020/
36G s3://backups-es-statistics/indices/statistics-20131021/
37G s3://backups-es-statistics/indices/statistics-20131022/
32G s3://backups-es-statistics/indices/statistics-20131023/
40G s3://backups-es-statistics/indices/statistics-20131024/
36G s3://backups-es-statistics/indices/statistics-20131025/
36G s3://backups-es-statistics/indices/statistics-20131026/
38G s3://backups-es-statistics/indices/statistics-20131027/
34G s3://backups-es-statistics/indices/statistics-20131028/
45G s3://backups-es-statistics/indices/statistics-20131029/
33G s3://backups-es-statistics/indices/statistics-20131030/
39G s3://backups-es-statistics/indices/statistics-20131031/
7G s3://backups-es-statistics/indices/statistics-20131101/
6G s3://backups-es-statistics/indices/statistics-20131102/
7G s3://backups-es-statistics/indices/statistics-20131103/
7G s3://backups-es-statistics/indices/statistics-20131104/
7G s3://backups-es-statistics/indices/statistics-20131105/
7G s3://backups-es-statistics/indices/statistics-20131106/
7G s3://backups-es-statistics/indices/statistics-20131107/
7G s3://backups-es-statistics/indices/statistics-20131108/
7G s3://backups-es-statistics/indices/statistics-20131109/
7G s3://backups-es-statistics/indices/statistics-20131110/
7G s3://backups-es-statistics/indices/statistics-20131111/
7G s3://backups-es-statistics/indices/statistics-20131112/

Segments are here:

statistics-20131004 0 p 4.6
statistics-20131004 0 r 4.6
statistics-20131005 0 p 4.4
statistics-20131005 0 p 4.9
statistics-20131005 0 r 4.4
statistics-20131005 0 r 4.9
statistics-20131006 0 p 4.4
statistics-20131006 0 p 4.9
statistics-20131006 0 r 4.4
statistics-20131006 0 r 4.9
statistics-20131007 0 p 4.4
statistics-20131007 0 p 4.9
statistics-20131007 0 r 4.4
statistics-20131007 0 r 4.9
statistics-20131008 0 p 4.4
statistics-20131008 0 p 4.9
statistics-20131008 0 r 4.4
statistics-20131008 0 r 4.9
statistics-20131009 0 p 4.4
statistics-20131009 0 p 4.9
statistics-20131009 0 r 4.4
statistics-20131009 0 r 4.9
statistics-20131010 0 p 4.4
statistics-20131010 0 p 4.9
statistics-20131010 0 r 4.4
statistics-20131010 0 r 4.9
statistics-20131011 0 p 4.4
statistics-20131011 0 p 4.9
statistics-20131011 0 r 4.4
statistics-20131011 0 r 4.9
statistics-20131012 0 p 4.4
statistics-20131012 0 p 4.9
statistics-20131012 0 r 4.4
statistics-20131012 0 r 4.9
statistics-20131013 0 p 4.4
statistics-20131013 0 p 4.9
statistics-20131013 0 r 4.4
statistics-20131013 0 r 4.9
statistics-20131014 0 p 4.4
statistics-20131014 0 p 4.9
statistics-20131014 0 r 4.4
statistics-20131014 0 r 4.9
statistics-20131015 0 p 4.4
statistics-20131015 0 p 4.9
statistics-20131015 0 r 4.4
statistics-20131015 0 r 4.9
statistics-20131016 0 p 4.4
statistics-20131016 0 p 4.9
statistics-20131016 0 r 4.4
statistics-20131016 0 r 4.9
statistics-20131017 0 p 4.4
statistics-20131017 0 p 4.9
statistics-20131017 0 r 4.4
statistics-20131017 0 r 4.9
statistics-20131018 0 p 4.4
statistics-20131018 0 p 4.9
statistics-20131018 0 r 4.4
statistics-20131018 0 r 4.9
statistics-20131019 0 p 4.4
statistics-20131019 0 p 4.9
statistics-20131019 0 r 4.4
statistics-20131019 0 r 4.9
statistics-20131020 0 p 4.4
statistics-20131020 0 p 4.9
statistics-20131020 0 r 4.4
statistics-20131020 0 r 4.9
statistics-20131021 0 p 4.4
statistics-20131021 0 p 4.9
statistics-20131021 0 r 4.4
statistics-20131021 0 r 4.9
statistics-20131022 0 p 4.4
statistics-20131022 0 p 4.9
statistics-20131022 0 r 4.4
statistics-20131022 0 r 4.9
statistics-20131023 0 p 4.4
statistics-20131023 0 p 4.9
statistics-20131023 0 r 4.4
statistics-20131023 0 r 4.9
statistics-20131024 0 p 4.4
statistics-20131024 0 p 4.9
statistics-20131024 0 r 4.4
statistics-20131024 0 r 4.9
statistics-20131025 0 p 4.4
statistics-20131025 0 p 4.9
statistics-20131025 0 r 4.4
statistics-20131025 0 r 4.9
statistics-20131026 0 p 4.4
statistics-20131026 0 p 4.9
statistics-20131026 0 r 4.4
statistics-20131026 0 r 4.9
statistics-20131027 0 p 4.4
statistics-20131027 0 p 4.9
statistics-20131027 0 r 4.4
statistics-20131027 0 r 4.9
statistics-20131028 0 p 4.4
statistics-20131028 0 p 4.9
statistics-20131028 0 r 4.4
statistics-20131028 0 r 4.9
statistics-20131029 0 p 4.4
statistics-20131029 0 p 4.9
statistics-20131029 0 r 4.4
statistics-20131029 0 r 4.9
statistics-20131030 0 p 4.4
statistics-20131030 0 p 4.9
statistics-20131030 0 r 4.4
statistics-20131030 0 r 4.9
statistics-20131031 0 p 4.4
statistics-20131031 0 p 4.9
statistics-20131031 0 r 4.4
statistics-20131031 0 r 4.9
statistics-20131101 0 p 4.4
statistics-20131101 0 p 4.9
statistics-20131101 0 r 4.4
statistics-20131101 0 r 4.9
statistics-20131101 1 p 4.4
statistics-20131101 1 p 4.9
statistics-20131101 1 r 4.4
statistics-20131101 1 r 4.9
statistics-20131101 2 p 4.4
statistics-20131101 2 p 4.9
statistics-20131101 2 r 4.4
statistics-20131101 2 r 4.9
statistics-20131101 3 p 4.4
statistics-20131101 3 p 4.9
statistics-20131101 3 r 4.4
statistics-20131101 3 r 4.9
statistics-20131101 4 p 4.4
statistics-20131101 4 p 4.9
statistics-20131101 4 r 4.4
statistics-20131101 4 r 4.9
statistics-20131102 0 p 4.4
statistics-20131102 0 p 4.9
statistics-20131102 0 r 4.4
statistics-20131102 0 r 4.9
statistics-20131102 1 p 4.4
statistics-20131102 1 p 4.9
statistics-20131102 1 r 4.4
statistics-20131102 1 r 4.9
statistics-20131102 2 p 4.4
statistics-20131102 2 p 4.9
statistics-20131102 2 r 4.4
statistics-20131102 2 r 4.9
statistics-20131102 3 p 4.4
statistics-20131102 3 p 4.9
statistics-20131102 3 r 4.4
statistics-20131102 3 r 4.9
statistics-20131102 4 p 4.4
statistics-20131102 4 p 4.9
statistics-20131102 4 r 4.4
statistics-20131102 4 r 4.9
statistics-20131103 0 p 4.4
statistics-20131103 0 p 4.9
statistics-20131103 0 r 4.4
statistics-20131103 0 r 4.9
statistics-20131103 1 p 4.4
statistics-20131103 1 p 4.9
statistics-20131103 1 r 4.4
statistics-20131103 1 r 4.9
statistics-20131103 2 p 4.4
statistics-20131103 2 p 4.9
statistics-20131103 2 r 4.4
statistics-20131103 2 r 4.9
statistics-20131103 3 p 4.4
statistics-20131103 3 p 4.9
statistics-20131103 3 r 4.4
statistics-20131103 3 r 4.9
statistics-20131103 4 p 4.4
statistics-20131103 4 p 4.9
statistics-20131103 4 r 4.4
statistics-20131103 4 r 4.9
statistics-20131104 0 p 4.4
statistics-20131104 0 p 4.9
statistics-20131104 0 r 4.4
statistics-20131104 0 r 4.9
statistics-20131104 1 p 4.4
statistics-20131104 1 p 4.9
statistics-20131104 1 r 4.4
statistics-20131104 1 r 4.9
statistics-20131104 2 p 4.4
statistics-20131104 2 p 4.9
statistics-20131104 2 r 4.4
statistics-20131104 2 r 4.9
statistics-20131104 3 p 4.4
statistics-20131104 3 p 4.9
statistics-20131104 3 r 4.4
statistics-20131104 3 r 4.9
statistics-20131104 4 p 4.4
statistics-20131104 4 p 4.9
statistics-20131104 4 r 4.4
statistics-20131104 4 r 4.9
statistics-20131105 0 p 4.4
statistics-20131105 0 p 4.9
statistics-20131105 0 r 4.4
statistics-20131105 0 r 4.9
statistics-20131105 1 p 4.4
statistics-20131105 1 p 4.9
statistics-20131105 1 r 4.4
statistics-20131105 1 r 4.9
statistics-20131105 2 p 4.4
statistics-20131105 2 p 4.9
statistics-20131105 2 r 4.4
statistics-20131105 2 r 4.9
statistics-20131105 3 p 4.4
statistics-20131105 3 p 4.9
statistics-20131105 3 r 4.4
statistics-20131105 3 r 4.9
statistics-20131105 4 p 4.4
statistics-20131105 4 p 4.9
statistics-20131105 4 r 4.4
statistics-20131105 4 r 4.9
statistics-20131106 0 p 4.4
statistics-20131106 0 p 4.9
statistics-20131106 0 r 4.4
statistics-20131106 0 r 4.9
statistics-20131106 1 p 4.4
statistics-20131106 1 p 4.9
statistics-20131106 1 r 4.4
statistics-20131106 1 r 4.9
statistics-20131106 2 p 4.4
statistics-20131106 2 p 4.9
statistics-20131106 2 r 4.4
statistics-20131106 2 r 4.9
statistics-20131106 3 p 4.4
statistics-20131106 3 p 4.9
statistics-20131106 3 r 4.4
statistics-20131106 3 r 4.9
statistics-20131106 4 p 4.4
statistics-20131106 4 p 4.9
statistics-20131106 4 r 4.4
statistics-20131106 4 r 4.9
statistics-20131107 0 p 4.4
statistics-20131107 0 p 4.9
statistics-20131107 0 r 4.4
statistics-20131107 0 r 4.9
statistics-20131107 1 p 4.4
statistics-20131107 1 p 4.9
statistics-20131107 1 r 4.4
statistics-20131107 1 r 4.9
statistics-20131107 2 p 4.4
statistics-20131107 2 p 4.9
statistics-20131107 2 r 4.4
statistics-20131107 2 r 4.9
statistics-20131107 3 p 4.4
statistics-20131107 3 p 4.9
statistics-20131107 3 r 4.4
statistics-20131107 3 r 4.9
statistics-20131107 4 p 4.4
statistics-20131107 4 p 4.9
statistics-20131107 4 r 4.4
statistics-20131107 4 r 4.9
statistics-20131108 0 p 4.4
statistics-20131108 0 p 4.9
statistics-20131108 0 r 4.4
statistics-20131108 0 r 4.9
statistics-20131108 1 p 4.4
statistics-20131108 1 p 4.9
statistics-20131108 1 r 4.4
statistics-20131108 1 r 4.9
statistics-20131108 2 p 4.4
statistics-20131108 2 p 4.9
statistics-20131108 2 r 4.4
statistics-20131108 2 r 4.9
statistics-20131108 3 p 4.4
statistics-20131108 3 p 4.9
statistics-20131108 3 r 4.4
statistics-20131108 3 r 4.9
statistics-20131108 4 p 4.4
statistics-20131108 4 p 4.9
statistics-20131108 4 r 4.4
statistics-20131108 4 r 4.9
statistics-20131109 0 p 4.4
statistics-20131109 0 p 4.9
statistics-20131109 0 r 4.4
statistics-20131109 0 r 4.9
statistics-20131109 1 p 4.4
statistics-20131109 1 p 4.9
statistics-20131109 1 r 4.4
statistics-20131109 1 r 4.9
statistics-20131109 2 p 4.4
statistics-20131109 2 p 4.9
statistics-20131109 2 r 4.4
statistics-20131109 2 r 4.9
statistics-20131109 3 p 4.4
statistics-20131109 3 p 4.9
statistics-20131109 3 r 4.4
statistics-20131109 3 r 4.9
statistics-20131109 4 p 4.4
statistics-20131109 4 p 4.9
statistics-20131109 4 r 4.4
statistics-20131109 4 r 4.9
statistics-20131110 0 p 4.4
statistics-20131110 0 p 4.9
statistics-20131110 0 r 4.4
statistics-20131110 0 r 4.9
statistics-20131110 1 p 4.4
statistics-20131110 1 p 4.9
statistics-20131110 1 r 4.4
statistics-20131110 1 r 4.9
statistics-20131110 2 p 4.4
statistics-20131110 2 p 4.9
statistics-20131110 2 r 4.4
statistics-20131110 2 r 4.9
statistics-20131110 3 p 4.4
statistics-20131110 3 p 4.9
statistics-20131110 3 r 4.4
statistics-20131110 3 r 4.9
statistics-20131110 4 p 4.4
statistics-20131110 4 p 4.9
statistics-20131110 4 r 4.4
statistics-20131110 4 r 4.9
statistics-20131111 0 p 4.4
statistics-20131111 0 p 4.9
statistics-20131111 0 r 4.4
statistics-20131111 0 r 4.9
statistics-20131111 1 p 4.4
statistics-20131111 1 p 4.9
statistics-20131111 1 r 4.4
statistics-20131111 1 r 4.9
statistics-20131111 2 p 4.4
statistics-20131111 2 p 4.9
statistics-20131111 2 r 4.4
statistics-20131111 2 r 4.9
statistics-20131111 3 p 4.4
statistics-20131111 3 p 4.9
statistics-20131111 3 r 4.4
statistics-20131111 3 r 4.9
statistics-20131111 4 p 4.4
statistics-20131111 4 p 4.9
statistics-20131111 4 r 4.4
statistics-20131111 4 r 4.9
statistics-20131112 0 p 4.4
statistics-20131112 0 p 4.9
statistics-20131112 0 r 4.4
statistics-20131112 0 r 4.9

Those indices should be roughly the same size in snapshot.

I also took dir diff from subsequent backups:

--- before.3.txt 2014-10-16 21:39:05.559338129 +0400
+++ after.3.txt 2014-10-16 21:56:46.272597922 +0400
@@ -152,6 +152,26 @@
2014-10-16 17:25 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3m.part0
2014-10-16 17:25 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3m.part1
2014-10-16 17:25 21M s3://backups-es-statistics/indices/statistics-20140108/3/__3m.part2
+2014-10-16 17:48 436 s3://backups-es-statistics/indices/statistics-20140108/3/__3n
+2014-10-16 17:48 179 s3://backups-es-statistics/indices/statistics-20140108/3/__3o
+2014-10-16 17:48 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3p.part0
+2014-10-16 17:49 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3p.part1
+2014-10-16 17:48 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3p.part2
+2014-10-16 17:49 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3p.part3
+2014-10-16 17:48 18M s3://backups-es-statistics/indices/statistics-20140108/3/__3p.part4
+2014-10-16 17:48 459k s3://backups-es-statistics/indices/statistics-20140108/3/__3q
+2014-10-16 17:48 7M s3://backups-es-statistics/indices/statistics-20140108/3/__3r
+2014-10-16 17:48 34 s3://backups-es-statistics/indices/statistics-20140108/3/__3s
+2014-10-16 17:48 2k s3://backups-es-statistics/indices/statistics-20140108/3/__3t
+2014-10-16 17:48 16M s3://backups-es-statistics/indices/statistics-20140108/3/__3u
+2014-10-16 17:49 81M s3://backups-es-statistics/indices/statistics-20140108/3/__3v
+2014-10-16 17:48 57 s3://backups-es-statistics/indices/statistics-20140108/3/__3w
+2014-10-16 17:48 2M s3://backups-es-statistics/indices/statistics-20140108/3/__3x
+2014-10-16 17:49 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3y.part0
+2014-10-16 17:49 87M s3://backups-es-statistics/indices/statistics-20140108/3/__3y.part1
+2014-10-16 17:49 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3z.part0
+2014-10-16 17:49 100M s3://backups-es-statistics/indices/statistics-20140108/3/__3z.part1
+2014-10-16 17:49 21M s3://backups-es-statistics/indices/statistics-20140108/3/__3z.part2
2014-09-30 19:39 959k s3://backups-es-statistics/indices/statistics-20140108/3/__4
2014-09-30 19:39 53M s3://backups-es-statistics/indices/statistics-20140108/3/__5
2014-09-30 19:39 100M s3://backups-es-statistics/indices/statistics-20140108/3/__6.part0
@@ -205,3 +225,4 @@
2014-10-15 08:46 5k s3://backups-es-statistics/indices/statistics-20140108/3/snapshot-statistics-2014-10-14
2014-10-16 08:41 5k s3://backups-es-statistics/indices/statistics-20140108/3/snapshot-statistics-2014-10-15
2014-10-16 17:25 5k s3://backups-es-statistics/indices/statistics-20140108/3/snapshot-statistics-2014-10-16
+2014-10-16 17:49 5k s3://backups-es-statistics/indices/statistics-20140108/3/snapshot-statistics-2014-10-16-again

Cluster consists of 5 nodes on 1.3.2.

cc @imotov