qa/workunits/hadoop/wordcount: remove bogus rm -r

Signed-off-by: Sage Weil <sage@redhat.com>
mds: restart on -EBLACKLISTED

Previously these cases would (hopefully) hit an
assert(r==0) in the various completion contexts,
and the MDS would "crash" from the user's point of view.

With the introduction of MDSIOContext, we have a single
place to filter all RADOS op responses, which also has
a handle to the global MDS instance.  Check result values
for -EBLACKLISTED and call MDS::respawn() in response.

Signed-off-by: John Spray <john.spray@redhat.com>
mds: make max file recovers configurable

Signed-off-by: Sage Weil <sage@redhat.com>
mds: change mds_max_file_recover from 5 -> 32

These are reasonably cheap operations (stat) and we should be too worried
about queueing up a bunch of them.

Ideally this sort of thing would magically tune to the throughput we can
get from the cluster, but until then, let's choose a default that works for
more users.

Signed-off-by: Sage Weil <sage@redhat.com>
mds/RecoveryQueue: add method to prioritize a file recovery; fix logging

Add a prioritize() method to make file recovery start immediately for the
given inode.  Note that this doesn't respect the max recovery limit: if
someone stats it, they are blocking, and we start the recovery immediately.

Also fix up the dout logging a bit so that everything is prefixed
consistently.

Signed-off-by: Sage Weil <sage@redhat.com>
mds/Locker: prioritize file recovery on rd/wr/x lock

If someone specifically touches the file lock, prioritize recovery for this
file.

Signed-off-by: Sage Weil <sage@redhat.com>
mds/Locker: if a client asks for file caps, prioritize file recovery

This normally happens when a process opens the file.  Prioritize in that
case.

Signed-off-by: Sage Weil <sage@redhat.com>
Cache tiering: use local_mtime to calculate the age of objects during
evicting

Commit 13b9dc70 introduces local_mtime to fix an issue when doing
flushing. Should also use this to calculate the object age when doing
evicting.

Signed-off-by: Zhiqiang Wang <wonzhq@hotmail.com>
Test: fixing a compile warning in ceph_objectstore_tool.cc

For the compiler's sake:
tools/ceph_objectstore_tool.cc:2547:15: warning: ‘r’ may be used
uninitialized in this function [-Wmaybe-uninitialized]

Signed-off-by: Zhiqiang Wang <wonzhq@hotmail.com>
erasure-code: preload the default plugins in the mon

The commit 9b802701f78288ba4f706c65b853415c69002d27 preloads the
supported plugins in the OSD. They must also be preloaded in the mon for
the same reasons.

http://tracker.ceph.com/issues/9273 Fixes: #9273

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
qa: fix+cleanup hadoop wordcount test

The glob for the examples jar was wrong.

Fixes: #9260

Signed-off-by: John Spray <john.spray@redhat.com>
Merge pull request #2340 from ceph/wip-blacklist-mds

mds: restart on -EBLACKLISTED

Reviewed-by: Sage Weil <sage@redhat.com>
Merge pull request #2355 from ceph/wip-hadoop

Wip hadoop

Reviewed-by: Sage Weil <sage@redhat.com>
Merge pull request #2354 from dachary/wip-9273-mon-preload-erasure-code

erasure-code: preload the default plugins in the mon

Reviewed-by: Sage Weil <sage@redhat.com>
Merge pull request #2352 from wonzhq/local-mtime

Cache tiering: use local_mtime to calculate the age of objects during evicting

Reviewed-by: Sage Weil <sage@redhat.com>
mds/RecoveryQueue: do not start prioritized items synchronously

When we prioritize an item move it into a second priority list/set, but
do not start immediately, so that we still obey the max.  When we go to
start an item, pull items first off the priority list, then off the regular
list.

Signed-off-by: Sage Weil <sage@redhat.com>
Merge pull request #2353 from wonzhq/compile-warn

Test: fixing a compile warning in ceph_objectstore_tool.cc

Reviewed-by: Sage Weil <sage@redhat.com>
Merge pull request #2258 from ceph/wip-mds-recover

mds: make max file recovers tunable

Reviewed-by: Yan, Zheng <ukernel@gmail.com>
Reviewed-by: John Spray <john.spray@redhat.com>
erasure-code: add ErasureCodeInterface::get_coding_chunk_count

Signed-off-by: Loic Dachary <loic@dachary.org>
erasure-code: relax profile parameter syntax

Do not restrict the character set of the key=value pairs of osd
erasure-code-profile set to allow for things like:

             layers='[
                       [ "_aAA_aAA", "" ],
                       [ "bBBB____", "" ],
                       [ "____cCCC", "" ],
                     ]'

Signed-off-by: Loic Dachary <loic@dachary.org>