crush: include CRUSH_V3, v2/v3 rules checks in dump_tunables()

Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
rbdmap: per-device post-map/pre-unmap hooks

There are cases when automatic (un-)mounting of file system on RBD is not
enough. Some services may need to be started when RBD device becomes
available (mapped) as well as it may be desirable to stop services in order
to release file system before unmapping RBD device.

File system(s) on RBD is not the only use case scenario. RBD devices may be
used as block devices in which case `/etc/fstab` is not sufficient to
perform action upon mapping RBD device. A handler script (hook) can be
useful to properly release RBD device before unmapping, etc.

Pre-unmap hooks can be important for clean shut down and for re-exporting
RBD device(s) as (iSCSI,AoE,DRBD) etc.

This commit introduces support for per-device hooks to perform per-device
post-map/pre-unmap actions. If hook named like "poolname/imagename" (same
as in `/etc/ceph/rbdmap` file) is found in

    /etc/ceph/rbd.d/poolname/imagename

it is executed as

    /etc/ceph/rbd.d/poolname/imagename map poolname/imagename

following after attempt to mount file system (if relevant `fstab` entry
exist) following mapping of corresponding RBD device.

Before un-mounting file system and un-mapping RBD device hook is called as
follows:

    /etc/ceph/rbd.d/poolname/imagename unmap poolname/imagename

Second argument is intentional to allow multiple RBD devices to share the
same hook (symlinked under different names).

Sample hook to use RBD device as "mdadm" hot spare may look like this:

~~~~
DEV="$2"
case "$1" in
    "map")
        mdadm /dev/md2 --add --write-mostly "${DEV}"
    ;;
    "unmap")
        mdadm /dev/md2 --fail "${DEV}"
        sleep 2
        mdadm /dev/md2 --remove "${DEV}"
    ;;
esac
~~~~

Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
doc: Fixes a broken link on the rados deploy osd page.

Signed-off-by: Stephen Jahl <stephenjahl@gmail.com>
osd: fix confusing debug output for op_applied

Signed-off-by: Sage Weil <sage@inktank.com>
common/admin_socket: remove dead code

Signed-off-by: John Spray <john.spray@redhat.com>
mon: remove unused attribute notified_global_id

Signed-off-by: John Spray <john.spray@redhat.com>
client: include ID in mds_sessions asok

So that an admin can map a ceph-fuse process
reliably to an entry in the MDS session list.

Signed-off-by: John Spray <john.spray@redhat.com>
mds: add `session ls` and `session evict` to asok

These commands are intended to help admins deal
with MDSs during recovery, to identify troublesome
clients which may need intervention (such as eviction).

Signed-off-by: John Spray <john.spray@redhat.com>
ceph_test_rados_api_tier: fix [EC] HitSet{Read,Write,Trim} tests

The hit_set_ fields can only be set on tier pools as of
f131dfbaedf6f451572e7aa3a83f653912122953.

Fixes: #8823
Signed-off-by: Sage Weil <sage@inktank.com>
doc/release-notes: some additional warnings and recommendations against adjusting tunables

Several users are having troubles related to the overhead of the data
rebalance from adjusting tunables.

Signed-off-by: Sage Weil <sage@redhat.com>
Merge pull request #2097 from sjahl/master

doc: Fixes a broken link on the rados deploy osd page.

Reviewed-by: John Wilkins <john.wilkins@inktank.com>
Merge pull request #2102 from ceph/wip-8823

ceph_test_rados_api_tier: fix [EC] HitSet{Read,Write,Trim} tests

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
XfsFileStoreBackend: default to disabling extsize on xfs

This appears to be responsible for the deep scrub mismatches on some rbd
workloads.

Fixes: 8830
Signed-off-by: Samuel Just <sam.just@inktank.com>
Merge pull request #2103 from ceph/wip-8830

XfsFileStoreBackend: default to disabling extsize on xfs

Reviewed-by: Sage Weil <sage@redhat.com>
Merge pull request #2098 from ceph/wip-dump-new-crush

crush: include CRUSH_V3, v2/v3 rules checks in dump_tunables()

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
qa: retire kclient-specific layout test

`cephfs set_layout` was broken and is now deprecated
in favour of using xattrs for layout.  Retire the
kclient-specific test.

Fixes: #8773

Signed-off-by: John Spray <john.spray@redhat.com>
cephfs: pool safety & print deprecation warning

Print a message indicating to users that this tool
is now deprecated in favour of vxattrs.

Signed-off-by: John Spray <john.spray@redhat.com>
doc: add cephfs layout documentation

This clarifies how to deal with layouts in CephFS
using vxattrs.  We can point people here if they
ask what they should use instead of the deprecated
`cephfs set_layout`.

Signed-off-by: John Spray <john.spray@redhat.com>
Merge pull request #2101 from ceph/wip-mds-session-asok-squash

Provide client session handling and information via the admin socket.

Reviewed-by: Greg Farnum <greg@inktank.com>
doc/release-notes: v0.80.4

Signed-off-by: Sage Weil <sage@redhat.com>