osd: log when scrub,deep scrub, repair starts

So it can be matched, in the logs, with the log messages announcing it
is complete.

http://tracker.ceph.com/issues/9817 Fixes: #9817

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
osd/ReplicatedPG: flush snaps immediately

Snaps are immutable, so there is no point in delaying flush and hoping
to capture additional updates first.

Signed-off-by: Sage Weil <sage@redhat.com>
OSD: batch trim for pg_log

Signed-off-by: Xinze Chi <xmdxcxz@gmail.com>
reserve a few feature bits

Make sure we have a bit of warning before we reach the end times.

Signed-off-by: Sage Weil <sage@redhat.com>
mon: use pre-encoded OSDMap for build_latest_full() MOSDMap message

Do not reencode; use our existing encoded bufferlist.

Signed-off-by: Sage Weil <sage@redhat.com>
osd: warn if reencoding and OSDMap with fewer features than the mon

It is very dangerous to reencode and OSDMap with fewer features than the
mon intended as we may be introducing a different variation of the same
OSDMap epoch into the wild.  Add a build warning here as well as this is
a potentially serious problem.

Signed-off-by: Sage Weil <sage@redhat.com>
osd: use encoded osdmap bl instead of reencoding

We have a good one on disk; there is no reason to do this.

Signed-off-by: Sage Weil <sage@redhat.com>
prevent random people from encoding the OSDMap

This is a safety check: nobody should be encoding OSDMaps except:

 - the mons
 - MOSDMap, when encoding old OSDMaps with legacy encodings
 - ceph-dencoder
 - the OSD

More importantly, nobody should be encoding OSDMap::Incremental except

 - the leader mon

We use a reserved feature bit to indicate that the encoder is enlightened.
Note that we skip this check for legacy encodings, so we don't touch
MOSDMap in this patch.

Signed-off-by: Sage Weil <sage@redhat.com>
add MMonGetOSDMap message

This message lets you explicitly request a range of full or incremental
maps from someone (the monitor, presumably), independent of any other
session state.

Signed-off-by: Sage Weil <sage@redhat.com>
mon/OSDMonitor: handle MMonGetOSDMap

Respond to MMonGetOSDMap with an MOSDMap filled with what we have.

Signed-off-by: Sage Weil <sage@redhat.com>
buffer: add iterator::get_bl()

Signed-off-by: Sage Weil <sage@redhat.com>
osd/OSDMap: encode crc

Note that we include the logic in OSDMap::encode to add data that comes
after the crc, although we do not use it yet.

Also note that we do not yet verify the crc on decode.

Signed-off-by: Sage Weil <sage@redhat.com>
mon/OSDMonitor: populate Incremental::full_crc

When we encode an Incremental, put in the expected crc for the resulting
full OSDMap.

Signed-off-by: Sage Weil <sage@redhat.com>
osd/OSDMap: verify CRC on decode

Signed-off-by: Sage Weil <sage@redhat.com>
AsyncMessenger: Eating up pipe buffer for waking up

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
AsyncMessenger: Release connection if stopped

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
AsyncMessenger: Normalise log informations

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
AsyncMessenger: Try send in queue bufferlist

If previous try_send failed to send all buffers, it will create write event
for next write. But if the message queue is empty and no need to send
in_seq_acked, handle_write will skip to send and in this condition buffers
in queue won't be send forever.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
AsyncMessenger: Fix large bufferlist send segment fault

If send long bufferlist exceed IOV_LEN(1024), try_send will stuck in looping
send the first IOV_LEN(1024) ptrs and raise segment fault.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
mon: fix formatted 'pg stat'

Previously it did a full pg dump, which is almost certainly not what the
user wants.

Signed-off-by: Sage Weil <sage@redhat.com>