[HBASE-8805] Added a test to verify that the compaction properties behave as expected when changed online

Author: gauravm

Summary: I wanted to verify that the compaction properties when changed online, behave as expected, and cause a change in the compaction algorithm (and not only test if the values are changing. Previous tests were geared towards that).

Test Plan: Unit Test

Reviewers: aaiyer, liyintang, adela, fan, manukranthk, rshroff, arjen

Reviewed By: fan

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D1031643

Task ID: 2842041

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1537574 13f79535-47bb-0310-9956-ffa450edef68
[master] Display start time of Master and RegionServer

Author: rsadziak

Summary: Added start time of Master and RegionServer

Test Plan: Start time can be viewed on info page of servers

Reviewers: gauravm

Reviewed By: gauravm

CC: bhall, hbase-eng@

Differential Revision: https://phabricator.fb.com/D1035550

Task ID: 2977295

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1538015 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-2856] [0.89-fb] [trunk version] Clean up the scannerReadPoing if there is an exception.

Author: aaiyer

Summary:
Clean up the scannerReadPoing if there is an exception.
See also https://phabricator.fb.com/D1037580

Test Plan: push to shadow and test

Reviewers: liyintang

Reviewed By: liyintang

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D1037582

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1538243 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-8185] Port the morse fix to trunk.

Author: manukranthk

Summary: Disabling the MVCC while doing a client side scan by passing the appropriate boolean. Fixed on the morse installation : https://phabricator.fb.com/D979753.

Test Plan: Tested on Morse. Observed that this prevents the code taking the MVCC code path.

Reviewers: aaiyer, rshroff, liyintang

Reviewed By: liyintang

CC: hbase-eng@, san

Differential Revision: https://phabricator.fb.com/D1014416

Task ID: 2966841

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1539104 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-9891] Add more counters to HTableMultiplexer

Author: gauravm

Summary: Adding the number of succeeded puts and retries in HTableMultiplexer.

Test Plan: Unit Test

Reviewers: liyintang, aaiyer, manukranthk, rshroff, adela, fan

Reviewed By: liyintang

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D1041574

Task ID: 3081647

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1539105 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-9896] Adds mappers/job option for HBaseStreaming

Author: rshroff

Summary:
Currently the split algo only supports mappers/region for any MR
job for HBase Streaming. The reason is to have locality of the
region server hosting the region and the mapper task.
However in certain scenarios, we need to have a strict limit on
the number of mappers per job.

This changes adds an additional parameter to control the total
number of mappers/job. The numMappersPerRegion  and numMappersPerJob
are mutually exclusive.

Test Plan: tested with various startRow/stopRow/num_mapper configs on SH004

Reviewers: manukranthk, liyintang

Reviewed By: liyintang

CC: hbase-eng@, chaoyc, nzhang

Differential Revision: https://phabricator.fb.com/D1032630

Task ID: 2381046

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1539432 13f79535-47bb-0310-9956-ffa450edef68
[master] Solve skipping data in HTable scans

Author: maxim

Summary:
The HTable client cannot retry a scan operation in the getRegionServerWithRetries code path.
This will result in the client missing data. This can be worked around using hbase.client.retries.number to 1.

The whole problem is that Callable knows nothing about retries and the protocol it dances to as well doesn't support retires.
This fix will keep Callable protocol (ugly thing worth merciless refactoring) intact but will change
ScannerCallable to anticipate retries.  What we want is to make failed operations to be identities for outside world:
 N1 * N2 * F3 * N3 * F4 * F4 * N4 ... = N1 * N2 * N3 * N4 ...
where Nk are successful operation and Fk are failed operations.

Test Plan: 1/ Enusure that new tests in TestScanRetries are working

Reviewers: manukranthk, liyintang, aaiyer

Reviewed By: manukranthk

CC: sfodor, aaiyer, jingweil, junfang, liyintang, peiyue, rishid, rshroff, san

Differential Revision: https://phabricator.fb.com/D1027350

Task ID: 2147851

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1539433 13f79535-47bb-0310-9956-ffa450edef68
[0.89-fb] [master] Enable ServerManager to pick up config changes online for resending messages

Author: aaiyer

Summary: Enable ServerManager to pick up config changes online for resending messages

Test Plan: added a unit test

Reviewers: gauravm

Reviewed By: gauravm

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D1046640

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1541201 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-9949] Fix the race condition between Compaction and StoreScanner.init

Author: manukranthk

Summary: The StoreScanner constructor has multiple stages and there can be a race betwwen an ongoing compaction and the StoreScanner constructor where we might get the list of scanners before a compaction and seek on those scanners after the compaction.

Test Plan: Unit tests

Reviewers: aaiyer, liyintang

Reviewed By: liyintang

CC: hbase-eng@, liyintang

Differential Revision: https://phabricator.fb.com/D1046675

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1541202 13f79535-47bb-0310-9956-ffa450edef68
[0.89-fb] [HBASE-9967] delete store files when a flush aborts

Author: pervyshev

Test Plan: unit test

Reviewers: aaiyer, liyintang, manukranthk, rshroff

Reviewed By: aaiyer

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D1049445

Task ID: 3111537

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1542033 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-9972] Make HBase export metrics to JMX by default, instead of to NullContext

Author: gauravm

Summary:
I was debugging the metrics issue in the swift branch, and found that HBase doesn't export to JMX by default. The JMX server is being spun-up anyways in single node setup, we might as well export the metrics to it.

Copied the hadoop-metrics.properties file from titan shadow 25.

Test Plan: Tested it by spinning up the cluster, and verifying that the metrics show up on JConsole

Reviewers: adela, manukranthk, fan, aaiyer

Reviewed By: adela

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D1057243

Task ID: 3193706

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1542373 13f79535-47bb-0310-9956-ffa450edef68