[HBASE-5032] Add Delete Column into the delete bloom filter

Author: adela

Summary:
https://issues.apache.org/jira/browse/HBASE-5032

Previously, the delete family bloom filter only contains the row key
which has the delete family. It helps us to avoid the top-row seek
operation.

This jira attempts to add the delete column into this delete bloom
filter as well (rename the delete family bloom filter as delete bloom
filter).

The motivation is to save seek ops for scan time-range queries if we
know there is no delete column for this row/column.
We can seek directly to the exact timestamp we are interested in,
instead of seeking to the latest timestamp and keep skipping to find
out whether there is any delete column before the interested timestamp.

Test Plan: write unit tests

Reviewers: kannan, liyintang, kranganathan

Reviewed By: liyintang

CC: erling, hbase-eng@

Differential Revision: https://phabricator.fb.com/D622271

Task ID: 849012, 1980066

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459466 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-7903] Add the partial rows, max response size, prefetch options to streaming

Author: rshroff

Summary:
Adds the partial rows, max response size, batchsize and prefetch options
to the TableInputFormat for HBase streaming.

Test Plan:
Test it on SH004. Scanned a 1.3G row.
http://hbase185.frc1.facebook.com.:50060/tasklog?taskid=attempt_201302121607_3232_m_000000_0&all=true

O/P file: https://phabricator.fb.com/P1997817

Reviewers: liyintang, pritam

Reviewed By: liyintang

CC: nzhang, hbase-eng@

Differential Revision: https://phabricator.fb.com/D715153

Task ID: 2120016

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459467 13f79535-47bb-0310-9956-ffa450edef68
[0.89-fb] [HBASE-7852] fix TestLoadIncrementalHFiles

Author: aaiyer

Summary:
TestIncrementalHFiles  does not use the Tool.run() mechanism to
do the bulk load.

In order to fix the test, ensure that we pick up the default options in
the constructor. If Tool.run() is called, the default options are overridden.

Test Plan: TestLoadIncrementalHFiles

Reviewers: liyintang

Reviewed By: liyintang

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D718323

Blame Revision: https://phabricator.fb.com/D693206

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459468 13f79535-47bb-0310-9956-ffa450edef68
[0.89-fb] 	[HBASE-5783] Fix a possible ConcurrentModificationException

Author: aaiyer

Summary: Fix possible ConcurrentModificationException

Test Plan: unit tests

Reviewers: adela, liyintang

Reviewed By: adela

CC: hbase-eng@, manukranthk

Differential Revision: https://phabricator.fb.com/D719424

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459469 13f79535-47bb-0310-9956-ffa450edef68
[Master]Optimize HRegionServer.updateOutboundMsgs and HRegionServer.addOutboundMsgs

Author: adela

Summary: Optimizing the two methods to execute in O(n).

Test Plan: will run unittests

Reviewers: aaiyer, liyintang, kannan

Reviewed By: aaiyer

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D715356

Task ID: 2124466

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459470 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-8082] Fixing NullPointerException in org.apache.hadoop.hbase.regionserver.HRegion.RegionScanner.nextRows

Author: manukranthk

Summary:
On occurance of IOException in the scanprefetch call,
the function should throw the exception instead of proceeding.

Test Plan: Unit tests on MR

Reviewers: liyintang, kranganathan, rshroff

Reviewed By: liyintang

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D735284

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459471 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-8083] Adds more information for HBase RetriesExhaustedExceptions

Author: rshroff

Summary:
The RetriesExhaustedException is the most common exception thrown to the
HBase client. Currently it just has a string which is either a text
message or set of exceptions converted into a text message.

For better diagnosability on the client side we need give more
information about these exceptions.

The change adds a new class HRegionFailureInfo which stores:
1. ServerName
2. RegionName
3. Exceptions encountered

This class is a part of RetriesExhaustedException and the clients can
use new methods to get more information about the exception.

Test Plan:
Added a few unit tests. Running MR unit test suite now.
Sample output https://phabricator.fb.com/P2010393

Reviewers: aaiyer, liyintang

Reviewed By: liyintang

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D723010

Task ID: 2121042

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459472 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-8111] Avoids un necessary DNS lookup for master web ui page

Author: rshroff

Summary:
Currently, whenever you load the master web ui, it will fetch the
hostname by giving the address to generate the RS url. This is a DNS
lookup, which might be slow sometimes. Hence, when we have a lot of RS like
SH003(349), these DNS timeouts cause the loading of the web ui to fail.

This failure will lead to alarm when the cluster goes into production.

The fix is to use already cached hostName to avoid the DNS lookup.

Test Plan:
tested it on SH003
http://hbaseproxy001.prn1.facebook.com/hbase_master/searchhbase003-frc1/master.jsp

Reviewers: liyintang, aleksandr

Reviewed By: aleksandr

CC: arjen, aleksandr, hbase-eng@

Differential Revision: https://phabricator.fb.com/D739051

Task ID: 2185822

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459473 13f79535-47bb-0310-9956-ffa450edef68
[HBASE-8113] Bring back the seek+read functionality to Pluto.

Author: manukranthk

Summary: It was observed that the seek + read gives better performance than pread when performing relatively large scans(scan which cannot be cached). Hence reverting [HBASE-7408] Removes the pread/seek+read option and defaults it to pread(D661385). Currently this feature is intended to be used only with the ClientSideScan(D708638). This can be potentially made configurable in the future.

Test Plan: Unit test on MR

Reviewers: liyintang, rshroff

Reviewed By: liyintang

CC: hbase-eng@

Differential Revision: https://phabricator.fb.com/D736962

Task ID: 2179482

git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1459474 13f79535-47bb-0310-9956-ffa450edef68