Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,347 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

2564 Commits

Author SHA1 Message Date
Jan Hentschel ae781e569c
HBASE-23837 Removed deprecated isLegalFamilyName(byte[]) from HColumnDescriptor 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-02-15 21:19:51 +01:00
Sakthi 5f61df4792
HBASE-22827 Expose multi-region merge in shell and Admin API (#1138) 
mergeRegionsAsync admin API with two regions as parameters deprecated since 2.3.0 and removed from 4.0
merge_region shell command now supports multiple regions merge since 2.3.0 & 3.0.0

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2020-02-13 14:40:46 -08:00
maoling 12f98bc50e
HBASE-20623: Introduce the helper method "getCellBuilder()" to Mutation (#1121) 
Signed-off-by: stack <stack@apache.org>
 2020-02-10 10:03:35 -08:00
Michael Stack 661abeb730 HBASE-23780 Edit of test classifications (#1109) 
These classifications come of running at various fork counts.. A test
may complete quick if low fork count but if it is accessing disk, it
will run much slower if fork count is high. This edit accommodates
some of this phenomenon.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
 2020-02-03 10:28:19 -08:00
stack 98cff8a26a HBASE-23753 Update of errorprone generated failures 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionInfo.java
hbase-server/src/main/java/org/apache/hadoop/hbase/executor/EventHandler.java
 Complains about mismatch in types when Compare. Implement Compare in
 base Interface.

hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
 Complains pbs never return null.

hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSinkManager.java
 Needed redo because errorprone complains can't mock Service from guava.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionReplicasWithRestartScenarios.java
hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestSnapshotScannerHDFSAclController.java
 Unrelated...adding one-liner debug statements chasing other test
 failures.
 2020-01-28 18:54:35 -08:00
Josh Elser fd9e19c12e HBASE-23722 Real user might be null in non-proxy-user case 
Closes #1085

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-01-23 16:02:01 -05:00
Josh Elser ae6a2de560 HBASE-23709 Unwrap the real user to properly dispatch proxy-user auth'n 
REST and Thrift servers started failing because the check in
BuiltinProviderSelector wasn't checking the "real" user for kerberos
credentials. This resulted in the KerberosAuthnProvider not being
invoked when it should have been.

Closes #1080

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2020-01-22 10:12:06 +01:00
Michael Stack ba3463d9de HBASE-23055 Alter hbase:meta (#1043) 
Make hbase:meta region schema dynamic.

Patch has been under development a good while and its focus has changed
a few times so its bloated with fixup from older versions.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZNodePaths.java
 Shut down access to internals and removed unused methods.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/EnableTableProcedure.java
 Cleanup/refactor section on replica-handling.

M hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
 Get hbase:meta schema from filesystem rather than from hard-coding.
 2020-01-21 15:02:40 -08:00
Peter Somogyi 00e64d83e8
HBASE-23347 Allow custom authentication methods for RPCs; addendum (#1060) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-01-21 18:47:13 +01:00
Nick Dimiduk 00fc46756a
HBASE-23653 Expose content of meta table in web ui (#1020) 
Adds a display of the content of 'hbase:meta' to the Master's
table.jsp, when that table is selected. Supports basic pagination,
filtering, &c.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-01-16 08:46:39 -08:00
Josh Elser 04d789f1a7 HBASE-23347 Allow custom authentication methods for RPCs 
Decouple the HBase internals such that someone can implement
their own SASL-based authentication mechanism and plug it into
HBase RegionServers/Masters.

Comes with a design doc in dev-support/design-docs and an example in
hbase-examples known as "Shade" which uses a flat-password file
for authenticating users.

Closes #884

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-01-16 10:27:28 -05:00
Viraj Jasani 0bf933b068
HBASE-23662 : Keep HCD constructor until shell usages are replaced 2020-01-12 16:55:01 -08:00
stack c8496bc694 Revert "HBASE-23055 Alter hbase:meta" 
This reverts commit 9abdb7b5ae.
 2020-01-11 09:17:17 -08:00
Viraj Jasani 2e0edacf72
HBASE-23662 : Replace HColumnDescriptor(String cf) with ColumnFamilyDescriptor 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
 2020-01-10 20:42:21 -08:00
stack 9abdb7b5ae HBASE-23055 Alter hbase:meta 
Make it so hbase:meta can be altered. TableState for hbase:meta
    was hardcoded ENABLED. Make it dynamic. State is now kept in
    current active Master. It is transient so falls back to default
    if Master crashes. Add to registry a getMetaTableState
    which reads mirrored state from zookeeper (NOT from Master and
    defaults ENABLED if no implementation or error fetching state).
    hbase:meta schema will be bootstrapped from the filesystem.
    Changes to filesystem schema are atomic so we should be ok if
    Master fails mid-edit (TBD). Undoes a bunch of guards that
    prevented our being able to edit hbase:meta.

    TODO: Tests, more clarity around hbase:meta table state, and undoing
    references to hard-coded hbase:meta regioninfo.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
     Throw illegal access exception if you try to use MetaTableAccessor
     getting state of the hbase:meta table.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
     Add fetching of hbase:meta table state from registry. Adds cache of
     tablestates w/ a ttl of 1 second (adjustable).

    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawAsyncHBaseAdmin.java
      Add querying registry for hbase:meta table state.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ZKAsyncRegistry.java
      Add querying of mirrored table state for hbase:meta table.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZNodePaths.java
     Shutdown access.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/TableDescriptors.java
     Just cleanup.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
     Add state holder for hbase:meta. Removed unused methods.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStateStore.java
     Shut down access.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/DisableTableProcedure.java
     Allow hbase:meta to be disabled.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/EnableTableProcedure.java
     Allow hbase:meta to be enabled.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-01-09 16:25:16 -08:00
Nick Dimiduk af3bb1feca HBASE-23333 Include Call.toShortString() in sendCall exceptions 2020-01-03 11:08:55 -08:00
stack d75a7001b1 HBASE-23369 Auto-close 'unknown' Regions reported as OPEN on RegionServers 
Master force-closes unknown/incorrect Regions OPEN on RS

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Added a note and small refactor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Fix an NPE when CJ ran.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Minor clean up of log message; make it clearer.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 Make it so closeRegionSilentlyAndWait can be used w/o timeout.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 If a RegionServer Report notes a Region is OPEN and the Master does not
 know of said Region, close it (We used to crash out the RegionServer)

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStateNode.java
 Minor tweak of toString -- label should be state, not rit (confusing).

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStates.java
 Doc.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/TransitRegionStateProcedure.java
 Add region name to exception.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/HBCKServerCrashProcedure.java
 Be more careful about which Regions we queue up for reassign. This
 procedure is run by the operator so could happen at any time. We
 will likely be running this when Master has some accounting of
 cluster members so check its answers for what Regions were on
 server before running.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 Doc and we were misrepresenting the case where a Region as not in RIT
 when we got CLOSE -- we were reporting it as though it was already
 trying to CLOSE.
 2020-01-03 10:25:18 -08:00
stack db7fb063d1 HBASE-23596 HBCKServerCrashProcedure can double assign 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

Change its behavior so it will only look in hbase:meta
if the call to the super class turns up zero references.
Only then will it search hbase:meta for references to
'Unknown Servers'. Normal operation where we read Master
context is usual and sufficient. The scan of hbase:meta
is only for case where Master state has been corrupted
and we need to clear out 'Unknown Servers'.
 2020-01-02 14:33:54 -08:00
belugabehr 280b94434c HBASE-23628: Remove Apache Commons Digest Base64 (#977) 
Signed-off-by: stack <stack@apache.org>
 2020-01-02 12:06:19 -08:00
Viraj Jasani e32dbe8ed2
HBASE-23590 : Update maxStoreFileRefCount to maxCompactedStoreFileRefCount for auto region recovery based on old reader references 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-01-01 22:16:54 +05:30
Duo Zhang 1b049a2d34
HBASE-23326 Implement a ProcedureStore which stores procedures in a HRegion (#941) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-12-25 12:02:12 +08:00
XinSun 270eb9886e HBASE-23376 NPE happens while replica region is moving (#906) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-12-19 15:11:04 +08:00
Ankit Singhal 29d1a97482 HBASE-23065 [hbtop] Top-N heavy hitter user and client drill downs 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-12-16 23:44:05 +09:00
Junegunn Choi ec317a6629 HBASE-23582 Unbalanced braces in string representation of table descriptor 
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
 2019-12-16 10:35:14 +01:00
Bharath Vissapragada efa4fe901a HBASE-23575 Remove dead code in AsyncRegistry (#929) 
Removes a bunch of dead code and fixes some checkstyle nits.

Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-12-13 13:26:03 -06:00
stack b0233a294f HBASE-23554 Encoded regionname to regionname utility (#923); ADDENDUM 2019-12-11 11:02:59 -08:00
Michael Stack 8742265d85 HBASE-23554 Encoded regionname to regionname utility (#923) 
Adds shell command regioninfo:

  hbase(main):001:0>  regioninfo '0e6aa5c19ae2b2627649dc7708ce27d0'
  {ENCODED => 0e6aa5c19ae2b2627649dc7708ce27d0, NAME => 'TestTable,,1575941375972.0e6aa5c19ae2b2627649dc7708ce27d0.', STARTKEY => '', ENDKEY => '00000000000000000000299441'}
  Took 0.4737 seconds

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-12-11 08:57:59 -08:00
Nick Dimiduk 8548463e74
HBASE-23373 Log `RetriesExhaustedException` context with full time precision (#903) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-12-06 11:05:58 -08:00
XinSun 27cfe1bb27 HBASE-23345 Table need to replication unless all of cfs are excluded (#881) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-12-03 13:35:23 +08:00
Wellington Ramos Chevreuil 636fa2c6b0
HBASE-23313 [hbck2] setRegionState should update Master in-memory sta… (#864) 
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-11-27 08:41:23 +00:00
bsglz dbbba7932c HBASE-23334 The table-lock node of zk is not needed since HBASE-16786 (#873) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2019-11-25 19:49:31 +08:00
Wellington Ramos Chevreuil 3b0c276aa3
HBASE-23329 Remove unused methods from RequestConverter (#870) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-11-22 14:33:22 +00:00
Michael Stack 54ad797abb HBASE-23328 info:regioninfo goes wrong when region replicas enabled (#863) 
Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
 2019-11-21 22:58:24 -08:00
belugabehr 33bedf8d4d HBASE-23308: Review of NullPointerExceptions (#836) 
Signed-off-by: stack <stack@apache.org>
 2019-11-19 13:51:11 -08:00
stack ca6e67a6de HBASE-23315 Miscellaneous HBCK Report page cleanup 
* Add a bit of javadoc around SerialReplicationChecker.
 * Miniscule edit to the profiler jsp page and then a bit of doc on how to make it work that might help.
 * Add some detail if NPE getting BitSetNode to help w/ debug.
 * Change HbckChore to log region names instead of encoded names; helps doing diagnostics; can take region name and query in shell to find out all about the region according to hbase:meta.
 * Add some fix-it help inline in the HBCK Report page – how to fix.
 * Add counts in procedures page so can see if making progress; move listing of WALs to end of the page.
 2019-11-19 07:34:24 -08:00
stack f8f9a26cb3 HBASE-23282 HBCKServerCrashProcedure for 'Unknown Servers' 
Have the existing scheduleRecoveries launch a new HBCKSCP
instead of SCP. It gets regions to recover from Master
in-memory context AND from a scan of hbase:meta. This
new HBCKSCP is For processing 'Unknown Servers', servers that
are 'dead' and purged but still have references in
hbase:meta. Rare occurance but needs tooling to address.
Later have catalogjanitor take care of these deviations
between Master in-memory and hbase:meta content (usually
because of overdriven cluster with failed RPCs to hbase:meta,
etc)

Changed expireServers in ServerManager so could pass in
custom reaction to expired server.... This is how we
run our custom HBCKSCP while keeping all other aspects
of expiring services (rather than try replicate it
externally).
 2019-11-18 14:28:55 -08:00
Mingliang Liu 8bfdfe1b85 HBASE-23289 Update links to Hadoop wiki in book and code 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2019-11-18 08:58:07 -08:00
Udai Bhan Kashyap b5e8727617 HBASE-22969 A new binary component comparator(BinaryComponentComparator) to perform comparison of arbitrary length and position (#829) 
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
 2019-11-18 13:28:06 +01:00
Karthik Palanisamy 8f92a14cd1 HBASE-23203 NPE in RSGroup info (#747) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-10-25 08:43:34 +08:00
Viraj Jasani 14dcf1d0c6 HBASE-22460 : Reopen regions with very high Store Ref Counts (#600) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2019-10-23 21:16:47 +05:30
Viraj Jasani 2ad62b0162 HBASE-22679 : Revamping CellUtil (#735) 
* HBASE-22679 : Revamping CellUtil

* checkstyle fix

* incorporating review

* minor indentation
 2019-10-21 23:04:21 -07:00
Wellington Ramos Chevreuil 4d414020bb
HBASE-23136 (#712) 
* HBASE-23136 PartionedMobFileCompactor bulkloaded files shouldn't get replicated (addressing buklload replication related issue raised in HBASE-22380)

Signed-off-by: Josh Elser <elserj@apache.org>
 2019-10-18 15:07:11 +01:00
meiyi 946f1e9e25
HBASE-23170 Admin#getRegionServers use ClusterMetrics.Option.SERVERS_NAME (#721) 2019-10-18 09:35:35 +08:00
Guanghao Zhang 7924ba39e7
HBASE-23155 May NPE when concurrent AsyncNonMetaRegionLocator#updateCachedLocationOnError (#718) 2019-10-15 11:16:43 +08:00
Karthik Palanisamy c0a09ccbbd HBASE-23152 Compaction_switch does not work by RegionServer name (#713) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 Signed-off-by: stack <stack@apache.org>
 2019-10-12 09:08:20 -07:00
Wellington Chevreuil 38b06c7517 Revert "HBASE-23136 PartionedMobFileCompactor bulkloaded files shouldn't get replicated" 
This reverts commit fec4c52499.
 2019-10-11 14:45:29 +01:00
Viraj Jasani 2f0b3ac91c HBASE-23093 Avoid Optional Anti-Pattern where possible (#673) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-10-11 15:28:50 +08:00
Wellington Ramos Chevreuil fec4c52499
HBASE-23136 PartionedMobFileCompactor bulkloaded files shouldn't get replicated 
Signed-off-by: stack <stack@apache.org>
 2019-10-10 10:37:42 +01:00
Istvan Toth 800c35a30e HBASE-23119 ArrayIndexOutOfBoundsException in PrivateCellUtil#qualifierStartsWith (#688) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
 2019-10-04 15:13:03 +02:00
stack 2ebdcbc3b0 Revert " HBASE-23055 Alter hbase:meta (#667)" 
Revert because new feedback and requested survey of master usage
figuring table state.

This reverts commit 52176184df.
 2019-10-01 09:24:10 -07:00
Michael Stack 52176184df
HBASE-23055 Alter hbase:meta (#667) 
Make it so hbase:meta can be altered. TableState for hbase:meta
    is kept in Master. State is in-memory transient so if  Master
    fails, hbase:meta is ENABLED again. hbase:meta schema will be
    bootstrapped from the filesystem. Changes to filesystem schema
    are atomic so we should be ok if Master fails mid-edit (TBD)
    Undoes a bunch of guards that prevented our being able to edit
    hbase:meta. At minimmum, need to add in a bunch of WARNING.

    TODO: Tests, more clarity around hbase:meta table state, and undoing
    references to hard-coded hbase:meta regioninfo.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
     Throw illegal access exception if you try to use MetaTableAccessor
     getting state of the hbase:meta table.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
     For table state, go to master rather than go to meta direct. Going
     to meta won't work for hbase;meta state. Puts load on Master.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
     Change isTableDisabled/Enabled implementation to ask the Master instead.
     This will give the Master's TableStateManager's opinion rather than
     client figuring it for themselves reading meta table direct.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawAsyncHBaseAdmin.java
     TODO: Cleanup in here. Go to master for state, not to meta.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ZKAsyncRegistry.java
     Logging cleanup.

    M hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZNodePaths.java
     Shutdown access.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/TableDescriptors.java
     Just cleanup.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
     Add state holder for hbase:meta.
     Removed unused methods.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStateStore.java
     Shut down access.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/DisableTableProcedure.java
     Allow hbase:meta to be disabled.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/EnableTableProcedure.java
     Allow hbase:meta to be enabled.

 Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
 2019-09-30 09:29:51 -07:00
Viraj Jasani 944108c38a HBASE-22903 : Table to RegionStatesCount metrics - Use for broken alter_status command (#611) 
Signed-off-by: huzheng <openinx@gmail.com>
 2019-09-30 17:35:22 +08:00
Wellington Ramos Chevreuil 3ae353cbf4
HBASE-22380 break circle replication when doing bulkload (#566) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-09-21 14:02:18 +01:00
Stig Døssing 0ec0a9403f HBase-22027: Split non-MR related parts of TokenUtil off into a Clien… (#361) 
* HBase-22027: Split non-MR related parts of TokenUtil off into a ClientTokenUtil, and move ClientTokenUtil to hbase-client

* Replace uses of deprecated TokenUtil methods with ClientTokenUtil methods. Make methods that don't need to be public package-private

* Don't use reflection where not necessary in TestClientTokenUtil

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-09-19 12:42:04 -07:00
Peter Somogyi 1655360951 Revert "HBASE-22700 refactor isMetaClearingException (#501)" 
This reverts commit cb62f73406.
 2019-09-19 13:21:22 +02:00
Guanghao Zhang 20bfb43db6
HBASE-23044 CatalogJanitor#cleanMergeQualifier may clean wrong parent regions (#637) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-09-19 08:08:49 +08:00
johnhomsea cb62f73406 HBASE-22700 refactor isMetaClearingException (#501) 2019-09-17 10:02:37 -07:00
Viraj Jasani 0dbae8f0e1 HBASE-23024 Replace initcause with Constructor arg (#627) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-09-17 13:39:26 +02:00
Viraj Jasani 1dcc8ee50c HBASE-22760 : Pause/Resume/Query Snapshot Auto Cleanup Activity (#617) 2019-09-13 10:34:01 +05:30
Guanghao Zhang a58149827b HBASE-23014 Should not show split parent regions in hbck report UI (#609) 2019-09-11 10:07:25 -07:00
stack e9e6202f9c HBASE-22796 [HBCK2] Add fix of overlaps to fixMeta hbck Service 
Signed-off-by: Sakthi <sakthi@apache.org>
 2019-09-10 17:04:06 -07:00
Duo Zhang 4ca760fe9d Revert "HBASE-22664 Move protobuf stuff in hbase-rsgroup to hbase-protocol-shaded (#362)" 
This reverts commit d36436408e.
 2019-09-10 11:14:37 +08:00
Duo Zhang 936bb82908 Revert "HBASE-22695 Store the rsgroup of a table in table configuration (#426)" 
This reverts commit eab7d3d502.
 2019-09-10 11:14:17 +08:00
Duo Zhang eab7d3d502 HBASE-22695 Store the rsgroup of a table in table configuration (#426) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-09-10 10:47:44 +08:00
Duo Zhang d36436408e HBASE-22664 Move protobuf stuff in hbase-rsgroup to hbase-protocol-shaded (#362) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-09-10 10:47:44 +08:00
Duo Zhang 693f201f3d
HBASE-22963 Netty ByteBuf leak in rpc client implementation (#577) 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-09-08 21:54:09 +08:00
stack 960a5fdc2a HBASE-22970 split parents show as overlaps in the HBCK Report 
Check if overlap is split parent.

Cleaned up the HBCK Report page too with some notes that it is made of
two reports; have the two sections display the same.
 2019-09-03 14:48:04 -07:00
meiyi 1d1813de48
HBASE-22878 Show table throttle quotas in table jsp (#510) 2019-09-03 09:37:49 +08:00
ravowlga123 43e732c177 HBASE-22886 Code Coverage Improvement: Create Unit Tests for class ConnectionId 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-09-02 22:35:47 +02:00
chenxu14 d32bf8daed HBASE-22905 Avoid temp ByteBuffer allocation in (#538) 
BlockingRpcConnection#writeRequest
 2019-09-01 22:01:36 -07:00
meiyi 345c21dbe7 HBASE-22945 Show quota infos in master UI (#560) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-09-01 22:42:47 +08:00
syedmurtazahassan b642ee0418 HBASE-22766 Code Coverage Improvement: Create Unit Tests for ResultStatsUtil (#520) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-31 22:24:05 +08:00
Jan Hentschel 5106f2826e
HBASE-22744 Removed deprecated status and load classes in client module 
Signed-off-by: stack <stack@apache.org>
 2019-08-27 19:46:08 +02:00
wuguihu 2d4580106a
HBASE-21400 correct spelling error of 'initilize' in comment 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-08-23 21:31:41 +02:00
Jan Hentschel 808f051b8a
HBASE-22755 Removed deprecated methods from Mutation 
Signed-off-by: stack <stack@apache.org>
 2019-08-23 20:56:19 +02:00
Jan Hentschel 1b50404f34
HBASE-22844 Fixed Checkstyle violations in client snapshot exceptions 
Signed-off-by: stack <stack@apache.org>
 2019-08-21 10:30:26 +02:00
Itsuki Toyota 78f5d8ebb2 HBASE-22833 MultiRowRangeFilter should provide a method for creating… (#493) 
* HBASE-22833: MultiRowRangeFilter should provide a method for creating a filter which is functionally equivalent to multiple prefix filters

* Delete superfluous comments

* Add description for MultiRowRangeFilter constructor

* Add null check for rowKeyPrefixes

* Fix checkstyle

Signed-off-by: huzheng <openinx@gmail.com>
 2019-08-16 09:59:01 +08:00
Sakthi e69af5affe HBASE-22845 Revert MetaTableAccessor#makePutFromTableState access to public (#489) 
HBCK2 is dependent on it
 2019-08-13 11:26:21 -07:00
Duo Zhang 07ab9ed237 Revert "HBASE-22699 refactor isMetaClearingException (#436)" 
This reverts commit 009851d680.
 2019-08-13 16:54:06 +08:00
johnhomsea 009851d680 HBASE-22699 refactor isMetaClearingException (#436) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-12 15:57:21 +08:00
Jan Hentschel 3867fae04d
HBASE-22829 Removed deprecated methods from SnapshotDescription 
Signed-off-by: stack <stack@apache.org>
 2019-08-12 08:41:05 +02:00
syedmurtazahassan 15c903b3f8 HBASE-22725 Remove all remaining Javadoc warnings 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-08-11 21:48:08 +02:00
stack 1b168cd6de HBASE-22777 Add a multi-region merge (for fixing overlaps) 
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.

Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.

Most of code below is undoing the assumption that there are two
parents on a merge only.
 2019-08-07 15:22:07 -07:00
stack 30805be078 HBASE-22771 [HBCK2] fixMeta method and server-side support 
This is a first cut at this patch. Implements hold fixing only
currently.

Add a fixMeta method to Hbck Interface.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Bug fix. If hole is on end of last table, I wasn't seeing it.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
 Add a general meta fixer class. Explains up top why this stuff doesn't
 belong inside MetaTableAccessor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Break out the filesystem messing so don't have to copy it nor do more
 than is needed doing fixup for Region holes.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
 Change behavious slightly. If directory exists, don't fail as we did
 but try and keep going and create .regioninfo file if missing (or
 overwrite if in place). This should make it idempotent. Can rerun
 command. Lets see if any repercussions in test suite.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
 Add test.

Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-08-05 22:08:31 -07:00
Jan Hentschel da114ac727
HBASE-22785 Fixed Checkstyle issues in exceptions and enhanced Javadoc 
Signed-off-by: stack <stack@apache.org>
 2019-08-05 15:05:49 +02:00
Jan Hentschel b021c364fe
HBASE-22786 Fixed Checkstyle issues in tests in hbase-client 
Signed-off-by: stack <stack@apache.org>
 2019-08-05 11:52:53 +02:00
Wellington Chevreuil 237229cade HBASE-22707 [HBCK2] MasterRpcServices assigns method should try to reload regions from meta if the passed regions isn't found under AssignmentManager RegionsStateStore 
Signed-off-by: stack <stack@apache.org>
 2019-08-01 16:49:57 +01:00
Guanghao Zhang 35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425) 
Signed-off-by: stack <stack@apache.org>
 2019-08-01 08:54:47 +08:00
Jan Hentschel 24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module" 
This reverts commit 4a61c8b10a.
 2019-07-31 12:29:19 +02:00
Jan Hentschel 586e177ded HBASE-22753 Removed deprecated ImmutableHRegionInfo (#420) 
Signed-off-by: stack <stack@apache.org>
 2019-07-31 08:07:31 +02:00
Thanh NM 5ce31dd120 HBASE-22714 - Fix opertationTimeout typo (#392) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-30 21:57:06 +08:00
Jan Hentschel 4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module 
Signed-off-by: stack <stack@apache.org>
 2019-07-30 12:40:42 +02:00
Jan Hentschel f9fd5b65fa HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor (#419) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-07-30 12:32:10 +02:00
Jan Hentschel 46a432386e
HBASE-22746 Removed deprecated methods from Delete 
Signed-off-by: stack <stack@apache.org>
 2019-07-30 08:52:19 +02:00
openinx c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta (#424) 2019-07-30 14:16:08 +08:00
stack 0c80d5b42b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta 
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-07-29 16:00:57 -07:00
Jan Hentschel 41490e792a HBASE-22754 Removed deprecated methods from Increment (#421) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-07-29 09:10:51 +02:00
Jan Hentschel c68e2f274a HBASE-22756 Removed deprecated method from SingleColumnValueFilter (#422) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-07-29 09:10:00 +02:00
Jan Hentschel e273d0bc3a
HBASE-22748 Removed deprecated methods from Put 
Signed-off-by: stack <stack@apache.org>
 2019-07-29 08:50:16 +02:00
Jan Hentschel 3318b4bc6d
HBASE-22745 Removed deprecated methods from Append 
Signed-off-by: stack <stack@apache.org>
 2019-07-27 15:19:56 +02:00
Viraj Jasani 9615c644f5 HBASE-22648 Snapshot TTL (#371) 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-07-22 15:03:44 -07:00
Guanghao 48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-19 08:03:06 +08:00
syedmurtazahassan 9f343c2efa HBASE-22571 Javadoc Warnings related to @return tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-13 13:34:48 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
 2019-07-01 21:15:00 -07:00
huzheng 532ebfb7a5 HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool 2019-06-24 10:25:31 +08:00
zhangduo ac3d09e7fd HBASE-22577 BufferedMutatorOverAsyncBufferedMutator.tryCompleteFuture consume too much CPU time 2019-06-18 08:43:35 +08:00
zhangduo 6278c98f5d HBASE-22550 Throw exception when creating thread pool if the connection has already been closed 2019-06-18 08:43:35 +08:00
zhangduo 492a105e5d HBASE-22526 RejectedExecutionException could be thrown from TableOverAsyncTable.coprocessor service if the connection has been shutown 2019-06-18 08:43:35 +08:00
Duo Zhang a116e0bab1 HBASE-21723 Remove ConnectionImplementation and related classes 2019-06-18 08:43:35 +08:00
Duo Zhang bd109506f3 HBASE-22223 Implement RegionLocator based on AsyncTableRegionLocator 2019-06-18 08:43:35 +08:00
zhangduo d1487fcfad HBASE-21725 Implement BufferedMutator Based on AsyncBufferedMutator 2019-06-18 08:43:35 +08:00
Duo Zhang d64d015f51 HBASE-21718 Implement Admin based on AsyncAdmin 2019-06-18 08:43:32 +08:00
Duo Zhang 6b87a4ce98 HBASE-21717 Implement Connection based on AsyncConnection 2019-06-18 08:37:51 +08:00
zhangduo b7793d7d1d HBASE-21585 Remove ClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 2182bfb942 HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 72d9f8747f HBASE-21778 Remove the usage of the locateRegion related methods in ClusterConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-06-18 08:35:59 +08:00
Duo Zhang d005d6f30a HBASE-21671 Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
Duo Zhang 7593e86c5f HBASE-21538 Rewrite RegionReplicaFlushHandler to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
zhangduo 04f737d9bd HBASE-21579 Use AsyncClusterConnection for HBaseInterClusterReplicationEndpoint 2019-06-18 08:35:58 +08:00
zhangduo 5d872d3422 HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin 2019-06-18 08:35:58 +08:00
zhangduo 2446f0026b HBASE-21516 Use AsyncConnection instead of Connection in SecureBulkLoadManager 2019-06-18 08:35:58 +08:00
zhangduo 30c131b5f7 HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer 2019-06-18 08:35:58 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208) 
Signed-off-by: stack <stack@apache.org>
 2019-06-17 22:02:23 +02:00
Apache9 9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface (#309) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
 2019-06-17 10:18:18 +08:00
Jan Hentschel ed30909d27
HBASE-19303 Removed ReplicationAdmin and all its usages 
Signed-off-by: stack <stack@apache.org>
 2019-06-16 16:20:04 +02:00
Jan Hentschel 47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation 
Signed-off-by: stack <stack@apache.org>
 2019-06-16 16:13:46 +02:00
Andrew Purtell 8e15f4ed61
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-06-13 17:42:26 -07:00
Duo Zhang 04a91f961e HBASE-22569 Should treat null consistency as Consistency.STRONG in ConnectionUtils.timelineConsistentRead 2019-06-13 08:20:19 +08:00
Jan Hentschel f62028593f HBASE-22262 Removed deprecated methods from Filter class 2019-06-10 00:47:15 +02:00
zhangduo 1b3914067e HBASE-22477 Throwing exception when meta region is not in OPEN state in client registry may crash a master 2019-06-08 14:06:38 +08:00
Philippe Laflamme 2ae3b4883b HBASE-21415 Snapshot requests can be done concurrently and the master will simply run them sequentially. 
Co-authored-by: Josh Elser <elserj@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-06-04 12:14:26 -04:00
meiyi 073de44445
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set 2019-06-03 16:55:23 +08:00
Andrew Purtell 98a1552687
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:04:16 -07:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
zhangduo b74df9b747 HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:54:29 +08:00
Andrew Purtell 81953d3e00
Amend HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions 
Sync Javadoc updates from branch-1 and branch-2 backports
 2019-05-14 12:59:10 -07:00
Andrew Purtell a9de9f5f28
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-05-14 11:56:16 -07:00
Duo Zhang 083605df8f HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:20 +08:00
zhangduo 0b8493f886 HBASE-21658 Addendum fix infinite wait when there are no meta locations yet 2019-05-14 08:12:36 +08:00
zhangduo df27820958 HBASE-21658 Should get the meta replica number from zk instead of config at client side 2019-05-11 09:22:00 +08:00
Jan Hentschel 2c7fdb39ce HBASE-22277 Removed deprecated methods from Get 2019-05-01 01:25:53 +02:00
Duo Zhang 3f40df8085 HBASE-22325 AsyncRpcRetryingCaller will not schedule retry if we hit a NotServingRegionException but there is no TableName provided 2019-04-30 15:12:35 +08:00
Duo Zhang f9f6354393 HBASE-22322 Use special pause for CallQueueTooBigException 2019-04-30 10:05:09 +08:00
Sakthi 5b07ee9953 HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-04-29 14:44:10 +08:00
Duo Zhang 4477dd5de8 HBASE-22317 Support reading from meta replicas 2019-04-28 15:46:59 +08:00
Duo Zhang 0db0491a9e Revert "HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table" 
This breaks TestQuotaTableUtil.testDeleteSnapshots.

This reverts commit fe7cf10272.
 2019-04-26 10:00:02 +08:00
Sean Busbey bf140acd20 HBASE-22083 move eclipse settings into a profile. 
Signed-off-by: stack <stack@apache.org>
 2019-04-25 14:17:18 -05:00
Duo Zhang ec36372649 HBASE-22307 Addendum deprecated PreemptiveFastFailException 2019-04-25 16:54:35 +08:00
Yu Li ab3d6cf811
HBASE-22283 Print row and table information when failed to get region location 2019-04-24 15:44:13 +08:00
李小保 7617b71f00 HBASE-22250 The same constants used in many places should be placed in constant classes 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 21:24:14 -07:00
Sakthi fe7cf10272 HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-04-23 19:20:38 -04:00
zouxiangwen 6855143ba9 HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 07:56:59 -07:00
Jan Hentschel 3dfa98ffc1 HBASE-22258 Removed deprecated methods in VisibilityClient 2019-04-23 16:45:02 +02:00
Michael Stack da286b9087
Merge pull request #158 from hextriclosan/HBASE-22047 
HBASE-22047 LeaseException in Scan should be retried
 2019-04-23 06:18:43 -07:00
Jan Hentschel 1f0e43a27a HBASE-22232 Removed deprecated methods in CompareFilter 2019-04-23 13:25:17 +02:00
zhangduo c3c48f30f7 HBASE-22279 Add a getRegionLocator method in Table/AsyncTable interface 2019-04-22 18:37:23 +08:00
zhangduo 38ff46f88f HBASE-22282 Should deal with error in the callback of RawAsyncHBaseAdmin.splitRegion methods 2019-04-22 16:44:38 +08:00
zhangduo b0075a160a HBASE-22278 RawAsyncHBaseAdmin should not use cached region location 2019-04-21 22:04:01 +08:00
zhangduo eb912bb1da HBASE-22261 Make use of ClusterStatusListener for async client 2019-04-21 22:03:43 +08:00
Jan Hentschel 226c90c058 HBASE-22276 Removed deprecated UnmodifyableHRegionInfo 2019-04-21 10:46:58 +02:00
zhangduo 0645d5a033 HBASE-22267 Implement client push back for async client 2019-04-21 16:31:49 +08:00
Jan Hentschel f30d6c958a HBASE-22231 Removed unused and '*' imports 2019-04-20 22:03:32 +02:00
zhangduo 353f9226c3 HBASE-22236 AsyncNonMetaRegionLocator should not cache HRegionLocation with null location 2019-04-20 08:56:11 +08:00
zhangduo a3d2a2df3a HBASE-22244 Make use of MetricsConnection in async client 2019-04-18 22:13:27 +08:00
Jan Hentschel f4aaf735e4 HBASE-22259 Removed deprecated method in ReplicationLoadSource 2019-04-18 11:32:55 +02:00
Sayed Anisul Hoque 09f484b1a0 HBASE-22260 Removed deprecated methods in ReplicationLoadSink 2019-04-18 08:44:22 +02:00
Igor Rudenko 375ac55d77 HBASE-22047 LeaseException in Scan should be retried 2019-04-16 20:03:29 +03:00
Sayed Anisul Hoque 88de644736 HBASE-22243 Removed deprecated method in Result 2019-04-15 16:46:10 +02:00
Jan Hentschel 7d1399caa7 HBASE-22242 Removed deprecated method in RegionLoadStats 2019-04-15 08:45:18 +02:00
Jan Hentschel 9c13dde84b HBASE-22228 Removed deprecated ThrottlingException 2019-04-13 10:50:10 +02:00
Jan Hentschel 37e93c311a HBASE-22227 Removed deprecated fields in ServerSideScanMetrics 2019-04-13 10:48:39 +02:00
Jan Hentschel bc58adac5b HBASE-22187 Removed remaining usages of ClusterConnection.clearRegionCache 2019-04-12 09:58:20 +02:00
Josh Elser 2bae04fb2b HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-04-11 17:49:39 -04:00
stack 387a5da462 HBASE-22155 Move 2.2.0 on to hbase-thirdparty-2.2.0 2019-04-09 09:40:19 -07:00
Jingyun Tian bd2f04dd54 HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-04-09 19:56:18 +08:00
meiyi d32f924ef4 HBASE-22117 Move hasPermission/checkPermissions from region server to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-09 17:01:01 +08:00
zhangduo 11547b79f3 HBASE-22178 Introduce a createTableAsync with TableDescriptor method in Admin 2019-04-07 21:06:00 +08:00
zhangduo 0247466210 HBASE-22179 Fix RawAsyncHBaseAdmin.getCompactionState 2019-04-07 08:31:44 +08:00
zhangduo 0ca97d482a HBASE-22177 Do not recreate IOException in RawAsyncHBaseAdmin.adminCall 2019-04-07 08:30:31 +08:00
Duo Zhang 04937baf7b HBASE-22158 RawAsyncHBaseAdmin.getTableSplits should filter out none default replicas 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-04-05 22:14:36 +08:00
Duo Zhang 3e8152837e HBASE-22157 Include the cause when constructing RestoreSnapshotException in restoreSnapshot 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-04-04 10:45:14 +08:00
zhangduo cd2374a7f0 HBASE-22108 Avoid passing null in Admin methods 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-02 21:13:17 +08:00
zhangduo 1c4e705592 HBASE-22135 AsyncAdmin will not refresh master address 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-01 09:23:43 +08:00
pingsutw 51dda380a6 HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-30 20:41:19 +08:00
zhangduo 7fe31b060f HBASE-22121 AsyncAdmin can not deal with non default meta replica 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-30 20:18:44 +08:00
Sakthi caa9650a70 HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-27 20:14:12 +08:00
pingsutw 56dd309b21 HBASE-22102 Remove AsyncAdmin.isTableAvailable(TableName, byte[][]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-27 17:45:01 +08:00
meiyi 7b3ff56202 HBASE-21911 Move getUserPermissions from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-27 11:22:21 +08:00
zhangduo 5f6143ebde HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition 2019-03-26 18:13:59 +08:00
yaojingyi f8524b8f8e HBASE-21964 unset Quota by Throttle Type 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-26 09:42:50 +08:00
zhangduo 386703811d Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back" 
This reverts commit 7e3ca7063c.
 2019-03-24 13:51:34 +08:00
pingsutw 21cb00eef6 HBASE-22064 Remove Admin.deleteSnapshot(byte[]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-23 21:27:12 +08:00
Jingyun Tian 7e3ca7063c HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:11:50 +08:00
niuyulin cbd9c9b2e1 HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-21 22:35:45 +08:00
xujunhong 556b98101c HBASE-22063 Deprecated Admin.deleteSnapshot(byte[]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-21 22:28:10 +08:00
Rishabh Jain b4b4854371 HBASE-22042 Missing @Override annotation for RawAsyncTableImpl.scan 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-19 17:01:20 +08:00
meiyi 86dd92cccb HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-19 14:41:22 +08:00
pingsutw f65bf79d1d HBASE-22056 Unexpected blank line in ClusterConnection 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-03-18 15:54:29 -04:00
zhangduo cc55835d03 HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-18 20:45:21 +08:00
Duo Zhang f1ebbb928b HBASE-22039 Should add the synchronous parameter for the XXXSwitch method in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-16 10:05:54 +08:00
Nihal Jain 01e5af5a34 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-03-15 12:16:58 -04:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-14 21:42:23 +08:00
zhangduo 10ca598004 HBASE-22001 Polish the Admin interface 
Signed-off-by: stack <stack@apache.org>
 2019-03-11 14:38:31 +08:00
Norbert Kalmar 8d3e7517e6 HBASE-21416 - fix TestRegionInfoDisplay flaky test 2019-03-08 09:18:17 -08:00
zhangduo 6e3987cf02 HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-08 18:03:00 +08:00
johnhomsea 63d0e6ed4a HBASE-22000 Deprecated isTableAvailable with splitKeys 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-03-07 09:18:01 +08:00
zhangduo c9804758d1 HBASE-21983 Should track the scan metrics in AsyncScanSingleRegionRpcRetryingCaller if scan metrics is enabled 2019-03-03 19:08:23 +08:00
zhangduo 1e12e88492 HBASE-21978 Should close AsyncRegistry if we fail to get cluster id when creating AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-03 08:19:07 +08:00
meiyi 841a45afb7 HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 23:41:48 +08:00
Syeda 030b4d12fb HBASE-21487 Concurrent modify table ops can lead to unexpected results 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 13:00:19 +08:00
Duo Zhang cbdbe6572b HBASE-21976 Deal with RetryImmediatelyException for batching request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 12:14:16 +08:00
meiyi 9370347efe HBASE-21820 Implement CLUSTER quota scope 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-27 18:23:45 +08:00
Duo Zhang b1c42f1009 HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-27 17:54:50 +08:00
Guanghao Zhang 6e06a0d790 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-27 15:45:42 +08:00
Duo Zhang c33ceb23d3 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-26 11:21:55 +08:00
zhangduo aa7d3ce39f HBASE-21944 Validate put for batch operation 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 20:19:51 +08:00
zhangduo b73f03e0cb Revert "HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client" 
This reverts commit 449ed0834b.
 2019-02-24 20:14:17 +08:00
zhangduo a47c1ddcd2 HBASE-21945 Maintain the original order when sending batch request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 17:55:49 +08:00
Duo Zhang 449ed0834b HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 17:34:12 +08:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-22 16:24:51 +08:00
Wellington Chevreuil 482b505796 HBASE-21505 - proposal for a more consistent report on status 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-02-22 12:08:38 +08:00
meiyi dfb95cfd83 HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-22 10:41:51 +08:00
meiyi 9a55cbb2c1 HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-21 15:36:37 +08:00
zhangduo a551149ca7 HBASE-21927 Always fail the locate request when error occur 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 19:47:28 +08:00
Jingyun Tian eedc33dfd2 Revert "HBASE-21505 - proposal for a more consistent report on status" 
This reverts commit c578020588.
 2019-02-20 18:06:42 +08:00
zhangduo e984515b74 HBASE-21928 Deprecated HConstants.META_QOS 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 14:16:40 +08:00
zhangduo e257f4698c HBASE-21930 Deal with ScannerResetException when opening region scanner 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 11:03:56 +08:00
Wellington Chevreuil c578020588 HBASE-21505 - proposal for a more consistent report on status 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-02-19 10:51:05 +08:00
Nihal Jain 593745e8ac HBASE-17942 Disable region splits and merges per table 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-19 07:15:27 +08:00
Duo Zhang 6176471957 HBASE-21907 Should set priority for rpc request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-18 19:46:17 +08:00
zhangduo dedab71381 HBASE-21909 Validate the put instance before executing in AsyncTable.put method 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-16 17:47:38 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-16 17:39:31 +08:00
Duo Zhang 81e1e2f943 HBASE-21910 The nonce implementation is wrong for AsyncTable 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-15 20:24:34 +08:00
Duo Zhang 8bed65fa01 HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-14 19:50:02 +08:00
Duo Zhang e06beb0d72 HBASE-21888 Add a isClosed method to AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-14 11:41:16 +08:00
zhangduo f1e5999ad2 HBASE-21859 Add clearRegionLocationCache method for AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-13 10:07:29 +08:00
zhangduo 28bc9a51e1 HBASE-21862 IPCUtil.wrapException should keep the original exception types for all the connection exceptions 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-10 09:37:14 +08:00
zhangduo 6f16836c20 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-02-08 19:47:37 +08:00
zhangduo 2b1b79f08b HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:24:54 +08:00
zhangduo 89c02dc0cc HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:13:45 +08:00
Tommy Li 513ba9ac59 HBASE-21775 ADDENDUM - fix TestAsyncProcess 2019-01-30 15:40:55 -08:00
wanghuan 16c7f5dac9 HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt' 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 15:56:25 +08:00
meiyi f997252344 HBASE-21739 Move grant/revoke from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 11:16:57 +08:00
Duo Zhang 7dc69b6128 HBASE-21792 Mark HTableMultiplexer as deprecated and remove it in 3.0.0 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-29 09:08:02 +08:00
zhangduo 274e4ccea8 HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:36:58 +08:00
Tommy Li e92b62be54 HBASE-21775 The BufferedMutator doesn't ever refresh region location cache 
Fix server location metadata refresh in multi-actions

Signed-off-by: stack <stack@apache.org>
 2019-01-26 13:10:22 -08:00
Duo Zhang 4f3b95b318 HBASE-21762 Move some methods in ClusterConnection to Connection 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-01-25 21:13:44 +08:00
meiyi 281558a3ab HBASE-21713 Support set region server throttle quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 13:50:42 +08:00
Wellington Chevreuil 54093b0d1f HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils 2019-01-24 20:55:15 -08:00
zhangduo e43c833145 HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 11:00:51 +08:00
zhangduo 416b70f461 HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-24 15:21:11 +08:00
xujunhong d4085d11bc HBASE-21715 set timeout instead of throwing Exception when calling ProcedureFuture.get in client side. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-01-24 14:55:12 +08:00
Kevin 250431144f HBASE-21716 Add toStringCustomizedValues to TableDescriptor 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-01-24 11:32:16 +08:00
Tommy Li d187af00ca HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-23 17:52:58 -08:00
Duo Zhang dfad304ddb HBASE-21753 Support getting the locations for all the replicas of a region 2019-01-23 18:09:39 +08:00
huzheng 35ed5d6c39 HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized 2019-01-22 19:58:03 +08:00
huzheng b0131e19f4 HBASE-21734 Some optimization in FilterListWithOR 2019-01-22 11:40:37 +08:00
Duo Zhang 882bd564f4 HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator 2019-01-19 11:14:35 +08:00
zhangduo 44dc872b7b HBASE-19695 Handle disabled table for async client 
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
 2019-01-17 18:34:12 +08:00
Duo Zhang 594341d6fe HBASE-21710 Add quota related methods to the Admin interface 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-16 21:08:47 +08:00
Duo Zhang 348cbf63ec HBASE-21732 Should call toUpperCase before using Enum.valueOf in some methods for ColumnFamilyDescriptor 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-01-16 20:46:14 +08:00
Peter Somogyi 51c58e083c HBASE-21727 Simplify documentation around client timeout 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-16 11:32:46 +01:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
Sakthi 93d4b95b3f HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE' 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-01-14 17:55:42 -07:00
zhangduo c5691a9f60 HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:40:52 +08:00
Duo Zhang fbf79373e6 HBASE-21663 Add replica scan support 2019-01-11 14:19:05 +08:00
Duo Zhang 7bebdff6a2 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:26:44 +08:00
meiyi 620d70d618 HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-09 22:02:21 +08:00
Sergey Shelukhin 37bc1686d6 HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-01-09 20:03:37 +08:00
zhangduo d957f0fa19 HBASE-21684 Throw DNRIOE when connection or rpc client is closed 2019-01-08 16:40:40 +08:00
zhangduo 4f0514e39a HBASE-21682 Support getting from specific replica 2019-01-08 09:49:12 +08:00
meiyi 77db1fae09 HBASE-21159 Add shell command to switch throttle on or off 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-07 14:21:41 +08:00
zhangduo db66e6cc9e HBASE-17356 Add replica get support 2019-01-03 08:38:20 +08:00
Sakthi b2bf22e209 HBASE-21631: list_quotas should print human readable values for LIMIT 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-22 22:00:58 +08:00
openinx e160b5ac8d HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-12-21 15:21:53 -08:00
Guanghao Zhang ad819380c7 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:49:24 +08:00
meiyi 1b08ba7385 HBASE-21578 Fix wrong throttling exception for capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-14 18:17:47 +08:00
Sakthi f88224ee34 HBASE-21453 Convert ReadOnlyZKClient to DEBUG instead of INFO 2018-12-11 08:18:02 +01:00
zhangduo b09b87d143 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 14:51:26 +08:00
Josh Elser 8a68f0d656 HBASE-21524 Fix logging in ConnectionImplementation.isTableAvailable() 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-29 11:40:06 -05:00
zhangduo 1acbd36c90 HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta 2018-11-26 14:51:56 +08:00
meiyi 5ded294419 HBASE-21034 Add new throttle type: read/write capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-21 09:46:49 +08:00
Reid Chan 130057f137 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table) 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-15 11:34:16 +08:00
Ben Lau d9f32137b6 HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-11-08 11:59:34 -08:00
tianjingyun 116eee6747
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-29 20:55:37 -07:00
Guanghao Zhang 23b7510ae2 HBASE-21365 Throw exception when user put data with skip wal to a table which may be replicated 2018-10-26 17:43:38 +08:00
Guanghao Zhang cd943419b6 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-25 16:22:36 -07:00
jingyuntian 5fbb227deb
HBASE-21269　Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:52 -07:00
Sahil Aggarwal e520399201
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup. 2018-10-17 21:04:27 -07:00
Michael Stack e736168567 HBASE-21303 [shell] clear_deadservers with no args fails 2018-10-12 11:19:56 -07:00
Nihal Jain 56ac4705e9
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 16:35:46 -07:00
Michael Stack 27369136be
HBASE-21223 [amv2] Remove abort_procedure from shell 
Signed-off-by: Balazs Meszaros <balazs.meszaros@cloudera.com>
 2018-09-25 11:29:15 -07:00
Guangxu Cheng 3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-09-21 16:06:39 -07:00
Umesh Agashe dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService 2018-09-19 15:18:16 -07:00
Michael Stack 3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign 
Adds 'raw' assigns and unassigns methods to Hbck Service.

Fixes HbckService so it works when cluster is Kerberized.
 2018-09-19 10:06:16 -07:00
Guangxu Cheng 3810ba2c6e HBASE-21179 Fix the number of actions in responseTooSlow log 2018-09-12 10:48:52 +08:00
Guangxu Cheng 2aae247e3f HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter 2018-09-10 21:32:46 +08:00
Toshihiro Suzuki a51c333856 HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck 2018-09-09 10:23:50 +09:00
Reid Chan 245bb44703 HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter 
Signed-off-by Ted Yu <yuzhihong@gmail.com>
 2018-09-04 11:09:21 +08:00
Toshihiro Suzuki bd0435892a HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online - addendum 2018-08-28 15:34:01 +09:00
Umesh Agashe 3813f0ac3d HBASE-20941 Created and implemented HbckService in master 
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
 2018-08-27 12:11:52 -07:00
subrat.mishra 8e1002913d HBASE-21030: Changed javadoc for append operation. 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2018-08-26 23:38:45 +09:00
liubangchen 72b36e1d9a HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-08-24 00:22:22 +08:00
zhangduo bb3494134e HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region 2018-08-21 06:12:09 +08:00
subrat.mishra 49ae8549cf HBASE-21040 Replace call to printStackTrace() with proper logger call 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-08-15 08:29:54 -07:00
jingyuntian 21e02813fe HBASE-20985 add two attributes when we do normalization 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-08-13 16:43:54 +08:00
Sakthi bd30ca62ef HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-08-03 11:06:50 -04:00
Michael Stack c365c4084e HBASE-20989 Minor, miscellaneous logging fixes 
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2018-08-01 11:20:59 -07:00
Reid Chan a8e184dc77 HBASE-20886 [Auth] Support keytab login in hbase client 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-07-31 11:04:40 +08:00
Allan Yang 44f6ef1c90 HBASE-20867 RS may get killed while master restarts 2018-07-25 18:16:28 +08:00
huzheng a888af3dc9 HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:29:24 +08:00
Ankit Singhal b4eacdabd6 HBASE-20901 Reducing region replica has no effect 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-19 13:38:32 -07:00
Mohit Goel 950d6e6fb0 HBASE-6028 Start/Stop compactions at region server level 
Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-19 06:20:44 -07:00
Balazs Meszaros 724e323494 HBASE-20853 Polish "Add defaults to Table Interface so Implementors don't have to" 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-19 19:38:43 +08:00
Mike Drob dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-13 12:59:36 -05:00
zhaoyuan 1e0650955a HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations() 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-07-11 10:52:06 +08:00
zhangduo d7561cee50 HBASE-20784 Will lose the SNAPSHOT suffix if we get the version of RS from ServerManager 2018-07-10 09:59:41 +08:00
Allan Yang 97c3984aa3 HBASE-20854 Wrong retries number in RpcRetryingCaller's log message 2018-07-09 15:29:53 +08:00
zhangduo b5222f88b2 HBASE-20822 TestAsyncNonMetaRegionLocator is flakey 2018-07-09 14:56:37 +08:00
Michael Stack 632aaef88b HBASE-20812 Add defaults to Table Interface so implementors don't have to 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-29 11:05:26 -07:00
Pankaj bb8826ca5f HBASE-20357 AccessControlClient API Enhancement 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-06-28 22:48:58 -07:00
zhangduo 63477d6251 HBASE-20810 Include the procedure id in the exception message in HBaseAdmin for better debugging 2018-06-29 11:40:44 +08:00
zhangduo 0789e15b5e HBASE-20790 Fix the style issues on branch HBASE-19064 before merging back to master 2018-06-28 18:08:43 +08:00
zhangduo a84cdbd579 HBASE-20783 Addendum fix broken TestSyncReplicationStandBy 2018-06-28 18:08:43 +08:00
huzheng f1806a11e6 HBASE-20783 NEP encountered when rolling update from master with an async peer to branch HBASE-19064 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-28 18:08:43 +08:00
zhangduo 39dd81a7c6 HBASE-19957 General framework to transit sync replication state 2018-06-28 18:07:44 +08:00
Guanghao Zhang 00e54aae24 HBASE-19935 Only allow table replication for sync replication for now 2018-06-28 18:07:44 +08:00
Guanghao Zhang 1481bd9481 HBASE-19864 Use protobuf instead of enum.ordinal to store SyncReplicationState 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-28 18:07:44 +08:00
Guanghao Zhang 2acebac00e HBASE-19781 Add a new cluster state flag for synchronous replication 2018-06-28 18:07:44 +08:00
Guanghao Zhang b4a1dbf768 HBASE-19078 Add a remote peer cluster wal directory config for synchronous replication 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-28 18:07:44 +08:00
Michael Stack 0db2b628d6
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do 
General log cleanup; setting stuff that can flood the log to TRACE.
 2018-06-25 12:13:04 -07:00
Michael Stack 959d9c16f3 HBASE-20710 extra cloneFamily() in Mutation.add(Cell); ADDENDUM checkstyle 2018-06-23 20:42:23 -07:00
Huaxiang Sun 79800e607c HBASE-20710 extra cloneFamily() in Mutation.add(Cell) 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-06-23 20:37:14 -07:00
zhangduo 14087cc919 HBASE-20775 TestMultiParallel is flakey 2018-06-22 21:32:07 +08:00
zhangduo 177458d9d0 HBASE-18569 Add prefetch support for async region locator 2018-06-22 18:25:31 +08:00
tedyu 98245ca6e4 HBASE-20740 StochasticLoadBalancer should consider CoprocessorService request factor when computing cost (chenxu) 2018-06-22 00:26:14 -07:00
zhangduo 7b716c964b HBASE-20752 Make sure the regions are truly reopened after ReopenTableRegionsProcedure 2018-06-22 14:04:33 +08:00
Ankit Singhal 72784c2d83 HBASE-20642 Clients should re-use the same nonce across DDL operations 
Also changes modify table operations to help the case where a MTP spans
two master, avoiding the sanity-checks propagating back to the client
unnecessarily.

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-06-20 14:56:10 -07:00
taiynlee d23a517b61 HBASE-20737 (addendum) put collection into ArrayList instead of addAll function -- RetriesExhaustedWithDetailsException.java 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-06-20 14:41:36 +08:00
zhangduo 6dbbd78aa0 HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup 2018-06-19 15:02:10 +08:00
Sean Busbey f1b536bad4 HBASE-20332 shaded mapreduce module shouldn't include hadoop 
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
 2018-06-18 11:31:04 -07:00
Rajeshbabu Chintaguntla 40f0a43462 HBASE-20635 Add missing shaded-pb conversion method for UserPermission 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-06-11 14:58:18 -04:00
Guanghao Zhang 5fd16f3853 HBASE-20698 Master don't record right server version until new started region server call regionServerReport method 2018-06-09 14:40:43 +08:00
EugeneNik 7d3750bd9f HBASE-20684 org.apache.hadoop.hbase.client.Scan#setStopRow javadoc uses incorrect method 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-05 21:57:51 +08:00
Josh Elser c17be2e622 HBASE-20640 Add missing test category and class rule 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-30 10:34:19 -04:00
Apekshit Sharma 92460c58aa HBASE-20594 Provide utility to get table desc delta 
Ammending Author: Mike Drob <mdrob@apache.org>

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2018-05-29 14:28:57 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-29 10:12:31 -05:00
huzheng 5721150c6d HBASE-20612 TestReplicationKillSlaveRSWithSeparateOldWALs sometimes fail because it uses an expired cluster conn 2018-05-23 12:07:01 +08:00
zhangduo 26babcf013 HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream 2018-05-15 20:56:20 +08:00