Commit Graph

2169 Commits

Author SHA1 Message Date
stack 0c80d5b42b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:00:57 -07:00
Jan Hentschel 41490e792a HBASE-22754 Removed deprecated methods from Increment (#421)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:51 +02:00
Jan Hentschel c68e2f274a HBASE-22756 Removed deprecated method from SingleColumnValueFilter (#422)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:00 +02:00
Jan Hentschel e273d0bc3a
HBASE-22748 Removed deprecated methods from Put
Signed-off-by: stack <stack@apache.org>
2019-07-29 08:50:16 +02:00
Jan Hentschel 3318b4bc6d
HBASE-22745 Removed deprecated methods from Append
Signed-off-by: stack <stack@apache.org>
2019-07-27 15:19:56 +02:00
Viraj Jasani 9615c644f5 HBASE-22648 Snapshot TTL (#371)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-22 15:03:44 -07:00
Guanghao 48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-19 08:03:06 +08:00
syedmurtazahassan 9f343c2efa HBASE-22571 Javadoc Warnings related to @return tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 13:34:48 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:15:00 -07:00
huzheng 532ebfb7a5 HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool 2019-06-24 10:25:31 +08:00
zhangduo ac3d09e7fd HBASE-22577 BufferedMutatorOverAsyncBufferedMutator.tryCompleteFuture consume too much CPU time 2019-06-18 08:43:35 +08:00
zhangduo 6278c98f5d HBASE-22550 Throw exception when creating thread pool if the connection has already been closed 2019-06-18 08:43:35 +08:00
zhangduo 492a105e5d HBASE-22526 RejectedExecutionException could be thrown from TableOverAsyncTable.coprocessor service if the connection has been shutown 2019-06-18 08:43:35 +08:00
Duo Zhang a116e0bab1 HBASE-21723 Remove ConnectionImplementation and related classes 2019-06-18 08:43:35 +08:00
Duo Zhang bd109506f3 HBASE-22223 Implement RegionLocator based on AsyncTableRegionLocator 2019-06-18 08:43:35 +08:00
zhangduo d1487fcfad HBASE-21725 Implement BufferedMutator Based on AsyncBufferedMutator 2019-06-18 08:43:35 +08:00
Duo Zhang d64d015f51 HBASE-21718 Implement Admin based on AsyncAdmin 2019-06-18 08:43:32 +08:00
Duo Zhang 6b87a4ce98 HBASE-21717 Implement Connection based on AsyncConnection 2019-06-18 08:37:51 +08:00
zhangduo b7793d7d1d HBASE-21585 Remove ClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 2182bfb942 HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 72d9f8747f HBASE-21778 Remove the usage of the locateRegion related methods in ClusterConnection
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-06-18 08:35:59 +08:00
Duo Zhang d005d6f30a HBASE-21671 Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
Duo Zhang 7593e86c5f HBASE-21538 Rewrite RegionReplicaFlushHandler to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
zhangduo 04f737d9bd HBASE-21579 Use AsyncClusterConnection for HBaseInterClusterReplicationEndpoint 2019-06-18 08:35:58 +08:00
zhangduo 5d872d3422 HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin 2019-06-18 08:35:58 +08:00
zhangduo 2446f0026b HBASE-21516 Use AsyncConnection instead of Connection in SecureBulkLoadManager 2019-06-18 08:35:58 +08:00
zhangduo 30c131b5f7 HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer 2019-06-18 08:35:58 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208)
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
Apache9 9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface (#309)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
2019-06-17 10:18:18 +08:00
Jan Hentschel ed30909d27
HBASE-19303 Removed ReplicationAdmin and all its usages
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:20:04 +02:00
Jan Hentschel 47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:13:46 +02:00
Andrew Purtell 8e15f4ed61
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo)
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-13 17:42:26 -07:00
Duo Zhang 04a91f961e HBASE-22569 Should treat null consistency as Consistency.STRONG in ConnectionUtils.timelineConsistentRead 2019-06-13 08:20:19 +08:00
Jan Hentschel f62028593f HBASE-22262 Removed deprecated methods from Filter class 2019-06-10 00:47:15 +02:00
zhangduo 1b3914067e HBASE-22477 Throwing exception when meta region is not in OPEN state in client registry may crash a master 2019-06-08 14:06:38 +08:00
Philippe Laflamme 2ae3b4883b HBASE-21415 Snapshot requests can be done concurrently and the master will simply run them sequentially.
Co-authored-by: Josh Elser <elserj@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2019-06-04 12:14:26 -04:00
meiyi 073de44445
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set 2019-06-03 16:55:23 +08:00
Andrew Purtell 98a1552687
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:04:16 -07:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
zhangduo b74df9b747 HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:54:29 +08:00
Andrew Purtell 81953d3e00
Amend HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions
Sync Javadoc updates from branch-1 and branch-2 backports
2019-05-14 12:59:10 -07:00
Andrew Purtell a9de9f5f28
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225)
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-14 11:56:16 -07:00
Duo Zhang 083605df8f HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:20 +08:00
zhangduo 0b8493f886 HBASE-21658 Addendum fix infinite wait when there are no meta locations yet 2019-05-14 08:12:36 +08:00
zhangduo df27820958 HBASE-21658 Should get the meta replica number from zk instead of config at client side 2019-05-11 09:22:00 +08:00
Jan Hentschel 2c7fdb39ce HBASE-22277 Removed deprecated methods from Get 2019-05-01 01:25:53 +02:00
Duo Zhang 3f40df8085 HBASE-22325 AsyncRpcRetryingCaller will not schedule retry if we hit a NotServingRegionException but there is no TableName provided 2019-04-30 15:12:35 +08:00
Duo Zhang f9f6354393 HBASE-22322 Use special pause for CallQueueTooBigException 2019-04-30 10:05:09 +08:00
Sakthi 5b07ee9953 HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-04-29 14:44:10 +08:00
Duo Zhang 4477dd5de8 HBASE-22317 Support reading from meta replicas 2019-04-28 15:46:59 +08:00