Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,411 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18411 Commits

Author SHA1 Message Date
Duo Zhang 9f5ef981f9 HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a4)
 2022-05-18 20:51:37 +08:00
Nick Dimiduk c47a2c3841 HBASE-26986 Trace a one-shot execution of a Master procedure 
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-18 13:08:42 +02:00
Nick Dimiduk 6bf8db8ec8 Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)" 
This reverts commit 04956ffe7e.
 2022-05-18 13:05:09 +02:00
Mohammad Arshad 04956ffe7e HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394) 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit c198f23e5e)
 2022-05-17 10:59:59 +05:30
litao c4d7d55958 HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a)
 2022-05-17 10:44:40 +05:30
Andrew Purtell 2e4d9a2adf HBASE-27019 Minor compression performance improvements (#4420) 
TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.

Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-05-13 18:31:01 -07:00
Rushabh Shah 4ba62c82f8 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-13 18:25:23 -07:00
Tak Lon (Stephen) Wu 603f3f5d0c HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-13 13:30:39 -07:00
Duo Zhang 3ed733e865 HBASE-26999 Addendum fix spotless errors 2022-05-13 10:01:05 +08:00
Wellington Chevreuil d55c90ee87 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way 
(Amending spotless errors after revert by Duo)
 2022-05-12 11:12:06 +01:00
Duo Zhang 28f848a35e Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)" 
Revert due to failure spotless:check

This reverts commit aa31b0f695.
 2022-05-12 11:11:55 +01:00
Wellington Ramos Chevreuil ea37b782e1 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-12 11:11:42 +01:00
litao 78cad034a1
HBASE-27003 Optimize log format for PerformanceEvaluation (#4411) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-10 22:32:52 -07:00
Wellington Ramos Chevreuil cdc0975d2e HBASE-26999 HStore should try write WAL compaction marker before repl… (#4407) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 7b7f57619b)
 2022-05-09 15:15:04 +01:00
skysiders 38cd57c951
HBASE-26994 MasterFileSystem create directory without permission check (#4391) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-08 13:29:10 -07:00
Andrew Purtell ad74cd993f HBASE-26330 Document new provided compression codecs (#4396) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
 2022-05-07 11:26:19 -07:00
Rushabh Shah ffbdac12ca HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 2022-05-07 17:43:24 +00:00
litao 139fa2cff9
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-05 23:35:46 -07:00
huaxiangsun c337e391e2
HBASE-26984 Chaos Monkey thread dies in ITBLL Chaos GracefulRollingRestartRsAction (#4383) (#4409) 
There are two cases here:
  1. Chaos Monkey thread died and there is no chaos after that.
  2. Sometimes, regions are being moved back too quick that region server has not finished its initliazation yet.
     wait sometime to make sure that region server finishes its initialization.

Signed-off-by:  Wellington Chevreuil <wellington.chevreuil@gmail.com>
 2022-05-05 13:43:33 -05:00
Duo Zhang 622ee086fb HBASE-26995 Remove ref guide check in pre commit and nightly for branches other than master (#4399) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 9a41117ca5)
 2022-05-05 18:40:10 +08:00
Bryan Beaudreault 341ce509fe HBASE-26990 Add default implementation for BufferedMutator interface setters (#4387) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-03 15:12:01 -04:00
Duo Zhang 3a1536169e HBASE-26892 Add spotless:check in our pre commit general check (#4393) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 386869a428)
 2022-05-03 21:22:49 +08:00
Nick Dimiduk 48b1587d34 HBASE-26648 Improve fidelity of RegionLocator spans (addendum) 
Addendum extends the test case to cover both `RpcConnectionRegistry` and `ZKConnectionRegistry`.
 2022-05-03 13:47:35 +02:00
Nick Dimiduk ede80fb108 HBASE-26648 Improve fidelity of RegionLocator spans 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-03 13:47:35 +02:00
d-c-manning 44884eaa81 HBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
 2022-05-02 11:05:40 -07:00
Duo Zhang 1aea663c6d HBASE-26899 Run spotless:apply 2022-05-01 22:52:40 +08:00
Duo Zhang 8ac84a7f1d HBASE-26899 tweak pom and formatter 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 0edecbf9e0)
 2022-05-01 22:48:58 +08:00
Andrew Purtell 22211d2b27 HBASE-26992 Brotli compressor has unexpected behavior during reinitialization (#4389) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-04-30 09:12:40 -07:00
d-c-manning adc9d07385 HBASE-26988 dynamic configuration of loadbalance.bytable (#4384) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
 2022-04-29 15:28:23 -07:00
Duo Zhang 7b9fb0f047 HBASE-26917 Do not add --threads when running 'mvn site' (#4354) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f4eb9071fd)
 2022-04-29 17:49:43 +08:00
Duo Zhang c1c6ff9c3a HBASE-26932 Skip generating ref guide when running 'mvn site' on branch other than master (#4360) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 30908482c5)
 2022-04-29 08:17:59 +08:00
d-c-manning 6556350d4f HBASE-22349 slop in StochasticLoadBalancer (#4371) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/BalancerTestBase.java
 2022-04-28 14:35:01 -07:00
liangxs 27c3584f90 HBASE-26975 Add on heap and off heap memstore info in rs web UI (#4368) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit cdf81ea5cc)
 2022-04-28 23:15:27 +08:00
liangxs abedac5a2d HBASE-26980 Update javadoc of BucketCache.java (#4374) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c02e7553d4)
 2022-04-28 23:12:07 +08:00
Andrew Purtell 4b2ac4b38e HBASE-26979 StoreFileListFile logs frequent stacktraces at INFO level (#4373) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileListFile.java
 2022-04-27 18:03:50 -07:00
Bri Augenreich 3439c5bd90 HBASE-26581 Add metrics for failed replication edits (#4347) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-26 17:46:26 -04:00
Bryan Beaudreault 4fb47b4800 HBASE-26807 Addendum: adhere to maxAttempts in RawAsyncTableImpl.batch (#4370) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-04-25 13:25:59 -04:00
Wellington Ramos Chevreuil 47c62a9165 HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366) 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit af13c6d4c6)
 2022-04-25 14:20:14 +01:00
Andrew Purtell d90522163f HBASE-26959 Brotli compression support (#4353) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-04-22 16:55:23 -07:00
Ruanhui e2ac5a9338 HBASE-26942 cache region locations when getAllRegionLocations (#4364) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-22 15:31:53 -04:00
Bryan Beaudreault 6fae190413 HBASE-26891 Make MetricsConnection scope configurable (#4365) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-04-22 11:57:53 -04:00
Bryan Beaudreault dc86de467b HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-04-22 08:58:35 -04:00
Duo Zhang 96628db03d HBASE-25058 Export necessary modules when running under JDK11 (#4337) 
Singed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 82e47cde27)
 2022-04-21 23:50:24 +08:00
Duo Zhang 5c0c15b1c5 HBASE-26947 Implement a special TestAppender to limit the size of test output (#4340) 
Singed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 13d932cba3)
 2022-04-21 23:07:13 +08:00
Nick Dimiduk 903ffe22bf HBASE-26906 Remove duplicate dependency declaration 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-04-19 16:08:26 +02:00
Duo Zhang cd51da1d5a HBASE-26941 LocalHBaseCluster.waitOnRegionServer should not call join while interrupted (#4352) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 35aa57e445)
 2022-04-17 23:27:10 +08:00
Duo Zhang 450a54bed8 HBASE-26938 Compaction failures after StoreFileTracker integration (#4350) 
Introduce a StoreFileWriterCreationTracker to track the store files being written

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 48c4a4626e)
 2022-04-17 22:53:36 +08:00
Duo Zhang 07531728b1 HBASE-26946 TestRetainAssignmentOnRestartSplitWithoutZk infinite loop (#4344) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2622fa05a6)
 2022-04-16 13:24:07 +08:00
Pankaj 3510db4d2d HBASE-26944 Possible resource leak while creating new region scanner (#4339) 
* HBASE-26944 Possible resource leak while creating new region scanner

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 62e3efccef)
 2022-04-15 11:40:39 +05:30
Duo Zhang 785a54661f Revert "HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)" 
This reverts commit 29ce27c5d5.
 2022-04-13 11:53:00 +08:00