Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,112 Commits 95 Branches 866 Tags
Commit Graph

8659 Commits

Author SHA1 Message Date
Duo Zhang
a1994ee152 HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit c3d0cc70400645f89af78c800003e734e9e49852)
 2022-03-14 11:24:45 +08:00
Duo Zhang
6cef9e1602 HBASE-25465 Use javac --release option for supporting cross version compilation (#4164) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-12 18:30:40 +08:00
Duo Zhang
5844b53dea HBASE-26802 Backport the log4j2 changes to branch-2 (#4166) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-hadoop-compat/pom.xml
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
	hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml
	hbase-shaded/hbase-shaded-client/pom.xml
	hbase-shaded/hbase-shaded-mapreduce/pom.xml
	hbase-shaded/hbase-shaded-testing-util/pom.xml
	hbase-shaded/pom.xml
	hbase-testing-util/pom.xml
 2022-03-11 11:38:37 -08:00
Xiaolin Ha
bf9233f511 HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-11 09:28:59 -08:00
Xiaolin Ha
70ec3beef4 HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-11 09:28:59 -08:00
Tak Lon (Stephen) Wu
b08321c08c HBASE-26729 Backport "HBASE-26714 Introduce path configuration for system coprocessors" to branch-2 (#4093) 
- rename from HBaseCommonTestingUtil to HBaseCommonTestingUtility

Signed-off-by: Ankit Singhal <ankit@apache.org>
 2022-03-11 09:28:59 -08:00
Nick Dimiduk
eebc2e0bbb HBASE-26819 Minor code cleanup in and around RpcScheduler 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:16:05 +01:00
Nick Dimiduk
775c020625 HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:08:54 +01:00
Andrew Purtell
057bc95268 HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME (#4204) 
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-11 15:13:06 +08:00
Andrew Purtell
cc256bd78f HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 (#4203) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-11 15:07:01 +08:00
Andrew Purtell
5386325acd HBASE-26582 Prune use of Random and SecureRandom objects (#4118) 
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 15:06:48 +08:00
Andrew Purtell
e8cca6d111 HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184) 
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-10 12:16:03 -08:00
Xiaolin Ha
99912c9783 HBASE-26552 Introduce retry to logroller to avoid abort (#4170) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-10 12:16:03 -08:00
Bryan Beaudreault
1f9e5a1f7c HBASE-26814 Addendum: Fix spotbugs warning and clarify intent (#4201) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-10 10:10:16 -08:00
Nick Dimiduk
9359449a3a HBASE-26782 Minor code cleanup in and around RpcExecutor 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-10 14:32:47 +01:00
Bryan Beaudreault
206100f515 HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on (#4194) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 14:44:29 -08:00
Bryan Beaudreault
8251e8d2c9 HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 12:03:12 -08:00
Bryan Beaudreault
6facc82585 HBASE-26784 Use HIGH_QOS for ResultScanner.close requests (#4163) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-08 11:42:12 -08:00
Nick Dimiduk
84eb868f98 HBASE-26764 Implement generic exception support for TraceUtil methods over Callables and Runnables 
For the `TraceUtil` methods that accept `Callable` and `Runnable` types, make them generic over a
child of `Throwable`. This allows us to consolidate the two method signatures into a single more
flexible definition.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-07 13:57:22 +01:00
Rushabh Shah
9ddc90e258 HBASE-26792 Implement ScanInfo#toString (#4154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-05 17:49:26 +08:00
Nick Dimiduk
09bd726d46 HBASE-26759 Fix trace continuity through CallRunner (#4126) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-04 16:03:02 -08:00
Andrew Purtell
6c70e4b4c5 [branch-2.5] Amend HBASE-26731 Add metrics for active and expired scanners 
Compliation fixes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 14:11:33 -08:00
Bryan Beaudreault
0f28fa8433 HBASE-26731 Add metrics for active and expired scanners (#4145) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionServer.java
 2022-03-04 14:07:16 -08:00
Istvan Toth
d4060aeda7 HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 13:53:29 -08:00
Duo Zhang
71ddf74dda HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 12:08:36 -08:00
Mike Drob
d971a9d298 HBASE-26622 Update error-prone to 2.10 
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-03 11:52:00 +01:00
Niels Basjes
4858b2543c HBASE-26762 Un-Deprecate and improve documentation for Scan#setRowPrefixFilter (#4119) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-02 23:34:02 +08:00
Nick Dimiduk
ff7f18923a HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-03-02 15:52:22 +01:00
Bryan Beaudreault
5f11bc4e50 HBASE-26703 Allow configuration of IPC queue balancer (#4063) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
 2022-02-18 17:55:06 -08:00
Bryan Beaudreault
1fb4ee37be HBASE-26727 Fix CallDroppedException reporting (#4088) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-18 17:27:59 -08:00
Richard Marscher
2be2072704 HBASE-26576 Allow pluggable queue to be used with the fast path executor or normal balanced executor (#3944) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-18 10:26:35 -08:00
Yutong Xiao
932bf591b3 HBASE-26659 The ByteBuffer of metadata in RAMQueueEntry in BucketCache could be reused. (#4026) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-19 00:42:04 +08:00
chenglei
af338d2c99
HBASE-26712 Balancer encounters NPE in rare case (#4112) (#4092) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-02-16 12:15:12 +05:30
Xiaolin Ha
42bb0afaf8 HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate (#4105) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-16 11:23:48 +08:00
Andrew Purtell
a19dcc3be0 HBASE-26730 Extend hbase shell 'status' command to support an option 'tasks' (#4094) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-02-15 18:39:03 -08:00
Xiaolin Ha
40882b5681 HBASE-26434 Do compact when all L0 files are expired (#3830) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-15 22:39:14 +08:00
Yutong Xiao
3803b8be2c HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down (#4073) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-15 20:31:19 +08:00
Nick Dimiduk
600a6a8faf HBASE-26521 Name RPC spans as $package.$service/$method (#4024) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-10 12:58:01 +01:00
Duo Zhang
b64a507340 HBASE-26709 Ban the usage of junit 3 TestCase (#4065) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-02-10 01:06:21 +08:00
Duo Zhang
12002e6a79 HBASE-26724 Backport the UT changes in HBASE-24510 to branch-2.x (#4081) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2022-02-10 00:53:14 +08:00
Andrew Purtell
d091751ab0 HBASE-26726 Allow disable of region warmup before graceful move (#4086) 
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
 2022-02-01 15:39:56 -08:00
Bryan Beaudreault
59d60fd421 HBASE-26713 Default to LATEST_TIMESTAMP if no timestamp sent along on Increment/Append (#4075) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-01-28 12:57:59 -08:00
Duo Zhang
9f1f705686 HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2022-01-27 17:33:37 -08:00
Nick Dimiduk
4d86d3be08 HBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969) 
The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-01-26 09:00:52 -08:00
Peter Somogyi
2c82cf3207 HBASE-26689 Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider (#4049) 
Duo Zhang <zhangduo@apache.org>
 2022-01-20 15:05:45 +01:00
Nick Dimiduk
0ee15e0865 HBASE-26474 Implement connection-level attributes (#4014) 
Add support for `db.system`, `db.connection_string`, `db.user`.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Co-authored-by: Josh Elser <josh.elser@gmail.com>
 2022-01-18 16:09:08 -08:00
Yutong Xiao
540fbe51b0
HBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor (#4036) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2022-01-18 11:13:13 +08:00
xianjingfeng
b840ed68f5 HBASE-26671 Misspellings of hbck usage (#4033) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-16 16:34:34 +08:00
Nick Dimiduk
9ef7f5977e HBASE-26616 Refactor code related to ZooKeeper authentication (#3973) 
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-10 16:08:17 -08:00
Xiaolin Ha
6a060adc8b HBASE-26397 Display the excluded datanodes on regionserver UI (#3990) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-10 13:03:49 +08:00