Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,202 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18202 Commits

Author SHA1 Message Date
Duo Zhang 350db514c7 HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable (#4219) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 5ad51e8b2b)
 2022-03-15 20:19:32 +08:00
Nick Dimiduk e6879b8fd7 HBASE-25895 Implement a Cluster Metrics JSON endpoint (addendum) 2022-03-14 17:26:20 +01:00
Nick Dimiduk cdabd6a1ad HBASE-25895 Implement a Cluster Metrics JSON endpoint 
Publishes a set of JSON endpoints following a RESTful structure, which expose a subset of the
`o.a.h.h.ClusterMetrics` object tree. The URI structure is as follows

    /api/v1/admin/cluster_metrics
    /api/v1/admin/cluster_metrics/live_servers
    /api/v1/admin/cluster_metrics/dead_servers

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 17:26:20 +01:00
meiyi 50e12309ea HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled (#4032) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 12:25:03 +08:00
Duo Zhang 2a5b3407b1 HBASE-26828 Increase the concurrency when running UTs in pre commit job (#4213) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit a49d147d49)
 2022-03-14 12:20:58 +08:00
Duo Zhang 05627b78ec HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit c3d0cc7040)
 2022-03-14 11:24:31 +08:00
Ruanhui 0f93663db5 HBASE-26323 Introduce a Snapshot Procedure (#4115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-12 23:58:56 +08:00
Duo Zhang 9e1de13d03 HBASE-25465 Use javac --release option for supporting cross version compilation (#4164) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-12 18:30:29 +08:00
Duo Zhang 340cc6c6f1
HBASE-26802 Backport the log4j2 changes to branch-2 (#4166) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-11 11:17:43 -08:00
Nick Dimiduk a227d76009 HBASE-26819 Minor code cleanup in and around RpcScheduler 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:15:59 +01:00
Nick Dimiduk 51fd863daa HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:08:14 +01:00
Andrew Purtell e46fbedf56 HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME (#4204) 
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-11 15:12:51 +08:00
Andrew Purtell 0b879f2054 HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 (#4203) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-11 14:54:49 +08:00
Xiaolin Ha 8c42bca86e HBASE-26816 Fix CME in ReplicationSourceManager (#4187) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:49:29 +08:00
Andrew Purtell 49d3a00652 HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184) 
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-10 11:57:01 -08:00
Bryan Beaudreault fac011ed87 HBASE-26814 Addendum: Fix spotbugs warning and clarify intent (#4201) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-10 10:10:12 -08:00
Tak Lon (Stephen) Wu 3ebb8c1f45
HBASE-26804 Missing opentelemetry agent in hadoop-two-compat.xml (#4185) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-10 07:52:53 -08:00
xicm e9065e76e9 HBASE-26815 TestFanOutOneBlockAsyncDFSOutput is flakey (#4186) 
Trigger BlockReports in MiniDFSCluster after restarting datanode

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-10 16:10:07 +08:00
Bryan Beaudreault 8a4317838b HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on (#4194) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 14:44:23 -08:00
Bryan Beaudreault 91cb3028c4
HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 12:02:51 -08:00
Nick Dimiduk 7e267c6069 HBASE-26782 Minor code cleanup in and around RpcExecutor 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-09 12:44:54 +01:00
Andrew Purtell 300f9b9576 HBASE-26582 Prune use of Random and SecureRandom objects (#4118) 
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-08 15:22:00 -08:00
Bryan Beaudreault 98836fb2b4
HBASE-26784 Addendum: Close scanner request should properly inherit original timeout and priority (#4183) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-08 11:40:39 -08:00
Bryan Beaudreault 5bae04e20c
HBASE-26784 Use HIGH_QOS for ResultScanner.close requests (#4163) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-08 10:50:00 +08:00
Sean Busbey 2e2764fa73 HBASE-26760 LICENSE handling should not allow non-aggregated apache-2.0 (#4172) 
branch-2* already has correct names for Xerial Snappy wrapper and GSON.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit bcd9a9acef)
 2022-03-07 10:47:25 -06:00
Xiaolin Ha f4c91ee65b
HBASE-26552 Introduce retry to logroller to avoid abort (#4170) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 16:41:49 +08:00
Xiaolin Ha 1aff89e0e4 HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 11:45:40 +08:00
Rushabh Shah 0a7e49ca3b
HBASE-26792 Implement ScanInfo#toString (#4154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-05 17:45:45 +08:00
Nick Dimiduk 01acd870b7 HBASE-26759 Fix trace continuity through CallRunner (#4126) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-04 15:26:48 -08:00
Andrew Purtell 961796a59e [branch-2] Amend HBASE-26731 Add metrics for active and expired scanners 
Compliation fixes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 14:14:12 -08:00
Bryan Beaudreault fc92a00bd1 HBASE-26731 Add metrics for active and expired scanners (#4145) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionServer.java
 2022-03-04 14:06:13 -08:00
Istvan Toth eb1c57d12e HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 13:50:03 -08:00
Andrew Purtell bed30b153b Amend HBASE-26691 Replacing log4j with reload4j for branch-2.x 
- Update reload4j version to 1.2.19
- Update shading and assembly configurations

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 12:29:19 -08:00
Duo Zhang 4644efb9f3
HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 12:06:34 -08:00
Xiaolin Ha df90a4ba6b HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 20:47:50 +08:00
haxiaolin b5ac6380c4 Revert "HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652)" 
This reverts commit 2fa4bb0313.
 2022-03-04 20:38:32 +08:00
Xiaolin Ha 2fa4bb0313 HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 20:25:23 +08:00
Nick Dimiduk 87ce5755cd
HBASE-26764 Implement generic exception support for TraceUtil methods over Callables and Runnables 
For the `TraceUtil` methods that accept `Callable` and `Runnable` types, make them generic over a
child of `Throwable`. This allows us to consolidate the two method signatures into a single more
flexible definition.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-04 09:19:03 +01:00
Nick Dimiduk 651ec820ff HBASE-26788 Disable Checks API callback from test results in PRs 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-03-03 12:02:35 +01:00
Mike Drob 8a9e083994 HBASE-26622 Update error-prone to 2.10 
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-03 11:51:51 +01:00
Bri Augenreich d020cba795 HBASE-26745: Include balancer cost metrics in jmx endpoint (#4140) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-02 17:39:49 -08:00
Niels Basjes c5f63550b7 HBASE-26762 Un-Deprecate and improve documentation for Scan#setRowPrefixFilter (#4119) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-02 23:34:17 +08:00
Nick Dimiduk e93abe687b HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-03-02 15:51:27 +01:00
Andor Molnár 7f30aa8b63 HBASE-23303 Add default security headers if SSL is enabled (#4128) 
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
 2022-03-02 15:28:45 +01:00
Peter Somogyi 4ad66df49e HBASE-26772 Shell suspended in background (#4137) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-03-01 11:53:33 +01:00
Nick Dimiduk b3292b88a8 HBASE-26663 Upgrade Maven Enforcer Plugin 
The upgrade is to get the fix in MENFORCER-336, making beanshell evaluation safe for use with `mvn
-T`. Also upgrade extra-enforcer-rules to 1.5.1, as per experience with HBASE-26664.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-02-28 10:24:26 +01:00
BukrosSzabolcs 77bb153a2e
HBASE-26707: Reduce number of renames during bulkload (#4066) (#4122) 
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-02-25 20:11:41 +00:00
Nick Dimiduk 82282a9f95 HBASE-26765 Minor refactor of async scanning code (#4121) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-24 19:07:59 +01:00
Duo Zhang 4cdb380ccc HBASE-26640 Reimplement master local region initialization to better work with SFT (#4111) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-02-24 11:09:50 +08:00
Sergey Soldatov e1131a2608 HBASE-26767 Rest server should not use a large Header Cache. 
Closes #4123

Co-authored-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-02-23 15:37:03 -05:00