Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,176 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

19176 Commits

Author SHA1 Message Date
Nick Dimiduk f640b7fd27 HBASE-25895 Implement a Cluster Metrics JSON endpoint (addendum) 2022-03-14 17:27:53 +01:00
Nick Dimiduk 36a5f86c50 HBASE-26531 Trace coprocessor exec endpoints 
Trace table ExecService invocations as table operations. Ensure span relationships for both table
and master invocations.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 11:27:30 +01:00
Duo Zhang a49d147d49
HBASE-26828 Increase the concurrency when running UTs in pre commit job (#4213) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-03-14 12:01:51 +08:00
meiyi d542f471d1
HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled (#4032) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 11:47:23 +08:00
Duo Zhang c3d0cc7040
HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-14 11:04:15 +08:00
Ruanhui fd301ad55f
HBASE-26323 Introduce a Snapshot Procedure (#4115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-12 23:21:22 +08:00
Duo Zhang c2485215de
HBASE-25465 Use javac --release option for supporting cross version compilation (#4164) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-12 16:51:49 +08:00
Duo Zhang f4866a49dc
HBASE-26822 Revert the changes on hbase-daemon.sh after switching to log4j2 properties file (#4209) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-12 16:48:06 +08:00
Andrew Purtell 71ff3ec323
HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME (#4204) 
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-11 14:44:42 +08:00
Andrew Purtell f3faa26047
HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 (#4203) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-11 14:43:00 +08:00
Xiaolin Ha dbf56819c3
HBASE-26816 Fix CME in ReplicationSourceManager (#4187) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:06:14 +08:00
Andrew Purtell addace21b6
HBASE-26821 Bump dependencies in /dev-support/git-jira-release-audit (#4193) 
Bumps urllib3 from 1.25.8 to 1.26.5 to resolve two dependabot warnings

  CRLF injection (Moderate)
  urllib3 (pip) · dev-support/git-jira-release-audit/requirements.txt

  Catastrophic backtracking in URL authority parser when passed URL containing many @ characters (High)
  urllib3 (pip) · dev-support/git-jira-release-audit/requirements.txt

Bumps cryptography from 2.8 to 3.3.2 to resolve one dependabot warning

  RSA decryption vulnerable to Bleichenbacher timing vulnerability (Moderate)
  cryptography (pip) · dev-support/git-jira-release-audit/requirements.txt

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2022-03-10 12:25:33 -08:00
Andrew Purtell e5dbbd20ac
HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184) 
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-10 11:55:38 -08:00
Bryan Beaudreault 4da53efcf9
HBASE-26814 Addendum: Fix spotbugs warning and clarify intent (#4201) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-10 10:09:51 -08:00
Nick Dimiduk be0afbf23a HBASE-25895 Implement a Cluster Metrics JSON endpoint 
Publishes a set of JSON endpoints following a RESTful structure, which expose a subset of the
`o.a.h.h.ClusterMetrics` object tree. The URI structure is as follows

    /api/v1/admin/cluster_metrics
    /api/v1/admin/cluster_metrics/live_servers
    /api/v1/admin/cluster_metrics/dead_servers

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-10 14:58:05 +01:00
Nick Dimiduk 5851400a46 HBASE-26819 Minor code cleanup in and around RpcScheduler 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-10 14:45:04 +01:00
Nick Dimiduk 068031ea82 HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-10 14:36:39 +01:00
xicm 9293d6af2c
HBASE-26815 TestFanOutOneBlockAsyncDFSOutput is flakey (#4186) 
Trigger BlockReports in MiniDFSCluster after restarting datanode

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-10 16:06:12 +08:00
chenglei 1057da8be6
HBASE-26768 Avoid unnecessary replication suspending in RegionReplica… (#4127) 2022-03-10 10:58:47 +08:00
Bryan Beaudreault 1dd29dba5c
HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on (#4194) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 14:43:58 -08:00
Andrew Purtell 10471944bd
HBASE-26582 Prune use of Random and SecureRandom objects (#4118) 
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-08 13:49:02 -08:00
Bryan Beaudreault 39ecaa1975
HBASE-26784 Use HIGH_QOS for ResultScanner.close requests (#4146) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-08 10:48:57 +08:00
Sean Busbey bcd9a9acef
HBASE-26760 LICENSE handling should not allow non-aggregated apache-2.0 (#4172) 
- correct the license name for the Xerial Snappy wrapper.
- correct the license name for the version of GSON brought in with Hadoop 3.3.2+

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-03-07 10:31:02 -06:00
Nick Dimiduk f3f2aa9631 HBASE-26782 Minor code cleanup in and around RpcExecutor 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-07 11:55:36 +01:00
Xiaolin Ha 591f7819f3
HBASE-26552 Introduce retry to logroller to avoid abort (#4038) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 12:20:01 +08:00
Xiaolin Ha f3a48d1910
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 11:21:39 +08:00
Duo Zhang fee9bb0c2f
HBASE-26803 Ban reload4j and logback dependencies (#4167) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-03-07 09:54:20 +08:00
Duo Zhang 19ad3d6654 HBASE-26805 Addendum forward port the test improvements in HBASE-26304 for branch-2 2022-03-07 08:16:21 +08:00
Duo Zhang 480db06e46
HBASE-26805 TestRegionHDFSBlockLocationFinder is flaky (#4169) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2022-03-07 08:08:04 +08:00
Rushabh Shah 2b205d2230
HBASE-26792 Implement ScanInfo#toString (#4153) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-05 17:45:37 +08:00
Duo Zhang 905a6e0472
HBASE-26799 TestCanaryTool.testWriteTableTimeout is flaky (#4165) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2022-03-05 12:05:38 +08:00
Andrew Purtell f90816d6dc HBASE-26800 Update downloads.xml for 2.4.10 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 16:40:02 -08:00
Nick Dimiduk 2b9ab90a03
HBASE-26759 Fix trace continuity through CallRunner (#4126) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-04 15:23:25 -08:00
Bryan Beaudreault be59eb7e8d
HBASE-26731 Add metrics for active and expired scanners (#4145) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 14:03:32 -08:00
Istvan Toth 7d2457e075
HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 13:49:19 -08:00
Xiaolin Ha f4b05a8364
HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 20:18:38 +08:00
Nick Dimiduk 9c037b1be7 HBASE-26764 Implement generic exception support for TraceUtil methods over Callables and Runnables 
For the `TraceUtil` methods that accept `Callable` and `Runnable` types, make them generic over a
child of `Throwable`. This allows us to consolidate the two method signatures into a single more
flexible definition.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-03 12:18:33 +01:00
Nick Dimiduk dbaa68ab58 HBASE-26788 Disable Checks API callback from test results in PRs 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-03-03 10:58:08 +01:00
chenglei 1b994a179b
HBASE-26787 TestRegionReplicaReplicationError should inject error in replicateToReplica method (#4148) 2022-03-03 12:00:45 +08:00
Bri Augenreich b81ddd83bc
HBASE-26745: Include balancer cost metrics in jmx endpoint (#4140) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-02 17:38:05 -08:00
Mike Drob 06f06cbd86 HBASE-26622 Update error-prone to 2.10 
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-02 16:07:23 +01:00
Andor Molnár 87f8d9ac4e
HBASE-23303 Add default security headers if SSL is enabled (#4128) 
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
 2022-03-02 15:25:57 +01:00
Duo Zhang 4bea1e8c37
HBASE-26723 Switch to use log4j2.properties file to configure log4j2 (#4096) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-02 21:08:32 +08:00
Niels Basjes f6b74b3083
HBASE-26762 Un-Deprecate and improve documentation for Scan#setRowPrefixFilter (#4119) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-02 20:19:13 +08:00
Nick Dimiduk e85bf414ab
HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-03-01 14:33:02 +01:00
Peter Somogyi 1f2ddbe7cd
HBASE-26772 Shell suspended in background (#4137) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-03-01 11:52:07 +01:00
Nick Dimiduk f8699176f7 HBASE-26663 Upgrade Maven Enforcer Plugin 
The upgrade is to get the fix in MENFORCER-336, making beanshell evaluation safe for use with `mvn
-T`. Also upgrade extra-enforcer-rules to 1.5.1, as per experience with HBASE-26664.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-02-28 10:24:02 +01:00
Nick Dimiduk 5dc663ea38
HBASE-26765 Minor refactor of async scanning code (#4121) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-24 17:20:57 +01:00
Yutong Xiao 3a53c11dbf
Add xiaoyt to the developer list (#4129) 2022-02-24 12:36:28 +08:00
Duo Zhang c8662ed575
HBASE-26640 Reimplement master local region initialization to better work with SFT (#4111) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-02-24 10:10:02 +08:00