Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,500 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18500 Commits

Author SHA1 Message Date
Duo Zhang 98db15acd2 HBASE-26245 Store region server list in master local region (#4136) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit bb1bbddf74)
(cherry picked from commit 27111421d9)
 2022-03-31 22:26:40 +08:00
chenglei 1a85588265
HBASE-26812 ShortCircuitingClusterConnection fails to close RegionSca… (#4243) 2022-03-31 20:04:01 +08:00
Andrew Purtell 455b7c701f HBASE-26903 Bump httpclient from 4.5.3 to 4.5.13 (#4296) 
Bump httpclient from 4.5.3 to 4.5.13 to avoid a CVE of medium severity in this
dependency.

Newer httpclient versions enable a URI normalization algorithm by default that
rewrites URIs in a way that breaks some forms of valid REST gateway interactions,
so disable it when building the httpclient instance in Client.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-30 14:31:24 -07:00
Sean Busbey bb18f407c0
HBASE-26871 addendum. use the jar command from JAVA_HOME (#4297) 2022-03-30 14:41:51 -05:00
dependabot[bot] cd09f3a3aa HBASE-26902 Bump bcprov-jdk15on from 1.60 to 1.67 (#4292) 
Bumps [bcprov-jdk15on](https://github.com/bcgit/bc-java) from 1.60 to 1.67.

updated-dependencies:
- dependency-name: org.bouncycastle:bcprov-jdk15on 

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-29 09:03:24 -07:00
bsglz af5624bb8e HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276) 
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM

(cherry picked from commit 1efd8fe53c)
 2022-03-29 10:18:15 +08:00
Istvan Toth 5308eb3772 HBASE-26896 list_quota_snapshots fails with ‘ERROR NameError: uninitialized constant Shell::Commands::ListQuotaSnapshots::TABLE’ (#4284) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-28 21:34:43 +02:00
d-c-manning 0dbcf8f263 HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-28 11:47:11 -07:00
Xiaolin Ha 170570b799 HBASE-26872 Load rate calculator for cost functions should be more precise (#4253) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
 2022-03-28 23:38:30 +08:00
Duo Zhang 89e7050542 HBASE-26617 Addendum add removeUnusedImports 2022-03-28 22:57:15 +08:00
Duo Zhang e0ae456262 HBASE-26617 Use spotless to reduce the pain on fixing checkstyle issues (#4214) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2022-03-28 21:14:01 +08:00
haxiaolin 762390045b Revert "HBASE-26872 Load rate calculator for cost functions should be more precise (#4253)" 
This reverts commit 7ae6be7c25.
 2022-03-28 18:16:38 +08:00
Duo Zhang fd621a7c1b HBASE-26832 Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompleted (#4281) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 4f491fd5e4)
 2022-03-28 07:59:58 +08:00
Xiaolin Ha 7ae6be7c25 HBASE-26872 Load rate calculator for cost functions should be more precise (#4253) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
 2022-03-27 11:13:55 +08:00
huaxiangsun 9ecd4e7c56 HBASE-26864 SplitTableRegionProcedure calls openParentRegions() at a … (#4261) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-26 12:04:44 -07:00
Sean Busbey bd5b447322
HBASE-26871 shaded mapreduce and shaded byo-hadoop client artifacts contain no classes (#4279) 
- revert poms for both modules
- add a test to the shaded artifact validation that checks for java classes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-26 09:02:08 -07:00
Bryan Beaudreault c73ef2c0c8
HBASE-26876 Use toStringBinary for rowkey in RegionServerCallable error string (#4269) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-26 06:46:33 +08:00
Bryan Beaudreault 51f8c87ab4
HBASE-26875 RpcRetryingCallerImpl translateException ignores return value of recursive call (#4270) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-25 09:05:12 -07:00
Wellington Ramos Chevreuil 66508074cc
HBASE-26881 Backport HBASE-25368 to branch-2 (#4267) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-25 10:04:13 +00:00
Bryan Beaudreault ef40c044d1 HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-24 16:08:33 -07:00
Xiaolin Ha b7cfc1d0bd HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-24 19:04:59 +08:00
Bryan Beaudreault 1caa28869b
HBASE-21065 Try ROW_INDEX_V1 encoding on meta table (#4268) 
Set encoding and blooms on meta as default. Also shutdown access to the
initial meta schema creating method; get from TableDescriptors if you
need access to schema or edit it as you would any other table if you
want to edit it.

Co-authored-by: Michael Stack <stack@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-23 16:30:08 -07:00
chenglei 5affa20359
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4264) 2022-03-23 18:31:47 +08:00
chenglei c55c289e99
Revert "HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4262)" (#4263) 
This reverts commit d889746bc6.
 2022-03-23 17:52:11 +08:00
chenglei d889746bc6
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4262) 2022-03-23 17:48:20 +08:00
Duo Zhang 68f3fbe035 HBASE-26791 Memstore flush fencing issue for SFT (#4202) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit e56ed404cb)
 2022-03-22 12:35:09 +08:00
Nick Dimiduk 0a30289d29 HBASE-26531 Trace coprocessor exec endpoints (addendum) 
Stuck by this again. branch-2 needs this configuration instance to be initialized as an
HBaseConfiguration.
 2022-03-21 19:29:37 +01:00
Nick Dimiduk 0d968af513 HBASE-26531 Trace coprocessor exec endpoints 
Trace table ExecService invocations as table operations. Ensure span relationships for both table
and master invocations.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-21 19:29:37 +01:00
Nick Dimiduk 321c35a6ef
HBASE-26834 Adapt ConnectionRule for both sync and async connections 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-21 12:42:18 +01:00
Duo Zhang 8640453d70
HBASE-26870 Log4j2 integration is incorrect in nighly's client integration test (#4250) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-03-21 10:02:00 +08:00
Duo Zhang ba14796289 Revert "HBASE-26813 Remove javax.ws.rs-api dependency (#4191)" 
MiniYARNCluster needs it

This reverts commit abde344767.
 2022-03-19 19:45:29 +08:00
Nick Dimiduk d09b04df64 HBASE-26855 Delete unnecessary dependency on jaxb-runtime jar (#4236) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-18 19:13:37 +01:00
Duo Zhang 7af08ce614 HBASE-26861 Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving (#4242) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 520ad638d9)
 2022-03-19 00:46:31 +08:00
Duo Zhang ac5651c1b2 HBASE-26858 Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop (#4238) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 31db8e3b3b)
 2022-03-19 00:46:03 +08:00
huiruan 4a6ba116bf HBASE-26842 TestSnapshotProcedure fails in branch-2 (#4225) 
Closes #4225

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-18 16:21:29 +08:00
Duo Zhang 81398f9064 HBASE-26833 Addendum fix NPE in TestReplicationSource.testTerminateClearsBuffer 
(cherry picked from commit bd65ad42a2)
 2022-03-17 23:23:10 +08:00
Duo Zhang b5d5fe8fe5 HBASE-26848 Addendum make tmpdir absolute 
(cherry picked from commit caea843e94)
 2022-03-17 13:03:20 +08:00
Nick Dimiduk abde344767 HBASE-26813 Remove javax.ws.rs-api dependency (#4191) 
This is no longer needed since we've transitioned to the shaded Jersey shipped in
hbase-thirdparty. Also drop supplemental models entry.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-16 17:24:20 +01:00
Duo Zhang 26af3b9822 HBASE-26828 Addendum fix syntax error 
(cherry picked from commit fec5478226)
 2022-03-16 21:52:43 +08:00
xicm fdc7c49c01 HBASE-26720 ExportSnapshot should validate the source snapshot before copying files (#4216) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-16 20:29:48 +08:00
xicm 50757ef97d Hbase 26275 update error message when executing deleteall with ROWPREFIXFILTER in meta table (#4205) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-16 20:29:37 +08:00
Xiaolin Ha db5e954068 HBASE-26680 Close and do not write trailer for the broken WAL writer (#4174) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-16 20:29:27 +08:00
Duo Zhang d3629bbf16 HBASE-26837 Set SFT config when creating TableDescriptor in TestCloneSnapshotProcedure (#4226) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 5b28d76652)
 2022-03-16 20:16:26 +08:00
Duo Zhang 4dff67c2e4 HBASE-26848 Set java.io.tmpdir on mvn command when running jenkins job (#4231) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit cc13624232)
 2022-03-16 18:47:44 +08:00
Nick Dimiduk 3c968a1bb8 HBASE-25896 Implement a Region Visualization on Master WebUI (#4228) 
This is a demonstration of visualization of regions on the cluster. The visualization is a stacked
bar chart showing total storefile size per table per region server, with the x-axis being server
names, the y-axis being storfile size, and the bars stacked per table. The visualization is
generated entirely on the fly from within the browser, implemented using Vega Lite. So far, Vega
appears to handle rendering this visualization for a cluster of over 700 region servers with
approximately 300,000 regions.

Per [0], include an update to the top-level LICENSE.txt. Also update LICENSE files in all binary
distributions (i.e., jars), by way of LICENSE.vm. Vega uses a BSD 3-clause variant without
advertising clause, and as such is a "Category A" license, per [1].

No changes are made to the NOTICE files, as per the existing example of bundling the minified
JQuery, which is also a Category A license.

[0]: https://infra.apache.org/licensing-howto.html
[1]: https://www.apache.org/legal/resolved.html#category-a

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-15 21:10:23 +01:00
Xiaolin Ha c1bf2ffcd9 HBASE-26833 Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS (#4218) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-15 22:12:02 +08:00
Xiaolin Ha 46af73b5c0 HBASE-26840 Fix NPE in the retry of logroller (#4224) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-15 22:08:41 +08:00
Duo Zhang a4b192e33d HBASE-26611 Changing SFT implementation on disabled table is dangerous (#4082) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-15 20:26:24 +08:00
Duo Zhang 350db514c7 HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable (#4219) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 5ad51e8b2b)
 2022-03-15 20:19:32 +08:00
Nick Dimiduk e6879b8fd7 HBASE-25895 Implement a Cluster Metrics JSON endpoint (addendum) 2022-03-14 17:26:20 +01:00