Commit Graph

18160 Commits

Author SHA1 Message Date
Sean Busbey 780cea5c02 HBASE-26871 addendum. use the jar command from JAVA_HOME (#4297) 2022-03-30 15:03:55 -07:00
Sean Busbey 2af359caf0 HBASE-26871 shaded mapreduce and shaded byo-hadoop client artifacts contain no classes (#4279)
- add a test to the shaded artifact validation that checks for java classes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-30 15:03:34 -07:00
Andrew Purtell 55bc977279 HBASE-26903 Bump httpclient from 4.5.3 to 4.5.13 (#4296)
Bump httpclient from 4.5.3 to 4.5.13 to avoid a CVE of medium severity in this
dependency.

Newer httpclient versions enable a URI normalization algorithm by default that
rewrites URIs in a way that breaks some forms of valid REST gateway interactions,
so disable it when building the httpclient instance in Client.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>

Conflicts:
	pom.xml
2022-03-30 14:32:15 -07:00
dependabot[bot] 602c7f682b HBASE-26902 Bump bcprov-jdk15on from 1.60 to 1.67 (#4292)
Bumps [bcprov-jdk15on](https://github.com/bcgit/bc-java) from 1.60 to 1.67.

updated-dependencies:
- dependency-name: org.bouncycastle:bcprov-jdk15on

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	pom.xml
2022-03-29 09:04:26 -07:00
bsglz a25e779f26 HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276)
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM

(cherry picked from commit 1efd8fe53c)
2022-03-29 10:13:11 +08:00
Istvan Toth 543128db4a HBASE-26896 list_quota_snapshots fails with ‘ERROR NameError: uninitialized constant Shell::Commands::ListQuotaSnapshots::TABLE’ (#4284)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-28 21:17:14 +02:00
d-c-manning da2c32c36d HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-28 11:52:53 -07:00
Duo Zhang 9355506c30 HBASE-26832 Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompleted (#4281)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 4f491fd5e4)
2022-03-28 08:00:16 +08:00
Xiaolin Ha 9a7ee77bd4
HBASE-26872 Load rate calculator for cost functions should be more precise (#4280)
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2022-03-27 15:20:51 +08:00
huaxiangsun 34cb2ee967 HBASE-26864 SplitTableRegionProcedure calls openParentRegions() at a … (#4261)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:19:02 -07:00
Bryan Beaudreault 42ad0a24cb HBASE-26876 Use toStringBinary for rowkey in RegionServerCallable error string (#4269)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 06:48:20 +08:00
Bryan Beaudreault 3a90de63a2 HBASE-26875 RpcRetryingCallerImpl translateException ignores return value of recursive call (#4270)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-25 09:01:32 -07:00
Bryan Beaudreault 83d5a9ea27 HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-24 16:25:10 -07:00
Xiaolin Ha ce5c7a4327 HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-24 19:50:02 +08:00
chenglei 4bb1d75f67
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4265) 2022-03-23 19:13:46 +08:00
Nick Dimiduk 18d53339a8 HBASE-26834 Adapt ConnectionRule for both sync and async connections
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-21 18:27:33 +01:00
Duo Zhang 7acfbc0bea HBASE-26861 Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving (#4242)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 520ad638d9)
2022-03-19 00:46:42 +08:00
Duo Zhang 2b2308afc7 HBASE-26858 Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop (#4238)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 31db8e3b3b)
2022-03-19 00:46:13 +08:00
Duo Zhang c4f546041e HBASE-26833 Addendum fix NPE in TestReplicationSource.testTerminateClearsBuffer
(cherry picked from commit bd65ad42a2)
2022-03-17 23:23:25 +08:00
Duo Zhang 362e08ea69 HBASE-26848 Addendum make tmpdir absolute
(cherry picked from commit caea843e94)
2022-03-17 13:04:16 +08:00
Duo Zhang b7fb4a278a HBASE-26828 Addendum fix syntax error
(cherry picked from commit fec5478226)
2022-03-16 21:54:34 +08:00
xicm 9043cb90d0 HBASE-26720 ExportSnapshot should validate the source snapshot before copying files (#4216)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 20:16:36 +08:00
xicm 8d161e4352 Hbase 26275 update error message when executing deleteall with ROWPREFIXFILTER in meta table (#4205)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 20:16:24 +08:00
Xiaolin Ha 8cce0d3302 HBASE-26680 Close and do not write trailer for the broken WAL writer (#4174)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-16 20:15:59 +08:00
Duo Zhang 2edb9fdf4d HBASE-26848 Set java.io.tmpdir on mvn command when running jenkins job (#4231)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit cc13624232)
2022-03-16 18:47:55 +08:00
Andrew Purtell ec40003898 Preparing development version 2.4.12-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 10:17:31 -07:00
Andrew Purtell 7e672a0da0 Preparing hbase release 2.4.11RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 10:17:28 -07:00
Xiaolin Ha 89754dd314 HBASE-26833 Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS (#4218)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-15 22:17:18 +08:00
Xiaolin Ha 31cb0b809c HBASE-26840 Fix NPE in the retry of logroller (#4224)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-15 22:07:21 +08:00
Duo Zhang 920cf9d7d4 HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable (#4219)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 5ad51e8b2b)
2022-03-15 20:19:44 +08:00
Andrew Purtell 95f4128973 Preparing development version 2.4.12-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 15:55:02 -07:00
Andrew Purtell 2743fa5b9c Preparing hbase release 2.4.11RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 15:54:59 -07:00
Andrew Purtell d401c63955
HBASE-26839 Fix compatibility issues in 2.4.11RC0 (#4222)
In org.apache.hadoop.hbase.http.SecurityHeadersFilter, marked
LimitedPrivate(CONFIG), static method getDefaultParameters(Configuration)
returning Map<String,String> was removed.

In org.apache.hadoop.hbase.filter.RandomRowFilter, marked Public, the
protected field 'random' of type java.util.Random was removed, which
might cause NoSuchFieldError exceptions in downstreamers.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 15:39:10 -07:00
Bryan Beaudreault cdda96fb47 HBASE-26603 Cherry pick HBASE-26537 to branch-2.4
HBASE-26537: Make HBASE-15676 backwards compatible, using a flag on the proto (#3931)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 14:48:37 -07:00
meiyi c3c8047977 HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled (#4032)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 12:30:41 +08:00
Duo Zhang f42e465a7a HBASE-26828 Increase the concurrency when running UTs in pre commit job (#4213)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit a49d147d49)
2022-03-14 12:21:18 +08:00
Duo Zhang cffb006d8d HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit c3d0cc7040)
2022-03-14 11:24:51 +08:00
Nick Dimiduk fd356e6682 HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-11 11:09:28 +01:00
Andrew Purtell 40f873867e HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME (#4204)
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-11 15:13:17 +08:00
Andrew Purtell 097e19eae2 HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 (#4203)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-11 15:07:07 +08:00
Xiaolin Ha e9711a6bb9 HBASE-26816 Fix CME in ReplicationSourceManager (#4187)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-11 11:50:44 +08:00
Andrew Purtell bfae8539bf HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184)
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-10 15:14:17 -08:00
xicm 1fca21722b HBASE-26815 TestFanOutOneBlockAsyncDFSOutput is flakey (#4186)
Trigger BlockReports in MiniDFSCluster after restarting datanode

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-10 16:11:48 +08:00
Bryan Beaudreault 9849d3caec HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-09 12:03:14 -08:00
Andrew Purtell 210517040b HBASE-26582 Prune use of Random and SecureRandom objects (#4118)
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 16:12:08 -08:00
Sean Busbey fa1a17726f HBASE-26760 LICENSE handling should not allow non-aggregated apache-2.0 (#4172)
branch-2* already has correct names for Xerial Snappy wrapper and GSON.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit bcd9a9acef)
2022-03-07 11:37:44 -06:00
Xiaolin Ha 77dbf7a059
HBASE-26552 Introduce retry to logroller to avoid abort (#4171)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 16:41:12 +08:00
Xiaolin Ha 45801a7d74 HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 11:43:57 +08:00
Rushabh Shah 6bd2cd6d11 HBASE-26792 Implement ScanInfo#toString (#4154)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-05 17:49:34 +08:00
Istvan Toth 622c436e17 HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 13:57:33 -08:00