18177 Commits

Author SHA1 Message Date
Bryan Beaudreault
cdda96fb47 HBASE-26603 Cherry pick HBASE-26537 to branch-2.4
HBASE-26537: Make HBASE-15676 backwards compatible, using a flag on the proto (#3931)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 14:48:37 -07:00
meiyi
c3c8047977 HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled (#4032)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 12:30:41 +08:00
Duo Zhang
f42e465a7a HBASE-26828 Increase the concurrency when running UTs in pre commit job (#4213)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit a49d147d49b079c3974e9a29fd1a6d861ca6b525)
2022-03-14 12:21:18 +08:00
Duo Zhang
cffb006d8d HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit c3d0cc70400645f89af78c800003e734e9e49852)
2022-03-14 11:24:51 +08:00
Nick Dimiduk
fd356e6682 HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-11 11:09:28 +01:00
Andrew Purtell
40f873867e HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME (#4204)
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-11 15:13:17 +08:00
Andrew Purtell
097e19eae2 HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 (#4203)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-11 15:07:07 +08:00
Xiaolin Ha
e9711a6bb9 HBASE-26816 Fix CME in ReplicationSourceManager (#4187)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-11 11:50:44 +08:00
Andrew Purtell
bfae8539bf HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184)
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-10 15:14:17 -08:00
xicm
1fca21722b HBASE-26815 TestFanOutOneBlockAsyncDFSOutput is flakey (#4186)
Trigger BlockReports in MiniDFSCluster after restarting datanode

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-10 16:11:48 +08:00
Bryan Beaudreault
9849d3caec HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-09 12:03:14 -08:00
Andrew Purtell
210517040b HBASE-26582 Prune use of Random and SecureRandom objects (#4118)
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 16:12:08 -08:00
Sean Busbey
fa1a17726f HBASE-26760 LICENSE handling should not allow non-aggregated apache-2.0 (#4172)
branch-2* already has correct names for Xerial Snappy wrapper and GSON.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit bcd9a9acefe0f5ceb3ccf6cc11e6ba9464526426)
2022-03-07 11:37:44 -06:00
Xiaolin Ha
77dbf7a059
HBASE-26552 Introduce retry to logroller to avoid abort (#4171)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 16:41:12 +08:00
Xiaolin Ha
45801a7d74 HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 11:43:57 +08:00
Rushabh Shah
6bd2cd6d11 HBASE-26792 Implement ScanInfo#toString (#4154)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-05 17:49:34 +08:00
Istvan Toth
622c436e17 HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 13:57:33 -08:00
Andrew Purtell
6ec1659152 Amend HBASE-26691 Replacing log4j with reload4j for branch-2.x
- Update reload4j version to 1.2.19
- Update shading and assembly configurations

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 12:29:01 -08:00
Duo Zhang
694e9faad5 HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	pom.xml
2022-03-04 12:10:43 -08:00
Xiaolin Ha
2af6bb75f5 HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 20:36:11 +08:00
Nick Dimiduk
b4d0205315 HBASE-26788 Disable Checks API callback from test results in PRs
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-03-03 12:02:58 +01:00
Mike Drob
c3ac78691e HBASE-26622 Update error-prone to 2.10
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-03 11:52:16 +01:00
Bri Augenreich
067c28e9ae HBASE-26745: Include balancer cost metrics in jmx endpoint (#4140)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-02 17:39:57 -08:00
Nick Dimiduk
36e1a1d260 HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-03-02 15:52:05 +01:00
Andor Molnár
1d0d70e641 HBASE-23303 Add default security headers if SSL is enabled (#4128)
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-03-02 15:47:03 +01:00
Peter Somogyi
25dc0eb44b HBASE-26772 Shell suspended in background (#4137)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-03-01 13:33:00 +01:00
Andrew Purtell
819afc7a39 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 09:53:11 -08:00
Andrew Purtell
3e5359c73d Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
rel/2.4.10 2.4.10RC1
2022-02-28 09:53:07 -08:00
Andrew Purtell
9e8b5a89e5 Revert "Preparing development version 2.4.11-SNAPSHOT"
Revert "Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 31a9beaf949385d75a23c672572fbb70c937cf97.
This reverts commit 0dc107e15b5684aea64892fa4db460724de2a779.
This reverts commit a86548a25755c574c76ef27c374fe05be295d057.
This reverts commit 27343174e7837f5859b0e7bd8cc23ec0e62a25c1.
2022-02-28 09:17:45 -08:00
Andrew Purtell
31a9beaf94 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:55 -08:00
Andrew Purtell
0dc107e15b Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:52 -08:00
Andrew Purtell
a86548a257 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-25 18:34:32 -08:00
Andrew Purtell
27343174e7 Preparing hbase release 2.4.10RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2.4.10RC0
2022-02-25 18:34:29 -08:00
Sergey Soldatov
6b10e242c9 HBASE-26767 Rest server should not use a large Header Cache.
Closes #4123

Co-authored-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-02-23 17:34:01 -05:00
Bryan Beaudreault
87e993db26 HBASE-26546 hbase-shaded-client missing required thirdparty classes under hadoop 3.3.1 (#3926)
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit cd45cadbc1a42db359ff4e775cbd4b55cfe28140)
2022-02-22 01:03:18 -06:00
Richard Marscher
f358125fe5 HBASE-26576 Allow pluggable queue to be used with the fast path executor or normal balanced executor (#3944)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 10:26:38 -08:00
chenglei
9999f875c9
HBASE-26712 Balancer encounters NPE in rare case (#4117) 2022-02-18 10:59:29 +08:00
Xiaolin Ha
0020da472d HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate (#4105)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-16 11:24:49 +08:00
Xiaolin Ha
c8ccbde51a HBASE-26434 Do compact when all L0 files are expired (#3830)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 22:40:22 +08:00
Yutong Xiao
3f315d7e93 HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down (#4073)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 20:36:23 +08:00
Duo Zhang
a69e41d850 HBASE-26749 Migrate HBase main pre commit job to ci-hbase (#4107)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-02-11 11:44:34 +08:00
Duo Zhang
cfc9dcc932 HBASE-26747 Addendum use python2 directly in Jenkinsfile and Jenkinsfile_Github 2022-02-11 00:21:59 +08:00
Peter Somogyi
3994374bbc HBASE-26741 Incorrect exception handling in shell (#4101)
Override eval_input in HIRB to modify exception handling logic.

Signed-off-by: Josh Elser <elserj@apache.org>
2022-02-10 12:30:27 +01:00
Duo Zhang
d645cc8365 HBASE-26747 Addendum remove python from Jenkinsfile and Jenkinsfile_Github 2022-02-09 21:43:23 +08:00
Duo Zhang
6e11b70dd7 HBASE-26747 Use python2 instead of python in our python scripts (#4102)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-02-09 16:32:06 +08:00
Duo Zhang
92872285de HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase (#4053)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-02-09 16:32:00 +08:00
Rushabh Shah
869243e738 HBASE-26702 Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram. (#4098)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-09 10:24:26 +08:00
Tak Lon (Stephen) Wu
b8db5ac24c HBASE-26729 Backport "HBASE-26714 Introduce path configuration for system coprocessors" to branch-2 (#4093)
- rename from HBaseCommonTestingUtil to HBaseCommonTestingUtility

Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-02-04 06:01:37 -08:00
Bryan Beaudreault
590e38e8e4 HBASE-26713 Default to LATEST_TIMESTAMP if no timestamp sent along on Increment/Append (#4075)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-01-28 12:58:05 -08:00
Pankaj
70018b0918 HBASE-25918 Upgrade hbase-thirdparty dependency to 3.5.1 (#3317)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit be14605898a5c8162d98760479ef01dd76d3d46d)

Reapplied. See HBASE-26717

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-01-28 12:56:44 -08:00