18342 Commits

Author SHA1 Message Date
Xiaolin Ha
fde0f4b5ee
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) (#5123)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-20 19:26:32 +08:00
chaijunjie0101
7e1f243c4e HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a95975580831a31d122c800d01cadac007a)
2023-03-19 20:19:55 +08:00
Bryan Beaudreault
acda5b7f73 HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5115)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-17 15:25:24 -04:00
Duo Zhang
5f2f73db80 HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4ff2b5456c8655558378a127f3274107)
2023-03-15 10:55:54 +08:00
alan.zhao
52d3824bd8 HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5097)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6920e72f50b35eea79921f20dbe6a15f5cfdf492)
2023-03-15 08:21:49 +08:00
Horváth Dóra
e2e7968cb1 HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076)
(cherry picked from commit 72d5a46899ef0866d777f0a9508649beed6d8dd3)
2023-03-10 21:40:57 +01:00
Rajeshbabu Chintaguntla
ad90a7b046 HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468a258b4ee47e40cf3645bf27d66471d)
2023-03-09 10:58:15 +08:00
alan.zhao
11d3a9d61b HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f726dcd65fbfb58f9ea6aa499f2a903c)
2023-03-04 22:39:10 +08:00
Ruanhui
1ea4473cba
HBASE-27458 Use ReadWriteLock for region scanner readpoint map (#5068)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-02 11:24:58 +08:00
Yuta Imazu
3fab7b3f29 HBASE-24781 Clean up peer metrics when disabling peer (#4997)
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0f1a186b1d31f11be26ec95e3588ae2)
2023-02-28 13:35:21 +08:00
Bryan Beaudreault
4b30d41672 HBASE-27650 Merging empty regions corrupts meta cache (branch-2) (#5038)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 21:15:37 -05:00
Duo Zhang
890c89b5c0 HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c340f6eeb145410e88b089e636fd6f5e)
2023-02-28 10:07:32 +08:00
Victor
426425944e
HBASE-15242: add client side metrics for timeout and remote exceptions. (#5023) (#5054)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-27 10:16:17 -08:00
Duo Zhang
22093cb442 HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f8cd2fa646a5c43280e2d91d2dccafd)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
2023-02-26 16:32:44 +08:00
tianhang
c49b5e7acc HBASE-27661 Set size of systable queue in UT (#5053)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e857c5bb51b7de77c2f5c2e06153d0cd1)
2023-02-25 23:38:34 +08:00
Kerasone
44c4e90b33 HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 (#5034)
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5f0dcdd121833e7665633aabc7706ae1b18f8672)
2023-02-18 10:48:33 +08:00
Bryan Beaudreault
1b8434b232 HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent (#5031)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 19:19:24 -05:00
tianhang
d3c5e1db0c HBASE-27645 [JDK17] Use ReflectionUtils#getModifiersField in UT (#5029)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3b8d7ad51219c98d586b31c02dd58aaa8a7696cf)
2023-02-17 21:18:09 +08:00
tianhang
41427cfd74 HBASE-27643 [JDK17] Add-opens java.util.concurrent (#5028)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a1cf0731e362a22cdde4a2085c724891a8051494)
2023-02-17 21:17:36 +08:00
Xiaolin Ha
2dd582ccc4
HBASE-21521 Expose master startup status via web UI (#4788) (#5021)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-14 15:07:47 +08:00
Peter Somogyi
6c5c65a342 HBASE-27590 Change Iterable to List in SnapshotFileCache (#4995)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d2c5af11ea46c86c592751608e44f563406aa4f3)
2023-02-13 14:38:13 +01:00
Peter Somogyi
c580835860
HBASE-27629 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#5020)
Backport of HBASE-27043

Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-13 14:00:14 +01:00
Duo Zhang
8df32127ef HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file (#5016)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 833b10e8bab7c28457caa854c0f714b489f88fa3)
2023-02-11 20:20:02 +08:00
tianhang
af6b63a14a HBASE-27602 Remove the impact of operating env on testHFileCleaning (#5003)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e71253f4d8db0f808b4a2d27f66fca37b1ad0632)
2023-02-11 19:41:55 +08:00
Nihal Jain
9236242dac HBASE-27626 Suppress noisy logging in client.ConnectionImplementation (#5019)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 10:31:58 -08:00
Peter Somogyi
1843cefa98
HBASE-27627 Improve efficiency of SnapshotHFileCleaner (#5017)
Backport of HBASE-25899

Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 19:07:56 +01:00
Peter Somogyi
0978630e22 HBASE-27628 Spotless fix in RELEASENOTES.md (#5018) 2023-02-09 17:32:34 +01:00
Bryan Beaudreault
447846dab7 HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding (#5006)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:20:31 -05:00
Duo Zhang
2729e148d4 HBASE-27608 Use lowercase image reference name in our docker file (#5005)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit bbc20f3611fdada137790ead41c6c4fdc31e0d06)
2023-02-03 11:39:40 +08:00
Duo Zhang
b4ad7d0bd5 Preparing development version 2.4.17-SNAPSHOT
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-01 09:36:56 +00:00
Duo Zhang
d171471087 Preparing hbase release 2.4.16RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Duo Zhang <zhangduo@apache.org>
rel/2.4.16 2.4.16RC1
2023-02-01 09:36:51 +00:00
Duo Zhang
c4eb3e5b8d Preparing development version 2.4.17-SNAPSHOT
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-01 06:22:50 +00:00
Duo Zhang
c9c07b3506 Preparing hbase release 2.4.16RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-01 06:22:46 +00:00
Duo Zhang
4124bc92d4 Revert "HBASE-27585 Bump up jruby to 9.3.9.0 and related joni and jcodings to 2.1.43 and 1.0.57 respectively (#4992)"
This reverts commit 2e727a859bc17fa8fe539710bdf295dbc7aac825.
2023-02-01 11:41:47 +08:00
tianhang
902f5e2122 HBASE-27581 [JDK17] Fix failure TestHBaseTestingUtil#testResolvePortConflict (#4991)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8e72cc6ee0415608d2d31e1c0c0175e8fc228d8d)
2023-01-31 11:20:59 +08:00
Duo Zhang
40c266c53d Preparing development version 2.4.17-SNAPSHOT
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-30 07:29:04 +00:00
Duo Zhang
b91e903536 Preparing hbase release 2.4.16RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2.4.16RC0
2023-01-30 07:28:58 +00:00
chaijunjie0101
32fe73eea4 HBASE-26967 FilterList with FuzzyRowFilter and SingleColumnValueFilter evaluated with operator MUST_PASS_ONE doesn't work as expected(#4820)
Close #4820

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 382681e2d6b6c417145022d7df81390bf42f2773)
2023-01-29 17:40:07 +08:00
EungsopYoo
93ad9c4114 HBASE-27547 Close store file readers after region warmup (#4942)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 45fd3f628ab2ec2268c6449b62a85e7178f511b6)
2023-01-28 23:40:57 +08:00
Rajeshbabu Chintaguntla
2e727a859b HBASE-27585 Bump up jruby to 9.3.9.0 and related joni and jcodings to 2.1.43 and 1.0.57 respectively (#4992)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
(cherry picked from commit 235864056c5e504f640ec55f6bac1474ad36a4d1)
2023-01-28 11:13:58 +08:00
tianhang
96457e4e25 HBASE-27591 [JDK17] Fix failure TestImmutableScan#testScanCopyConstructor (#4994)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 06f294e637b1c00cdae00d9466e0d8db71424d07)
2023-01-27 23:09:43 +08:00
Rajeshbabu Chintaguntla
b6d99600c7 HBASE-27586 Bump up commons-codec to 1.15 (#4993)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
(cherry picked from commit 5516fb86b60a3233373f7b3726789f6675bc092c)
2023-01-27 23:06:27 +08:00
Tak Lon (Stephen) Wu
18944c1f51 HBASE-27589 Rename TestConnectionImplementation in hbase-it to fix javadoc failure (#4990)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-01-24 18:59:08 -08:00
Duo Zhang
45d0df7544 HBASE-27583 Remove -X option when building protoc check in nightly and pre commit job (#4988)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit 5bdf264633c627086cef74cf060cd3b3d58cd50f)
2023-01-24 23:34:32 +08:00
Wei-Chiu Chuang
bfee537c94 HBASE-25516 [JDK17] reflective access Field.class.getDeclaredField("modifiers") not supported (#3443)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 29cd782d25bee0c7d59d3773e4aaf1cc8f0dccd9)
2023-01-24 22:51:05 +08:00
Duo Zhang
667af49955 HBASE-27578 Upgrade hbase-thirdparty to 4.1.4 (#4985)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
(cherry picked from commit a0fdfa782b7ef18c1d0459dcb46ae38feb489b67)
(cherry picked from commit 83d450d5b5c069371f4696022331d251ffb02873)
2023-01-21 16:42:12 +08:00
Bryan Beaudreault
a7f776f06e HBASE-27579 CatalogJanitor can cause data loss due to errors during cleanMergeRegion (#4986)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 13:01:00 -05:00
Dongjoon Hyun
67a30f364f HBASE-27562 Publish SBOM artifacts (#4953)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5feb06bd69fa23eab4bd778275a034a5d47b446f)
2023-01-20 16:27:43 +08:00
tianhang
b9cf8a1f19 HBASE-27564 Add default encryption type for MiniKDC to fix failed tests on JDK11+ (#4968)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8e11f91b3b7786da518969070a1befeacb783ecc)
2023-01-20 16:27:21 +08:00
tianhang
e63331e93e
HBASE-27557 [JDK17] Update shade plugin version (#4970)
Signed-off-by Reid Chan <reidchan@apache.org>
2023-01-20 13:32:47 +08:00