18213 Commits

Author SHA1 Message Date
Duo Zhang
c94ec54185 HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04cf2ffa71c23b80c5680d8cbb69234b)
2022-09-15 15:35:50 +08:00
Duo Zhang
356f91a433 HBASE-27371 Bump spotbugs version (#4783)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 00aba9ca746dd27c3c5ea36de87ee6655e15ae94)
2022-09-14 23:32:34 +08:00
chenglei
b73348515e HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf105743de28c62a6442eba2ef04d17d46af)
2022-09-08 16:44:09 +08:00
Xiaolin Ha
f7f2d7e1ae HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:16:52 +08:00
Istvan Toth
acc657aa59
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. (#4750)
Signed-off-by: Sakthi <sakthi@apache.org>
2022-08-31 15:51:18 +02:00
LiangJun He
fd27d68b18 HBASE-27335 HBase shell hang for a minute when quiting (#4737)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6a7a91a256be7b51efb48cb341d9f0f9d21eb8ef)
2022-08-31 11:06:55 +08:00
Ujjawal
8659c937b7
HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533) (#4734)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2022-08-27 11:21:31 -04:00
Yutong Xiao
c8969e1859 HBASE-27246 RSGroupMappingScript#getRSGroup has thread safety problem (#4657)
Co-authored-by: Sean Xiao Yutong <sean.xiaoyt@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b44bfc52cc9b1d46a15f2dbca0caa220c2f0828b)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java
2022-08-24 15:41:04 +08:00
Ruanhui
2de39807f3 HBASE-27320 hide some sensitive configuration information in the UI (#4723)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b4e5875dd9def78e242a66fdf785270dbc8c90f2)
2022-08-24 14:28:11 +08:00
Huaxiang Sun
bcc725c56c Preparing development version 2.4.15-SNAPSHOT
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2022-08-23 23:18:32 +00:00
Huaxiang Sun
2e7d75a892 Preparing hbase release 2.4.14RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
rel/2.4.14 2.4.14RC1
2022-08-23 23:18:18 +00:00
Huaxiang Sun
0bcbc02b5b Preparing development version 2.4.15-SNAPSHOT
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2022-08-22 19:38:35 +00:00
Huaxiang Sun
f507fb71c6 Preparing hbase release 2.4.14RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2.4.14RC0
2022-08-22 19:38:24 +00:00
wenwj0
999cc74bd5 HBASE-27089 Add “commons.crypto.stream.buffer.size” configuration (#4491)
Co-authored-by: wenwj0 <wenweijian2@huawei.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ff927dbd84578f203e83c6695165443059b3f23)
2022-08-21 22:36:02 +08:00
Fantasy-Jay
1227704af3 HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710)
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a552970e592ed39735186b4364f85ed1)
2022-08-20 21:11:04 +08:00
Duo Zhang
7c52a76125 HBASE-27294 Add new hadoop releases in our hadoop checks (#4692)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 4a57cbd2cb01b63a93f0171c068b9fd49d239c99)
2022-08-16 21:43:43 +08:00
huaxiangsun
a925b333c2
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695) (#4703)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-15 09:17:10 -07:00
Duo Zhang
58f6bdfa51 HBASE-27221 Bump spotless version to 2.24.1 (#4693)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 9215066e2b8e114fb4e96f1b701a8cbd85638284)

 Conflicts:
	pom.xml
2022-08-15 15:24:45 +08:00
SiCheng-Zheng
6f9b857620 HBASE-27301 Add Delete addFamilyVersion timestamp verify (#4700)
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b531e71455423a9f5a5956da90026085dde96117)
2022-08-15 15:23:53 +08:00
Peter Somogyi
b9a13eba67 HBASE-27281 Add default implementation for Connection$getClusterId (#4683)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-11 17:23:56 +02:00
Duo Zhang
73cf184a90 HBASE-27293 Remove jenkins and personality scripts support for 1.x (#4690)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit bffae99f40f5fb144d52450bfedadfd168a429e0)
2022-08-11 17:10:38 +08:00
Masatake Iwasaki
c701c1262e HBASE-27292. Fix build failure against Hadoop 3.3.4 due to added dependency on okhttp. (#4687)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00612106b5fa78a0dd198cbcaab610bd8b1be277)
2022-08-10 22:16:29 +08:00
alexdongli0829
e157378524
HBASE-27244 bin/hbase still use slf4j-log4j while reload4j in place (#4652)
Co-authored-by: Dong Li <dongaws@amazon.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-10 16:13:09 +08:00
chaijunjie0101
ae8652cdbd HBASE-27282 CME in AuthManager causes region server crash (#4684)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d6641626a97529982720de2b73593e294869c4ca)
2022-08-09 09:57:46 +08:00
LiangJun He
027165e252 HBASE-27275 graceful_stop.sh unable to restore the balance state (#4680)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b431652e48e7cd003c7f8cad4eb9e3065cb0b40f)
2022-08-09 09:56:13 +08:00
ryakhovskiy
0713d0380b HBASE-26775 - add synchronized modifier to the toString() method of ProcedureEvent.java (#4681)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 74726617b8418f9cd0b1f3ae209cfc42adbf26cd)
2022-08-08 18:06:34 +08:00
Duo Zhang
25cf86e028 HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big (#4679)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 486d19e99ff4370bc60e0db235508198c84a00e3)
2022-08-06 20:31:43 +08:00
LiangJun He
1183f06c16 HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect (#4678)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2dc26082be978796046d9124212e8c9d2d8a1f5d)
2022-08-04 23:17:37 +08:00
Duo Zhang
1094b154ab HBASE-27271 BufferCallBeforeInitHandler should ignore the flush request (#4676)
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
(cherry picked from commit fb529e23526eaa250bdd355db3c2f0dedc55c3e8)

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcConnection.java
2022-08-04 23:11:51 +08:00
huaxiangsun
e93ff10b01
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' Addendum (#4665)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-01 16:42:13 -07:00
Bryan Beaudreault
b5329877f1 HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-29 15:33:21 -04:00
huaxiangsun
aa0fa58d06
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' (#4663)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-28 10:42:14 -07:00
Andrew Purtell
57cba05d09 HBASE-27087 TestQuotaThrottle times out
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 14:06:08 -07:00
Andrew Purtell
146a1baf0e
HBASE-27239 Upgrade reload4j due to XXE vulnerability (#4650)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <virajjasani@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-07-26 11:39:26 -07:00
Bryan Beaudreault
1dfbd6cd54 HBASE-27225 Add BucketAllocator bucket size statistic logging (#4637)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-25 21:07:50 -04:00
Andrew Purtell
33b3bbe5ca HBASE-27204 BlockingRpcClient will hang for 20 seconds when SASL is enabled after finishing negotiation (#4642)
Revert "HBASE-24579: Failed SASL authentication does not result in an exception on client side (#1921)"

This reverts commit bd79c4065ccb13a5e217d844376b3e7b9489d2fe.

When Kerberos authentication succeeds, on the server side, after
receiving the final SASL token from the client, we simply wait for
the client to continue by sending the connection header.
After HBASE-24579, on the client side, an additional readStatus()
was added, which mistakenly assumes that after negotiation has
completed a status code will be sent. However when authentication
has succeeded the server will not send one. As a result the client
will hang and only throw an exception when the configured read
timeout is reached, which is 20 seconds by default.

We cannot unilaterally send the expected additional status code
from the server side because older clients will not expect it. The
first call will fail because the client finds unexpected bytes in
the stream ahead of the call response. Fabricating a call response
also does not seem a viable strategy for backwards compatibility.

The HBASE-24579 change needs to be reconsidered given the
difficult backwards compatibility challenges here.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-client/src/test/java/org/apache/hadoop/hbase/security/TestHBaseSaslRpcClient.java
2022-07-24 23:09:01 -07:00
Minwoo Kang
0df2cc3c37 HBASE-27219 Change JONI encoding in RegexStringComparator (#4632)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-19 09:21:11 -07:00
Duo Zhang
fb2593b840 HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-19 10:03:16 +08:00
Duo Zhang
be6f517d92 HBASE-27208 Use spotless to purge the missing summary warnings from error prone (#4628)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 7484a9163a438f2cd9c4e0ac5ab88b00b3340737)
2022-07-19 09:48:43 +08:00
Bryan Beaudreault
f5f248d054
HBASE-27205 Fix tests that rely on EnvironmentEdgeManager in branch-2.4 (addendum) (#4631)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-18 14:54:26 -04:00
Duo Zhang
bc6295e0a5 HBASE-27211 Data race in MonitoredTaskImpl could cause split wal failure (#4630)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 9ab0b1504f589c78cd4e01895027d2ce954ba7f7)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/TaskMonitor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2022-07-18 20:06:12 +08:00
Bryan Beaudreault
33b25ab19a HBASE-27053 IOException during caching of uncompressed block to the block cache (#4610)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: wenwj0 <wenweijian2@huawei.com>
2022-07-16 18:21:12 -04:00
Bryan Beaudreault
cc62da2944
HBASE-27205 Fix tests that rely on EnvironmentEdgeManager in branch-2.4 (#4625)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-14 16:08:29 -04:00
Duo Zhang
4b3464531a HBASE-27192 The retry number for TestSeparateClientZKCluster is too small (#4614)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 648bb6d0eba64f32a90e8b4df20fe50ffe80dd02)
2022-07-14 08:52:32 +08:00
Duo Zhang
b8f71ec487 HBASE-27193 TestZooKeeper is flaky (#4615)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 2662607b716bab12d5f01de013ba3349cff0d78c)
2022-07-13 10:34:33 +08:00
Andrew Purtell
3316b48365 HBASE-27161 Improve TestMultiRespectsLimits (#4586)
TestMultiRespectLimits submits a put with an empty value. This appears
to not be what was intended. Instead, use a single byte.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-12 11:21:04 -07:00
Andrew Purtell
9af341c672 HBASE-27097 SimpleRpcServer is broken (#4613)
Replace BufferChain#write(channel,int) with a simpler #write(channel)
implementation that does not attempt to "chunk" data to be written. This
method was used exclusively by SimpleRpcServer. The code was unnecessarily
complex and caused short writes when values were large, so was corrected
and simplified. Any difference in performance from this change will be
limited to SimpleRpcServer. Testing under load confirms the fix and does
not show significant regression.

SimpleRpcServer and its related code is now also marked as @Deprecated.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcServer.java
2022-07-12 11:14:42 -07:00
Andrew Purtell
ad82104233 Amend HBASE-27180 Fix multiple possible buffer leaks (#4597)
spotless:apply fix

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-12 11:14:42 -07:00
Bryan Beaudreault
7dfed53819 HBASE-27188 Report maxStoreFileCount in jmx (#4609)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:19:30 -04:00
Bryan Beaudreault
a8a67d4314 HBASE-27186 Report block cache size metrics separately for L1 and L2 (#4608)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:09:57 -04:00