Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,151 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18151 Commits

Author SHA1 Message Date
Huaxiang Sun f507fb71c6 Preparing hbase release 2.4.14RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2022-08-22 19:38:24 +00:00
wenwj0 999cc74bd5 HBASE-27089 Add “commons.crypto.stream.buffer.size” configuration (#4491) 
Co-authored-by: wenwj0 <wenweijian2@huawei.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ff927dbd8)
 2022-08-21 22:36:02 +08:00
Fantasy-Jay 1227704af3 HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710) 
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a5)
 2022-08-20 21:11:04 +08:00
Duo Zhang 7c52a76125 HBASE-27294 Add new hadoop releases in our hadoop checks (#4692) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 4a57cbd2cb)
 2022-08-16 21:43:43 +08:00
huaxiangsun a925b333c2
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695) (#4703) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-15 09:17:10 -07:00
Duo Zhang 58f6bdfa51 HBASE-27221 Bump spotless version to 2.24.1 (#4693) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 9215066e2b)

 Conflicts:
	pom.xml
 2022-08-15 15:24:45 +08:00
SiCheng-Zheng 6f9b857620 HBASE-27301 Add Delete addFamilyVersion timestamp verify (#4700) 
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b531e71455)
 2022-08-15 15:23:53 +08:00
Peter Somogyi b9a13eba67 HBASE-27281 Add default implementation for Connection$getClusterId (#4683) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-08-11 17:23:56 +02:00
Duo Zhang 73cf184a90 HBASE-27293 Remove jenkins and personality scripts support for 1.x (#4690) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit bffae99f40)
 2022-08-11 17:10:38 +08:00
Masatake Iwasaki c701c1262e HBASE-27292. Fix build failure against Hadoop 3.3.4 due to added dependency on okhttp. (#4687) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00612106b5)
 2022-08-10 22:16:29 +08:00
alexdongli0829 e157378524
HBASE-27244 bin/hbase still use slf4j-log4j while reload4j in place (#4652) 
Co-authored-by: Dong Li <dongaws@amazon.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-08-10 16:13:09 +08:00
chaijunjie0101 ae8652cdbd HBASE-27282 CME in AuthManager causes region server crash (#4684) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d6641626a9)
 2022-08-09 09:57:46 +08:00
LiangJun He 027165e252 HBASE-27275 graceful_stop.sh unable to restore the balance state (#4680) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b431652e48)
 2022-08-09 09:56:13 +08:00
ryakhovskiy 0713d0380b HBASE-26775 - add synchronized modifier to the toString() method of ProcedureEvent.java (#4681) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 74726617b8)
 2022-08-08 18:06:34 +08:00
Duo Zhang 25cf86e028 HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big (#4679) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 486d19e99f)
 2022-08-06 20:31:43 +08:00
LiangJun He 1183f06c16 HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect (#4678) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2dc26082be)
 2022-08-04 23:17:37 +08:00
Duo Zhang 1094b154ab HBASE-27271 BufferCallBeforeInitHandler should ignore the flush request (#4676) 
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
(cherry picked from commit fb529e2352)

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcConnection.java
 2022-08-04 23:11:51 +08:00
huaxiangsun e93ff10b01
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' Addendum (#4665) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-08-01 16:42:13 -07:00
Bryan Beaudreault b5329877f1 HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-07-29 15:33:21 -04:00
huaxiangsun aa0fa58d06
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' (#4663) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-07-28 10:42:14 -07:00
Andrew Purtell 57cba05d09 HBASE-27087 TestQuotaThrottle times out 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-26 14:06:08 -07:00
Andrew Purtell 146a1baf0e
HBASE-27239 Upgrade reload4j due to XXE vulnerability (#4650) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <virajjasani@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2022-07-26 11:39:26 -07:00
Bryan Beaudreault 1dfbd6cd54 HBASE-27225 Add BucketAllocator bucket size statistic logging (#4637) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-07-25 21:07:50 -04:00
Andrew Purtell 33b3bbe5ca HBASE-27204 BlockingRpcClient will hang for 20 seconds when SASL is enabled after finishing negotiation (#4642) 
Revert "HBASE-24579: Failed SASL authentication does not result in an exception on client side (#1921)"

This reverts commit bd79c4065c.

When Kerberos authentication succeeds, on the server side, after
receiving the final SASL token from the client, we simply wait for
the client to continue by sending the connection header.
After HBASE-24579, on the client side, an additional readStatus()
was added, which mistakenly assumes that after negotiation has
completed a status code will be sent. However when authentication
has succeeded the server will not send one. As a result the client
will hang and only throw an exception when the configured read
timeout is reached, which is 20 seconds by default.

We cannot unilaterally send the expected additional status code
from the server side because older clients will not expect it. The
first call will fail because the client finds unexpected bytes in
the stream ahead of the call response. Fabricating a call response
also does not seem a viable strategy for backwards compatibility.

The HBASE-24579 change needs to be reconsidered given the
difficult backwards compatibility challenges here.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-client/src/test/java/org/apache/hadoop/hbase/security/TestHBaseSaslRpcClient.java
 2022-07-24 23:09:01 -07:00
Minwoo Kang 0df2cc3c37 HBASE-27219 Change JONI encoding in RegexStringComparator (#4632) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-19 09:21:11 -07:00
Duo Zhang fb2593b840 HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-19 10:03:16 +08:00
Duo Zhang be6f517d92 HBASE-27208 Use spotless to purge the missing summary warnings from error prone (#4628) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 7484a9163a)
 2022-07-19 09:48:43 +08:00
Bryan Beaudreault f5f248d054
HBASE-27205 Fix tests that rely on EnvironmentEdgeManager in branch-2.4 (addendum) (#4631) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-07-18 14:54:26 -04:00
Duo Zhang bc6295e0a5 HBASE-27211 Data race in MonitoredTaskImpl could cause split wal failure (#4630) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 9ab0b1504f)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/TaskMonitor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2022-07-18 20:06:12 +08:00
Bryan Beaudreault 33b25ab19a HBASE-27053 IOException during caching of uncompressed block to the block cache (#4610) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: wenwj0 <wenweijian2@huawei.com>
 2022-07-16 18:21:12 -04:00
Bryan Beaudreault cc62da2944
HBASE-27205 Fix tests that rely on EnvironmentEdgeManager in branch-2.4 (#4625) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-14 16:08:29 -04:00
Duo Zhang 4b3464531a HBASE-27192 The retry number for TestSeparateClientZKCluster is too small (#4614) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 648bb6d0eb)
 2022-07-14 08:52:32 +08:00
Duo Zhang b8f71ec487 HBASE-27193 TestZooKeeper is flaky (#4615) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 2662607b71)
 2022-07-13 10:34:33 +08:00
Andrew Purtell 3316b48365 HBASE-27161 Improve TestMultiRespectsLimits (#4586) 
TestMultiRespectLimits submits a put with an empty value. This appears
to not be what was intended. Instead, use a single byte.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-07-12 11:21:04 -07:00
Andrew Purtell 9af341c672 HBASE-27097 SimpleRpcServer is broken (#4613) 
Replace BufferChain#write(channel,int) with a simpler #write(channel)
implementation that does not attempt to "chunk" data to be written. This
method was used exclusively by SimpleRpcServer. The code was unnecessarily
complex and caused short writes when values were large, so was corrected
and simplified. Any difference in performance from this change will be
limited to SimpleRpcServer. Testing under load confirms the fix and does
not show significant regression.

SimpleRpcServer and its related code is now also marked as @Deprecated.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcServer.java
 2022-07-12 11:14:42 -07:00
Andrew Purtell ad82104233 Amend HBASE-27180 Fix multiple possible buffer leaks (#4597) 
spotless:apply fix

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-12 11:14:42 -07:00
Bryan Beaudreault 7dfed53819 HBASE-27188 Report maxStoreFileCount in jmx (#4609) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-11 22:19:30 -04:00
Bryan Beaudreault a8a67d4314 HBASE-27186 Report block cache size metrics separately for L1 and L2 (#4608) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-11 22:09:57 -04:00
Duo Zhang d054c93be1 HBASE-27189 NettyServerRpcConnection is not properly closed when the netty channel is closed (#4611) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 5bc8670322)
 2022-07-12 09:47:03 +08:00
Norman Maurer ff710b8252 HBASE-27180 Fix multiple possible buffer leaks (#4597) 
* Fix multiple possible buffer leaks

Motivation:

When using ByteBuf you need to be very careful about releasing it as otherwise you might leak data. There were various places in the code-base where such a leak could happen.

Modifications:

- Fix possible buffer leaks
- Ensure we call touch(...) so its easier to debug buffer leaks

Result:

Fix buffer leaks

* Formatting

* Revert some changes as requested

* revert touch

* Also release checksum and header buffers

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2197b3806b)
 2022-07-08 08:32:33 +08:00
Duo Zhang decb96edd2 HBASE-26708 Netty leak detected and OutOfDirectMemoryError due to direct memory buffering with SASL implementation (#4596) 
Co-authored-by: Norman Maurer <norman_maurer@apple.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 816e919e95)
 2022-07-07 16:04:40 +08:00
Ujjawal 60521caf9f
HBASE-27175 - Failure to cleanup WAL split dir log should be at INFO level (#4593) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-07-06 16:35:22 -07:00
Bryan Beaudreault 87f22813f4 HBASE-27048 Server side scanner time limit should account for time in queue (#4562) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-06 14:21:56 -04:00
tianhang c725dc98e5 HBASE-27171 Fix Annotation Error in HRegionFileSystem (#4588) 
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6031a3a8d4)
 2022-07-06 12:39:35 +08:00
Duo Zhang 2cd30e5f00 HBASE-23330: Fix delegation token fetch with MasterRegistry (#1084) (#4598) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit d8b3f55518)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>
 2022-07-06 12:00:09 +08:00
Bryan Beaudreault f36b8eadd8 HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse (#4592) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-07-04 16:47:47 -04:00
Duo Zhang ab722fe765 HBASE-27169 TestSeparateClientZKCluster is flaky (#4587) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 03c23beb57)
 2022-07-01 22:16:52 +08:00
Ishika ba9aa5df99 HBASE-26218 Add logs in Canary tool (#4501) 
Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit acfbc3ff7d)
 2022-06-30 23:28:41 +08:00
Duo Zhang aaf6435317 HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded (#4579) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit d7f6861e8d)
 2022-06-26 15:29:47 +08:00
Bryan Beaudreault 9735b545d1 HBASE-27060 Addendum spotless fix (#4580) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-06-25 17:36:49 -04:00