8713 Commits

Author SHA1 Message Date
Duo Zhang
4605c323cc HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47b5340ff02e0dec144424ab91407e07)
2022-11-08 00:20:33 +08:00
Ruanhui
5f55ff7578 HBASE-27414 Adjust hfilelink alternative paths order (#4847)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699fd2f03e88dcd37cb9dc7d20bacfa3f2)
2022-11-05 23:03:34 +08:00
Duo Zhang
a6a5f03e5b HBASE-27437 TestHeapSize is flaky (#4841)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da9298b7f2f396826487d4133e78810895)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
2022-10-28 23:22:56 +08:00
tianliuliu
098e59863b HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e9be5723ff5bfb0e97cadca4092455a)
2022-10-24 18:56:49 +08:00
d-c-manning
cbad5f595c HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:19:59 -07:00
Andrew Purtell
de02ee2970 Preparing development version 2.4.16-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 11:39:40 -07:00
Andrew Purtell
35310fcd6b Preparing hbase release 2.4.15RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 11:39:36 -07:00
Duo Zhang
8c2dd12adb HBASE-27401 Clean up current broken 'n's in our javadoc (#4812)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f08cdde6ac0fde1342ffd050e8e02441)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
2022-10-07 00:42:57 +08:00
Rajeshbabu Chintaguntla
9d7614bbdc HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:40:41 +05:30
Rajeshbabu Chintaguntla
1c90547e8a HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:54:12 +05:30
Rajeshbabu Chintaguntla
5fa5b0364f HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-05 04:03:45 +05:30
Bryan Beaudreault
804844c018 HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-04 08:29:57 -04:00
Aman Poonia
f24e7b55f9
HBASE-27384 Backport HBASE-27064 (CME in TestRegionNormalizerWorkQueue) to 2.4 (#4794) (#4468)
Co-authored-by: Andrew Purtell <apurtell@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-09-26 22:59:58 -07:00
Andrew Purtell
e7b67a19b3
HBASE-27393 Frequent and not useful "Final timeLimitDelta" log lines (#4802)
Signed-off-by: Viraj Jasani <virajjasani@apache.org>
2022-09-26 17:54:49 -07:00
Wellington Ramos Chevreuil
e25b2a7cd0 HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781)
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-09-20 14:37:01 +01:00
Duo Zhang
82f966474e
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4791)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-19 12:02:00 +08:00
Duo Zhang
c94ec54185 HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04cf2ffa71c23b80c5680d8cbb69234b)
2022-09-15 15:35:50 +08:00
chenglei
b73348515e HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf105743de28c62a6442eba2ef04d17d46af)
2022-09-08 16:44:09 +08:00
Xiaolin Ha
f7f2d7e1ae HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:16:52 +08:00
Istvan Toth
acc657aa59
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. (#4750)
Signed-off-by: Sakthi <sakthi@apache.org>
2022-08-31 15:51:18 +02:00
Ujjawal
8659c937b7
HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533) (#4734)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2022-08-27 11:21:31 -04:00
Huaxiang Sun
bcc725c56c Preparing development version 2.4.15-SNAPSHOT
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2022-08-23 23:18:32 +00:00
Huaxiang Sun
2e7d75a892 Preparing hbase release 2.4.14RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2022-08-23 23:18:18 +00:00
Huaxiang Sun
0bcbc02b5b Preparing development version 2.4.15-SNAPSHOT
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2022-08-22 19:38:35 +00:00
Huaxiang Sun
f507fb71c6 Preparing hbase release 2.4.14RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2022-08-22 19:38:24 +00:00
Fantasy-Jay
1227704af3 HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710)
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a552970e592ed39735186b4364f85ed1)
2022-08-20 21:11:04 +08:00
huaxiangsun
a925b333c2
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695) (#4703)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-15 09:17:10 -07:00
chaijunjie0101
ae8652cdbd HBASE-27282 CME in AuthManager causes region server crash (#4684)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d6641626a97529982720de2b73593e294869c4ca)
2022-08-09 09:57:46 +08:00
Duo Zhang
25cf86e028 HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big (#4679)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 486d19e99ff4370bc60e0db235508198c84a00e3)
2022-08-06 20:31:43 +08:00
LiangJun He
1183f06c16 HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect (#4678)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2dc26082be978796046d9124212e8c9d2d8a1f5d)
2022-08-04 23:17:37 +08:00
huaxiangsun
e93ff10b01
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' Addendum (#4665)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-01 16:42:13 -07:00
Bryan Beaudreault
b5329877f1 HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-29 15:33:21 -04:00
huaxiangsun
aa0fa58d06
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' (#4663)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-28 10:42:14 -07:00
Andrew Purtell
57cba05d09 HBASE-27087 TestQuotaThrottle times out
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 14:06:08 -07:00
Bryan Beaudreault
1dfbd6cd54 HBASE-27225 Add BucketAllocator bucket size statistic logging (#4637)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-25 21:07:50 -04:00
Duo Zhang
fb2593b840 HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-19 10:03:16 +08:00
Bryan Beaudreault
f5f248d054
HBASE-27205 Fix tests that rely on EnvironmentEdgeManager in branch-2.4 (addendum) (#4631)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-18 14:54:26 -04:00
Duo Zhang
bc6295e0a5 HBASE-27211 Data race in MonitoredTaskImpl could cause split wal failure (#4630)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 9ab0b1504f589c78cd4e01895027d2ce954ba7f7)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/TaskMonitor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2022-07-18 20:06:12 +08:00
Bryan Beaudreault
33b25ab19a HBASE-27053 IOException during caching of uncompressed block to the block cache (#4610)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: wenwj0 <wenweijian2@huawei.com>
2022-07-16 18:21:12 -04:00
Bryan Beaudreault
cc62da2944
HBASE-27205 Fix tests that rely on EnvironmentEdgeManager in branch-2.4 (#4625)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-14 16:08:29 -04:00
Duo Zhang
4b3464531a HBASE-27192 The retry number for TestSeparateClientZKCluster is too small (#4614)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 648bb6d0eba64f32a90e8b4df20fe50ffe80dd02)
2022-07-14 08:52:32 +08:00
Duo Zhang
b8f71ec487 HBASE-27193 TestZooKeeper is flaky (#4615)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 2662607b716bab12d5f01de013ba3349cff0d78c)
2022-07-13 10:34:33 +08:00
Andrew Purtell
3316b48365 HBASE-27161 Improve TestMultiRespectsLimits (#4586)
TestMultiRespectLimits submits a put with an empty value. This appears
to not be what was intended. Instead, use a single byte.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-12 11:21:04 -07:00
Andrew Purtell
9af341c672 HBASE-27097 SimpleRpcServer is broken (#4613)
Replace BufferChain#write(channel,int) with a simpler #write(channel)
implementation that does not attempt to "chunk" data to be written. This
method was used exclusively by SimpleRpcServer. The code was unnecessarily
complex and caused short writes when values were large, so was corrected
and simplified. Any difference in performance from this change will be
limited to SimpleRpcServer. Testing under load confirms the fix and does
not show significant regression.

SimpleRpcServer and its related code is now also marked as @Deprecated.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcServer.java
2022-07-12 11:14:42 -07:00
Bryan Beaudreault
7dfed53819 HBASE-27188 Report maxStoreFileCount in jmx (#4609)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:19:30 -04:00
Bryan Beaudreault
a8a67d4314 HBASE-27186 Report block cache size metrics separately for L1 and L2 (#4608)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:09:57 -04:00
Duo Zhang
d054c93be1 HBASE-27189 NettyServerRpcConnection is not properly closed when the netty channel is closed (#4611)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 5bc867032299099822298ede1382e011224c3add)
2022-07-12 09:47:03 +08:00
Duo Zhang
decb96edd2 HBASE-26708 Netty leak detected and OutOfDirectMemoryError due to direct memory buffering with SASL implementation (#4596)
Co-authored-by: Norman Maurer <norman_maurer@apple.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 816e919e952de72c94543180870a438ff3c53caa)
2022-07-07 16:04:40 +08:00
Ujjawal
60521caf9f
HBASE-27175 - Failure to cleanup WAL split dir log should be at INFO level (#4593)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-06 16:35:22 -07:00
Bryan Beaudreault
87f22813f4 HBASE-27048 Server side scanner time limit should account for time in queue (#4562)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-06 14:21:56 -04:00