Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,233 Commits 95 Branches 866 Tags
Commit Graph

8729 Commits

Author SHA1 Message Date
liuzhongjun
56ebf93870 HBASE-27560 fix consistencyCheck did not report the hole on last region (#4950) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c1b9d8ba068ab909174b5a21d3b2fa7f69578bef)
 2023-01-11 18:13:39 +08:00
Peter Somogyi
695dce5bd5
HBASE-27556 Reuse Zookeeper session of Master in LogCleaner (#4946) 
Backport of HBASE-23340
hmaster /hbase/replication/rs session expired (hbase replication default value is true, we don't use )
causes logcleaner can not clean oldWALs, which resulits in oldWALs too large (more than 2TB))

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2023-01-06 20:45:28 +01:00
LYCJeff
9164ed4815 HBASE-27530 Fix comment syntax errors (#4910) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f9518cc1a13becb669a3ca5c257850c4fcea989c)
 2022-12-14 23:27:12 +08:00
chenglei
bc45f1584e
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction (#4923) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-12-10 12:41:05 +08:00
Bryan Beaudreault
4814438cdf HBASE-27487 Addendum remove unused imports 2022-12-02 08:04:10 -05:00
Bri Augenreich
fea54b6afa HBASE-27487: Slow meta can create pathological feedback loop with multigets (#4900) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-12-01 08:32:03 -05:00
Wellington Ramos Chevreuil
6e562bb84b HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction (#4882) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-11-29 11:54:58 +00:00
Peter Somogyi
f0c857a784
HBASE-26320 Implement a separate thread pool for the LogCleaner (#4895) 
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Co-authored-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-11-27 19:14:44 +01:00
Ruanhui
5ce1d8f9bd HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
(cherry picked from commit bb9f43c6f9079b196e7a9d5a5eb35e721b092052)
 2022-11-27 23:50:05 +08:00
Peter Somogyi
0a37292113 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit b68dcf46e9eacbce3325f70163756f91b0447658)
 2022-11-25 15:54:52 +01:00
Ruanhui
a3ac3c581d HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee592959ee5ddd646a6769bb81a781d610)
 2022-11-23 20:48:15 +08:00
chenglei
acc4d13e7f HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d6ca51c310c41a194628f90e3815c17)
 2022-11-17 23:21:59 +08:00
YiweiLi4
fd92057f22 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a84676c4fac7eb697a21255abddf143a)
 2022-11-17 21:39:31 +08:00
mrzhao
843cc5f952 HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2c14bec591597a74f043b36f35bd6a3)
 2022-11-16 16:43:45 +08:00
Peter Somogyi
ba53872fb1
HBASE-27001 The deleted variable cannot be printed out (#4883) 
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0027d031ce6dec8b2ba0243c3a58554)
 2022-11-15 17:22:37 +01:00
Xin Sun
f7b2efc7b7 HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-15 13:00:57 +08:00
Duo Zhang
4605c323cc HBASE-27443 Use java11 in the general check of our jenkins job (#4845) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47b5340ff02e0dec144424ab91407e07)
 2022-11-08 00:20:33 +08:00
Ruanhui
5f55ff7578 HBASE-27414 Adjust hfilelink alternative paths order (#4847) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699fd2f03e88dcd37cb9dc7d20bacfa3f2)
 2022-11-05 23:03:34 +08:00
Duo Zhang
a6a5f03e5b HBASE-27437 TestHeapSize is flaky (#4841) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da9298b7f2f396826487d4133e78810895)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
 2022-10-28 23:22:56 +08:00
tianliuliu
098e59863b HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e9be5723ff5bfb0e97cadca4092455a)
 2022-10-24 18:56:49 +08:00
d-c-manning
cbad5f595c HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 14:19:59 -07:00
Andrew Purtell
de02ee2970 Preparing development version 2.4.16-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-13 11:39:40 -07:00
Andrew Purtell
35310fcd6b Preparing hbase release 2.4.15RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-13 11:39:36 -07:00
Duo Zhang
8c2dd12adb HBASE-27401 Clean up current broken 'n's in our javadoc (#4812) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f08cdde6ac0fde1342ffd050e8e02441)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
 2022-10-07 00:42:57 +08:00
Rajeshbabu Chintaguntla
9d7614bbdc HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:40:41 +05:30
Rajeshbabu Chintaguntla
1c90547e8a HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:54:12 +05:30
Rajeshbabu Chintaguntla
5fa5b0364f HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-05 04:03:45 +05:30
Bryan Beaudreault
804844c018 HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-04 08:29:57 -04:00
Aman Poonia
f24e7b55f9
HBASE-27384 Backport HBASE-27064 (CME in TestRegionNormalizerWorkQueue) to 2.4 (#4794) (#4468) 
Co-authored-by: Andrew Purtell <apurtell@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-09-26 22:59:58 -07:00
Andrew Purtell
e7b67a19b3
HBASE-27393 Frequent and not useful "Final timeLimitDelta" log lines (#4802) 
Signed-off-by: Viraj Jasani <virajjasani@apache.org>
 2022-09-26 17:54:49 -07:00
Wellington Ramos Chevreuil
e25b2a7cd0 HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781) 
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2022-09-20 14:37:01 +01:00
Duo Zhang
82f966474e
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4791) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-19 12:02:00 +08:00
Duo Zhang
c94ec54185 HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04cf2ffa71c23b80c5680d8cbb69234b)
 2022-09-15 15:35:50 +08:00
chenglei
b73348515e HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf105743de28c62a6442eba2ef04d17d46af)
 2022-09-08 16:44:09 +08:00
Xiaolin Ha
f7f2d7e1ae HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-05 21:16:52 +08:00
Istvan Toth
acc657aa59
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. (#4750) 
Signed-off-by: Sakthi <sakthi@apache.org>
 2022-08-31 15:51:18 +02:00
Ujjawal
8659c937b7
HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533) (#4734) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2022-08-27 11:21:31 -04:00
Huaxiang Sun
bcc725c56c Preparing development version 2.4.15-SNAPSHOT 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2022-08-23 23:18:32 +00:00
Huaxiang Sun
2e7d75a892 Preparing hbase release 2.4.14RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2022-08-23 23:18:18 +00:00
Huaxiang Sun
0bcbc02b5b Preparing development version 2.4.15-SNAPSHOT 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2022-08-22 19:38:35 +00:00
Huaxiang Sun
f507fb71c6 Preparing hbase release 2.4.14RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2022-08-22 19:38:24 +00:00
Fantasy-Jay
1227704af3 HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710) 
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a552970e592ed39735186b4364f85ed1)
 2022-08-20 21:11:04 +08:00
huaxiangsun
a925b333c2
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695) (#4703) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-15 09:17:10 -07:00
chaijunjie0101
ae8652cdbd HBASE-27282 CME in AuthManager causes region server crash (#4684) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d6641626a97529982720de2b73593e294869c4ca)
 2022-08-09 09:57:46 +08:00
Duo Zhang
25cf86e028 HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big (#4679) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 486d19e99ff4370bc60e0db235508198c84a00e3)
 2022-08-06 20:31:43 +08:00
LiangJun He
1183f06c16 HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect (#4678) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2dc26082be978796046d9124212e8c9d2d8a1f5d)
 2022-08-04 23:17:37 +08:00
huaxiangsun
e93ff10b01
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' Addendum (#4665) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-08-01 16:42:13 -07:00
Bryan Beaudreault
b5329877f1 HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-07-29 15:33:21 -04:00
huaxiangsun
aa0fa58d06
HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' (#4663) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-07-28 10:42:14 -07:00
Andrew Purtell
57cba05d09 HBASE-27087 TestQuotaThrottle times out 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-26 14:06:08 -07:00