Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,386 Commits 95 Branches 866 Tags
Commit Graph

8834 Commits

Author SHA1 Message Date
Viraj Jasani
9741f1a5c1 Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524) 
This reverts commit f3a48d19101a6a485628f71fc4b980fb95b44ad2.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
 2022-06-12 10:25:23 -07:00
Nick Dimiduk
cc2af766d6
HBASE-27095 HbckChore should produce a report 
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-10 15:47:08 +02:00
Nick Dimiduk
7ead4b1617 HBASE-27066 The Region Visualizer display failed 
Reviewed-by: litao <tomleescut@gmail.com>
 2022-06-09 13:09:38 +02:00
Nick Dimiduk
d24f4ce2f0 Revert "HBASE-27066 The Region Visualizer display failed (#4472)" 
This reverts commit 8b9df125a365d2b048fa9a98719197cbb9d4b7bd.
 2022-06-09 13:09:38 +02:00
liuzhuang2017
19f67d22d4 HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec7e3c86b60ae818d736b9f83fb69604)
 2022-06-06 13:42:08 +08:00
BukrosSzabolcs
8139cf6477 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-06-06 00:29:27 +01:00
huaxiangsun
5a13ad8137
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4484) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-03 15:27:00 -07:00
skysiders
0c5d6601da
HBASE-26985 check permission for SecureBulkLoadManager (#4379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-02 15:30:12 -07:00
Duo Zhang
2625c67e73 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac780a36b51064372868a31849df6727)
 2022-06-03 00:11:10 +08:00
Xiaolin Ha
8bf5256c24 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3fddf35f77b1e3f2b352110d296a2415)
 2022-06-03 00:08:45 +08:00
LiangJun He
a93b7cd654 HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4abb187467a9355f436d533928da7ef)
 2022-06-02 21:39:13 +08:00
Andrew Purtell
b7158a87ea Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 20:06:32 -07:00
Andrew Purtell
2da2dd917f Preparing hbase release 2.5.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 20:06:29 -07:00
Andrew Purtell
2f63d99c48 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 12:43:45 -07:00
litao
f0dcbe78a7 HBASE-27068 NPE occurs when the active master has not yet been elected (#4474) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
 2022-05-31 11:50:36 -07:00
Andrew Purtell
2a59ebffaa HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 11:33:43 -07:00
Istvan Toth
7f7c42e33e HBASE-27069 Hbase SecureBulkload permission regression (#4475) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-05-31 10:10:28 +01:00
litao
8b9df125a3 HBASE-27066 The Region Visualizer display failed (#4472) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-29 11:56:39 -07:00
Sergey Soldatov
c9fc396dfa HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-05-26 13:55:31 +01:00
Xiaolin Ha
e1843af1d5 HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403) (#4461) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-24 15:52:54 +08:00
Xiaolin Ha
4be25a3a61 HBASE-26320 Implement a separate thread pool for the LogCleaner (#3712) (#4460) 
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2022-05-24 14:34:47 +08:00
d-c-manning
188dfeec5f HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
 2022-05-21 09:24:42 -07:00
Xiaolin Ha
f81bb8b6ec HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:34:21 -07:00
Nick Dimiduk
8bbba7353e
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4456) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:14:15 -07:00
Andrew Purtell
f982e6d39c HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-20 15:11:23 -07:00
Duo Zhang
9f5ef981f9 HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a46a5df9201d24f19117b79967082b73)
 2022-05-18 20:51:37 +08:00
Nick Dimiduk
c47a2c3841 HBASE-26986 Trace a one-shot execution of a Master procedure 
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-18 13:08:42 +02:00
litao
c4d7d55958 HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a221f9f36ce7c8905d9ed063c6e9eac)
 2022-05-17 10:44:40 +05:30
Rushabh Shah
4ba62c82f8 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-13 18:25:23 -07:00
Tak Lon (Stephen) Wu
603f3f5d0c HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-13 13:30:39 -07:00
Duo Zhang
3ed733e865 HBASE-26999 Addendum fix spotless errors 2022-05-13 10:01:05 +08:00
Wellington Chevreuil
d55c90ee87 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way 
(Amending spotless errors after revert by Duo)
 2022-05-12 11:12:06 +01:00
Duo Zhang
28f848a35e Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)" 
Revert due to failure spotless:check

This reverts commit aa31b0f695ab02015a7a183aaf10ac9963a22ddb.
 2022-05-12 11:11:55 +01:00
Wellington Ramos Chevreuil
ea37b782e1 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-12 11:11:42 +01:00
Wellington Ramos Chevreuil
cdc0975d2e HBASE-26999 HStore should try write WAL compaction marker before repl… (#4407) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 7b7f57619b841c8aab483a1a5a6b11f1d87e7d5a)
 2022-05-09 15:15:04 +01:00
skysiders
38cd57c951
HBASE-26994 MasterFileSystem create directory without permission check (#4391) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-08 13:29:10 -07:00
Rushabh Shah
ffbdac12ca HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 2022-05-07 17:43:24 +00:00
litao
139fa2cff9
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-05 23:35:46 -07:00
Nick Dimiduk
48b1587d34 HBASE-26648 Improve fidelity of RegionLocator spans (addendum) 
Addendum extends the test case to cover both `RpcConnectionRegistry` and `ZKConnectionRegistry`.
 2022-05-03 13:47:35 +02:00
Nick Dimiduk
ede80fb108 HBASE-26648 Improve fidelity of RegionLocator spans 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-03 13:47:35 +02:00
d-c-manning
44884eaa81 HBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
 2022-05-02 11:05:40 -07:00
Duo Zhang
1aea663c6d HBASE-26899 Run spotless:apply 2022-05-01 22:52:40 +08:00
d-c-manning
adc9d07385 HBASE-26988 dynamic configuration of loadbalance.bytable (#4384) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
 2022-04-29 15:28:23 -07:00
d-c-manning
6556350d4f HBASE-22349 slop in StochasticLoadBalancer (#4371) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/BalancerTestBase.java
 2022-04-28 14:35:01 -07:00
liangxs
27c3584f90 HBASE-26975 Add on heap and off heap memstore info in rs web UI (#4368) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit cdf81ea5cca16cec3b854ac67bc08c43c489918b)
 2022-04-28 23:15:27 +08:00
liangxs
abedac5a2d HBASE-26980 Update javadoc of BucketCache.java (#4374) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c02e7553d46ddfb3b0911240f6edd4b900b869b6)
 2022-04-28 23:12:07 +08:00
Andrew Purtell
4b2ac4b38e HBASE-26979 StoreFileListFile logs frequent stacktraces at INFO level (#4373) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileListFile.java
 2022-04-27 18:03:50 -07:00
Bri Augenreich
3439c5bd90 HBASE-26581 Add metrics for failed replication edits (#4347) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-26 17:46:26 -04:00
Wellington Ramos Chevreuil
47c62a9165 HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366) 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit af13c6d4c67757c8029ae5e546ba1f2d1e9a4299)
 2022-04-25 14:20:14 +01:00
Ruanhui
e2ac5a9338 HBASE-26942 cache region locations when getAllRegionLocations (#4364) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-22 15:31:53 -04:00