Baiqiang Zhao
479ae88be3
HBASE-25928 TestHBaseConfiguration#testDeprecatedConfigurations is broken with Hadoop 3.3 ( #3320 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: stack <stack@apache.org>
2021-05-28 07:24:48 -07:00
Rahul Kumar
560297d189
HBASE-25651 NORMALIZER_TARGET_REGION_SIZE needs a unit in its name ( #3063 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Baiqiang Zhao <ZhaoBQ>
2021-05-28 19:32:22 +08:00
Duo Zhang
7218c83f81
HBASE-25931 Move FavoredNodeManager to hbase-balancer module ( #3324 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-05-28 15:57:59 +08:00
Duo Zhang
ed8df5eded
HBASE-25758 Move MetaTableAccessor out of hbase-balancer module ( #3309 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-28 09:19:07 +08:00
Wei-Chiu Chuang
c88ae3add8
HBASE-25908 Exclude jakarta.activation-api ( #3299 )
...
Signed-off-by: stack <stack@apache.org>
2021-05-27 18:05:52 -07:00
Wellington Ramos Chevreuil
feb89d988b
HBASE-25933 Log trace raw exception, instead of cause message in NettyRpcServerRequestDecoder ( #3323 )
...
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-05-27 19:54:25 +01:00
Duo Zhang
63141bf576
HBASE-25926 Cleanup MetaTableAccessor references in FavoredNodeBalancer related code ( #3313 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-27 16:05:14 +08:00
Rushabh Shah
a22e418cf6
HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream ( #3314 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-26 10:40:44 -07:00
Nick Dimiduk
19fd42b1dc
HBASE-25841 Add basic jshell support (addendum)
2021-05-25 09:50:38 -07:00
Duo Zhang
76fbb8b965
HBASE-25818 Move StochasticLoadBalancer to hbase-balancer module ( #3206 )
...
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
2021-05-25 23:24:35 +08:00
Duo Zhang
6a77872879
HBASE-25894 Improve the performance for region load and region count related cost functions ( #3276 )
...
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
2021-05-25 18:04:06 +08:00
GeorryHuang
36affdaa8e
HBASE-25906 UI of master-status to show recent history of balancer desicion ( #3296 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-25 11:08:48 +05:30
Baiqiang Zhao
21aa553bc1
HBASE-25745 Deprecate/Rename config `hbase.normalizer.min.region.count` to `hbase.normalizer.merge.min.region.count`
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-05-24 13:03:27 -07:00
Anoop Sam John
f53ceeecb0
HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream ( #3292 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
2021-05-24 23:41:45 +05:30
Xiaolin Ha
b02c8102b7
HBASE-25899 Improve efficiency of SnapshotHFileCleaner ( #3280 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-24 22:15:47 +08:00
Duo Zhang
f94f4e29fe
HBASE-25873 Refactor and cleanup the code for CostFunction ( #3274 )
...
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
2021-05-24 18:14:55 +08:00
Mallikarjun
fe70fced07
HBASE-25888 Backup tests are categorically flakey ( #3279 )
...
cleanup backup tests setup and teardown
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-24 09:35:40 +08:00
Xiaolin Ha
7f6b778c14
HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky ( #3160 )
2021-05-22 21:56:17 +08:00
caoliqing
edde01c605
HBASE-25892: 'False' should be 'True' in auditlog of listLabels ( #3273 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-22 11:22:51 +08:00
sambong0113
b581b322a1
HBASE-25817 Memory leak from thrift server hashMap ( #3257 )
...
Use GuavaCache in thrift server hashmap
Signed-off-by: Michael Stack <stack@apache.org>
2021-05-22 09:55:15 +08:00
Andrew Purtell
8ec6fd9459
HBASE-25869 WAL value compression ( #3244 )
...
WAL storage can be expensive, especially if the cell values
represented in the edits are large, consisting of blobs or
significant lengths of text. Such WALs might need to be kept around
for a fairly long time to satisfy replication constraints on a space
limited (or space-contended) filesystem.
We have a custom dictionary compression scheme for cell metadata that
is engaged when WAL compression is enabled in site configuration.
This is fine for that application, where we can expect the universe
of values and their lengths in the custom dictionaries to be
constrained. For arbitrary cell values it is better to use one of the
available compression codecs, which are suitable for arbitrary albeit
compressible data.
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-05-21 11:05:52 -07:00
Rushabh Shah
dfa88e1ffe
HBASE-25827 Per Cell TTL tags get duplicated with increments causing tags length overflow ( #3210 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Aman Poonia <apoonia@salesforce.com>
2021-05-21 22:56:11 +05:30
Baiqiang Zhao
a1177b3e91
HBASE-25682 Add a new command to update the configuration of all RSs in a RSGroup ( #3080 )
...
* HBASE-25682 Add a new command to update the configuration of all RSs in a RSGroup
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2021-05-21 22:49:25 +05:30
Sandeep Pal
15e861169f
HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception ( #3283 )
...
* HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception
2021-05-20 13:31:44 -07:00
Duo Zhang
7c24ed4f45
HBASE-25897 TestRetainAssignmentOnRestart is flaky after HBASE-25032 ( #3281 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-05-20 20:58:53 +08:00
Nick Dimiduk
fe47557f4c
HBASE-25841 Add basic jshell support
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-19 11:37:10 -07:00
GeorryHuang
5b9940907e
HBASE-25791 UI of master-status to show a recent history of that why balancer was rejected to run ( #3275 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-19 12:05:29 +08:00
Duo Zhang
741b4b4674
HBASE-25032 Do not assign regions to region server which has not called regionServerReport yet ( #3268 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-05-18 08:08:03 +08:00
Pankaj
2126ec94f0
HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager ( #3250 )
...
* HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager's start & retrievePassword method
Signed-off-by: stack <stack@apache.com>
2021-05-17 12:17:24 +05:30
Duo Zhang
1c6994ad70
HBASE-25872 Add documentation for LoadBalancer about synchronization ( #3267 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-05-17 10:17:24 +08:00
Duo Zhang
85d8ec7dae
HBASE-25883 The regionFinder and rackManager fields in BaseLoadBalancer should be volatile ( #3262 )
...
Signed-off-by: meiyi <myimeiyi@gmail.com>
2021-05-15 20:20:03 +08:00
Mallikarjun
8ae4d65aa5
HBASE-25870 Validate only direct ancestors instead of entire history for a particular backup
...
Co-authored-by: Mallikarjun <mallikvarjun@gmail.com>
Signed-off-by: stack <stack@apache.org>
2021-05-14 09:42:03 -07:00
Nick Dimiduk
4115c2ed8c
Revert "while creating manifest, search only for ancestors insteadd of all of history ( #3246 )"
...
This reverts commit b65733c093
.
2021-05-14 09:35:50 -07:00
Baiqiang Zhao
d69d5c24b1
HBASE-25861 Correct the usage of Configuration#addDeprecation ( #3249 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-05-14 09:31:06 -07:00
haxiaolin
f6c3ecacdc
Add haxiaolin to pom.xml
2021-05-14 22:57:26 +08:00
Viraj Jasani
0955a7a22e
HBASE-25884 Return empty records for disabled balancer in-memory queue ( #3263 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Aman Poonia <apoonia@salesforce.com>
2021-05-14 12:54:07 +05:30
Mallikarjun
b65733c093
while creating manifest, search only for ancestors insteadd of all of history ( #3246 )
...
Co-authored-by: Mallikarjun <mallikvarjun@gmail.com>
2021-05-12 16:43:17 -07:00
Che Xun
cdac8fdb7c
HBASE-25862 update reference guide for log4j2.xml ( #3252 )
2021-05-12 16:26:31 -07:00
Michael Stack
630c73fda4
HBASE-25867 Extra doc around ITBLL ( #3242 )
...
* HBASE-25867 Extra doc around ITBLL
Minor edits to a few log messages.
Explain how the '-c' option works when passed to ChaosMonkeyRunner.
Some added notes on ITBLL.
Fix whacky 'R' and 'Not r' thing in Master (shows when you run ITBLL).
In HRS, report hostname and port when it checks in (was debugging issue
where Master and HRS had different notions of its hostname).
Spare a dirty FNFException on startup if base dir not yet in place.
* Address Review by Sean
Signed-off-by: Sean Busbey <busbey@apache.org>
2021-05-11 19:26:57 +01:00
Duo Zhang
29bd3dd586
HBASE-25852 Move all the intialization work of LoadBalancer implementation to initialize method ( #3248 )
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-11 22:03:33 +08:00
Catalin Luca
2b6a91a1da
HBASE-25859 Reference class incorrectly parses the protobuf magic marker ( #3236 )
...
Co-authored-by: Catalin Luca <luca@adobe.com>
Signed-off-by: stack <stack@apache.org>
2021-05-10 12:45:23 -07:00
Rushabh Shah
8c2332d465
HBASE-25860 Add metric for successful wal roll requests. ( #3238 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-08 12:58:29 +05:30
Duo Zhang
c2a1d31270
HBASE-25774 Addendum fix compile error
2021-05-08 13:56:57 +08:00
Andrew Purtell
02b018cf1a
HBASE-25774 ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations
...
Revert "HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2769 )"
This reverts commit 1e4639d2eb
.
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
2021-05-07 18:21:46 -07:00
niuyulin
6cfff27465
HBASE-25837 TestRollingRestart is flaky ( #3220 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-07 18:58:45 +08:00
Andrew Purtell
6309c090b5
HBASE-25854 Remove redundant AM in-memory state changes in CatalogJanitor ( #3234 )
...
In CatalogJanitor we schedule GCRegionProcedure to clean up both
filesystem and in-memory state after a split, and
GCMultipleMergedRegionsProcedure to do the same for merges. Both of these
procedures clean up in-memory state, but CatalogJanitor also does this
redundantly just after scheduling the procedures. The cleanup should be
done in only one place. Presumably we are using the procedures to do it in
a principled way. Remove the redundancy in CatalogJanitor and fix any
follow on issues, like test failures.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-06 09:13:33 -07:00
Duo Zhang
ba4cb91211
HBASE-25851 Make LoadBalancer not extend Configurable interface ( #3233 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-06 16:11:46 +08:00
Andrew Purtell
cc88cf0ecf
HBASE-25847 More DEBUG and TRACE level logging in CatalogJanitor and HbckChore ( #3230 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-05-05 17:01:00 -07:00
Nick Dimiduk
eb9b54304e
HBASE-25843 move master http-related code into o.a.h.h.master.http
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-05 08:34:37 -07:00
Duo Zhang
90f986497b
HBASE-25834 Remove balanceTable method from LoadBalancer interface ( #3217 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-05 15:48:01 +08:00