Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,713 Commits 95 Branches 866 Tags
Commit Graph

17713 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sandeep Pal
5157521213
HBASE-25927: Fix the log messages by not stringifying the exceptions in log (#3338) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit 9a2027bf714fa9787733c442561ec1ac2b4a0153)
 2021-05-28 21:34:14 -07:00
Duo Zhang
2a84fd40d3 HBASE-25938 The SnapshotOfRegionAssignmentFromMeta.initialize call in FavoredNodeLoadBalancer is just a dummy one (#3329) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-05-29 11:10:52 +08:00
stack
fada9884a4 HBASE-25908 Exclude jakarta.activation-api (#3299) 
Reapply of a revert because commit message was in wrong format

Signed-off-by: stack <stack@apache.org>
 2021-05-28 13:27:13 -07:00
stack
5ce6005550 Revert "Subject: [PATCH] HBASE-25908 Exclude jakarta.activation-api (#3299)" 
This reverts commit 1e01c94ba3657b1b9a947db27be5ebeeab81dfd2.
 2021-05-28 13:27:13 -07:00
Baiqiang Zhao
bbe9558040
HBASE-25745 Deprecate/Rename config hbase.normalizer.min.region.count to hbase.normalizer.merge.min.region.count 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-05-28 13:10:20 -07:00
Victor
5aa39a975c
HBASE-25910 - Fix port assignment test (#3308) 
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-28 20:53:20 +05:30
Baiqiang Zhao
a1cac20e95 HBASE-25928 TestHBaseConfiguration#testDeprecatedConfigurations is broken with Hadoop 3.3 (#3320) 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-05-28 07:27:39 -07:00
mokai
b4e8b91414
HBASE-25718 Backport "HBASE-25705 Convert proto to RSGroupInfo is costly" (#3109) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2021-05-28 19:23:25 +08:00
Wei-Chiu Chuang
1e01c94ba3 Subject: [PATCH] HBASE-25908 Exclude jakarta.activation-api (#3299) 
Signed-off-by: stack <stack@apache.org>
 2021-05-27 18:47:20 -07:00
stack
a3aec54e06 Revert "HBASE-25908 Exclude jakarta.activation-api (#3299)" 
This reverts commit 21e9c6ae9e871892ee883bb48f2fc5457027098d.
 2021-05-27 18:40:52 -07:00
Wei-Chiu Chuang
21e9c6ae9e HBASE-25908 Exclude jakarta.activation-api (#3299) 
Signed-off-by: stack <stack@apache.org>
 2021-05-27 18:14:36 -07:00
Wellington Ramos Chevreuil
cad9ae386a HBASE-25933 Log trace raw exception, instead of cause message in NettyRpcServerRequestDecoder (#3323) 
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-05-27 20:03:17 +01:00
Duo Zhang
3cf0678aee HBASE-25926 Cleanup MetaTableAccessor references in FavoredNodeBalancer related code (#3313) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-05-27 16:25:01 +08:00
Rushabh Shah
e265eccf20
HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream (#3315) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-05-26 10:42:03 -07:00
Nick Dimiduk
f7358cd618 HBASE-25841 Add basic jshell support (addendum) 2021-05-25 10:10:11 -07:00
Baiqiang Zhao
563ebc214a
HBASE-25534 Honor TableDescriptor settings earlier in normalization (#2917) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-05-25 08:24:05 -07:00
Duo Zhang
2cb6cc8a6c HBASE-25894 Improve the performance for region load and region count related cost functions (#3276) 
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
 2021-05-25 18:07:33 +08:00
GeorryHuang
8754e88fa7
HBASE-25906 UI of master-status to show recent history of balancer desicion (#3303) (#3296) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-25 12:39:47 +05:30
Baiqiang Zhao
073f23e2bd HBASE-25513 When the table is turned on normalize, the first region may not be merged even the size is 0 (#2887) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-05-24 17:27:06 -07:00
Anoop Sam John
1649013b99 HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream (#3292) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
 2021-05-24 23:44:32 +05:30
Xiaolin Ha
76d56bc42e HBASE-25899 Improve efficiency of SnapshotHFileCleaner (#3280) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-05-24 22:18:43 +08:00
Duo Zhang
1c1acee2fb HBASE-25873 Refactor and cleanup the code for CostFunction (#3274) 
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
 2021-05-24 22:13:01 +08:00
Xiaolin Ha
16f865f65d HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3160) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-05-22 22:20:47 +08:00
caoliqing
a19dee1eed HBASE-25892: 'False' should be 'True' in auditlog of listLabels (#3273) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-05-22 17:25:43 +08:00
sambong0113
375aee2327 HBASE-25817 Memory leak from thrift server hashMap (#3257) 
Use GuavaCache in thrift server hashmap

Signed-off-by: Michael Stack <stack@apache.org>
 2021-05-22 10:51:09 +08:00
Sandeep Pal
926c1132c0
HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception 
Signed-off-by: Xu Cang <xcang@salesforce.com>
 2021-05-21 12:14:35 -07:00
Andrew Purtell
2d591ab3c4 HBASE-25869 WAL value compression (#3244) 
WAL storage can be expensive, especially if the cell values
represented in the edits are large, consisting of blobs or
significant lengths of text. Such WALs might need to be kept around
for a fairly long time to satisfy replication constraints on a space
limited (or space-contended) filesystem.

We have a custom dictionary compression scheme for cell metadata that
is engaged when WAL compression is enabled in site configuration.
This is fine for that application, where we can expect the universe
of values and their lengths in the custom dictionaries to be
constrained. For arbitrary cell values it is better to use one of the
available compression codecs, which are suitable for arbitrary albeit
compressible data.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-05-21 11:53:36 -07:00
Rushabh Shah
7b374b7c76
HBASE-25827 Per Cell TTL tags get duplicated with increments causing tags length overflow (#3290)(#3210) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-21 22:58:32 +05:30
Baiqiang Zhao
cd06870f07
HBASE-25682 Add a new command to update the configuration of all RSs in a RSGroup for branch-2 (#3106) 
* HBASE-25682 Add a new command to update the configuration of all RSs in a RSGroup

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-05-21 22:49:48 +05:30
Duo Zhang
d78c164429 HBASE-25897 TestRetainAssignmentOnRestart is flaky after HBASE-25032 (#3281) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-05-20 21:18:09 +08:00
GeorryHuang
3040be1438
HBASE-25791 UI of master-status to show a recent history of that why balancer was rejected to run (#3278) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-05-20 15:00:00 +08:00
Nick Dimiduk
d19e0587fa HBASE-25841 Add basic jshell support 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-05-19 12:02:30 -07:00
Nick Dimiduk
aab6e1d0ff
HBASE-25861 Correct the usage of Configuration#addDeprecation (#3249) 
Co-authored-by: Baiqiang Zhao <zbq.dean@gmail.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-05-18 06:53:31 -07:00
Duo Zhang
8110b18ab0 HBASE-25032 Do not assign regions to region server which has not called regionServerReport yet (#3268) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2021-05-18 10:43:01 +08:00
Pankaj
1a8d3c3b6b HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager (#3250) 
* HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager's start & retrievePassword method

Signed-off-by: stack <stack@apache.com>
(cherry picked from commit 2126ec94f0032220fcccdca463f0f185e3653ace)
 2021-05-17 12:21:47 +05:30
Duo Zhang
439fd4aff2 HBASE-25872 Add documentation for LoadBalancer about synchronization (#3267) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2021-05-17 10:20:48 +08:00
Duo Zhang
d5d972f92e HBASE-25883 The regionFinder and rackManager fields in BaseLoadBalancer should be volatile (#3262) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
 2021-05-17 09:54:40 +08:00
Viraj Jasani
1bb16fea5b
HBASE-25884 Return empty records for disabled balancer in-memory queue (#3263) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Aman Poonia <apoonia@salesforce.com>
 2021-05-14 12:57:24 +05:30
Duo Zhang
72d7641fb5
HBASE-25852 Move all the intialization work of LoadBalancer implementation to initialize method (#3248) (#3258) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-05-13 14:19:03 +08:00
Michael Stack
075545731a
HBASE-25876 Add retry if we fail to read all bytes of the protobuf magic marker (#3251) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2021-05-12 11:20:50 -07:00
Michael Stack
61d9b46aab HBASE-25867 Extra doc around ITBLL (#3242) 
* HBASE-25867 Extra doc around ITBLL

Minor edits to a few log messages.
Explain how the '-c' option works when passed to ChaosMonkeyRunner.
Some added notes on ITBLL.
Fix whacky 'R' and 'Not r' thing in Master (shows when you run ITBLL).
In HRS, report hostname and port when it checks in (was debugging issue
where Master and HRS had different notions of its hostname).
Spare a dirty FNFException on startup if base dir not yet in place.

* Address Review by Sean

Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-05-11 19:24:33 +01:00
Catalin Luca
4e507ccda0 HBASE-25859 Reference class incorrectly parses the protobuf magic marker (#3236) 
Co-authored-by: Catalin Luca <luca@adobe.com>
Signed-off-by: stack <stack@apache.org>
 2021-05-10 14:47:18 -05:00
GeorryHuang
63d49cb7ed
HBASE-25790 NamedQueue 'BalancerRejection' for recent history of balancer skipping (#3182) (#3245) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-09 00:09:23 +05:30
Rushabh Shah
90dc150b1b
HBASE-25860 Add metric for successful wal roll requests. (#3238) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-08 13:02:52 +05:30
Andrew Purtell
d60aa0a865 HBASE-25774 ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations 
Revert "HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2771)"

This reverts commit 3bb978894db2c7ce41010e403a83a8a9f5d1110e.
 2021-05-07 17:55:20 -07:00
niuyulin
5e65da64e2 HBASE-25837 TestRollingRestart is flaky (#3220) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-05-07 20:28:37 +08:00
xiaozhang0319
bec79d877f
HBASE-25850 Fix spotbugs warnings on branch-2 (#3239) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-05-07 20:21:53 +08:00
Andrew Purtell
2938ba421b HBASE-25854 Remove redundant AM in-memory state changes in CatalogJanitor (#3234) 
In CatalogJanitor we schedule GCRegionProcedure to clean up both
filesystem and in-memory state after a split, and
GCMultipleMergedRegionsProcedure to do the same for merges. Both of these
procedures clean up in-memory state, but CatalogJanitor also does this
redundantly just after scheduling the procedures. The cleanup should be
done in only one place. Presumably we are using the procedures to do it in
a principled way. Remove the redundancy in CatalogJanitor and fix any
follow on issues, like test failures.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-06 09:17:29 -07:00
Duo Zhang
2d4904ceea
HBASE-25851 Make LoadBalancer not extend Configurable interface (#3233) (#3235) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-05-06 23:39:43 +08:00
Andrew Purtell
b2c58331f3 HBASE-25847 More DEBUG and TRACE level logging in CatalogJanitor and HbckChore (#3230) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2021-05-05 17:02:12 -07:00