17691 Commits

Author SHA1 Message Date
stack
e84b8891b0 Revert "HBASE-25908 Exclude jakarta.activation-api (#3299)"
This reverts commit 9d18d770b9f76926eed8cb4cad148e8c3239751e.
2021-05-27 18:41:54 -07:00
Wei-Chiu Chuang
9d18d770b9 HBASE-25908 Exclude jakarta.activation-api (#3299)
Signed-off-by: stack <stack@apache.org>
2021-05-27 18:36:51 -07:00
Wellington Ramos Chevreuil
fa577ad92c HBASE-25933 Log trace raw exception, instead of cause message in NettyRpcServerRequestDecoder (#3323)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(Cherry picked from commit feb89d988b73512c6c68072c4db669dbb703bfc6)
2021-05-27 20:04:42 +01:00
Rushabh Shah
286899450d HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream (#3315)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-26 10:43:48 -07:00
Pankaj
22c26f1fc8 HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager (#3250)
* HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager's start & retrievePassword method

Signed-off-by: stack <stack@apache.com>
(cherry picked from commit 2126ec94f0032220fcccdca463f0f185e3653ace)
2021-05-26 00:14:32 +05:30
GeorryHuang
4e079ace58
HBASE-25906 UI of master-status to show recent history of balancer desicion (#3303) (#3296)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-25 12:42:01 +05:30
Anoop Sam John
0df3deab92 HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream (#3292)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
2021-05-24 23:46:26 +05:30
GeorryHuang
a7e6cac7a0 HBASE-25791 UI of master-status to show a recent history of that why balancer was rejected to run (#3278)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-24 21:40:13 +08:00
caoliqing
1e1ac9eda3 HBASE-25892: 'False' should be 'True' in auditlog of listLabels (#3273)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-22 17:25:51 +08:00
sambong0113
0e18900c36 HBASE-25817 Memory leak from thrift server hashMap (#3257)
Use GuavaCache in thrift server hashmap

Signed-off-by: Michael Stack <stack@apache.org>
2021-05-22 10:51:36 +08:00
Sandeep Pal
646dbfee03
HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception (#3289) 2021-05-21 11:55:47 -07:00
Rushabh Shah
700499be36
HBASE-25827 Per Cell TTL tags get duplicated with increments causing tags length overflow (#3290)(#3210)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-21 23:00:52 +05:30
Andrew Purtell
e82340ec64 Preparing development version 2.4.4-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 12:38:15 -07:00
Andrew Purtell
401b60b217 Preparing hbase release 2.4.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
rel/2.4.3 2.4.3RC1
2021-05-19 12:38:07 -07:00
Andrew Purtell
bf518cff56 Revert "HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager (#3250)"
This reverts commit 21c1dc7e6c5adfe80b2a452e0b534eac6a2d86c9.
2021-05-19 12:29:24 -07:00
Andrew Purtell
2fec951303 Revert "HBASE-25032 Do not assign regions to region server which has not called regionServerReport yet (#3268)"
This reverts commit 2bf86468d82088366d79c539adc01018f735bcc8.
2021-05-19 12:29:12 -07:00
Andrew Purtell
ca3b267130 Revert "Amend HBASE-25032: Compliation fix for TestRSGroupsKillRS"
This reverts commit 4d44bfa8ad7762110a5b346079fce66e6a4c55ce.
2021-05-19 12:29:03 -07:00
Andrew Purtell
4eaba9e9b1 Revert "Preparing hbase release 2.4.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit c2707bc6a8c89d2a528950851c9a47e3ab9e1cab.
2021-05-19 12:28:57 -07:00
Andrew Purtell
49ed8cc306 Revert "Preparing development version 2.4.4-SNAPSHOT"
This reverts commit cf287aaf954b06e3e6d1da3bdf69b0dbcb49638e.
2021-05-19 12:28:48 -07:00
Andrew Purtell
cf287aaf95 Preparing development version 2.4.4-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 11:13:54 -07:00
Andrew Purtell
c2707bc6a8 Preparing hbase release 2.4.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 11:13:48 -07:00
Andrew Purtell
4d44bfa8ad Amend HBASE-25032: Compliation fix for TestRSGroupsKillRS 2021-05-19 10:54:33 -07:00
Andrew Purtell
97c8201f9a Revert "Preparing hbase release 2.4.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit f9ed394627b62ff6cd569d5815002428dc189307.
2021-05-19 10:52:24 -07:00
Andrew Purtell
ed71600540 Revert "Preparing development version 2.4.4-SNAPSHOT"
This reverts commit 231c37b4f64b31d4f3a2e627d9f4a226bd1542d5.
2021-05-19 10:52:15 -07:00
Andrew Purtell
231c37b4f6 Preparing development version 2.4.4-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 10:18:46 -07:00
Andrew Purtell
f9ed394627 Preparing hbase release 2.4.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 10:18:40 -07:00
Andrew Purtell
8ce0aba77e Revert "Preparing hbase release 2.4.3RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit af14fd998cc756e0e2bdad64ac72a543d0b12268.
2021-05-19 10:08:39 -07:00
Andrew Purtell
d82426c41c Revert "Preparing development version 2.4.4-SNAPSHOT"
This reverts commit 0c5c0e5da82a390e902f0e79700d04dd283e5c0f.
2021-05-19 10:07:40 -07:00
Duo Zhang
2bf86468d8 HBASE-25032 Do not assign regions to region server which has not called regionServerReport yet (#3268)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-05-18 10:43:13 +08:00
Pankaj
21c1dc7e6c HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager (#3250)
* HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager's start & retrievePassword method

Signed-off-by: stack <stack@apache.com>
(cherry picked from commit 2126ec94f0032220fcccdca463f0f185e3653ace)
2021-05-17 22:51:11 +05:30
Andrew Purtell
0c5c0e5da8 Preparing development version 2.4.4-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-14 13:12:49 -07:00
Andrew Purtell
5d40399bac Update CHANGES and RELEASENOTES for 2.4.3RC0 respin 2.4.3RC0 2021-05-14 13:12:49 -07:00
Andrew Purtell
13043ecf96 Revert "Preparing development version 2.4.4-SNAPSHOT"
This reverts commit 8fd02a75f832e36fdd157ba5602a5ff15efb1f84.
2021-05-14 13:12:49 -07:00
Viraj Jasani
112b58ad8c
HBASE-25884 Return empty records for disabled balancer in-memory queue (#3263)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Aman Poonia <apoonia@salesforce.com>
2021-05-14 12:57:59 +05:30
Michael Stack
1c829af56a HBASE-25876 Add retry if we fail to read all bytes of the protobuf magic marker (#3251)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2021-05-12 19:23:14 +01:00
Michael Stack
924f256006
HBASE-25867 Extra doc around ITBLL (#3242)
* HBASE-25867 Extra doc around ITBLL

Minor edits to a few log messages.
Explain how the '-c' option works when passed to ChaosMonkeyRunner.
Some added notes on ITBLL.
Fix whacky 'R' and 'Not r' thing in Master (shows when you run ITBLL).
In HRS, report hostname and port when it checks in (was debugging issue
where Master and HRS had different notions of its hostname).
Spare a dirty FNFException on startup if base dir not yet in place.

* Address Review by Sean

Signed-off-by: Sean Busbey <busbey@apache.org>
2021-05-11 11:23:14 -07:00
Catalin Luca
992d80ad39 HBASE-25859 Reference class incorrectly parses the protobuf magic marker (#3236)
Co-authored-by: Catalin Luca <luca@adobe.com>
Signed-off-by: stack <stack@apache.org>
2021-05-10 14:50:50 -05:00
Viraj Jasani
e4dc6eaa76
HBASE-25790 Test fix Addendum 2021-05-09 00:39:31 +05:30
GeorryHuang
26e9c5b3ce
HBASE-25790 NamedQueue 'BalancerRejection' for recent history of balancer skipping (#3182) (#3245)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-09 00:26:58 +05:30
Rushabh Shah
c33767029e
HBASE-25860 Add metric for successful wal roll requests. (#3238)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-08 13:08:34 +05:30
Andrew Purtell
6978b8a0ef HBASE-25774 ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations
Revert "HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2771)"

This reverts commit 5d7e2f71f74bcdb7cf1d530372fb3d0ffd03d6fd.
2021-05-07 17:56:57 -07:00
Andrew Purtell
4de3841074 HBASE-25854 Remove redundant AM in-memory state changes in CatalogJanitor (#3234)
In CatalogJanitor we schedule GCRegionProcedure to clean up both
filesystem and in-memory state after a split, and
GCMultipleMergedRegionsProcedure to do the same for merges. Both of these
procedures clean up in-memory state, but CatalogJanitor also does this
redundantly just after scheduling the procedures. The cleanup should be
done in only one place. Presumably we are using the procedures to do it in
a principled way. Remove the redundancy in CatalogJanitor and fix any
follow on issues, like test failures.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-06 09:17:35 -07:00
Andrew Purtell
c32b6c8eff HBASE-25847 More DEBUG and TRACE level logging in CatalogJanitor and HbckChore (#3230)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-05-05 17:02:18 -07:00
Andrew Purtell
0fc6852f6a HBASE-25835 Ignore duplicate split requests from regionserver reports (#3218)
Processing of the RS report happens asynchronously from other activities
which can mutate region state. For example, a split procedure may already
be running. A split procedure cannot succeed if the parent region is no
longer open, so we can ignore it in that case.

Note that submitting more than one split procedure for a given region is
harmless -- the split is fenced in the procedure handling -- but it would
be noisy in the logs. Only one procedure can succeed. The other
procedure(s) would abort during initialization and report failure with
WARN level logging.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2021-05-04 10:23:04 -07:00
Andrew Purtell
fd3e28364c HBASE-25836 RegionStates#getAssignmentsForBalancer should only care about OPEN or OPENING regions (#3219)
RegionStates#getAssignmentsForBalancer is used by the HMaster to
collect all regions of interest to the balancer for the next chore
iteration. We check if a table is in disabled state to exclude
regions that will not be of interest (because disabled regions are
or will be offline) or are in a state where they shouldn't be
mutated (like SPLITTING). The current checks are not actually
comprehensive.

Filter out regions not in OPEN or OPENING state when building the
set of interesting regions for the balancer to consider. Only
regions open (or opening) on the cluster are of interest to
balancing calculations for the current iteration. Regions in all
other states can be expected to not be of interest – either offline
(OFFLINE, or FAILED_*), not subject to balancer decisions now
(SPLITTING, SPLITTING_NEW, MERGING, MERGING_NEW), or will be
offline shortly (CLOSING) – until at least the next chore
iteration.

Add TRACE level logging.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-03 18:24:17 -07:00
Andrew Purtell
368d52fe99 HBASE-25840 CatalogJanitor warns about skipping gc of regions during RIT, but does not actually skip (#3223)
We claim in a WARN level log line to be "Playing-it-safe skipping merge/
split gc'ing of regions from hbase:meta while regions-in-transition (RIT)"
but do not actually skip because of a missing return. Remove the warning.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-03 18:17:56 -07:00
Duo Zhang
08507b86a8 HBASE-25838 Use double instead of Double in StochasticLoadBalancer (#3221)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-04 09:10:35 +08:00
Duo Zhang
a7814bbe57 HBASE-25825 RSGroupBasedLoadBalancer.onConfigurationChange should chain the request to internal balancer (#3209)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-04-30 22:57:29 +08:00
Andrew Purtell
8fd02a75f8 Preparing development version 2.4.4-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-04-27 14:58:08 -07:00
Andrew Purtell
af14fd998c Preparing hbase release 2.4.3RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-04-27 14:58:03 -07:00