Commit Graph

13107 Commits

Author SHA1 Message Date
bitterfox d07ef8fbcb
HBASE-25670 Backport HBASE-25665 to branch-1 (#3059)
Signed-off-by: stack <stack@apache.org>
2021-03-29 13:02:52 -07:00
Baiqiang Zhao 060e9e7cb1
HBASE-25687 Backport "HBASE-25681 Add a switch for server/table queryMeter" to branch-2 and branch-1 (#3082)
Signed-off-by: stack <stack@apache.org>
2021-03-29 12:25:45 -07:00
Toshihiro Suzuki 90a83f5a6a HBASE-25686 [hbtop] Add some javadoc
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-03-27 17:32:21 +09:00
Andrew Purtell 87527d62ad
HBASE-25699 [branch-1] UnsupportedOperationException in DumpClusterStatusAction (#3094)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-03-26 14:16:42 -07:00
caroliney14 7652bef985
HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2770)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-03-25 17:11:22 -07:00
Aman Poonia 35bb776f55
HBASE-25593 Backport changes from HBASE-24418 to branch-1 (#2991)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-03-25 01:07:42 +05:30
YutSean 74bb6a7a3a
HBASE-25677 Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy load (#3066)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-03-24 14:12:51 +08:00
Sandeep Pal 97c152ea7a
HBASE-25627: HBase replication should have a metric to represent if the source is stuck getting initialized (#3009)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-03-22 22:55:04 -07:00
bitterfox 716c685497
HBASE-25672 Backport HBASE-25608 to branch-1 (#3068)
Signed-off-by: stack <stack@apache.org>
2021-03-22 08:57:11 -07:00
Toshihiro Suzuki f8078009e9
HBASE-25258 Backport HBASE-24776 "[hbtop] Support Batch mode" to branch-1 (#3065)
Signed-off-by: stack stack@apache.org
2021-03-20 11:16:26 +09:00
shahrs87 bea87b30ec
HBASE-25679 Size of log queue metric is incorrect (#3072)
Co-authored-by: Rushabh <rushabh.shah@salesforce.com>
Signed-off-by: stack <stack@apache.org>
2021-03-19 16:17:35 -07:00
shahrs87 2a979e8bb0
HBASE-25622 Result#compareResults should compare tags. (#3004)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2021-03-18 12:27:16 -07:00
Bo Cui 9534a1b150
HBASE-24395 Backport HBASE-20589 to branch-1 (#2690)
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
Signed-off-by: stack <stack@apache.org>
2021-03-15 16:55:41 -07:00
d-c-manning ba80103a8c
HBASE-25648 Fix normalizer and TestSimpleRegionNormalizerOnCluster in branch-1 (#3038)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-03-09 11:43:10 +05:30
Narges Shadab 4546163d90
HBASE-25626 Possible Resource Leak in HeterogeneousRegionCountCostFunction
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by shahrs87 <shahrs87@gmail.com>
2021-03-05 15:14:49 +05:30
Rahul Kumar c90d122653
HBASE-25460 : Expose drainingServers as cluster metric (#2994) (#2995)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-03-04 12:59:07 +05:30
Sandeep Pal 4cfbf19791
HBASE-25583: NoNodeException of the peer should call the remove peer workflow (#2970)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-02-26 16:00:37 -08:00
Josh Elser a7574ec9a0 HBASE-25601 Use ASF-official mailing list archives
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Closes #2983
2021-02-25 11:43:56 -05:00
Sandeep Pal 19fe18e466
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2975)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-02-23 13:20:00 -08:00
Aman Poonia d37f734299
HBASE-25592 Improve normalizer code in line with HBASE-23932 (#2972)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-02-23 10:41:34 +05:30
shahrs87 9e9301a242
[HBASE-25539] Add age of oldest wal metric (#2963)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-02-22 15:00:41 -08:00
Sandeep Pal f9a91488b2
HBASE-25583: Handle the running replication source gracefully with replication nodes deleted (#2960)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-02-19 10:15:45 -08:00
Sandeep Pal 2d26c94ef0
HBASE-25541 : Setting the path to null when we dequeue the current log (#2959)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-02-18 11:58:33 +05:30
Aman Poonia e2a00af843
HBASE-25569 Adding region count and average region size in a table at regionserver level (#2948)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-02-13 09:35:04 +05:30
YutSean 7d80d9971a
HBASE-25543 When configuration hadoop.security.authorization is set to false, the system will still try to authorize an RPC and raise AccessDeniedException (#2932) (#2919)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-02-07 21:11:35 +05:30
Bharath Vissapragada f52b457cf9
HBASE-25528: Dedicated merge dispatch threadpool on master (#2909)
Adds "hbase.master.executor.merge.dispatch.threads" and defaults to 2.

Also adds additional logging that includes the number of split plans
and merge plans computed for each normalizer run.

(cherry picked from commit 36b4698cea)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-02-02 11:15:09 -08:00
Baiqiang Zhao 3f0829abba
HBASE-25533 The metadata of the table and family should not be an empty string (#2916) (#2906)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-01-29 21:05:59 +05:30
shahrs87 5c9ee97aab
HBASE-25536 Remove 0 length wal file from logQueue if it belongs to old sources (#2912) (#2908)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-01-29 17:59:20 +05:30
Aman Poonia cf337c4b2c
HBASE-25523 Region normalizer chore thread is getting killed (#2899)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-01-26 12:01:43 +05:30
Geoffrey Jacoby 1d89ef96e7
HBASE-25525 - WALKey Extended Attributes don't serialize to Replicati… (#2900)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-01-25 08:37:06 -08:00
caroliney14 a8190124b6
HBASE-25329 Dump ritsOverThreshold in logs (#2762) (#2761)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-01-20 18:21:52 +05:30
Wei-Chiu Chuang a6b0d5bef6
Backport HBASE-25287 to branch-1 (#2799) 2021-01-06 13:00:46 -08:00
Gary Wang e37ec1bd0b
HBASE-25463 fix comment error of append.rb (#2845)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-01-05 20:14:29 +05:30
lujiefsi 8a16aed817
HBASE-25441 : add security check for some APIs in RSRpcServices (#2832) (#2810)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-12-31 00:27:57 +05:30
lujiefsi 14d8f2f268
HBASE-25432 : branch-1 backport (Update SecureTestUtil) (#2820)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-12-29 17:34:36 +05:30
Viraj Jasani 73d079eb67
HBASE-24620 : Replace String.join with StringBuilder for JDK 7 compatibility 2020-12-22 11:16:35 +05:30
scotthunt e9c45a1353 HBASE-25084 Add "regexstringnocase" to ParseFilter for case-insensitivity (#2784)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-12-21 12:55:39 +00:00
Lokesh Khurana e250c7fc63
HBASE-24620 : Add a ClusterManager which submits command to ZooKeeper and its Agent which picks and execute those Commands (#2299)
Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Aman Poonia <apoonia@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-12-21 16:13:18 +05:30
shahrs87 d8083e8599
HBASE-25246 Backup/Restore hbase cell tags (#2767)
Closes #2745

Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-12-16 19:13:35 +05:30
Andrew Purtell 8e4516536c HBASE-25292 Improve InetSocketAddress usage discipline (#2669)
Network identities should be bound late. Remote addresses should be
resolved at the last possible moment, just before connect(). Network
identity mappings can change, so our code should not inappropriately
cache them. Otherwise we might miss a change and fail to operate normally.

Revert "HBASE-14544 Allow HConnectionImpl to not refresh the dns on errors"
Removes hbase.resolve.hostnames.on.failure and related code. We always
resolve hostnames, as late as possible.

Preserve InetSocketAddress caching per RPC connection. Avoids potential
lookups per Call.

Replace InetSocketAddress with Address where used as a map key. If we want
to key by hostname and/or resolved address we should be explicit about it.
Using Address chooses mapping by hostname and port only.

Add metrics for potential nameservice resolution attempts, whenever an
InetSocketAddress is instantiated for connect; and metrics for failed
resolution, whenever InetSocketAddress#isUnresolved on the new instance
is true.

* Use ServerName directly to build a stub key

* Resolve and cache ISA on a RpcChannel as late as possible, at first call

* Remove now invalid unit test TestCIBadHostname

We resolve DNS at the latest possible time, at first call, and do not
resolve hostnames for creating stubs at all, so this unit test cannot
work now.

Reviewed-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-12-04 10:19:53 -08:00
Laxman Goswami 23ef0cb36a
HBASE-25230 Embedded zookeeper server not clean up the old data
Closes #2732

Signed-off-by: maoling <maoling199210191@sina.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-12-03 14:57:59 +05:30
Akshay Sudheer 298e721839 HBASE-25321 The sort icons not shown after Upgrade JQuery to 3.5.1 (#2694)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-11-29 21:55:10 +08:00
Lokesh Khurana fac1d4aab7
HBASE-25237 : 'hbase master stop' shuts down the cluster, not the master only (#2705)
Closes #2713

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-11-27 16:34:37 +05:30
Andrew Purtell 30d988f6e2
HBASE-24640 [branch-1] Purge use of VisibleForTesting (#2697)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-11-25 14:25:24 -08:00
Reid Chan 4640b2224d
HBASE-25285 [branch-1] Fix two methods removed problems reported by compat-check (#2658)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-11-24 22:17:19 +08:00
Reid Chan edccfe439a
HBASE-25313 [branch-1] Fix the broken pre-commit
Closes #2686

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-11-21 12:47:41 +05:30
Mate Szalay-Beko a0f55cd439 HBASE-25261 Upgrade Bootstrap to 3.4.1
HBase UI is currently using in bootstrap 3.3.7. This version is vulnerable to 4
medium CVEs (CVE-2018-14040, CVE-2018-14041, CVE-2018-14042, and CVE-2019-8331).
Details on all the bootstrap versions and vulnerabilities is
here: https://snyk.io/vuln/npm:bootstrap

Upgrading to bootstrap 4 would be nice, but potentially more work to do. We
should at least upgrade to the latest bootstrap 3, which is 3.4.1 currently.

closes #2661

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-11-17 14:35:25 +01:00
WenFeiYi 18e9660962
HBASE-25240 gson format of RpcServer.logResponse is abnormal
Closes #2623

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-11-05 20:25:43 +05:30
Andrew Purtell 6626cc1a33
HBASE-25212 [branch-1] Optionally abort requests in progress after deciding a region should close (#2576)
If hbase.regionserver.close.wait.abort is set to true, interrupt RPC
handler threads holding the region close lock.

Until requests in progress can be aborted, wait on the region close lock for
a configurable interval (specified by hbase.regionserver.close.wait.time.ms,
default 60000 (1 minute)). If we have failed to acquire the close lock after
this interval elapses, if allowed (also specified by
hbase.regionserver.close.wait.abort), abort the regionserver.

We will attempt to interrupt any running handlers every
hbase.regionserver.close.wait.interval.ms (default 10000 (10 seconds)) until
either the close lock is acquired or we reach the maximum wait time.

Define a subset of region operations as interruptible. Track threads holding
the close lock transiting those operations. Set the thread interrupt status
of tracked threads when trying to close the region. Use the thread interrupt
status where safe to break out of request processing.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-11-03 15:22:47 -08:00
GeorryHuang 16b91c8f49
HBASE-25090 CompactionConfiguration logs unrealistic store file sizes (#2612)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-11-02 13:58:26 -08:00