5560 Commits

Author SHA1 Message Date
shahrs87
e1fc3c4fd0
[HBASE-24956] ConnectionManager#locateRegionInMeta waits for user region lock indefinitely. (#2415)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-18 13:49:24 -07:00
ankitjain64
f0acafc58e
HBASE-24764 : Add support of adding base peer configs via hbase-site.xml for all replication peers (#2327)
Note: branch-1 has design difference compared to other branches in the replication sub-system. HMaster does not coordinate replication actions in branch-1 and hence each RS is responsible for initing peers and updating ZK states. As part of this change we are updating zk state of peers after reading from configuration, so if there is a divergence in configuration across RS the result can be can be non-deterministic and the last RS RPC will win.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-17 09:39:55 -07:00
Clara Xiong
7801b45f47
HBASE-25006 Make the cost functions optional for StochastoicBalancer
Closes #2386

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-13 14:23:45 +05:30
Sandeep Pal
d6f0128c83
HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2389)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-12 12:47:30 -07:00
Viraj Jasani
c8d6d7a780
HBASE-25004 : Log RegionTooBusyException details (#2371)
Signed-off-by: mnpoonia <apoonia@salesforce.com>
Signed-off-by: stack <stack@apache.org>
2020-09-12 21:44:01 +05:30
Javier Akira Luca de Tena
624fd046ce
HBASE-24994 Add hedgedReadOpsInCurThread metric (#2368)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-11 13:49:33 +08:00
mnpoonia
e5c0a9422c
HBASE-24988 Do not merge regions if they are non adjacent in MergeNormalizationPlan.execute
Closes #2355

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-07 17:43:14 +05:30
Mohammad Arshad
76db1e1791
HBASE-24940: runCatalogJanitor() API should return -1 to indicate already running status
Closes #2331

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 16:39:37 +05:30
mnpoonia
a48515ab7d
HBASE-24970 Backport HBASE-20985 to branch-1
Closes #2334

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 14:06:42 +05:30
Abhey Rana
1dc75e74a7
[HBASE-24893] Fix failing TestLogLevel Unit Test (#2338)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-01 14:52:26 -07:00
Andrew Purtell
80ce76cb02 HBASE-24971 Upgrade JQuery to 3.5.1 (#2336)
- Update embedded minimized jquery to 3.5.1
- Update embedded minimized jquery.tablesorter to 2.31.3

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 10:41:28 -07:00
Zheng Wang
19e2878d2f
HBASE-24569 Get hostAndWeights in addition using localhost if it is null in local mode (#2339)
Closes #1909

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 18:43:29 +05:30
shahrs87
fb654a9125
HBASE-24957 ZKTableStateClientSideReader#isDisabledTable doesn't check if table exists or not
Closes #2323

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-01 14:01:18 +05:30
Zheng Wang
041debde02
HBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier
Closes #2270

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-30 20:32:33 +05:30
Zheng Wang
31e47af665
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2319

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-28 11:45:24 +05:30
Andrew Purtell
cbfbdd9635 Revert "HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider"
This reverts commit e7fdf58b3df5f68f5a7cf11ca3bafa1a3532b4e3.
2020-08-24 13:55:40 -07:00
Zheng Wang
e7fdf58b3d
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2272

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-22 16:04:24 +05:30
Bharath Vissapragada
d258cd07ac
HBASE-24846: Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-10 17:03:13 -07:00
Bharath Vissapragada
6bf44ddcc0
Revert "HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)"
This reverts commit 839ce8e5607a4796e1d742c4e73e93f5f602cef2.

Reverting to apply as HBASE-24846.
2020-08-10 17:02:50 -07:00
Bo Cui
57e4144ddf
HBASE-21721 reduce write#syncs() times (#2220)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-08-10 18:13:14 +05:30
Bharath Vissapragada
839ce8e560
HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-06 09:31:41 -07:00
Wellington Ramos Chevreuil
2fd587384a
HBASE-24807 Backport HBASE-20417 to branch-1 (#2197)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-08-05 12:00:43 +01:00
Sean Busbey
af18670665
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.

Closes #2188

adapted for jdk7

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2df89de37c2c3bd50e64292eaf28b11)
(cherry picked from commit 0806349adab338330428c900588234d7f6fcfcc2)
2020-08-04 11:15:02 -05:00
Zheng Wang
9e975d1b98
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:59:48 +05:30
Viraj Jasani
6e34609376
Revert "HBASE-24704 Make Table Schema easier to view with multiple families"
This reverts commit 4b77c00e4ff6c72eb5ac5c180c476c21d23a83a8.
2020-08-02 23:58:25 +05:30
Viraj Jasani
4b77c00e4f
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:54:36 +05:30
Sean Busbey
51161b5f48 HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 (#2174)
if hbase.rowlock.wait.duration is <=0 then log a message and treat it as a value of 1ms.

amended for branches-1

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 840a55761b4b3db6bfcf8ca5b7ae67509fc21566)
2020-07-30 15:03:32 -05:00
Bharath Vissapragada
ac576d23e5
HBASE-24788: Fix the connection leaks on getting hbase admin from unclosed connection (#2170)
Rewrote the patch for branch-1 since master has significanly diverged.

(cherry picked from commit dc5ef7af1f8b9e386495a73924c9442203f65a77)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>

 Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 Signed-off-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>

Co-authored-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>
2020-07-30 10:35:11 -07:00
Bharath Vissapragada
daeccb1c46
HBASE-20226: Parallelize region manifest deletes (#2159) (#2171)
We observed this delete call to be a bottleneck for table with lots of
regions. Patch attempts to parallelize them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit f07f30ae24e6d0e9151bb76aebf78928ec9572e3)
2020-07-30 10:29:02 -07:00
Viraj Jasani
dd4417a9e2
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold (#2146)
Closes #2127

Signed-off-by: stack <stack@apache.org>
2020-07-28 01:10:02 +05:30
YeChao Chen
b154f20c4d
HBASE-24777 InfoServer support ipv6 host and port
Closes #2147

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-27 22:32:03 +05:30
Mingliang Liu
527e4a67d8
HBASE-24696 Include JVM information on Web UI under "Software Attributes"
Closes #2117

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-22 14:00:09 +05:30
Zheng Wang
fb0fb58677
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours
Closes #2099

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-07-19 20:13:08 +05:30
sguggilam
5211859058
HBASE-24740 Enable journal logging for HBase snapshot operation (#2076)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-17 13:27:08 -07:00
WenFeiYi
37903b0340
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-07-17 10:25:32 +08:00
lhofhansl
71aec0fb43
HBASE-24742 Improve performance of SKIP vs SEEK logic. (#2075) 2020-07-16 10:16:03 -07:00
Geoffrey Jacoby
be151e3fce
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0
Closes #1094

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-13 13:07:14 +05:30
David Manning
15c20be6ff
HBASE-24657 fix JsonBean.java from HBASE-23015 HBASE-20571 (branch-1)
Closes #1999

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-02 19:06:47 +05:30
Bharath Vissapragada
32690e1e89
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1976)
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b197bfa4307172db5465214771b78d38)
(cherry picked from commit 2379a25f0c4f2bdd3ea91fa5e0ba63f034c8d21c)
2020-06-25 18:36:14 -07:00
Abhishek Singh Chouhan
54c38c840c HBASE-24618 Backport HBASE-21204 to branch-1 2020-06-24 10:21:41 -07:00
Viraj Jasani
d1449231f0
HBASE-24380 : Provide WAL splitting journal logging (#1860) (#1939)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-22 23:43:12 +05:30
BukrosSzabolcs
186373bea4 HBASE-22982: region server suspend/resume (#592)
* Add chaos monkey action for suspend/resume region servers
* Add these to relevant chaos monkeys

branch-1-backport-note: Graceful regionserver restart action wasn't
backported due to a dependency of "RegionMover" script. Can be done
later if needed.

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-06-22 10:29:09 -07:00
Josh Elser
404c2dd3fe HBASE-19365 Guard against a missing table descriptor which crashes master
While we never expect table descriptors to be missing, a corrupt meta
can result in the master crashing before regions get assigned. We can
guard against that happening with a simple null-check.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Closes #1908
2020-06-17 16:48:02 -04:00
Bharath Vissapragada
4dd59a0635 HBASE-24564: Make RS abort call idempotent.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2567d15)
2020-06-16 09:06:36 -07:00
satanson
5d64f062d8 HBASE-22870 reflection fails to access a private nested class
Signed-off-by Reid Chan <reidchan@apache.org>

(cherry picked from commit 7697d48cd7b636396d5f73be43326a4501a9ea43)
2020-06-15 18:22:32 -07:00
Anoop Sam John
81ee344439
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data. 2020-06-13 22:21:49 +05:30
sguggilam
a21e9049a5
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1886)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-12 16:54:18 +05:30
Andrew Purtell
f74d181914
HBASE-24525 [branch-1] Support ZooKeeper 3.6.0+ (#1879)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-06-10 11:44:22 -07:00
thangTang
e07aaf7fef
HBASE-24184 Backport HBASE-23896 to branch-1: Snapshot owner cannot delete snapshot when ACL is enabled and Kerberos is not enabled (#1510)
Signed-off-by: binlijin <binlijin@gmail.com>
2020-06-10 16:12:36 +08:00
Viraj Jasani
94a04fb88c
Revert "HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835)"
This reverts commit 4853961b2c83369cba4aace9db20661ea979094d.
2020-06-07 14:45:14 +05:30