Commit Graph

13203 Commits

Author SHA1 Message Date
Mohammad Arshad 76db1e1791
HBASE-24940: runCatalogJanitor() API should return -1 to indicate already running status
Closes #2331

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 16:39:37 +05:30
mnpoonia a48515ab7d
HBASE-24970 Backport HBASE-20985 to branch-1
Closes #2334

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 14:06:42 +05:30
Abhey Rana 1dc75e74a7
[HBASE-24893] Fix failing TestLogLevel Unit Test (#2338)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-01 14:52:26 -07:00
Andrew Purtell 80ce76cb02 HBASE-24971 Upgrade JQuery to 3.5.1 (#2336)
- Update embedded minimized jquery to 3.5.1
- Update embedded minimized jquery.tablesorter to 2.31.3

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 10:41:28 -07:00
Zheng Wang 19e2878d2f
HBASE-24569 Get hostAndWeights in addition using localhost if it is null in local mode (#2339)
Closes #1909

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 18:43:29 +05:30
shahrs87 fb654a9125
HBASE-24957 ZKTableStateClientSideReader#isDisabledTable doesn't check if table exists or not
Closes #2323

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-01 14:01:18 +05:30
Zheng Wang 041debde02
HBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier
Closes #2270

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-30 20:32:33 +05:30
Zheng Wang 31e47af665
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2319

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-28 11:45:24 +05:30
ethanhur 8f946befe4
HBASE-14847 Add FIFO compaction section to HBase book
Closes #2298

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-25 18:52:43 +05:30
Andrew Purtell cbfbdd9635 Revert "HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider"
This reverts commit e7fdf58b3d.
2020-08-24 13:55:40 -07:00
Zheng Wang e7fdf58b3d
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2272

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-22 16:04:24 +05:30
Guanghao Zhang c2e0cf989e HBASE-24876 Fix the flaky job url in hbase-personality.sh (#2253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-13 16:57:02 +08:00
WenFeiYi 670d70deca
HBASE-24844 RecoverableZookeeper#close followed by ExecutorService shutdown
* Resolves Exception on standalone (master) shutdown

Closes #2239

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-12 17:17:07 +05:30
Duo Zhang 42a6d9a131 HBASE-24841 Change the jenkins job urls in our jenkinsfile (#2227)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-11 09:14:14 +08:00
Bharath Vissapragada d258cd07ac
HBASE-24846: Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-10 17:03:13 -07:00
Bharath Vissapragada 6bf44ddcc0
Revert "HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)"
This reverts commit 839ce8e560.

Reverting to apply as HBASE-24846.
2020-08-10 17:02:50 -07:00
Bo Cui 57e4144ddf
HBASE-21721 reduce write#syncs() times (#2220)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-08-10 18:13:14 +05:30
Bharath Vissapragada 839ce8e560
HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-06 09:31:41 -07:00
Nick Dimiduk 714a6f53d8 HBASE-24662 Update DumpClusterStatusAction to notice changes in region server count
Sometimes running chaos monkey, I've found that we lose accounting of
region servers. I've taken to a manual process of checking the
reported list against a known reference. It occurs to me that
ChaosMonkey has a known reference, and it can do this accounting for
me.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-06 09:18:51 -07:00
Wellington Ramos Chevreuil 2fd587384a
HBASE-24807 Backport HBASE-20417 to branch-1 (#2197)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-08-05 12:00:43 +01:00
Bharath Vissapragada 2c047eafc0
HBASE-24816: Remove unused credential hbaseqa-at-asf-jira (#2195)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-04 12:16:50 -07:00
Sean Busbey af18670665
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.

Closes #2188

adapted for jdk7

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2)
(cherry picked from commit 0806349ada)
2020-08-04 11:15:02 -05:00
Nick Dimiduk 1f0abf8279 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy ; ADDENDUM
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-08-03 12:57:11 -07:00
Nick Dimiduk 8d1228ece7 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy
Adds `protected abstract Logger getLogger()` to `Action` so that
implementation's names are logged when actions are performed.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>

foo
2020-08-03 12:57:11 -07:00
Zheng Wang 9e975d1b98
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:59:48 +05:30
Viraj Jasani 6e34609376
Revert "HBASE-24704 Make Table Schema easier to view with multiple families"
This reverts commit 4b77c00e4f.
2020-08-02 23:58:25 +05:30
Viraj Jasani 4b77c00e4f
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:54:36 +05:30
Sean Busbey 51161b5f48 HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 (#2174)
if hbase.rowlock.wait.duration is <=0 then log a message and treat it as a value of 1ms.

amended for branches-1

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 840a55761b)
2020-07-30 15:03:32 -05:00
Bharath Vissapragada ac576d23e5
HBASE-24788: Fix the connection leaks on getting hbase admin from unclosed connection (#2170)
Rewrote the patch for branch-1 since master has significanly diverged.

(cherry picked from commit dc5ef7af1f8b9e386495a73924c9442203f65a77)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>

 Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 Signed-off-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>

Co-authored-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>
2020-07-30 10:35:11 -07:00
Bharath Vissapragada daeccb1c46
HBASE-20226: Parallelize region manifest deletes (#2159) (#2171)
We observed this delete call to be a bottleneck for table with lots of
regions. Patch attempts to parallelize them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit f07f30ae24)
2020-07-30 10:29:02 -07:00
Toshihiro Suzuki b0d49aebea HBASE-24775 [hbtop] StoreFile size should be rounded off (#2144)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-28 08:34:07 +09:00
Viraj Jasani dd4417a9e2
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold (#2146)
Closes #2127

Signed-off-by: stack <stack@apache.org>
2020-07-28 01:10:02 +05:30
YeChao Chen b154f20c4d
HBASE-24777 InfoServer support ipv6 host and port
Closes #2147

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-27 22:32:03 +05:30
Mingliang Liu 527e4a67d8
HBASE-24696 Include JVM information on Web UI under "Software Attributes"
Closes #2117

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-22 14:00:09 +05:30
Nick Dimiduk 46f6d46b64 HBASE-24658 Update PolicyBasedChaosMonkey to handle uncaught exceptions
Running `ServerKillingChaosMonkey` via `RESTApiClusterManager` for any
duration of time slowly leaks region servers. I see failures on the
RESTApi side go unreported on the ChaosMonkey side. It seems like
`RuntimeException`s are being thrown and lost.

`PolicyBasedChaosMonkey` uses a primitive means of thread management
anyway. Update to use a thread pool, thread groups, and an
uncaughtExceptionHandler.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-21 09:59:39 -07:00
Mohammad Arshad d697c4061a
HBASE-24675: On Master restart all servers are assigned to default rsgroup
Closes #2102

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-20 19:11:08 +05:30
Zheng Wang fb0fb58677
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours
Closes #2099

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-07-19 20:13:08 +05:30
sguggilam 5211859058
HBASE-24740 Enable journal logging for HBase snapshot operation (#2076)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-17 13:27:08 -07:00
WenFeiYi 37903b0340
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-07-17 10:25:32 +08:00
lhofhansl 71aec0fb43
HBASE-24742 Improve performance of SKIP vs SEEK logic. (#2075) 2020-07-16 10:16:03 -07:00
Reid Chan b249092a5f
HBASE-24739 [Build] branch-1's build seems broken because of pylint (#2065)
* Specify the version
* by using apt-get instead of pip install
* Remove comment blocks

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-16 10:54:50 +08:00
Mohammad Arshad f5080eb9a6
HBASE-24721: rename_rsgroup overwriting the existing rsgroup
Closes #2066

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-15 18:42:38 +05:30
WenFeiYi e5b2334124
HBASE-24615 MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket
Closes #1962

Signed-off-by: David Manning
Signed-off-by: Rushabh
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-15 15:59:28 +05:30
Bo Cui 0841f12e4e
HBASE-24693 regioninfo#isLast() should point to EMPTY_END_ROW (readability improvement)
Closes #2051

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-14 15:48:16 +05:30
Geoffrey Jacoby be151e3fce
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0
Closes #1094

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-13 13:07:14 +05:30
David Manning 15c20be6ff
HBASE-24657 fix JsonBean.java from HBASE-23015 HBASE-20571 (branch-1)
Closes #1999

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-02 19:06:47 +05:30
Bharath Vissapragada 32690e1e89
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1976)
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b1)
(cherry picked from commit 2379a25f0c)
2020-06-25 18:36:14 -07:00
Abhishek Singh Chouhan 54c38c840c HBASE-24618 Backport HBASE-21204 to branch-1 2020-06-24 10:21:41 -07:00
Viraj Jasani d1449231f0
HBASE-24380 : Provide WAL splitting journal logging (#1860) (#1939)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-22 23:43:12 +05:30
Nick Dimiduk 0224dccdb8 HBASE-24360 RollingBatchRestartRsAction loses track of dead servers
`RollingBatchRestartRsAction` doesn't handle failure cases when
tracking its list of dead servers. The original author believed that a
failure to restart would result in a retry. However, by removing the
dead server from the failed list, that state is lost, and retry never
occurs. Because this action doesn't ever look back to the current
state of the cluster, relying only on its local state for the current
action invocation, it never realizes the abandoned server is still
dead. Instead, be more careful to only remove the dead server from the
list when the `startRs` invocation claims to have been successful.

Signed-off-by: stack <stack@apache.org>
(cherry picked from commit 0dae377f53)
2020-06-22 10:29:09 -07:00