12983 Commits

Author SHA1 Message Date
Bharath Vissapragada
2c047eafc0
HBASE-24816: Remove unused credential hbaseqa-at-asf-jira (#2195)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-04 12:16:50 -07:00
Sean Busbey
af18670665
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.

Closes #2188

adapted for jdk7

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2df89de37c2c3bd50e64292eaf28b11)
(cherry picked from commit 0806349adab338330428c900588234d7f6fcfcc2)
2020-08-04 11:15:02 -05:00
Nick Dimiduk
1f0abf8279 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy ; ADDENDUM
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-08-03 12:57:11 -07:00
Nick Dimiduk
8d1228ece7 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy
Adds `protected abstract Logger getLogger()` to `Action` so that
implementation's names are logged when actions are performed.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>

foo
2020-08-03 12:57:11 -07:00
Zheng Wang
9e975d1b98
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:59:48 +05:30
Viraj Jasani
6e34609376
Revert "HBASE-24704 Make Table Schema easier to view with multiple families"
This reverts commit 4b77c00e4ff6c72eb5ac5c180c476c21d23a83a8.
2020-08-02 23:58:25 +05:30
Viraj Jasani
4b77c00e4f
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:54:36 +05:30
Sean Busbey
51161b5f48 HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 (#2174)
if hbase.rowlock.wait.duration is <=0 then log a message and treat it as a value of 1ms.

amended for branches-1

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 840a55761b4b3db6bfcf8ca5b7ae67509fc21566)
2020-07-30 15:03:32 -05:00
Bharath Vissapragada
ac576d23e5
HBASE-24788: Fix the connection leaks on getting hbase admin from unclosed connection (#2170)
Rewrote the patch for branch-1 since master has significanly diverged.

(cherry picked from commit dc5ef7af1f8b9e386495a73924c9442203f65a77)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>

 Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 Signed-off-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>

Co-authored-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>
2020-07-30 10:35:11 -07:00
Bharath Vissapragada
daeccb1c46
HBASE-20226: Parallelize region manifest deletes (#2159) (#2171)
We observed this delete call to be a bottleneck for table with lots of
regions. Patch attempts to parallelize them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit f07f30ae24e6d0e9151bb76aebf78928ec9572e3)
2020-07-30 10:29:02 -07:00
Toshihiro Suzuki
b0d49aebea HBASE-24775 [hbtop] StoreFile size should be rounded off (#2144)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-28 08:34:07 +09:00
Viraj Jasani
dd4417a9e2
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold (#2146)
Closes #2127

Signed-off-by: stack <stack@apache.org>
2020-07-28 01:10:02 +05:30
YeChao Chen
b154f20c4d
HBASE-24777 InfoServer support ipv6 host and port
Closes #2147

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-27 22:32:03 +05:30
Mingliang Liu
527e4a67d8
HBASE-24696 Include JVM information on Web UI under "Software Attributes"
Closes #2117

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-22 14:00:09 +05:30
Nick Dimiduk
46f6d46b64 HBASE-24658 Update PolicyBasedChaosMonkey to handle uncaught exceptions
Running `ServerKillingChaosMonkey` via `RESTApiClusterManager` for any
duration of time slowly leaks region servers. I see failures on the
RESTApi side go unreported on the ChaosMonkey side. It seems like
`RuntimeException`s are being thrown and lost.

`PolicyBasedChaosMonkey` uses a primitive means of thread management
anyway. Update to use a thread pool, thread groups, and an
uncaughtExceptionHandler.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-21 09:59:39 -07:00
Mohammad Arshad
d697c4061a
HBASE-24675: On Master restart all servers are assigned to default rsgroup
Closes #2102

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-20 19:11:08 +05:30
Zheng Wang
fb0fb58677
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours
Closes #2099

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-07-19 20:13:08 +05:30
sguggilam
5211859058
HBASE-24740 Enable journal logging for HBase snapshot operation (#2076)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-17 13:27:08 -07:00
WenFeiYi
37903b0340
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-07-17 10:25:32 +08:00
lhofhansl
71aec0fb43
HBASE-24742 Improve performance of SKIP vs SEEK logic. (#2075) 2020-07-16 10:16:03 -07:00
Reid Chan
b249092a5f
HBASE-24739 [Build] branch-1's build seems broken because of pylint (#2065)
* Specify the version
* by using apt-get instead of pip install
* Remove comment blocks

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-16 10:54:50 +08:00
Mohammad Arshad
f5080eb9a6
HBASE-24721: rename_rsgroup overwriting the existing rsgroup
Closes #2066

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-15 18:42:38 +05:30
WenFeiYi
e5b2334124
HBASE-24615 MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket
Closes #1962

Signed-off-by: David Manning
Signed-off-by: Rushabh
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-15 15:59:28 +05:30
Bo Cui
0841f12e4e
HBASE-24693 regioninfo#isLast() should point to EMPTY_END_ROW (readability improvement)
Closes #2051

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-14 15:48:16 +05:30
Geoffrey Jacoby
be151e3fce
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0
Closes #1094

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-13 13:07:14 +05:30
David Manning
15c20be6ff
HBASE-24657 fix JsonBean.java from HBASE-23015 HBASE-20571 (branch-1)
Closes #1999

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-02 19:06:47 +05:30
Bharath Vissapragada
32690e1e89
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1976)
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b197bfa4307172db5465214771b78d38)
(cherry picked from commit 2379a25f0c4f2bdd3ea91fa5e0ba63f034c8d21c)
2020-06-25 18:36:14 -07:00
Abhishek Singh Chouhan
54c38c840c HBASE-24618 Backport HBASE-21204 to branch-1 2020-06-24 10:21:41 -07:00
Viraj Jasani
d1449231f0
HBASE-24380 : Provide WAL splitting journal logging (#1860) (#1939)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-22 23:43:12 +05:30
Nick Dimiduk
0224dccdb8 HBASE-24360 RollingBatchRestartRsAction loses track of dead servers
`RollingBatchRestartRsAction` doesn't handle failure cases when
tracking its list of dead servers. The original author believed that a
failure to restart would result in a retry. However, by removing the
dead server from the failed list, that state is lost, and retry never
occurs. Because this action doesn't ever look back to the current
state of the cluster, relying only on its local state for the current
action invocation, it never realizes the abandoned server is still
dead. Instead, be more careful to only remove the dead server from the
list when the `startRs` invocation claims to have been successful.

Signed-off-by: stack <stack@apache.org>
(cherry picked from commit 0dae377f53db6388a933fd7a1ebe231cf0d997d7)
2020-06-22 10:29:09 -07:00
BukrosSzabolcs
186373bea4 HBASE-22982: region server suspend/resume (#592)
* Add chaos monkey action for suspend/resume region servers
* Add these to relevant chaos monkeys

branch-1-backport-note: Graceful regionserver restart action wasn't
backported due to a dependency of "RegionMover" script. Can be done
later if needed.

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-06-22 10:29:09 -07:00
WenFeiYi
655658ce36
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected
Closes #1930

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-19 23:09:17 +05:30
Josh Elser
404c2dd3fe HBASE-19365 Guard against a missing table descriptor which crashes master
While we never expect table descriptors to be missing, a corrupt meta
can result in the master crashing before regions get assigned. We can
guard against that happening with a simple null-check.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Closes #1908
2020-06-17 16:48:02 -04:00
Bharath Vissapragada
4dd59a0635 HBASE-24564: Make RS abort call idempotent.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2567d15)
2020-06-16 09:06:36 -07:00
satanson
5d64f062d8 HBASE-22870 reflection fails to access a private nested class
Signed-off-by Reid Chan <reidchan@apache.org>

(cherry picked from commit 7697d48cd7b636396d5f73be43326a4501a9ea43)
2020-06-15 18:22:32 -07:00
Anoop Sam John
81ee344439
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data. 2020-06-13 22:21:49 +05:30
sguggilam
a21e9049a5
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1886)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-12 16:54:18 +05:30
Andrew Purtell
f74d181914
HBASE-24525 [branch-1] Support ZooKeeper 3.6.0+ (#1879)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-06-10 11:44:22 -07:00
thangTang
e07aaf7fef
HBASE-24184 Backport HBASE-23896 to branch-1: Snapshot owner cannot delete snapshot when ACL is enabled and Kerberos is not enabled (#1510)
Signed-off-by: binlijin <binlijin@gmail.com>
2020-06-10 16:12:36 +08:00
bsglz
b6598ccaad
HBASE-24483 Add repeated prefix logging for MultipleColumnPrefixFilter (#1822)
Signed-off-by: clarax
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-08 16:30:05 +05:30
Viraj Jasani
94a04fb88c
Revert "HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835)"
This reverts commit 4853961b2c83369cba4aace9db20661ea979094d.
2020-06-07 14:45:14 +05:30
Ravi Kishore Valeti
cdab7b33f2
HBASE-24499 Use a client property for SaslConnection MAX_ATTEMPTS (#1857)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-05 20:37:30 +05:30
sguggilam
4853961b2c
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-05 16:45:31 +05:30
Bharath Vissapragada
4e4d11cb19
HBASE-24260 Add a ClusterManager that issues commands via coprocessor (#1853)
Implements `ClusterManager` that relies on the new
`ShellExecEndpointCoprocessor` for remote shell command execution.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
2020-06-04 22:08:16 -07:00
thangTang
d3d527637f
HBASE-24485 Backport to branch-1 HBASE-17738 BucketCache startup is slow (#1823)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-05 11:48:23 +08:00
thangTang
4118383fb1
HBASE-24501 Backport to branch-1 HBASE-15785 Unnecessary lock in ByteBufferArray (#1842)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-04 09:06:22 +08:00
Bharath Vissapragada
26828ac615
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files (#1829)
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).

Fixes the edge case and cleans up the test code a bit.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-03 16:22:28 -07:00
Viraj Jasani
bbfb4d432f
HBASE-24492 : Remove infinite loop from ProtobufLogReader#readNext (#1831)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-03 22:22:05 +05:30
Bharath Vissapragada
d889c7b442
HBASE-24480: Deflake TestRSGroupsBasics#testClearDeadServers (#1821)
More details about the flakiness in the jira comments.

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-01 09:11:27 -07:00
Bharath Vissapragada
cd0aaed929
HBASE-24477 (addendum): Fix missing IA annotations in ConfigurationManager
Found this via failure in the nightly tests on branch-1
2020-06-01 09:03:32 -07:00