Commit Graph

13007 Commits

Author SHA1 Message Date
Sandeep Pal d6f0128c83
HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2389)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-12 12:47:30 -07:00
Viraj Jasani c8d6d7a780
HBASE-25004 : Log RegionTooBusyException details (#2371)
Signed-off-by: mnpoonia <apoonia@salesforce.com>
Signed-off-by: stack <stack@apache.org>
2020-09-12 21:44:01 +05:30
Javier Akira Luca de Tena 624fd046ce
HBASE-24994 Add hedgedReadOpsInCurThread metric (#2368)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-11 13:49:33 +08:00
mnpoonia e5c0a9422c
HBASE-24988 Do not merge regions if they are non adjacent in MergeNormalizationPlan.execute
Closes #2355

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-07 17:43:14 +05:30
Mohammad Arshad 76db1e1791
HBASE-24940: runCatalogJanitor() API should return -1 to indicate already running status
Closes #2331

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 16:39:37 +05:30
mnpoonia a48515ab7d
HBASE-24970 Backport HBASE-20985 to branch-1
Closes #2334

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 14:06:42 +05:30
Abhey Rana 1dc75e74a7
[HBASE-24893] Fix failing TestLogLevel Unit Test (#2338)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-01 14:52:26 -07:00
Andrew Purtell 80ce76cb02 HBASE-24971 Upgrade JQuery to 3.5.1 (#2336)
- Update embedded minimized jquery to 3.5.1
- Update embedded minimized jquery.tablesorter to 2.31.3

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 10:41:28 -07:00
Zheng Wang 19e2878d2f
HBASE-24569 Get hostAndWeights in addition using localhost if it is null in local mode (#2339)
Closes #1909

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 18:43:29 +05:30
shahrs87 fb654a9125
HBASE-24957 ZKTableStateClientSideReader#isDisabledTable doesn't check if table exists or not
Closes #2323

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-01 14:01:18 +05:30
Zheng Wang 041debde02
HBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier
Closes #2270

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-30 20:32:33 +05:30
Zheng Wang 31e47af665
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2319

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-28 11:45:24 +05:30
ethanhur 8f946befe4
HBASE-14847 Add FIFO compaction section to HBase book
Closes #2298

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-25 18:52:43 +05:30
Andrew Purtell cbfbdd9635 Revert "HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider"
This reverts commit e7fdf58b3d.
2020-08-24 13:55:40 -07:00
Zheng Wang e7fdf58b3d
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2272

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-22 16:04:24 +05:30
Guanghao Zhang c2e0cf989e HBASE-24876 Fix the flaky job url in hbase-personality.sh (#2253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-13 16:57:02 +08:00
WenFeiYi 670d70deca
HBASE-24844 RecoverableZookeeper#close followed by ExecutorService shutdown
* Resolves Exception on standalone (master) shutdown

Closes #2239

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-12 17:17:07 +05:30
Duo Zhang 42a6d9a131 HBASE-24841 Change the jenkins job urls in our jenkinsfile (#2227)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-11 09:14:14 +08:00
Bharath Vissapragada d258cd07ac
HBASE-24846: Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-10 17:03:13 -07:00
Bharath Vissapragada 6bf44ddcc0
Revert "HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)"
This reverts commit 839ce8e560.

Reverting to apply as HBASE-24846.
2020-08-10 17:02:50 -07:00
Bo Cui 57e4144ddf
HBASE-21721 reduce write#syncs() times (#2220)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-08-10 18:13:14 +05:30
Bharath Vissapragada 839ce8e560
HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-06 09:31:41 -07:00
Nick Dimiduk 714a6f53d8 HBASE-24662 Update DumpClusterStatusAction to notice changes in region server count
Sometimes running chaos monkey, I've found that we lose accounting of
region servers. I've taken to a manual process of checking the
reported list against a known reference. It occurs to me that
ChaosMonkey has a known reference, and it can do this accounting for
me.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-06 09:18:51 -07:00
Wellington Ramos Chevreuil 2fd587384a
HBASE-24807 Backport HBASE-20417 to branch-1 (#2197)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-08-05 12:00:43 +01:00
Bharath Vissapragada 2c047eafc0
HBASE-24816: Remove unused credential hbaseqa-at-asf-jira (#2195)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-04 12:16:50 -07:00
Sean Busbey af18670665
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.

Closes #2188

adapted for jdk7

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2)
(cherry picked from commit 0806349ada)
2020-08-04 11:15:02 -05:00
Nick Dimiduk 1f0abf8279 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy ; ADDENDUM
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-08-03 12:57:11 -07:00
Nick Dimiduk 8d1228ece7 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy
Adds `protected abstract Logger getLogger()` to `Action` so that
implementation's names are logged when actions are performed.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>

foo
2020-08-03 12:57:11 -07:00
Zheng Wang 9e975d1b98
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:59:48 +05:30
Viraj Jasani 6e34609376
Revert "HBASE-24704 Make Table Schema easier to view with multiple families"
This reverts commit 4b77c00e4f.
2020-08-02 23:58:25 +05:30
Viraj Jasani 4b77c00e4f
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:54:36 +05:30
Sean Busbey 51161b5f48 HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 (#2174)
if hbase.rowlock.wait.duration is <=0 then log a message and treat it as a value of 1ms.

amended for branches-1

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 840a55761b)
2020-07-30 15:03:32 -05:00
Bharath Vissapragada ac576d23e5
HBASE-24788: Fix the connection leaks on getting hbase admin from unclosed connection (#2170)
Rewrote the patch for branch-1 since master has significanly diverged.

(cherry picked from commit dc5ef7af1f8b9e386495a73924c9442203f65a77)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>

 Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 Signed-off-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>

Co-authored-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>
2020-07-30 10:35:11 -07:00
Bharath Vissapragada daeccb1c46
HBASE-20226: Parallelize region manifest deletes (#2159) (#2171)
We observed this delete call to be a bottleneck for table with lots of
regions. Patch attempts to parallelize them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit f07f30ae24)
2020-07-30 10:29:02 -07:00
Toshihiro Suzuki b0d49aebea HBASE-24775 [hbtop] StoreFile size should be rounded off (#2144)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-28 08:34:07 +09:00
Viraj Jasani dd4417a9e2
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold (#2146)
Closes #2127

Signed-off-by: stack <stack@apache.org>
2020-07-28 01:10:02 +05:30
YeChao Chen b154f20c4d
HBASE-24777 InfoServer support ipv6 host and port
Closes #2147

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-27 22:32:03 +05:30
Mingliang Liu 527e4a67d8
HBASE-24696 Include JVM information on Web UI under "Software Attributes"
Closes #2117

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-22 14:00:09 +05:30
Nick Dimiduk 46f6d46b64 HBASE-24658 Update PolicyBasedChaosMonkey to handle uncaught exceptions
Running `ServerKillingChaosMonkey` via `RESTApiClusterManager` for any
duration of time slowly leaks region servers. I see failures on the
RESTApi side go unreported on the ChaosMonkey side. It seems like
`RuntimeException`s are being thrown and lost.

`PolicyBasedChaosMonkey` uses a primitive means of thread management
anyway. Update to use a thread pool, thread groups, and an
uncaughtExceptionHandler.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-21 09:59:39 -07:00
Mohammad Arshad d697c4061a
HBASE-24675: On Master restart all servers are assigned to default rsgroup
Closes #2102

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-20 19:11:08 +05:30
Zheng Wang fb0fb58677
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours
Closes #2099

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-07-19 20:13:08 +05:30
sguggilam 5211859058
HBASE-24740 Enable journal logging for HBase snapshot operation (#2076)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-17 13:27:08 -07:00
WenFeiYi 37903b0340
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-07-17 10:25:32 +08:00
lhofhansl 71aec0fb43
HBASE-24742 Improve performance of SKIP vs SEEK logic. (#2075) 2020-07-16 10:16:03 -07:00
Reid Chan b249092a5f
HBASE-24739 [Build] branch-1's build seems broken because of pylint (#2065)
* Specify the version
* by using apt-get instead of pip install
* Remove comment blocks

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-16 10:54:50 +08:00
Mohammad Arshad f5080eb9a6
HBASE-24721: rename_rsgroup overwriting the existing rsgroup
Closes #2066

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-15 18:42:38 +05:30
WenFeiYi e5b2334124
HBASE-24615 MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket
Closes #1962

Signed-off-by: David Manning
Signed-off-by: Rushabh
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-15 15:59:28 +05:30
Bo Cui 0841f12e4e
HBASE-24693 regioninfo#isLast() should point to EMPTY_END_ROW (readability improvement)
Closes #2051

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-14 15:48:16 +05:30
Geoffrey Jacoby be151e3fce
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0
Closes #1094

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-13 13:07:14 +05:30
David Manning 15c20be6ff
HBASE-24657 fix JsonBean.java from HBASE-23015 HBASE-20571 (branch-1)
Closes #1999

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-02 19:06:47 +05:30