Commit Graph

13112 Commits

Author SHA1 Message Date
Bharath Vissapragada 98d80fc5e4
HBASE-23257: Track clusterID in stand by masters (#798)
This patch implements a simple cache that all the masters
can lookup to serve cluster ID to clients. Active HMaster
is still responsible for creating it but all the masters
will read it from fs to serve clients.

RPCs exposing it will come in a separate patch as a part of
HBASE-18095.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
(cherry picked from commit c2e01f2398)
(cherry picked from commit 9ab652982b)
2020-09-19 15:01:05 -07:00
KevinSmile 20d0a32691
HBASE-24481 REST - Fix incorrect response code of get-regions in rest api
Closes #2425

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-19 19:59:14 +05:30
shahrs87 e1fc3c4fd0
[HBASE-24956] ConnectionManager#locateRegionInMeta waits for user region lock indefinitely. (#2415)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-18 13:49:24 -07:00
ankitjain64 f0acafc58e
HBASE-24764 : Add support of adding base peer configs via hbase-site.xml for all replication peers (#2327)
Note: branch-1 has design difference compared to other branches in the replication sub-system. HMaster does not coordinate replication actions in branch-1 and hence each RS is responsible for initing peers and updating ZK states. As part of this change we are updating zk state of peers after reading from configuration, so if there is a divergence in configuration across RS the result can be can be non-deterministic and the last RS RPC will win.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-17 09:39:55 -07:00
Clara Xiong 7801b45f47
HBASE-25006 Make the cost functions optional for StochastoicBalancer
Closes #2386

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-13 14:23:45 +05:30
Sandeep Pal d6f0128c83
HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2389)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-12 12:47:30 -07:00
Viraj Jasani c8d6d7a780
HBASE-25004 : Log RegionTooBusyException details (#2371)
Signed-off-by: mnpoonia <apoonia@salesforce.com>
Signed-off-by: stack <stack@apache.org>
2020-09-12 21:44:01 +05:30
Javier Akira Luca de Tena 624fd046ce
HBASE-24994 Add hedgedReadOpsInCurThread metric (#2368)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-11 13:49:33 +08:00
mnpoonia e5c0a9422c
HBASE-24988 Do not merge regions if they are non adjacent in MergeNormalizationPlan.execute
Closes #2355

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-07 17:43:14 +05:30
Mohammad Arshad 76db1e1791
HBASE-24940: runCatalogJanitor() API should return -1 to indicate already running status
Closes #2331

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 16:39:37 +05:30
mnpoonia a48515ab7d
HBASE-24970 Backport HBASE-20985 to branch-1
Closes #2334

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-03 14:06:42 +05:30
Abhey Rana 1dc75e74a7
[HBASE-24893] Fix failing TestLogLevel Unit Test (#2338)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-01 14:52:26 -07:00
Andrew Purtell 80ce76cb02 HBASE-24971 Upgrade JQuery to 3.5.1 (#2336)
- Update embedded minimized jquery to 3.5.1
- Update embedded minimized jquery.tablesorter to 2.31.3

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 10:41:28 -07:00
Zheng Wang 19e2878d2f
HBASE-24569 Get hostAndWeights in addition using localhost if it is null in local mode (#2339)
Closes #1909

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-01 18:43:29 +05:30
shahrs87 fb654a9125
HBASE-24957 ZKTableStateClientSideReader#isDisabledTable doesn't check if table exists or not
Closes #2323

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-01 14:01:18 +05:30
Zheng Wang 041debde02
HBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier
Closes #2270

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-30 20:32:33 +05:30
Zheng Wang 31e47af665
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2319

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-28 11:45:24 +05:30
ethanhur 8f946befe4
HBASE-14847 Add FIFO compaction section to HBase book
Closes #2298

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-25 18:52:43 +05:30
Andrew Purtell cbfbdd9635 Revert "HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider"
This reverts commit e7fdf58b3d.
2020-08-24 13:55:40 -07:00
Zheng Wang e7fdf58b3d
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider
Closes #2272

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-22 16:04:24 +05:30
Guanghao Zhang c2e0cf989e HBASE-24876 Fix the flaky job url in hbase-personality.sh (#2253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-13 16:57:02 +08:00
WenFeiYi 670d70deca
HBASE-24844 RecoverableZookeeper#close followed by ExecutorService shutdown
* Resolves Exception on standalone (master) shutdown

Closes #2239

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-12 17:17:07 +05:30
Duo Zhang 42a6d9a131 HBASE-24841 Change the jenkins job urls in our jenkinsfile (#2227)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-11 09:14:14 +08:00
Bharath Vissapragada d258cd07ac
HBASE-24846: Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-10 17:03:13 -07:00
Bharath Vissapragada 6bf44ddcc0
Revert "HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)"
This reverts commit 839ce8e560.

Reverting to apply as HBASE-24846.
2020-08-10 17:02:50 -07:00
Bo Cui 57e4144ddf
HBASE-21721 reduce write#syncs() times (#2220)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-08-10 18:13:14 +05:30
Bharath Vissapragada 839ce8e560
HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-08-06 09:31:41 -07:00
Nick Dimiduk 714a6f53d8 HBASE-24662 Update DumpClusterStatusAction to notice changes in region server count
Sometimes running chaos monkey, I've found that we lose accounting of
region servers. I've taken to a manual process of checking the
reported list against a known reference. It occurs to me that
ChaosMonkey has a known reference, and it can do this accounting for
me.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-06 09:18:51 -07:00
Wellington Ramos Chevreuil 2fd587384a
HBASE-24807 Backport HBASE-20417 to branch-1 (#2197)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-08-05 12:00:43 +01:00
Bharath Vissapragada 2c047eafc0
HBASE-24816: Remove unused credential hbaseqa-at-asf-jira (#2195)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-04 12:16:50 -07:00
Sean Busbey af18670665
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.

Closes #2188

adapted for jdk7

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2)
(cherry picked from commit 0806349ada)
2020-08-04 11:15:02 -05:00
Nick Dimiduk 1f0abf8279 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy ; ADDENDUM
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-08-03 12:57:11 -07:00
Nick Dimiduk 8d1228ece7 HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy
Adds `protected abstract Logger getLogger()` to `Action` so that
implementation's names are logged when actions are performed.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>

foo
2020-08-03 12:57:11 -07:00
Zheng Wang 9e975d1b98
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:59:48 +05:30
Viraj Jasani 6e34609376
Revert "HBASE-24704 Make Table Schema easier to view with multiple families"
This reverts commit 4b77c00e4f.
2020-08-02 23:58:25 +05:30
Viraj Jasani 4b77c00e4f
HBASE-24704 Make Table Schema easier to view with multiple families
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:54:36 +05:30
Sean Busbey 51161b5f48 HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 (#2174)
if hbase.rowlock.wait.duration is <=0 then log a message and treat it as a value of 1ms.

amended for branches-1

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 840a55761b)
2020-07-30 15:03:32 -05:00
Bharath Vissapragada ac576d23e5
HBASE-24788: Fix the connection leaks on getting hbase admin from unclosed connection (#2170)
Rewrote the patch for branch-1 since master has significanly diverged.

(cherry picked from commit dc5ef7af1f8b9e386495a73924c9442203f65a77)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>

 Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 Signed-off-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>

Co-authored-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>
2020-07-30 10:35:11 -07:00
Bharath Vissapragada daeccb1c46
HBASE-20226: Parallelize region manifest deletes (#2159) (#2171)
We observed this delete call to be a bottleneck for table with lots of
regions. Patch attempts to parallelize them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit f07f30ae24)
2020-07-30 10:29:02 -07:00
Toshihiro Suzuki b0d49aebea HBASE-24775 [hbtop] StoreFile size should be rounded off (#2144)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-28 08:34:07 +09:00
Viraj Jasani dd4417a9e2
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold (#2146)
Closes #2127

Signed-off-by: stack <stack@apache.org>
2020-07-28 01:10:02 +05:30
YeChao Chen b154f20c4d
HBASE-24777 InfoServer support ipv6 host and port
Closes #2147

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-27 22:32:03 +05:30
Mingliang Liu 527e4a67d8
HBASE-24696 Include JVM information on Web UI under "Software Attributes"
Closes #2117

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-22 14:00:09 +05:30
Nick Dimiduk 46f6d46b64 HBASE-24658 Update PolicyBasedChaosMonkey to handle uncaught exceptions
Running `ServerKillingChaosMonkey` via `RESTApiClusterManager` for any
duration of time slowly leaks region servers. I see failures on the
RESTApi side go unreported on the ChaosMonkey side. It seems like
`RuntimeException`s are being thrown and lost.

`PolicyBasedChaosMonkey` uses a primitive means of thread management
anyway. Update to use a thread pool, thread groups, and an
uncaughtExceptionHandler.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-21 09:59:39 -07:00
Mohammad Arshad d697c4061a
HBASE-24675: On Master restart all servers are assigned to default rsgroup
Closes #2102

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-20 19:11:08 +05:30
Zheng Wang fb0fb58677
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours
Closes #2099

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-07-19 20:13:08 +05:30
sguggilam 5211859058
HBASE-24740 Enable journal logging for HBase snapshot operation (#2076)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-17 13:27:08 -07:00
WenFeiYi 37903b0340
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-07-17 10:25:32 +08:00
lhofhansl 71aec0fb43
HBASE-24742 Improve performance of SKIP vs SEEK logic. (#2075) 2020-07-16 10:16:03 -07:00
Reid Chan b249092a5f
HBASE-24739 [Build] branch-1's build seems broken because of pylint (#2065)
* Specify the version
* by using apt-get instead of pip install
* Remove comment blocks

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-16 10:54:50 +08:00