Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,173 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5668 Commits

Author SHA1 Message Date
Bharath Vissapragada 3e1450d8b3
HBASE-24765: Dynamic master discovery (#2314) 
This patch adds the ability to discover newly added masters
dynamically on the master registry side. The trigger for the
re-fetch is either periodic (5 mins) or any registry RPC failure.
Master server information is cached in masters to avoid repeated
ZK lookups.

Updates the client side connection metrics to maintain a counter
per RPC type so that clients have visibility into counts grouped
by RPC method name.

I didn't add the method to ZK registry interface since there
is a design discussion going on in splittable meta doc. We can
add it later if needed.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 275a38e153)
(cherry picked from commit bb9121da77)
 2020-09-19 15:01:06 -07:00
Bharath Vissapragada ebe9e68274
HBASE-23305: Implement master based registry for client connections 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-09-19 15:01:06 -07:00
Bharath Vissapragada d866994635
HBASE-23604: Clarify Registry usage in the code 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-09-19 15:01:06 -07:00
stack cb756629b0
HBASE-7767 Get rid of ZKTable, and table enable/disable state in ZK (Andrey Stepachev) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

(cherry picked from commit 3cc5d19039)
 2020-09-19 15:01:06 -07:00
Bharath Vissapragada 18200b09e2
HBASE-23304: RPCs needed for client meta information lookup (#904) 
* HBASE-23304: RPCs needed for client meta information lookup

This patch implements the RPCs needed for the meta information
lookup during connection init. New tests added to cover the RPC
code paths. HBASE-23305 builds on this to implement the client
side logic.

Fixed a bunch of checkstyle nits around the places the patch
touches.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 4f8fbba0c0)
(cherry picked from commit 488460e840)
 2020-09-19 15:01:05 -07:00
Bharath Vissapragada 9a1d5a02b0
HBASE-23281: Track meta region locations in masters (#830) 
* HBASE-23281: Track meta region changes on masters

This patch adds a simple cache that tracks the meta region replica
locations. It keeps an eye on the region movements so that the
cached locations are not stale.

This information is used for servicing client RPCs for connections
that use master based registry (HBASE-18095). The RPC end points
will be added in a separate patch.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 8571d389cf)
(cherry picked from commit 89581d9d21)
 2020-09-19 15:01:05 -07:00
Bharath Vissapragada e4161e5875
HBASE-23275: Track active master's address in ActiveMasterManager (#812) 
Currently we just track whether an active master exists.
It helps to also track the address of the active master in
all the masters to help serve the client RPC requests to
know which master is active.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit efebb843af)
(cherry picked from commit 742949165f)
 2020-09-19 15:01:05 -07:00
Bharath Vissapragada 98d80fc5e4
HBASE-23257: Track clusterID in stand by masters (#798) 
This patch implements a simple cache that all the masters
can lookup to serve cluster ID to clients. Active HMaster
is still responsible for creating it but all the masters
will read it from fs to serve clients.

RPCs exposing it will come in a separate patch as a part of
HBASE-18095.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
(cherry picked from commit c2e01f2398)
(cherry picked from commit 9ab652982b)
 2020-09-19 15:01:05 -07:00
shahrs87 e1fc3c4fd0
[HBASE-24956] ConnectionManager#locateRegionInMeta waits for user region lock indefinitely. (#2415) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-09-18 13:49:24 -07:00
ankitjain64 f0acafc58e
HBASE-24764 : Add support of adding base peer configs via hbase-site.xml for all replication peers (#2327) 
Note: branch-1 has design difference compared to other branches in the replication sub-system. HMaster does not coordinate replication actions in branch-1 and hence each RS is responsible for initing peers and updating ZK states. As part of this change we are updating zk state of peers after reading from configuration, so if there is a divergence in configuration across RS the result can be can be non-deterministic and the last RS RPC will win.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-09-17 09:39:55 -07:00
Clara Xiong 7801b45f47
HBASE-25006 Make the cost functions optional for StochastoicBalancer 
Closes #2386

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-09-13 14:23:45 +05:30
Sandeep Pal d6f0128c83
HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2389) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-09-12 12:47:30 -07:00
Viraj Jasani c8d6d7a780
HBASE-25004 : Log RegionTooBusyException details (#2371) 
Signed-off-by: mnpoonia <apoonia@salesforce.com>
Signed-off-by: stack <stack@apache.org>
 2020-09-12 21:44:01 +05:30
Javier Akira Luca de Tena 624fd046ce
HBASE-24994 Add hedgedReadOpsInCurThread metric (#2368) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-09-11 13:49:33 +08:00
mnpoonia e5c0a9422c
HBASE-24988 Do not merge regions if they are non adjacent in MergeNormalizationPlan.execute 
Closes #2355

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-09-07 17:43:14 +05:30
Mohammad Arshad 76db1e1791
HBASE-24940: runCatalogJanitor() API should return -1 to indicate already running status 
Closes #2331

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-09-03 16:39:37 +05:30
mnpoonia a48515ab7d
HBASE-24970 Backport HBASE-20985 to branch-1 
Closes #2334

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-09-03 14:06:42 +05:30
Abhey Rana 1dc75e74a7
[HBASE-24893] Fix failing TestLogLevel Unit Test (#2338) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-09-01 14:52:26 -07:00
Andrew Purtell 80ce76cb02 HBASE-24971 Upgrade JQuery to 3.5.1 (#2336) 
- Update embedded minimized jquery to 3.5.1
- Update embedded minimized jquery.tablesorter to 2.31.3

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-09-01 10:41:28 -07:00
Zheng Wang 19e2878d2f
HBASE-24569 Get hostAndWeights in addition using localhost if it is null in local mode (#2339) 
Closes #1909

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-09-01 18:43:29 +05:30
shahrs87 fb654a9125
HBASE-24957 ZKTableStateClientSideReader#isDisabledTable doesn't check if table exists or not 
Closes #2323

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-09-01 14:01:18 +05:30
Zheng Wang 041debde02
HBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier 
Closes #2270

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-08-30 20:32:33 +05:30
Zheng Wang 31e47af665
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider 
Closes #2319

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-08-28 11:45:24 +05:30
Andrew Purtell cbfbdd9635 Revert "HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider" 
This reverts commit e7fdf58b3d.
 2020-08-24 13:55:40 -07:00
Zheng Wang e7fdf58b3d
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider 
Closes #2272

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-08-22 16:04:24 +05:30
Bharath Vissapragada d258cd07ac
HBASE-24846: Address compaction races in TestFIFOCompactionPolicy (#2203) 
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2020-08-10 17:03:13 -07:00
Bharath Vissapragada 6bf44ddcc0
Revert "HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203)" 
This reverts commit 839ce8e560.

Reverting to apply as HBASE-24846.
 2020-08-10 17:02:50 -07:00
Bo Cui 57e4144ddf
HBASE-21721 reduce write#syncs() times (#2220) 
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-08-10 18:13:14 +05:30
Bharath Vissapragada 839ce8e560
HBASE-21905 (addendum): Address compaction races in TestFIFOCompactionPolicy (#2203) 
Looped through the test 100 times and it passes. Without the patch it fails
every ~10 runs or so.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2020-08-06 09:31:41 -07:00
Wellington Ramos Chevreuil 2fd587384a
HBASE-24807 Backport HBASE-20417 to branch-1 (#2197) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-08-05 12:00:43 +01:00
Sean Busbey af18670665
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe 
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.

Closes #2188

adapted for jdk7

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2)
(cherry picked from commit 0806349ada)
 2020-08-04 11:15:02 -05:00
Zheng Wang 9e975d1b98
HBASE-24704 Make Table Schema easier to view with multiple families 
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-08-02 23:59:48 +05:30
Viraj Jasani 6e34609376
Revert "HBASE-24704 Make Table Schema easier to view with multiple families" 
This reverts commit 4b77c00e4f.
 2020-08-02 23:58:25 +05:30
Viraj Jasani 4b77c00e4f
HBASE-24704 Make Table Schema easier to view with multiple families 
Closes #2185

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-08-02 23:54:36 +05:30
Sean Busbey 51161b5f48 HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 (#2174) 
if hbase.rowlock.wait.duration is <=0 then log a message and treat it as a value of 1ms.

amended for branches-1

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 840a55761b)
 2020-07-30 15:03:32 -05:00
Bharath Vissapragada ac576d23e5
HBASE-24788: Fix the connection leaks on getting hbase admin from unclosed connection (#2170) 
Rewrote the patch for branch-1 since master has significanly diverged.

(cherry picked from commit dc5ef7af1f8b9e386495a73924c9442203f65a77)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>

 Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 Signed-off-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>

Co-authored-by: Sandeep Pal <50725353+sandeepvinayak@users.noreply.github.com>
 2020-07-30 10:35:11 -07:00
Bharath Vissapragada daeccb1c46
HBASE-20226: Parallelize region manifest deletes (#2159) (#2171) 
We observed this delete call to be a bottleneck for table with lots of
regions. Patch attempts to parallelize them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit f07f30ae24)
 2020-07-30 10:29:02 -07:00
Viraj Jasani dd4417a9e2
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold (#2146) 
Closes #2127

Signed-off-by: stack <stack@apache.org>
 2020-07-28 01:10:02 +05:30
YeChao Chen b154f20c4d
HBASE-24777 InfoServer support ipv6 host and port 
Closes #2147

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-27 22:32:03 +05:30
Mingliang Liu 527e4a67d8
HBASE-24696 Include JVM information on Web UI under "Software Attributes" 
Closes #2117

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-07-22 14:00:09 +05:30
Zheng Wang fb0fb58677
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours 
Closes #2099

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2020-07-19 20:13:08 +05:30
sguggilam 5211859058
HBASE-24740 Enable journal logging for HBase snapshot operation (#2076) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-17 13:27:08 -07:00
WenFeiYi 37903b0340
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-07-17 10:25:32 +08:00
lhofhansl 71aec0fb43
HBASE-24742 Improve performance of SKIP vs SEEK logic. (#2075) 2020-07-16 10:16:03 -07:00
Geoffrey Jacoby be151e3fce
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0 
Closes #1094

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-13 13:07:14 +05:30
David Manning 15c20be6ff
HBASE-24657 fix JsonBean.java from HBASE-23015 HBASE-20571 (branch-1) 
Closes #1999

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-02 19:06:47 +05:30
Bharath Vissapragada 32690e1e89
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1976) 
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b1)
(cherry picked from commit 2379a25f0c)
 2020-06-25 18:36:14 -07:00
Abhishek Singh Chouhan 54c38c840c HBASE-24618 Backport HBASE-21204 to branch-1 2020-06-24 10:21:41 -07:00
Viraj Jasani d1449231f0
HBASE-24380 : Provide WAL splitting journal logging (#1860) (#1939) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-06-22 23:43:12 +05:30
BukrosSzabolcs 186373bea4 HBASE-22982: region server suspend/resume (#592) 
* Add chaos monkey action for suspend/resume region servers
* Add these to relevant chaos monkeys

branch-1-backport-note: Graceful regionserver restart action wasn't
backported due to a dependency of "RegionMover" script. Can be done
later if needed.

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2020-06-22 10:29:09 -07:00
Josh Elser 404c2dd3fe HBASE-19365 Guard against a missing table descriptor which crashes master 
While we never expect table descriptors to be missing, a corrupt meta
can result in the master crashing before regions get assigned. We can
guard against that happening with a simple null-check.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Closes #1908
 2020-06-17 16:48:02 -04:00
Bharath Vissapragada 4dd59a0635 HBASE-24564: Make RS abort call idempotent. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2567d15)
 2020-06-16 09:06:36 -07:00
satanson 5d64f062d8 HBASE-22870 reflection fails to access a private nested class 
Signed-off-by Reid Chan <reidchan@apache.org>

(cherry picked from commit 7697d48cd7)
 2020-06-15 18:22:32 -07:00
Anoop Sam John 81ee344439
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data. 2020-06-13 22:21:49 +05:30
sguggilam a21e9049a5
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1886) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-12 16:54:18 +05:30
Andrew Purtell f74d181914
HBASE-24525 [branch-1] Support ZooKeeper 3.6.0+ (#1879) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-06-10 11:44:22 -07:00
thangTang e07aaf7fef
HBASE-24184 Backport HBASE-23896 to branch-1: Snapshot owner cannot delete snapshot when ACL is enabled and Kerberos is not enabled (#1510) 
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-06-10 16:12:36 +08:00
Viraj Jasani 94a04fb88c
Revert "HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835)" 
This reverts commit 4853961b2c.
 2020-06-07 14:45:14 +05:30
sguggilam 4853961b2c
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-05 16:45:31 +05:30
thangTang d3d527637f
HBASE-24485 Backport to branch-1 HBASE-17738 BucketCache startup is slow (#1823) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-05 11:48:23 +08:00
Bharath Vissapragada 26828ac615
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files (#1829) 
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).

Fixes the edge case and cleans up the test code a bit.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-06-03 16:22:28 -07:00
Viraj Jasani bbfb4d432f
HBASE-24492 : Remove infinite loop from ProtobufLogReader#readNext (#1831) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-03 22:22:05 +05:30
Bharath Vissapragada 6bca1dd1c1
HBASE-24479: Deflake TestCompaction#testStopStartCompaction (#1820) 
HBASE-24479: Deflake TestCompaction#testStopStartCompaction

Polling of active compaction count is racy. Tightened the asserts
to be more reliable.

Reid Chan <reidchan@apache.org>
 2020-05-31 22:45:31 -07:00
sguggilam 3c138845d9
HBASE-24069 Provide an ExponentialBackOffPolicy sleep between failed … (#1755) 
HBASE-24069: Provide an ExponentialBackOffPolicy sleep between failed region close requests

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-31 14:41:18 -07:00
Bharath Vissapragada ee869b9aea
HBASE-24477: Move ConfigurationObserver and related classes to hbase-common 
This utility is useful for any module that wants to detect
dynamic config changes. Having it to hbase-common makes it
accessible to all the other modules.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-31 14:26:26 -07:00
jacob-leblanc 90b66544f0 HBASE-24454 - Read ioErrorStartTime to local temporary variable to avoid issue when it is set to -1 between greater than zero check and calculation of error duration (#1816) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2020-05-30 21:10:56 -07:00
xincunSong 61fa21e657
HBASE-24470 : Add store file info when log meessages in HStore. (#1804) 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-29 19:20:37 +05:30
Viraj Jasani 7df034a824
HBASE-24428 : Update compaction priority (ADDENDUM) 2020-05-28 14:39:49 +05:30
Javier Akira Luca de Tena 6aa2286733
HBASE-24435 Add hedgedReads and hedgedReadWins count metrics (#1781) 
Co-authored-by: stack <stack@apache.org>
Co-authored-by: Javier <javier.lucadetena@linecorp.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-05-28 10:11:10 +08:00
Viraj Jasani 1e386e3d83
HBASE-24428 : Update compaction priority for recently split daughter regions (#1784) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-05-27 22:52:56 +05:30
Zheng Wang 9f12ef0772 HBASE-24423 No need to get lock in canSplit because hasReferences will get lock too 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-26 13:38:06 -07:00
niuyulin 3235b568da
HBASE-24386 TableSnapshotScanner support scan limit (#1724) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
 2020-05-19 21:30:59 +05:30
Sandeep Pal fbe5e68251
HBASE-24350: Extending and Fixing HBaseTable level replication metrics (#1704) 
branch-1 backport

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Co-Authored-by: Andrew Purtell <apurtell@apache.org>
 2020-05-14 15:00:37 -07:00
Gkkkk302 59a48fc470
HBASE-24355 Fix typos in the HStore#compact annotation (#1699) 
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-12 21:06:47 +05:30
Wellington Ramos Chevreuil f57b3d68c7
HBASE-24351 Backport HBASE-24302 to branch-1 (#1693) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-12 16:27:05 +01:00
shahrs87 be59ddc263
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive (#1687) 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-11 12:10:03 +05:30
Mohammad Arshad d1aff27e06
HBASE-24211: [Addendum] Create table is slow in large cluster when AccessController is enabled. (#1658) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-07 00:32:33 +05:30
Reid Chan febf15f1ea HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong (#1667) 
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-05-06 19:47:22 +08:00
Anoop Sam John e4dbfe9bed
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message (#1654) 2020-05-05 12:46:06 -07:00
xincunSong 92654691d7
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call (#1604) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-04-30 16:02:44 -07:00
bsglz 178005efb9
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … (#801) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-26 16:23:22 +05:30
Mohammad Arshad 9fc8263ca4
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1577) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2020-04-25 17:48:47 +05:30
Viraj Jasani a7a4f61040
HBASE-24024 : Reject multi() requests with rows higher than threshold (#1560) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-04-22 14:13:05 +05:30
Beata Sudi aaa6450d40
HBASE-24139 : Balancer should avoid leaving idle region servers (#1511) 
Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-04-22 11:36:48 +05:30
Reid Chan 1eeff370c4
HBASE-24174 Fix findbugs warning on ServiceAuthorizationManager (#1494) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-17 13:55:47 +08:00
binlijin 589d075de8
HBASE-24191 HRegion#processRowsWithLocks count memstore size wrong when sync failed (#1518) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-04-16 16:31:38 +08:00
Reid Chan 0d8683507b
HBASE-24112 [RSGroup] Support renaming rsgroup (#1467) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-04-15 19:20:14 +08:00
Wei-Chiu Chuang b644e3ccd8
HBASE-8868 add metric to report client shortcircuit reads. 
branch-1 backport of #1334

Signed-off-by: stack <stack@apache.net>
Signed-off-by: Sean Busbey <busbey@apache.org>

Co-authored-by: Andrew Purtell <apurtell@apache.org>
 2020-04-14 19:05:37 -07:00
binlijin 73d1c2a10f
HBASE-24077 When encounter RowTooBigException, log the row info. (#1379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-14 18:43:24 -07:00
Reid Chan 7b1270956a HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be (#1439) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
 2020-04-09 17:00:57 +08:00
Sean Busbey 4b94f2ed41 HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer (#1455) 
- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 2d78a286b6)
 2020-04-09 00:30:09 -05:00
Andrew Purtell 27f512d334
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2020-04-08 11:41:24 -07:00
Viraj Jasani 96ae39b01b
HBASE-23678 : Builder API for version management - setVersionsWithTimeToLive 
Signed-off-by: Xu Cang <xucang@apache.org>
 2020-04-01 16:58:44 +05:30
WenFeiYi f94c19494b HBASE-24040 WALFactory.Providers.multiwal causes StackOverflowError (#1338) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-03-27 10:25:55 +08:00
Huaxiang Sun 61f9048b01
HBASE-23957 [flakey test] client.TestMultiParallel fails to read hbase-site.xml (#1310) (#1344) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-03-25 09:58:04 -07:00
Viraj Jasani 957bfcb065
HBASE-23631 : Backport HBASE-23350 (Make compaction files cacheonWrite configurable based on threshold) to branch-1 (#1256) 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>

Backport of commit: 77229c79e3
 2020-03-10 20:35:55 +05:30
Viraj Jasani a50d5c4a8d
HBASE-23631 : Backport HBASE-23588 Cache index & bloom blocks on write if CacheCompactedBlocksOnWrite is enabled 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: chenxu14 <47170471+chenxu14@users.noreply.github.com>
 2020-02-28 20:42:51 +05:30
Viraj Jasani bd99a55de8
HBASE-23066 : Allow cache on write during compactions when prefetching is enabled 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-02-28 20:06:48 +05:30
Sakthi 25654df98b
HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions (#1181) 
Backport HBASE-23658 - Fix flaky TestSnapshotFromMaster

(cherry picked from commit e750d2c7af)

Signed-off-by: Guanghao Zhang <zghaobac@gmail.com>
 2020-02-19 19:51:07 -08:00
Andrew Purtell b9c676cdc0
Set version on branch-1 to 1.7.0-SNAPSHOT 2020-02-14 11:31:32 -08:00
Andrew Purtell 5ec5a5b115
Update POMs and CHANGES.txt for 1.6.0RC0 2020-02-14 11:30:22 -08:00
Sandeep Pal 901dffd241
HBASE-21776: Avoid duplicate calls to setStoragePolicy which shows up in debug Logging (#856) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2020-02-13 11:56:17 -08:00
Abhishek Singh Chouhan b25071c679 HBASE-23825 Increment proto conversion is broken 2020-02-11 17:07:43 -08:00
thangTang 942bb77d84 HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-02-10 17:03:42 +00:00
Wellington Chevreuil bb49aa205c Revert "HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071)" 
This reverts commit f99e899ca3.
 2020-02-10 17:03:09 +00:00
thangTang f99e899ca3
HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071) 2020-02-10 16:57:30 +00:00
Nick Dimiduk 9e4aec56c3
HBASE-23802 Remove unnecessary Configuration instantiation in LossyAccounting (#1127) (#1140) 
Signed-off-by: stack <stack@apache.org>
 2020-02-07 08:56:11 -08:00
Gkkkk302 66f1658167
HBASE-23045 currentPath may be stitched in a loop in replication source code. (#1006) 
Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-01-30 01:07:40 +05:30
Viraj Jasani dfe636017d
HBASE-23749 : TestHFileWriterV3 for all DataBlock Encoders 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
 2020-01-30 00:51:45 +05:30
Jan Hentschel 2267ab9399
HBASE-23621 Reduced the number of Checkstyle violations in tests of hbase-common 
Signed-off-by: stack <stack@apache.org>
 2020-01-27 13:05:25 +01:00
Geoffrey Jacoby c080923d77
HBASE-23710 - Priority configuration for system coprocessor 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-01-23 16:54:26 -08:00
Geoffrey Jacoby 99d26e884b
HBASE-23711 - Add test for MinVersions and KeepDeletedCells TTL 
Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-01-22 01:05:08 -08:00
Jeongdae Kim 8bf4985d69 HBASE-23254 Release replication buffer quota correctly, when batch includes bulk loaded hfiles (#792) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-01-21 09:23:55 +00:00
Viraj Jasani 64b9d2f5ab
HBASE-23335 : Improving cost functions array copy in StochasticLoadBalancer 
Signed-off-by: stack <stack@apache.org>
 2020-01-18 17:45:03 -08:00
Bharath Vissapragada 71bfac3353 HBASE-23665: Split unit tests from TestTableName into a separate test-only class. (#1032) (#1051) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-01-17 09:52:31 -08:00
Viraj Jasani d466f775ad
HBASE-23569 : Validate that all default chores of HRegionServer are scheduled (ADDENDUM) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-01-16 23:32:14 -08:00
Peter Somogyi 907184dfa0
HBASE-23675 Move to Apache parent POM version 22 (#1023) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-01-15 10:10:23 +01:00
Viraj Jasani 3cb0431383
HBASE-23569 : Validate that all default chores of HMaster are scheduled 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-01-14 23:47:53 -08:00
Baiqiang Zhao 6b940ae986 HBASE-23585 MetricsRegionServerWrapperImpl.getL1CacheHitCount always returns 200 (#945) 
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-01-03 07:04:57 -08:00
Viraj Jasani 19b35d2b19
HBASE-23590 : Update maxCompactedStoreFileRef (ADDENDUM) 2020-01-02 19:24:01 +05:30
Jeongdae Kim e0c419d76d HBASE-23205 Correctly update the position of WALs currently being replicated (#944) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-01-02 11:56:38 +00:00
Viraj Jasani 1451063115
HBASE-23590 : Update maxStoreFileRefCount to maxCompactedStoreFileRefCount for auto region recovery based on old reader references 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-01-01 23:50:24 +05:30
Bharath Vissapragada 27fc96e076
HBASE-23238: Remove 'static'ness of cell counter in LimitKVsReturnFilter (addendum) 
Having it as static means the test cannot be parameterized (ran into
this issue in HBASE-23305). That happens because the field is not
reset between parameterized runs.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2019-12-27 23:07:53 +05:30
Bharath Vissapragada 85b43a7059
HBASE-23362: [WalPrettyPrinter] print/filter by table name. (#898) 
Reapplied with missing delta for branch-1

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-12-18 16:49:05 -08:00
Andrew Purtell d77da0dcfc
Revert "HBASE-23362: [WalPrettyPrinter] print/filter by table name. (#898)" 
This reverts commit afb2e348e6.
 2019-12-18 16:48:56 -08:00
Bharath Vissapragada afb2e348e6
HBASE-23362: [WalPrettyPrinter] print/filter by table name. (#898) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-12-18 15:34:29 -08:00
Baiqiang Zhao 28673f0c22 HBASE-23375 HBASE-22441 BucketCache NullPointerException in cacheBlock 
branches-1 backport. closes #907

Co-authored-by: binlijin <binlijin@apache.org>
Signed-off-by: binlijin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-12-13 16:02:43 -06:00
Pierre Zemb f5171b419e HBASE-23073 Add an optional costFunction to balance regions according to a capacity rule (#894) 
Signed-off-by Wellington Chevreuil <wchevreuil@apache.org>
 2019-12-09 15:47:16 +00:00
Lars Hofhansl 9b10afde93 HBASE-23364 HRegionServer sometimes does not shut down. 2019-12-05 18:14:48 -08:00
Toshihiro Suzuki ec55c2a5d9 HBASE-22096 /storeFile.jsp shows CorruptHFileException when the storeFile is a reference file 
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-12-04 21:49:11 +09:00
Toshihiro Suzuki 737eaa635a
HBASE-23359 RS going down with NPE when splitting a region with compaction disabled in branch-1 (#899) 
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2019-12-04 21:24:03 +09:00
Karthik Palanisamy da9f6bf818 HBASE-23237 Prevent Negative values in metrics requestsPerSecond (#866) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-11-24 00:13:12 +08:00
Bharath Vissapragada eb5e94aced HBASE-23259: Populate master address end points in cluster/rs configs (#807) (#858) 
All the clients need to know the master RPC end points while using master
based registry for creating cluster connections. This patch amends the
test cluster utility to populate these configs in the base configuration
object used to spin up the cluster.

The config key added here ("hbase.master.addrs") is used in the subsequent
patches for HBASE-18095.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 834ccb4bf6)
 2019-11-21 09:47:05 -08:00
Baiqiang Zhao eee337f5c3 HBASE-23278 Add a table-level compaction progress display on the UI (#817) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2019-11-19 18:55:40 +08:00
Geoffrey Jacoby 5f36343949 HBASE-23288 - Backport HBASE-23251 (Add Column Family and Table Names to HFileContext) to branch-1 (#822) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-11-18 16:56:10 -08:00
Viraj Jasani 8e60b0c0c6
HBASE-23261 Region stuck in transition while splitting 
Processing ZK BadVersionException during node transition

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-11-15 17:32:21 -08:00
Baiqiang Zhao 5130bc52d5 HBASE-23287 LogCleaner is not added to choreService 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-11-15 10:14:39 -06:00
Guangxu Cheng 9b30df5c63 HBASE-23273 Fix table header display is incorrect on table.jsp when viewing hbase:meta 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2019-11-10 20:37:48 +08:00
Viraj Jasani a5f09cd756
HBASE-23212 Dynamically reload configs for Region Recovery chore (#803) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-11-06 15:43:08 -08:00
ravowlga123 1360816786
HBASE-23250 Log message about CleanerChore delegate initialization should be at INFO 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-11-05 20:51:36 +01:00
Thiruvel Thirumoolan 2451023327
HBASE-23219 Re-enable ZKLess tests for branch-1 (Revert HBASE-14622) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-10-31 16:22:34 -07:00
bitterfox 3c7c1b5489 HBASE-23185 Fix high cpu usage because getTable()#put() gets config value every time [Take2] (#748) 
* HBASE-23185 Fix test failure by HBASE-23185 changes

* HBASE-23185 Fix high cpu usage because getTable()#put() gets config value every time

This reverts commit db2ce23a93.
 2019-10-31 15:23:47 -07:00
Wellington Ramos Chevreuil 577db5d7e5
HBASE-23238 Additional test and checks for null references on ScannerCallableWithReplicas (#780) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-10-31 17:11:20 +00:00
Sean Busbey 4bcc397f3e
HBASE-23229 Update branch-1 to 1.6.0-SNAPSHOT (#772) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-10-30 09:22:39 -05:00
Viraj Jasani 5e414f2d46 HBASE-23213 Backport HBASE-22460 to branch-1 (#761) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-10-29 13:15:39 -07:00
Guangxu Cheng 93a97ca475
HBASE-20626 Change the value of "Requests Per Second" on WEBUI 
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
 2019-10-28 11:58:07 -07:00
Andrew Purtell d16cbfe91d
HBASE-23210 Backport HBASE-15519 (Add per-user metrics) to branch-1 (#755) 
HBASE-15519 Add per-user metrics with lossy counting

Introducing property hbase.regionserver.user.metrics.enabled(Default:true)
to disable user metrics in case it accounts for any performance issues

Signed-off-by: Josh Elser <elserj@apache.org>
 2019-10-28 09:05:36 -07:00
Jacky Lau 41f671336c HBASE-23149 RatioBasedCompactionPolicy#shouldPerformMajorCompaction logic is not correct (#744) 
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
 2019-10-24 17:01:35 +08:00
Andrew Purtell f0999a16ee
HBASE-23207 Log a region open journal (#751) 
Signed-off-by: Abhishek Singh Chouhan <achouhan@apache.org>
 2019-10-23 17:18:57 -07:00
Caroline Zhou e183c90fe9 HBASE-23172 HBase Canary region success count metrics reflect column family successes, not region successes 2019-10-21 09:19:48 -07:00