Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,965 Commits 95 Branches 866 Tags
Commit Graph

5526 Commits

Author SHA1 Message Date
WenFeiYi
37903b0340
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-07-17 10:25:32 +08:00
lhofhansl
71aec0fb43
HBASE-24742 Improve performance of SKIP vs SEEK logic. (#2075) 2020-07-16 10:16:03 -07:00
Geoffrey Jacoby
be151e3fce
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0 
Closes #1094

Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-13 13:07:14 +05:30
David Manning
15c20be6ff
HBASE-24657 fix JsonBean.java from HBASE-23015 HBASE-20571 (branch-1) 
Closes #1999

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-02 19:06:47 +05:30
Bharath Vissapragada
32690e1e89
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1976) 
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b197bfa4307172db5465214771b78d38)
(cherry picked from commit 2379a25f0c4f2bdd3ea91fa5e0ba63f034c8d21c)
 2020-06-25 18:36:14 -07:00
Abhishek Singh Chouhan
54c38c840c HBASE-24618 Backport HBASE-21204 to branch-1 2020-06-24 10:21:41 -07:00
Viraj Jasani
d1449231f0
HBASE-24380 : Provide WAL splitting journal logging (#1860) (#1939) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-06-22 23:43:12 +05:30
BukrosSzabolcs
186373bea4 HBASE-22982: region server suspend/resume (#592) 
* Add chaos monkey action for suspend/resume region servers
* Add these to relevant chaos monkeys

branch-1-backport-note: Graceful regionserver restart action wasn't
backported due to a dependency of "RegionMover" script. Can be done
later if needed.

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2020-06-22 10:29:09 -07:00
Josh Elser
404c2dd3fe HBASE-19365 Guard against a missing table descriptor which crashes master 
While we never expect table descriptors to be missing, a corrupt meta
can result in the master crashing before regions get assigned. We can
guard against that happening with a simple null-check.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Closes #1908
 2020-06-17 16:48:02 -04:00
Bharath Vissapragada
4dd59a0635 HBASE-24564: Make RS abort call idempotent. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2567d15)
 2020-06-16 09:06:36 -07:00
satanson
5d64f062d8 HBASE-22870 reflection fails to access a private nested class 
Signed-off-by Reid Chan <reidchan@apache.org>

(cherry picked from commit 7697d48cd7b636396d5f73be43326a4501a9ea43)
 2020-06-15 18:22:32 -07:00
Anoop Sam John
81ee344439
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data. 2020-06-13 22:21:49 +05:30
sguggilam
a21e9049a5
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1886) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-12 16:54:18 +05:30
Andrew Purtell
f74d181914
HBASE-24525 [branch-1] Support ZooKeeper 3.6.0+ (#1879) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-06-10 11:44:22 -07:00
thangTang
e07aaf7fef
HBASE-24184 Backport HBASE-23896 to branch-1: Snapshot owner cannot delete snapshot when ACL is enabled and Kerberos is not enabled (#1510) 
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-06-10 16:12:36 +08:00
Viraj Jasani
94a04fb88c
Revert "HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835)" 
This reverts commit 4853961b2c83369cba4aace9db20661ea979094d.
 2020-06-07 14:45:14 +05:30
sguggilam
4853961b2c
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-05 16:45:31 +05:30
thangTang
d3d527637f
HBASE-24485 Backport to branch-1 HBASE-17738 BucketCache startup is slow (#1823) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-05 11:48:23 +08:00
Bharath Vissapragada
26828ac615
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files (#1829) 
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).

Fixes the edge case and cleans up the test code a bit.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-06-03 16:22:28 -07:00
Viraj Jasani
bbfb4d432f
HBASE-24492 : Remove infinite loop from ProtobufLogReader#readNext (#1831) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-03 22:22:05 +05:30
Bharath Vissapragada
6bca1dd1c1
HBASE-24479: Deflake TestCompaction#testStopStartCompaction (#1820) 
HBASE-24479: Deflake TestCompaction#testStopStartCompaction

Polling of active compaction count is racy. Tightened the asserts
to be more reliable.

Reid Chan <reidchan@apache.org>
 2020-05-31 22:45:31 -07:00
sguggilam
3c138845d9
HBASE-24069 Provide an ExponentialBackOffPolicy sleep between failed … (#1755) 
HBASE-24069: Provide an ExponentialBackOffPolicy sleep between failed region close requests

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-31 14:41:18 -07:00
Bharath Vissapragada
ee869b9aea
HBASE-24477: Move ConfigurationObserver and related classes to hbase-common 
This utility is useful for any module that wants to detect
dynamic config changes. Having it to hbase-common makes it
accessible to all the other modules.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-31 14:26:26 -07:00
jacob-leblanc
90b66544f0 HBASE-24454 - Read ioErrorStartTime to local temporary variable to avoid issue when it is set to -1 between greater than zero check and calculation of error duration (#1816) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2020-05-30 21:10:56 -07:00
xincunSong
61fa21e657
HBASE-24470 : Add store file info when log meessages in HStore. (#1804) 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-29 19:20:37 +05:30
Viraj Jasani
7df034a824
HBASE-24428 : Update compaction priority (ADDENDUM) 2020-05-28 14:39:49 +05:30
Javier Akira Luca de Tena
6aa2286733
HBASE-24435 Add hedgedReads and hedgedReadWins count metrics (#1781) 
Co-authored-by: stack <stack@apache.org>
Co-authored-by: Javier <javier.lucadetena@linecorp.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-05-28 10:11:10 +08:00
Viraj Jasani
1e386e3d83
HBASE-24428 : Update compaction priority for recently split daughter regions (#1784) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-05-27 22:52:56 +05:30
Zheng Wang
9f12ef0772 HBASE-24423 No need to get lock in canSplit because hasReferences will get lock too 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-26 13:38:06 -07:00
niuyulin
3235b568da
HBASE-24386 TableSnapshotScanner support scan limit (#1724) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
 2020-05-19 21:30:59 +05:30
Sandeep Pal
fbe5e68251
HBASE-24350: Extending and Fixing HBaseTable level replication metrics (#1704) 
branch-1 backport

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Co-Authored-by: Andrew Purtell <apurtell@apache.org>
 2020-05-14 15:00:37 -07:00
Gkkkk302
59a48fc470
HBASE-24355 Fix typos in the HStore#compact annotation (#1699) 
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-12 21:06:47 +05:30
Wellington Ramos Chevreuil
f57b3d68c7
HBASE-24351 Backport HBASE-24302 to branch-1 (#1693) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-12 16:27:05 +01:00
shahrs87
be59ddc263
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive (#1687) 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-11 12:10:03 +05:30
Mohammad Arshad
d1aff27e06
HBASE-24211: [Addendum] Create table is slow in large cluster when AccessController is enabled. (#1658) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-07 00:32:33 +05:30
Reid Chan
febf15f1ea HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong (#1667) 
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-05-06 19:47:22 +08:00
Anoop Sam John
e4dbfe9bed
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message (#1654) 2020-05-05 12:46:06 -07:00
xincunSong
92654691d7
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call (#1604) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-04-30 16:02:44 -07:00
bsglz
178005efb9
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … (#801) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-26 16:23:22 +05:30
Mohammad Arshad
9fc8263ca4
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1577) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2020-04-25 17:48:47 +05:30
Viraj Jasani
a7a4f61040
HBASE-24024 : Reject multi() requests with rows higher than threshold (#1560) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-04-22 14:13:05 +05:30
Beata Sudi
aaa6450d40
HBASE-24139 : Balancer should avoid leaving idle region servers (#1511) 
Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-04-22 11:36:48 +05:30
Reid Chan
1eeff370c4
HBASE-24174 Fix findbugs warning on ServiceAuthorizationManager (#1494) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-17 13:55:47 +08:00
binlijin
589d075de8
HBASE-24191 HRegion#processRowsWithLocks count memstore size wrong when sync failed (#1518) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-04-16 16:31:38 +08:00
Reid Chan
0d8683507b
HBASE-24112 [RSGroup] Support renaming rsgroup (#1467) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-04-15 19:20:14 +08:00
Wei-Chiu Chuang
b644e3ccd8
HBASE-8868 add metric to report client shortcircuit reads. 
branch-1 backport of #1334

Signed-off-by: stack <stack@apache.net>
Signed-off-by: Sean Busbey <busbey@apache.org>

Co-authored-by: Andrew Purtell <apurtell@apache.org>
 2020-04-14 19:05:37 -07:00
binlijin
73d1c2a10f
HBASE-24077 When encounter RowTooBigException, log the row info. (#1379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-14 18:43:24 -07:00
Reid Chan
7b1270956a HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be (#1439) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
 2020-04-09 17:00:57 +08:00
Sean Busbey
4b94f2ed41 HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer (#1455) 
- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 2d78a286b682b34e8a718c521e265d58536f1e5e)
 2020-04-09 00:30:09 -05:00
Andrew Purtell
27f512d334
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2020-04-08 11:41:24 -07:00