Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,956 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5521 Commits

Author SHA1 Message Date
Abhishek Singh Chouhan 54c38c840c HBASE-24618 Backport HBASE-21204 to branch-1 2020-06-24 10:21:41 -07:00
Viraj Jasani d1449231f0
HBASE-24380 : Provide WAL splitting journal logging (#1860) (#1939) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-06-22 23:43:12 +05:30
BukrosSzabolcs 186373bea4 HBASE-22982: region server suspend/resume (#592) 
* Add chaos monkey action for suspend/resume region servers
* Add these to relevant chaos monkeys

branch-1-backport-note: Graceful regionserver restart action wasn't
backported due to a dependency of "RegionMover" script. Can be done
later if needed.

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2020-06-22 10:29:09 -07:00
Josh Elser 404c2dd3fe HBASE-19365 Guard against a missing table descriptor which crashes master 
While we never expect table descriptors to be missing, a corrupt meta
can result in the master crashing before regions get assigned. We can
guard against that happening with a simple null-check.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Closes #1908
 2020-06-17 16:48:02 -04:00
Bharath Vissapragada 4dd59a0635 HBASE-24564: Make RS abort call idempotent. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2567d15)
 2020-06-16 09:06:36 -07:00
satanson 5d64f062d8 HBASE-22870 reflection fails to access a private nested class 
Signed-off-by Reid Chan <reidchan@apache.org>

(cherry picked from commit 7697d48cd7)
 2020-06-15 18:22:32 -07:00
Anoop Sam John 81ee344439
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data. 2020-06-13 22:21:49 +05:30
sguggilam a21e9049a5
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1886) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-12 16:54:18 +05:30
Andrew Purtell f74d181914
HBASE-24525 [branch-1] Support ZooKeeper 3.6.0+ (#1879) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-06-10 11:44:22 -07:00
thangTang e07aaf7fef
HBASE-24184 Backport HBASE-23896 to branch-1: Snapshot owner cannot delete snapshot when ACL is enabled and Kerberos is not enabled (#1510) 
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-06-10 16:12:36 +08:00
Viraj Jasani 94a04fb88c
Revert "HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835)" 
This reverts commit 4853961b2c.
 2020-06-07 14:45:14 +05:30
sguggilam 4853961b2c
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1835) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-05 16:45:31 +05:30
thangTang d3d527637f
HBASE-24485 Backport to branch-1 HBASE-17738 BucketCache startup is slow (#1823) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-05 11:48:23 +08:00
Bharath Vissapragada 26828ac615
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files (#1829) 
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).

Fixes the edge case and cleans up the test code a bit.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-06-03 16:22:28 -07:00
Viraj Jasani bbfb4d432f
HBASE-24492 : Remove infinite loop from ProtobufLogReader#readNext (#1831) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-03 22:22:05 +05:30
Bharath Vissapragada 6bca1dd1c1
HBASE-24479: Deflake TestCompaction#testStopStartCompaction (#1820) 
HBASE-24479: Deflake TestCompaction#testStopStartCompaction

Polling of active compaction count is racy. Tightened the asserts
to be more reliable.

Reid Chan <reidchan@apache.org>
 2020-05-31 22:45:31 -07:00
sguggilam 3c138845d9
HBASE-24069 Provide an ExponentialBackOffPolicy sleep between failed … (#1755) 
HBASE-24069: Provide an ExponentialBackOffPolicy sleep between failed region close requests

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-31 14:41:18 -07:00
Bharath Vissapragada ee869b9aea
HBASE-24477: Move ConfigurationObserver and related classes to hbase-common 
This utility is useful for any module that wants to detect
dynamic config changes. Having it to hbase-common makes it
accessible to all the other modules.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-31 14:26:26 -07:00
jacob-leblanc 90b66544f0 HBASE-24454 - Read ioErrorStartTime to local temporary variable to avoid issue when it is set to -1 between greater than zero check and calculation of error duration (#1816) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2020-05-30 21:10:56 -07:00
xincunSong 61fa21e657
HBASE-24470 : Add store file info when log meessages in HStore. (#1804) 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-29 19:20:37 +05:30
Viraj Jasani 7df034a824
HBASE-24428 : Update compaction priority (ADDENDUM) 2020-05-28 14:39:49 +05:30
Javier Akira Luca de Tena 6aa2286733
HBASE-24435 Add hedgedReads and hedgedReadWins count metrics (#1781) 
Co-authored-by: stack <stack@apache.org>
Co-authored-by: Javier <javier.lucadetena@linecorp.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-05-28 10:11:10 +08:00
Viraj Jasani 1e386e3d83
HBASE-24428 : Update compaction priority for recently split daughter regions (#1784) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-05-27 22:52:56 +05:30
Zheng Wang 9f12ef0772 HBASE-24423 No need to get lock in canSplit because hasReferences will get lock too 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-26 13:38:06 -07:00
niuyulin 3235b568da
HBASE-24386 TableSnapshotScanner support scan limit (#1724) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
 2020-05-19 21:30:59 +05:30
Sandeep Pal fbe5e68251
HBASE-24350: Extending and Fixing HBaseTable level replication metrics (#1704) 
branch-1 backport

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Co-Authored-by: Andrew Purtell <apurtell@apache.org>
 2020-05-14 15:00:37 -07:00
Gkkkk302 59a48fc470
HBASE-24355 Fix typos in the HStore#compact annotation (#1699) 
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-12 21:06:47 +05:30
Wellington Ramos Chevreuil f57b3d68c7
HBASE-24351 Backport HBASE-24302 to branch-1 (#1693) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-12 16:27:05 +01:00
shahrs87 be59ddc263
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive (#1687) 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-11 12:10:03 +05:30
Mohammad Arshad d1aff27e06
HBASE-24211: [Addendum] Create table is slow in large cluster when AccessController is enabled. (#1658) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-07 00:32:33 +05:30
Reid Chan febf15f1ea HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong (#1667) 
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-05-06 19:47:22 +08:00
Anoop Sam John e4dbfe9bed
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message (#1654) 2020-05-05 12:46:06 -07:00
xincunSong 92654691d7
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call (#1604) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-04-30 16:02:44 -07:00
bsglz 178005efb9
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … (#801) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-26 16:23:22 +05:30
Mohammad Arshad 9fc8263ca4
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1577) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2020-04-25 17:48:47 +05:30
Viraj Jasani a7a4f61040
HBASE-24024 : Reject multi() requests with rows higher than threshold (#1560) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-04-22 14:13:05 +05:30
Beata Sudi aaa6450d40
HBASE-24139 : Balancer should avoid leaving idle region servers (#1511) 
Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-04-22 11:36:48 +05:30
Reid Chan 1eeff370c4
HBASE-24174 Fix findbugs warning on ServiceAuthorizationManager (#1494) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-17 13:55:47 +08:00
binlijin 589d075de8
HBASE-24191 HRegion#processRowsWithLocks count memstore size wrong when sync failed (#1518) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-04-16 16:31:38 +08:00
Reid Chan 0d8683507b
HBASE-24112 [RSGroup] Support renaming rsgroup (#1467) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-04-15 19:20:14 +08:00
Wei-Chiu Chuang b644e3ccd8
HBASE-8868 add metric to report client shortcircuit reads. 
branch-1 backport of #1334

Signed-off-by: stack <stack@apache.net>
Signed-off-by: Sean Busbey <busbey@apache.org>

Co-authored-by: Andrew Purtell <apurtell@apache.org>
 2020-04-14 19:05:37 -07:00
binlijin 73d1c2a10f
HBASE-24077 When encounter RowTooBigException, log the row info. (#1379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-14 18:43:24 -07:00
Reid Chan 7b1270956a HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be (#1439) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
 2020-04-09 17:00:57 +08:00
Sean Busbey 4b94f2ed41 HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer (#1455) 
- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 2d78a286b6)
 2020-04-09 00:30:09 -05:00
Andrew Purtell 27f512d334
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2020-04-08 11:41:24 -07:00
Viraj Jasani 96ae39b01b
HBASE-23678 : Builder API for version management - setVersionsWithTimeToLive 
Signed-off-by: Xu Cang <xucang@apache.org>
 2020-04-01 16:58:44 +05:30
WenFeiYi f94c19494b HBASE-24040 WALFactory.Providers.multiwal causes StackOverflowError (#1338) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-03-27 10:25:55 +08:00
Huaxiang Sun 61f9048b01
HBASE-23957 [flakey test] client.TestMultiParallel fails to read hbase-site.xml (#1310) (#1344) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-03-25 09:58:04 -07:00
Viraj Jasani 957bfcb065
HBASE-23631 : Backport HBASE-23350 (Make compaction files cacheonWrite configurable based on threshold) to branch-1 (#1256) 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>

Backport of commit: 77229c79e3
 2020-03-10 20:35:55 +05:30
Viraj Jasani a50d5c4a8d
HBASE-23631 : Backport HBASE-23588 Cache index & bloom blocks on write if CacheCompactedBlocksOnWrite is enabled 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: chenxu14 <47170471+chenxu14@users.noreply.github.com>
 2020-02-28 20:42:51 +05:30