Commit Graph

7281 Commits

Author SHA1 Message Date
zhangduo e9dae2adc3 HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region 2019-01-08 16:06:34 +08:00
zhangduo 4f0514e39a HBASE-21682 Support getting from specific replica 2019-01-08 09:49:12 +08:00
tianjingyun 281d6429e5 HBASE-21588 Procedure v2 wal splitting implementation 2019-01-07 15:58:15 +08:00
meiyi 77db1fae09 HBASE-21159 Add shell command to switch throttle on or off
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-07 14:21:41 +08:00
zhangduo db66e6cc9e HBASE-17356 Add replica get support 2019-01-03 08:38:20 +08:00
Guanghao Zhang ec948f5d90 HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor 2019-01-02 10:41:36 +08:00
Guanghao Zhang 3ab895979b HBASE-21660 Apply the cell to right memstore for increment/append operation 2019-01-01 17:32:44 +08:00
Guanghao Zhang f5ea00f724 HBASE-21643 Introduce two new region coprocessor method and deprecated postMutationBeforeWAL 2018-12-27 18:27:06 +08:00
huzheng c2d5991b82 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:22:54 +08:00
Guanghao Zhang 4281cb3b95 HBASE-21640 Remove the TODO when increment zero 2018-12-26 21:47:44 +08:00
Andrey Elenskiy dbafa1be83 HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sakthi
2018-12-23 22:01:11 -08:00
zhangduo 97fd647de2 HBASE-21635 Use maven enforcer to ban imports from illegal packages 2018-12-24 11:12:25 +08:00
Guanghao Zhang 7c0a3cc265 HBASE-21621 Reversed scan does not return expected number of rows
The unit test is contributed by Nihal Jain
2018-12-23 16:19:05 +08:00
Sakthi b2bf22e209 HBASE-21631: list_quotas should print human readable values for LIMIT
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-22 22:00:58 +08:00
openinx e160b5ac8d HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-21 15:21:53 -08:00
huzheng 12786f80c1 HBASE-21401 Sanity check when constructing the KeyValue 2018-12-21 18:01:35 +08:00
Guanghao Zhang ad819380c7 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:49:24 +08:00
Pankaj 787567336a HBASE-21610, numOpenConnections metric is set to -1 when zero server channel exist 2018-12-20 16:36:42 -08:00
Guanghao Zhang 8991877bb2 HBASE-21514: Refactor CacheConfig(addendum) 2018-12-19 13:55:13 +08:00
Pankaj fb58a23e56 HBASE-21535, Zombie Master detector is not working 2018-12-18 20:51:01 -08:00
Jingyun Tian c448604ceb HBASE-21565 Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same server 2018-12-18 16:57:11 +08:00
xuqinya f78284685f HBASE-21592 quota.addGetResult(r) throw NPE
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 16:15:51 +08:00
Guanghao Zhang 1971d02e72 HBASE-21514 Refactor CacheConfig 2018-12-18 13:43:30 +08:00
stack 68b5df0095 HBASE-21589 TestCleanupMetaWAL fails 2018-12-17 09:31:59 -08:00
huzheng ac0b3bb547 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:08:52 +08:00
Sean Busbey 491153488e HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum) 2018-12-14 17:08:22 -06:00
meiyi 1b08ba7385 HBASE-21578 Fix wrong throttling exception for capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-14 18:17:47 +08:00
Sergey Shelukhin 3ff274e22e HBASE-21575 : memstore above high watermark message is logged too much 2018-12-13 12:47:11 -08:00
Sergey Shelukhin 9a25d0c249 Revert "HIVE-21575 : memstore above high watermark message is logged too much"
This reverts commit 4640ff5959.
2018-12-13 12:46:39 -08:00
Lars Hofhansl cb1966dc2d HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:57:16 -08:00
huzheng f32d261843 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-13 10:35:20 +08:00
Sergey Shelukhin 4640ff5959 HIVE-21575 : memstore above high watermark message is logged too much 2018-12-12 11:02:25 -08:00
Josh Elser 67d6d5084c HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 10:02:18 -05:00
zhangduo b09b87d143 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 14:51:26 +08:00
Guanghao Zhang 79d90c87b5 HBASE-21560 Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptor 2018-12-08 09:28:14 +08:00
Guanghao Zhang 8d7061a487 HBASE-21554 Show replication endpoint classname for replication peer on master web UI 2018-12-07 13:31:59 +08:00
Allan Yang e0e0694fa1 HBASE-21413 Empty meta log doesn't get split when restart whole cluster
Signed-off-by: stack <stack@apache.org>
2018-12-06 21:21:41 -08:00
huzheng dfb9ae8e0e HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-12-07 08:22:22 +08:00
Tommy Li 170df27b88 HBASE-21414 : StoreFileSize growth rate metric
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2018-12-06 14:43:17 -08:00
huzheng 67ab8b888f HBASE-21551 Memory leak when use scan with STREAM at server side - (addendum) 2018-12-06 11:26:52 +08:00
huzheng 3b854859f6 HBASE-21551 Memory leak when use scan with STREAM at server side 2018-12-06 10:55:42 +08:00
Duo Zhang f49baf259e HBASE-21550 Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptor 2018-12-06 08:30:32 +08:00
zhangduo 8bf966c8e9 HBASE-21541 Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup module 2018-12-04 22:33:36 +08:00
zhangduo dec49135a3 HBASE-21534 Addendum output uncaught exception, fix the way that we add new region servers to avoid recreate a dead server 2018-12-03 08:19:21 +08:00
Duo Zhang d525ec6a12 HBASE-21534 TestAssignmentManager is flakey 2018-12-01 20:41:11 +08:00
Peter Somogyi 5c209f2cec HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-01 09:36:10 +01:00
Duo Zhang 766aa1bfcc HBASE-21486 The current replication implementation for peer in STANDBY state breaks serial replication 2018-12-01 12:15:18 +08:00
Peter Somogyi dfeab9f5c9 HBASE-21518 TestMasterFailoverWithProcedures is flaky
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-11-30 09:12:06 +01:00
huzheng d42e0ade1c HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 09:53:06 +08:00
Artem Ervits 3ad2a89fdf HBASE-18735 Provide an option to kill a MiniHBaseCluster without waiting on shutdown
Signed-off-by: Josh Elser <elserj@apache.org>
2018-11-29 16:37:50 -05:00
meiyi f1f2b5a038 HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-29 11:23:45 +08:00
Duo Zhang d6e1d18be9 HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster 2018-11-28 09:40:27 +08:00
BELUGA BEHR 7877e09b60 HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-11-27 08:57:06 -08:00
lixiaobao 6f15cecaed HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:56:23 +08:00
zhangduo 39bc458eab Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method"
Email address is broken.

This reverts commit 3133d43859.
2018-11-27 20:55:04 +08:00
lixiaobao 3133d43859 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:31:07 +08:00
Guanghao Zhang 34e1d744f7 HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache 2018-11-27 14:20:15 +08:00
zhangduo 1acbd36c90 HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta 2018-11-26 14:51:56 +08:00
Duo Zhang a0e3cb6c0c HBASE-21508 Ignore the reportRegionStateTransition call from a dead server
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-26 14:32:14 +08:00
Ted Yu 27c0bf5c63 HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 18:20:00 -08:00
zhangduo 701526d19f HBASE-21510 Test TestRegisterPeerWorkerWhenRestarting is flakey 2018-11-24 19:50:59 +08:00
Ted Yu d9c773b0a5 HBASE-21387 Addendum fix TestSnapshotFileCache
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:00:08 +08:00
huzheng 6d0dc960e6 HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 11:31:37 +08:00
Duo Zhang 5cc845b713 HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.
Found and analysed by Wellington Chevreuil
2018-11-21 17:14:54 +08:00
meiyi 5ded294419 HBASE-21034 Add new throttle type: read/write capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:46:49 +08:00
Duo Zhang 405bf5e638 HBASE-21490 WALProcedure may remove proc wal files still with active procedures
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-19 08:21:28 -08:00
zhangduo b329e6e3f2 HBASE-21494 NPE when loading RecoverStandByProcedure 2018-11-19 09:35:18 +08:00
zhangduo f555258e7a HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online 2018-11-18 21:07:22 +08:00
zhangduo 43a10df70f HBASE-21485 Add more debug logs for remote procedure execution 2018-11-16 14:30:59 +08:00
Reid Chan 130057f137 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:34:16 +08:00
zhangduo 9e42a9e310 HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase 2018-11-15 09:41:38 +08:00
huzheng a8b642067d HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:00:12 +08:00
zhangduo 640a5e390b HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-14 18:48:33 +08:00
zhangduo 64c4861272 Revert "HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors"
This reverts commit ffb003ee44.
2018-11-13 22:24:59 +08:00
zhangduo 3eb27a099a Revert "HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests"
This reverts commit 114377d426.
2018-11-13 22:24:50 +08:00
Duo Zhang 114377d426 HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests 2018-11-13 14:59:20 +08:00
Duo Zhang ffb003ee44 HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-13 11:49:22 +08:00
Duo Zhang 55fa8f4b33 HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP 2018-11-13 11:31:03 +08:00
tedyu f770081129 HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir 2018-11-12 17:02:17 -08:00
huzheng 362b5dd259 Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
This reverts commit f17382792f.
2018-11-12 11:37:46 +08:00
Duo Zhang 6786aca666 HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-11-10 17:17:12 +08:00
Duo Zhang fe2265fa4a HBASE-21451 The way we maintain the lastestPaths in ReplicationSourceManager is broken when sync replication is used 2018-11-09 14:53:33 +08:00
jingyuntian fa6373660f HBASE-21410 A helper page that help find all problematic regions and procedures
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-09 14:01:49 +08:00
Guanghao Zhang 13b4351012 Revert "HBASE-21410 A helper page that help find all problematic regions and procedures"
This reverts commit 3c34073988.

missing sign-off.
2018-11-09 14:01:29 +08:00
jingyuntian 3c34073988 HBASE-21410 A helper page that help find all problematic regions and procedures 2018-11-09 13:53:00 +08:00
Ben Lau d9f32137b6 HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-11-08 11:59:34 -08:00
Esteban Gutierrez a8ad61ec88
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:22:22 -08:00
huzheng f17382792f HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:07:04 +08:00
jingyuntian cf9b515563 HBASE-21419 Show sync replication related field for replication peer on master web UI
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-11-08 14:50:37 +08:00
zhangduo 6d46b8d256 HBASE-21441 NPE if RS restarts between REFRESH_PEER_SYNC_REPLICATION_STATE_ON_RS_BEGIN and TRANSIT_PEER_NEW_SYNC_REPLICATION_STATE 2018-11-07 16:10:42 +08:00
Allan Yang a31458bdee HBASE-21421 Do not kill RS if reportOnlineRegions fails 2018-11-06 14:58:35 +08:00
tedyu 7395ffac44 HBASE-21247 Custom WAL Provider cannot be specified by configuration whose value is outside the enums in Providers 2018-11-05 08:29:04 -08:00
Duo Zhang c8574ba3c5 HBASE-21420 Use procedure event to wake up the SyncReplicationReplayWALProcedures which wait for worker 2018-11-05 21:43:18 +08:00
Michael Stack d08990c962 HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned 2018-11-03 09:46:19 -07:00
zhangduo 62fe365934 HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:24:11 +08:00
jingyuntian 25c964e9a3
HBASE-21407 Resolve NPE in backup Master UI
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:47:02 -07:00
zhangduo e7f6c2972d HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR 2018-11-02 20:54:00 +08:00
Beluga Behr 21b98e1075 HBASE-19682 Use Collections.emptyList() For Empty List Values 2018-11-01 08:51:11 -07:00
Guanghao Zhang 6bdaedd7ce HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:15:18 +08:00
zhangduo 02f5f171f5 HBASE-21389 Revisit the procedure lock for sync replication 2018-10-30 18:11:20 +08:00