Commit Graph

7208 Commits

Author SHA1 Message Date
zhangduo c5b80ea2d4 HBASE-21843 RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta region 2019-02-07 08:44:21 +08:00
zhangduo d66e683216 HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine 2019-02-06 18:30:10 +08:00
Beluga Behr 1492bde036 HBASE-19616 Review of LogCleaner Class 2019-02-05 10:30:15 -08:00
Nihal Jain 4b2c5ae632 HBASE-21795 Client application may get stuck (time bound) if a table modify op is called immediately after split op
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-02-04 20:50:22 +08:00
zhangduo 2c6ab0c047 HBASE-21840 TestHRegionWithInMemoryFlush fails with NPE 2019-02-04 19:26:04 +08:00
zhangduo 54a8cc87c6 HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:29:20 +08:00
zhangduo b40aa4b099 HBASE-21833 Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegion 2019-02-03 15:00:14 +08:00
zhangduo ed60532543 HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:14:09 +08:00
Sergey Shelukhin 9c8aca73ed HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports
The original fix is provided by Sergey Shelukhin, the UT is added by Duo Zhang

Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-02-02 17:39:55 +08:00
huzheng 2b5dd388cd HBASE-21764 Size of in-memory compaction thread pool shoud be configurable 2019-02-01 10:34:07 +08:00
Nihal Jain 70fb6951d8 HBASE-21644 Modify table procedure runs infinitely for a table having region replication > 1
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-31 19:34:36 +08:00
Nihal Jain 3ef6366c4f HBASE-21404 Master/RS navbar active state does not work
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-01-31 16:34:33 +08:00
meiyi ec9029f77e HBASE-21739 Move grant/revoke from regionserver to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 19:03:43 +08:00
meiyi 32f3745e63 HBASE-21733 SnapshotQuotaObserverChore should only fetch space quotas
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 17:57:59 +08:00
wanghuan 69c331efed HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:57:21 +08:00
Pankaj 529eb47281 HBASE-21535 Zombie Master detector is not working
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:01:46 +08:00
Guanghao Zhang 16665b6e93 HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT 2019-01-29 21:53:21 +08:00
zhangduo f359d260d3 HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:37:11 +08:00
zhangduo 2d4819dbed HBASE-21782 LoadIncrementalHFiles should not be IA.Public
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:26:00 +08:00
Duo Zhang 1ac090b3f0 HBASE-21762 Move some methods in ClusterConnection to Connection
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-01-25 21:14:07 +08:00
meiyi 1e7f306e17 HBASE-21713 Support set region server throttle quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 15:47:32 +08:00
Jingyun Tian 3e72cb73ae HBASE-21729 Extract ProcedureCoordinatorRpcs and ProcedureMemberRpcs from CoordinatedStateManager 2019-01-25 14:28:33 +08:00
Wellington Chevreuil aae52f787c HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils 2019-01-24 20:55:55 -08:00
zhangduo de31d56c2d HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 11:05:29 +08:00
zhangduo 67ba050fce HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-24 15:21:26 +08:00
Tommy Li 8a7dd2de24 HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-01-23 17:53:59 -08:00
Nihal Jain 41e0362fd5
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:57:35 -08:00
Allan Yang d80556ec85 HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor 2019-01-23 21:08:13 +08:00
Duo Zhang 6c57050af6 HBASE-21753 Support getting the locations for all the replicas of a region 2019-01-23 18:10:01 +08:00
Sergey Shelukhin 96b98da19d HBASE-21575 : memstore above high watermark message is logged too much 2019-01-22 15:28:29 -08:00
huzheng 4eba6b3656 HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized 2019-01-22 20:21:49 +08:00
Nihal Jain 5b99a34a31
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:26:17 -08:00
huzheng c679a76845 HBASE-21738 Remove all the CSLM#size operation in our memstore because it's an quite time consuming. 2019-01-21 18:01:16 +08:00
zhangduo e0d4915f75 HBASE-21746 Fix two concern cases in RegionMover
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-20 08:57:16 +08:00
Duo Zhang ff272e8683 HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator 2019-01-19 11:14:40 +08:00
zhangduo 07484db1ff HBASE-19695 Handle disabled table for async client
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
2019-01-17 18:34:30 +08:00
Beluga Behr fffad56dd6 HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771)
2019-01-16 15:16:30 -07:00
Duo Zhang ebf4fe3bb9 HBASE-21710 Add quota related methods to the Admin interface
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 21:10:27 +08:00
huzheng fdfbd9a21c HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:47:27 +08:00
tianjingyun 87d4ab8669 HBASE-21647 Add status track for splitting WAL tasks 2019-01-15 16:39:02 -08:00
Pankaj 11a0793d72 HBASE-21639 maxHeapUsage value not read properly from config during EntryBuffers initialization 2019-01-15 12:18:53 -08:00
Pankaj a9f40d3bf7 HBASE-21595, Print thread's information and stack traces when RS is aborting forcibly 2019-01-15 12:14:40 -08:00
Sakthi dc50b570c6 HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-14 18:01:33 -07:00
zhangduo e7113edddf HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:41:01 +08:00
Duo Zhang 9ec84c235f HBASE-21704 The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect 2019-01-11 21:20:50 +08:00
Duo Zhang a09dffd106 HBASE-21663 Add replica scan support 2019-01-11 14:19:17 +08:00
Duo Zhang 8b9bfa0df5 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:26:48 +08:00
Nihal Jain d394d84420 HBASE-21297 ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION change
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-10 22:15:49 +08:00
Guanghao Zhang 2cf13d04a1 HBASE-21695 Fix flaky test TestRegionServerAbortTimeout 2019-01-10 10:23:47 +08:00
Guanghao Zhang f0c0f3e6ec HBASE-21691 Fix flaky test TestRecoveredEdits 2019-01-10 10:11:31 +08:00
meiyi 14fb3af5fb HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 22:22:47 +08:00
Sergey Shelukhin dfa86404dd HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-09 20:03:30 +08:00
Nihal Jain 26e02e1c0b HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 11:05:16 +08:00
Jingyun Tian f02ac310d2 HBASE-21588 Procedure v2 wal splitting implementation 2019-01-08 17:26:58 +08:00
zhangduo 348c2dfe9b HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region 2019-01-08 15:51:48 +08:00
zhangduo d5fff9c256 HBASE-21682 Support getting from specific replica 2019-01-08 10:04:08 +08:00
meiyi c28e03e5df HBASE-21159 Add shell command to switch throttle on or off
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-08 09:39:22 +08:00
zhangduo 77ca660389 HBASE-17356 Add replica get support 2019-01-03 08:38:53 +08:00
Guanghao Zhang ba9a49b8a5 HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor 2019-01-02 11:45:21 +08:00
Guanghao Zhang a237d97f72 HBASE-21660 Apply the cell to right memstore for increment/append operation 2019-01-01 17:38:37 +08:00
huzheng f60e8b0b95 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:50:10 +08:00
Guanghao Zhang cbc815cfb7 HBASE-21643 Introduce two new region coprocessor method and deprecated postMutationBeforeWAL 2018-12-27 18:29:38 +08:00
Guanghao Zhang e24d0e0ae0 HBASE-21640 Remove the TODO when increment zero 2018-12-26 21:52:26 +08:00
Andrey Elenskiy e7bd69f9e9 HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sakthi
2018-12-23 22:02:16 -08:00
Duo Zhang ad285eae4f HBASE-21635 Use maven enforcer to ban imports from illegal packages 2018-12-24 11:30:13 +08:00
Guanghao Zhang 24f740c3d9 HBASE-21621 Reversed scan does not return expected number of rows
The unit test is contributed by Nihal Jain
2018-12-23 16:26:39 +08:00
Sakthi b396051153 HBASE-21631: list_quotas should print human readable values for LIMIT
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-22 22:05:32 +08:00
openinx 406f44219f HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-21 15:21:34 -08:00
huzheng 46ba4591a4 HBASE-21401 Sanity check when constructing the KeyValue 2018-12-21 18:50:27 +08:00
Guanghao Zhang 1dd137b148 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:50:23 +08:00
Pankaj f47761f91c HBASE-21610, numOpenConnections metric is set to -1 when zero server channel exist 2018-12-20 16:36:23 -08:00
Jingyun Tian 83e12153d1 HBASE-21565 Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same server 2018-12-19 18:42:23 +08:00
Guanghao Zhang d2832c1708 HBASE-21514 Refactor CacheConfig 2018-12-19 13:49:58 +08:00
BELUGA BEHR fc7ca8a2ef
HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-12-18 17:45:37 -08:00
xuqinya 99de534cc4 HBASE-21592 quota.addGetResult(r) throw NPE
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 16:51:46 +08:00
stack ee214cbe40 HBASE-21589 TestCleanupMetaWAL fails 2018-12-17 09:31:35 -08:00
huzheng 56e7489625 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:10:48 +08:00
Sean Busbey aa36c3f6b6 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
2018-12-14 15:30:31 -06:00
meiyi c494e9ff20 HBASE-21578 Fix wrong throttling exception for capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-14 18:22:34 +08:00
Lars Hofhansl 11193d7cc1 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:56:39 -08:00
huzheng 9b139ca011 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-12 21:53:37 +08:00
Josh Elser b8405bfea4 HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 11:37:35 -05:00
zhangduo 9981e3f843 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 15:29:39 +08:00
Guanghao Zhang 0094335c52 HBASE-21560 Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptor 2018-12-08 16:03:30 +08:00
Guanghao Zhang 7b5b99e243 HBASE-21554 Show replication endpoint classname for replication peer on master web UI 2018-12-07 16:57:52 +08:00
Allan Yang f86d311f76 HBASE-21413 Empty meta log doesn't get split when restart whole cluster
Signed-off-by: stack <stack@apache.org>
2018-12-06 21:20:55 -08:00
David Manning 2ebf5ab02f Backport "HBASE-21126 Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes" to branch-2.0
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-06 21:20:51 -08:00
huzheng 5cb8c3e9c7 HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-12-07 08:25:49 +08:00
huzheng 1a1a65b565 HBASE-21551 Memory leak when use scan with STREAM at server side 2018-12-06 11:20:38 +08:00
Duo Zhang 96f8e0cbe9 HBASE-21534 TestAssignmentManager is flakey 2018-12-06 09:54:18 +08:00
Duo Zhang 7e8ce1c5cc HBASE-21550 Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptor 2018-12-06 08:30:37 +08:00
Duo Zhang 5648337545 HBASE-21541 Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup module 2018-12-04 22:27:49 +08:00
Peter Somogyi 4118bc688e HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-01 09:48:19 +01:00
Peter Somogyi 9d5df33be5 HBASE-21518 TestMasterFailoverWithProcedures is flaky
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-11-30 09:13:38 +01:00
huzheng 1be42994a5 HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 10:03:46 +08:00
Artem Ervits ad8fbf3fd3 HBASE-18735 Provide an option to kill a MiniHBaseCluster without waiting on shutdown
Signed-off-by: Josh Elser <elserj@apache.org>
2018-11-29 17:05:04 -05:00
meiyi aaafafe63b HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-29 13:57:33 +08:00
Duo Zhang 5688944721 HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster 2018-11-28 09:41:45 +08:00
lixiaobao 3c043440a8 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:58:24 +08:00
zhangduo beeb38d4dc Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method"
This reverts commit 6aa57f71f0.
2018-11-27 20:58:14 +08:00