Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,014 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

7317 Commits

Author SHA1 Message Date
Duo Zhang 33bdf09f77 HBASE-21888 Add a isClosed method to AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-14 11:41:30 +08:00
Sean Busbey cefaecdc83 HBASE-21884 avoid autoboxing in ugi ref counting for secure bulk load 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 4273e42ce5)
 2019-02-13 13:53:44 -06:00
zhangduo beb7d01092 HBASE-21859 Add clearRegionLocationCache method for AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-13 10:07:43 +08:00
Sakthi 9853f788e8 HBASE-21780: Avoid a wide line on the RegionServer webUI for many ZooKeeper servers 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-02-12 11:00:09 +01:00
huzheng df8fa5ef23 HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters 2019-02-12 11:06:11 +08:00
zhangduo c3f0466336 HBASE-21857 Addendum fix broken UTs 2019-02-11 10:26:34 +08:00
Sakthi 92eb920eca
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor 
Have included code refactoring in MetaTableMetrics & LossyCounting
 2019-02-08 10:44:29 -08:00
zhangduo 94c9aecea2 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-02-08 19:48:07 +08:00
kpalanisamy fceafde0fc HBASE-21816 : Print source cluster replication config directory 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-02-08 14:10:08 +09:00
zhangduo c5b80ea2d4 HBASE-21843 RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta region 2019-02-07 08:44:21 +08:00
zhangduo d66e683216 HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine 2019-02-06 18:30:10 +08:00
Beluga Behr 1492bde036 HBASE-19616 Review of LogCleaner Class 2019-02-05 10:30:15 -08:00
Nihal Jain 4b2c5ae632 HBASE-21795 Client application may get stuck (time bound) if a table modify op is called immediately after split op 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-02-04 20:50:22 +08:00
zhangduo 2c6ab0c047 HBASE-21840 TestHRegionWithInMemoryFlush fails with NPE 2019-02-04 19:26:04 +08:00
zhangduo 54a8cc87c6 HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:29:20 +08:00
zhangduo b40aa4b099 HBASE-21833 Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegion 2019-02-03 15:00:14 +08:00
zhangduo ed60532543 HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:14:09 +08:00
Sergey Shelukhin 9c8aca73ed HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports 
The original fix is provided by Sergey Shelukhin, the UT is added by Duo Zhang

Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-02-02 17:39:55 +08:00
huzheng 2b5dd388cd HBASE-21764 Size of in-memory compaction thread pool shoud be configurable 2019-02-01 10:34:07 +08:00
Nihal Jain 70fb6951d8 HBASE-21644 Modify table procedure runs infinitely for a table having region replication > 1 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-01-31 19:34:36 +08:00
Nihal Jain 3ef6366c4f HBASE-21404 Master/RS navbar active state does not work 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-01-31 16:34:33 +08:00
meiyi ec9029f77e HBASE-21739 Move grant/revoke from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 19:03:43 +08:00
meiyi 32f3745e63 HBASE-21733 SnapshotQuotaObserverChore should only fetch space quotas 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 17:57:59 +08:00
wanghuan 69c331efed HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt' 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 15:57:21 +08:00
Pankaj 529eb47281 HBASE-21535 Zombie Master detector is not working 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 15:01:46 +08:00
Guanghao Zhang 16665b6e93 HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT 2019-01-29 21:53:21 +08:00
zhangduo f359d260d3 HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:37:11 +08:00
zhangduo 2d4819dbed HBASE-21782 LoadIncrementalHFiles should not be IA.Public 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:26:00 +08:00
Duo Zhang 1ac090b3f0 HBASE-21762 Move some methods in ClusterConnection to Connection 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-01-25 21:14:07 +08:00
meiyi 1e7f306e17 HBASE-21713 Support set region server throttle quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 15:47:32 +08:00
Jingyun Tian 3e72cb73ae HBASE-21729 Extract ProcedureCoordinatorRpcs and ProcedureMemberRpcs from CoordinatedStateManager 2019-01-25 14:28:33 +08:00
Wellington Chevreuil aae52f787c HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils 2019-01-24 20:55:55 -08:00
zhangduo de31d56c2d HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 11:05:29 +08:00
zhangduo 67ba050fce HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-24 15:21:26 +08:00
Tommy Li 8a7dd2de24 HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-23 17:53:59 -08:00
Nihal Jain 41e0362fd5
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-23 16:57:35 -08:00
Allan Yang d80556ec85 HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor 2019-01-23 21:08:13 +08:00
Duo Zhang 6c57050af6 HBASE-21753 Support getting the locations for all the replicas of a region 2019-01-23 18:10:01 +08:00
Sergey Shelukhin 96b98da19d HBASE-21575 : memstore above high watermark message is logged too much 2019-01-22 15:28:29 -08:00
huzheng 4eba6b3656 HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized 2019-01-22 20:21:49 +08:00
Nihal Jain 5b99a34a31
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-21 17:26:17 -08:00
huzheng c679a76845 HBASE-21738 Remove all the CSLM#size operation in our memstore because it's an quite time consuming. 2019-01-21 18:01:16 +08:00
zhangduo e0d4915f75 HBASE-21746 Fix two concern cases in RegionMover 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-20 08:57:16 +08:00
Duo Zhang ff272e8683 HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator 2019-01-19 11:14:40 +08:00
zhangduo 07484db1ff HBASE-19695 Handle disabled table for async client 
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
 2019-01-17 18:34:30 +08:00
Beluga Behr fffad56dd6 HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771)
 2019-01-16 15:16:30 -07:00
Duo Zhang ebf4fe3bb9 HBASE-21710 Add quota related methods to the Admin interface 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-16 21:10:27 +08:00
huzheng fdfbd9a21c HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:47:27 +08:00
tianjingyun 87d4ab8669 HBASE-21647 Add status track for splitting WAL tasks 2019-01-15 16:39:02 -08:00
Pankaj 11a0793d72 HBASE-21639 maxHeapUsage value not read properly from config during EntryBuffers initialization 2019-01-15 12:18:53 -08:00
Pankaj a9f40d3bf7 HBASE-21595, Print thread's information and stack traces when RS is aborting forcibly 2019-01-15 12:14:40 -08:00
Sakthi dc50b570c6 HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE' 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-01-14 18:01:33 -07:00
zhangduo e7113edddf HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:41:01 +08:00
Duo Zhang 9ec84c235f HBASE-21704 The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect 2019-01-11 21:20:50 +08:00
Duo Zhang a09dffd106 HBASE-21663 Add replica scan support 2019-01-11 14:19:17 +08:00
Duo Zhang 8b9bfa0df5 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:26:48 +08:00
Nihal Jain d394d84420 HBASE-21297 ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION change 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-10 22:15:49 +08:00
Guanghao Zhang 2cf13d04a1 HBASE-21695 Fix flaky test TestRegionServerAbortTimeout 2019-01-10 10:23:47 +08:00
Guanghao Zhang f0c0f3e6ec HBASE-21691 Fix flaky test TestRecoveredEdits 2019-01-10 10:11:31 +08:00
meiyi 14fb3af5fb HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-09 22:22:47 +08:00
Sergey Shelukhin dfa86404dd HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-01-09 20:03:30 +08:00
Nihal Jain 26e02e1c0b HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-09 11:05:16 +08:00
Jingyun Tian f02ac310d2 HBASE-21588 Procedure v2 wal splitting implementation 2019-01-08 17:26:58 +08:00
zhangduo 348c2dfe9b HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region 2019-01-08 15:51:48 +08:00
zhangduo d5fff9c256 HBASE-21682 Support getting from specific replica 2019-01-08 10:04:08 +08:00
meiyi c28e03e5df HBASE-21159 Add shell command to switch throttle on or off 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-08 09:39:22 +08:00
zhangduo 77ca660389 HBASE-17356 Add replica get support 2019-01-03 08:38:53 +08:00
Guanghao Zhang ba9a49b8a5 HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor 2019-01-02 11:45:21 +08:00
Guanghao Zhang a237d97f72 HBASE-21660 Apply the cell to right memstore for increment/append operation 2019-01-01 17:38:37 +08:00
huzheng f60e8b0b95 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:50:10 +08:00
Guanghao Zhang cbc815cfb7 HBASE-21643 Introduce two new region coprocessor method and deprecated postMutationBeforeWAL 2018-12-27 18:29:38 +08:00
Guanghao Zhang e24d0e0ae0 HBASE-21640 Remove the TODO when increment zero 2018-12-26 21:52:26 +08:00
Andrey Elenskiy e7bd69f9e9 HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sakthi
 2018-12-23 22:02:16 -08:00
Duo Zhang ad285eae4f HBASE-21635 Use maven enforcer to ban imports from illegal packages 2018-12-24 11:30:13 +08:00
Guanghao Zhang 24f740c3d9 HBASE-21621 Reversed scan does not return expected number of rows 
The unit test is contributed by Nihal Jain
 2018-12-23 16:26:39 +08:00
Sakthi b396051153 HBASE-21631: list_quotas should print human readable values for LIMIT 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-22 22:05:32 +08:00
openinx 406f44219f HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-12-21 15:21:34 -08:00
huzheng 46ba4591a4 HBASE-21401 Sanity check when constructing the KeyValue 2018-12-21 18:50:27 +08:00
Guanghao Zhang 1dd137b148 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:50:23 +08:00
Pankaj f47761f91c HBASE-21610, numOpenConnections metric is set to -1 when zero server channel exist 2018-12-20 16:36:23 -08:00
Jingyun Tian 83e12153d1 HBASE-21565 Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same server 2018-12-19 18:42:23 +08:00
Guanghao Zhang d2832c1708 HBASE-21514 Refactor CacheConfig 2018-12-19 13:49:58 +08:00
BELUGA BEHR fc7ca8a2ef
HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-12-18 17:45:37 -08:00
xuqinya 99de534cc4 HBASE-21592 quota.addGetResult(r) throw NPE 
Signed-off-by: huzheng <openinx@gmail.com>
 2018-12-18 16:51:46 +08:00
stack ee214cbe40 HBASE-21589 TestCleanupMetaWAL fails 2018-12-17 09:31:35 -08:00
huzheng 56e7489625 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:10:48 +08:00
Sean Busbey aa36c3f6b6 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum) 
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
 2018-12-14 15:30:31 -06:00
meiyi c494e9ff20 HBASE-21578 Fix wrong throttling exception for capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-14 18:22:34 +08:00
Lars Hofhansl 11193d7cc1 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:56:39 -08:00
huzheng 9b139ca011 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-12 21:53:37 +08:00
Josh Elser b8405bfea4 HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running 
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-11 11:37:35 -05:00
zhangduo 9981e3f843 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 15:29:39 +08:00
Guanghao Zhang 0094335c52 HBASE-21560 Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptor 2018-12-08 16:03:30 +08:00
Guanghao Zhang 7b5b99e243 HBASE-21554 Show replication endpoint classname for replication peer on master web UI 2018-12-07 16:57:52 +08:00
Allan Yang f86d311f76 HBASE-21413 Empty meta log doesn't get split when restart whole cluster 
Signed-off-by: stack <stack@apache.org>
 2018-12-06 21:20:55 -08:00
David Manning 2ebf5ab02f Backport "HBASE-21126 Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes" to branch-2.0 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-12-06 21:20:51 -08:00
huzheng 5cb8c3e9c7 HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-12-07 08:25:49 +08:00
huzheng 1a1a65b565 HBASE-21551 Memory leak when use scan with STREAM at server side 2018-12-06 11:20:38 +08:00
Duo Zhang 96f8e0cbe9 HBASE-21534 TestAssignmentManager is flakey 2018-12-06 09:54:18 +08:00
Duo Zhang 7e8ce1c5cc HBASE-21550 Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptor 2018-12-06 08:30:37 +08:00
Duo Zhang 5648337545 HBASE-21541 Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup module 2018-12-04 22:27:49 +08:00
Peter Somogyi 4118bc688e HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-12-01 09:48:19 +01:00
Peter Somogyi 9d5df33be5 HBASE-21518 TestMasterFailoverWithProcedures is flaky 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-11-30 09:13:38 +01:00
huzheng 1be42994a5 HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 10:03:46 +08:00
Artem Ervits ad8fbf3fd3 HBASE-18735 Provide an option to kill a MiniHBaseCluster without waiting on shutdown 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-11-29 17:05:04 -05:00
meiyi aaafafe63b HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-29 13:57:33 +08:00
Duo Zhang 5688944721 HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster 2018-11-28 09:41:45 +08:00
lixiaobao 3c043440a8 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
 2018-11-27 20:58:24 +08:00
zhangduo beeb38d4dc Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method" 
This reverts commit 6aa57f71f0.
 2018-11-27 20:58:14 +08:00
lixiaobao 6aa57f71f0 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
 2018-11-27 20:31:42 +08:00
Guanghao Zhang 958e84d023 HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache 2018-11-27 14:23:27 +08:00
Duo Zhang 33c4da5558 HBASE-21508 Ignore the reportRegionStateTransition call from a dead server 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-26 14:32:33 +08:00
Ted Yu 7f02645741 HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 18:22:53 -08:00
Ted Yu 1731666b43 HBASE-21387 Addendum fix TestSnapshotFileCache 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-11-24 17:00:31 +08:00
huzheng cc26c8716f HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 11:51:58 +08:00
Duo Zhang 248b8a6f56 HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads. 
Found and analysed by Wellington Chevreuil
 2018-11-21 17:59:06 +08:00
meiyi d590d6e472 HBASE-21034 Add new throttle type: read/write capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-21 09:50:07 +08:00
Duo Zhang 6a64811f44 HBASE-21490 WALProcedure may remove proc wal files still with active procedures 
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-11-19 08:21:09 -08:00
zhangduo 7d16cf0977 HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online 2018-11-18 21:07:27 +08:00
zhangduo 37540b541d HBASE-21485 Add more debug logs for remote procedure execution 2018-11-16 14:47:24 +08:00
Reid Chan 6ab0fbb1f1 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table) 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-15 11:45:24 +08:00
zhangduo 17055cdc70 HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase 2018-11-15 09:41:43 +08:00
huzheng a765859131 HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:13:04 +08:00
zhangduo fbf5e9e0c4 HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-14 18:55:27 +08:00
zhangduo a44515aea7 Revert "HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors" 
This reverts commit a27eea0807.
 2018-11-13 22:24:02 +08:00
zhangduo f8970bdf04 Revert "HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests" 
This reverts commit 3153aae128.
 2018-11-13 22:23:25 +08:00
Duo Zhang 3153aae128 HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests 2018-11-13 14:59:48 +08:00
Duo Zhang a27eea0807 HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-13 11:52:12 +08:00
Duo Zhang ea3b2dfaeb HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP 2018-11-13 11:17:52 +08:00
tedyu 61f1d9735b HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir 2018-11-12 17:02:45 -08:00
huzheng 98ad5ca6e5 Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell" 
This reverts commit b6d32e8a10.
 2018-11-12 11:42:04 +08:00
Duo Zhang f1d9f59bfe HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-11-10 17:17:24 +08:00
jingyuntian 6f602db5f2 HBASE-21410 A helper page that help find all problematic regions and procedures 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-09 14:02:57 +08:00
Guanghao Zhang f936a1045d Revert "HBASE-21410 A helper page that help find all problematic regions and procedures" 
This reverts commit a2f650a0ec.

missing sign-off.
 2018-11-09 14:02:38 +08:00
jingyuntian a2f650a0ec HBASE-21410 A helper page that help find all problematic regions and procedures 2018-11-09 13:56:43 +08:00
Ben Lau 13b68abb58
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
 2018-11-08 14:08:52 -08:00
Esteban Gutierrez dcdebbffdc
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-11-08 10:22:11 -08:00
huzheng b6d32e8a10 HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:14:03 +08:00
tedyu 399fbb2aa6 HBASE-21247 Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers 2018-11-06 12:35:31 -08:00
Allan Yang d544b7adea HBASE-21421 Do not kill RS if reportOnlineRegions fails 2018-11-06 14:56:33 +08:00
Michael Stack a0bba8db46 HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned 2018-11-03 09:45:57 -07:00
zhangduo 4f22397ad4 HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:24:25 +08:00
jingyuntian 1bd98bb608
HBASE-21407 Resolve NPE in backup Master UI 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-02 11:46:47 -07:00
zhangduo 943f65f3b5 HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR 2018-11-02 20:55:36 +08:00
Beluga Behr 3d3dd04651 HBASE-19682 Use Collections.emptyList() For Empty List Values 2018-11-01 08:59:14 -07:00
jingyuntian b9c9f1d61f HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (addendum for branch-2) 2018-11-01 18:05:01 +08:00
Guanghao Zhang 2d0810a006 HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:20:49 +08:00
tianjingyun 857abfb082
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-29 20:56:11 -07:00
zhangduo eb0f9e15d1 HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 20:01:53 +08:00
Guanghao Zhang 6fbd70a611 HBASE-21325 Force to terminate regionserver when abort hang in somewhere 2018-10-29 10:12:21 +08:00
Duo Zhang 4ded55702d HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:45:03 +08:00
Guanghao Zhang f71768308c HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-25 16:22:18 -07:00
Michael Stack 8c1b534ee8 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-10-24 09:07:24 -07:00
xcang f3da04a552
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-23 14:44:45 -07:00
mazhenlin 390c3227e2
HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
 2018-10-23 15:52:05 -05:00
xcang d4ce9e534e
HBASE-21338 Warn if balancer is an ill-fit for cluster size 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-23 13:23:03 -07:00
huzheng bf2ce5488d HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls 2018-10-23 10:25:06 +08:00
zhangduo 328555a374 HBASE-21336 Addendum remove unused code in HBTU 2018-10-22 20:27:11 +08:00
huzheng ff2b332aef HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 19:33:36 +08:00
zhangduo 0cefe7312c HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-22 18:36:16 +08:00
zhangduo 69e65f1bd7 HBASE-21334 TestMergeTableRegionsProcedure is flakey 2018-10-22 14:18:59 +08:00
huzheng 6dce9cd218 HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 10:21:57 +08:00
Toshihiro Suzuki 46fe6c0e92 HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner. 2018-10-20 08:35:41 +09:00
Mike Drob 444f15785c HBASE-21073 Redo concept of maintenance mode 
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
 2018-10-19 10:04:35 -05:00
jingyuntian 4a609db30c
HBASE-21269　Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:22 -07:00
haxiaolin 20a9b8ad00 HBASE-21055 NullPointerException when balanceOverall() but server balance info is null 
Signed-off-by: huzheng <openinx@gmail.com>
 2018-10-18 14:06:08 +08:00
Duo Zhang d7d3beb6bc HBASE-21330 ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same time 2018-10-18 11:34:43 +08:00
tedyu 3563f48900 HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module 2018-10-17 16:00:28 -07:00
Michael Stack f32d3e1e2c
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2018-10-17 09:38:26 -07:00
Michael Stack c67f7f14e2
HBASE-21320 [canary] Cleanup of usage and add commentary 
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
 2018-10-16 22:19:34 -07:00
zhangduo 1a0e1039a2 HBASE-21311 Split TestRestoreSnapshotFromClient 2018-10-17 11:18:34 +08:00
subrat.mishra 6511dae07a
HBASE-21263 Mention compression algorithm along with other storefile details 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-10-16 12:47:11 -07:00
zhangduo 26292ab3d6 HBASE-21310 Split TestCloneSnapshotFromClient 2018-10-16 15:33:43 +08:00
zhangduo c79927bc22 HBASE-21278 Do not rollback successful sub procedures when rolling back a procedure 2018-10-16 15:12:55 +08:00
Andrew Purtell 3097bbc730
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list 2018-10-15 22:28:16 -07:00
Guanghao Zhang 5a6b68012d HBASE-21290 No need to instantiate BlockCache for master which not carry table 2018-10-15 17:25:07 +08:00
haxiaolin 287697bfdf HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2018-10-15 15:54:25 +08:00
zhangduo f01ea9b094 HBASE-21309 Increase the waiting timeout for TestProcedurePriority 2018-10-15 15:27:01 +08:00
Michael Stack 9d6afa9d72 HBASE-21299 List counts of actual region states in master UI tables section 2018-10-12 11:02:16 -07:00
Guanghao Zhang 2ab7e13dfa HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL 2018-10-12 20:38:19 +08:00
Duo Zhang 9da4c1393d HBASE-21254 Need to find a way to limit the number of proc wal files 2018-10-12 11:05:21 +08:00
Josh Elser 33d72e4db4 HBASE-21281 Upgrade bouncycastle to latest 
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
 2018-10-11 10:53:02 -04:00
Mike Drob 81adb704c8 HBASE-21287 Allow configuring test master initialization wait time. 2018-10-11 09:50:37 -05:00
Guanghao Zhang 91aceeb28d HBASE-21251 Refactor RegionMover 2018-10-10 15:14:57 +08:00
Michael Stack 701fe7a0c8 HBASE-21280 Add anchors for each heading in UI 
Signed-off-by: Ted Yu <tedyu@apache.org>
 2018-10-09 22:49:54 -07:00
Duo Zhang 17bd935301 HBASE-21250 Addendum remove unused modification in hbase-server module 2018-10-08 14:56:25 +08:00
zhangduo e1c89e5f8e HBASE-21250 Refactor WALProcedureStore and add more comments for better understanding the implementation 2018-10-07 17:12:27 +08:00
Wellington Chevreuil 9e3f3fdc1f HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes 
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-10-04 03:31:15 -07:00
Xu Cang 8a5537b5f5
HBASE-18549 Add metrics for failed replication queue recovery 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-01 18:39:03 -07:00
Xu Cang 44b01d5908
HBASE-19275 TestSnapshotFileCache never worked properly 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-01 17:12:18 -07:00
zhangduo 1728a20be2 HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure 2018-09-29 13:35:04 +08:00
Nihal Jain 3d1a2dbe68
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 16:35:53 -07:00
Kiran Kumar Maturi f9e18cf31b
HBASE-20857 balancer status tag in jmx metrics 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 16:12:04 -07:00
Archana Katiyar 40c1f072b4
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 15:29:49 -07:00
ramie-raufdeen 5fe40089f3
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 14:27:28 -07:00
xcang c9c861dbb9
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request, fix logging 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 11:50:19 -07:00
zhangduo 1109ebb617 HBASE-21244 Skip persistence when retrying for assignment related procedures 2018-09-28 21:09:41 +08:00
Allan Yang 7b71903baf HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later 2018-09-27 16:11:47 +08:00
Michael Stack 38d6829a62 HBASE-21232 Show table state in Tables view on Master home page 2018-09-26 10:57:53 -07:00
zhangduo 51854a41fc HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217 2018-09-26 20:54:06 +08:00