fceafde0fc
HBASE-21816 : Print source cluster replication config directory
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-02-08 14:10:08 +09:00
c5b80ea2d4
HBASE-21843 RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta region
2019-02-07 08:44:21 +08:00
d66e683216
HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine
2019-02-06 18:30:10 +08:00
1492bde036
HBASE-19616 Review of LogCleaner Class
2019-02-05 10:30:15 -08:00
4b2c5ae632
HBASE-21795 Client application may get stuck (time bound) if a table modify op is called immediately after split op
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-02-04 20:50:22 +08:00
2c6ab0c047
HBASE-21840 TestHRegionWithInMemoryFlush fails with NPE
2019-02-04 19:26:04 +08:00
54a8cc87c6
HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly
2019-02-03 15:29:20 +08:00
b40aa4b099
HBASE-21833 Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegion
2019-02-03 15:00:14 +08:00
ed60532543
HBASE-21828 Make sure we do not return CompletionException when locating region
2019-02-02 21:14:09 +08:00
9c8aca73ed
HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports
...
The original fix is provided by Sergey Shelukhin, the UT is added by Duo Zhang
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-02-02 17:39:55 +08:00
2b5dd388cd
HBASE-21764 Size of in-memory compaction thread pool shoud be configurable
2019-02-01 10:34:07 +08:00
70fb6951d8
HBASE-21644 Modify table procedure runs infinitely for a table having region replication > 1
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-31 19:34:36 +08:00
3ef6366c4f
HBASE-21404 Master/RS navbar active state does not work
...
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-01-31 16:34:33 +08:00
ec9029f77e
HBASE-21739 Move grant/revoke from regionserver to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 19:03:43 +08:00
32f3745e63
HBASE-21733 SnapshotQuotaObserverChore should only fetch space quotas
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 17:57:59 +08:00
69c331efed
HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt'
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:57:21 +08:00
529eb47281
HBASE-21535 Zombie Master detector is not working
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:01:46 +08:00
16665b6e93
HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT
2019-01-29 21:53:21 +08:00
f359d260d3
HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:37:11 +08:00
2d4819dbed
HBASE-21782 LoadIncrementalHFiles should not be IA.Public
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:26:00 +08:00
1ac090b3f0
HBASE-21762 Move some methods in ClusterConnection to Connection
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-01-25 21:14:07 +08:00
1e7f306e17
HBASE-21713 Support set region server throttle quota
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 15:47:32 +08:00
3e72cb73ae
HBASE-21729 Extract ProcedureCoordinatorRpcs and ProcedureMemberRpcs from CoordinatedStateManager
2019-01-25 14:28:33 +08:00
aae52f787c
HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils
2019-01-24 20:55:55 -08:00
de31d56c2d
HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 11:05:29 +08:00
67ba050fce
HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-24 15:21:26 +08:00
8a7dd2de24
HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction
...
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-01-23 17:53:59 -08:00
41e0362fd5
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:57:35 -08:00
d80556ec85
HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor
2019-01-23 21:08:13 +08:00
6c57050af6
HBASE-21753 Support getting the locations for all the replicas of a region
2019-01-23 18:10:01 +08:00
96b98da19d
HBASE-21575 : memstore above high watermark message is logged too much
2019-01-22 15:28:29 -08:00
4eba6b3656
HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized
2019-01-22 20:21:49 +08:00
5b99a34a31
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:26:17 -08:00
c679a76845
HBASE-21738 Remove all the CSLM#size operation in our memstore because it's an quite time consuming.
2019-01-21 18:01:16 +08:00
e0d4915f75
HBASE-21746 Fix two concern cases in RegionMover
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-20 08:57:16 +08:00
ff272e8683
HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator
2019-01-19 11:14:40 +08:00
07484db1ff
HBASE-19695 Handle disabled table for async client
...
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
2019-01-17 18:34:30 +08:00
fffad56dd6
HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
...
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771
2019-01-16 15:16:30 -07:00
ebf4fe3bb9
HBASE-21710 Add quota related methods to the Admin interface
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 21:10:27 +08:00
fdfbd9a21c
HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case
2019-01-16 09:47:27 +08:00
87d4ab8669
HBASE-21647 Add status track for splitting WAL tasks
2019-01-15 16:39:02 -08:00
11a0793d72
HBASE-21639 maxHeapUsage value not read properly from config during EntryBuffers initialization
2019-01-15 12:18:53 -08:00
a9f40d3bf7
HBASE-21595, Print thread's information and stack traces when RS is aborting forcibly
2019-01-15 12:14:40 -08:00
dc50b570c6
HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-14 18:01:33 -07:00
e7113edddf
HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin
2019-01-13 13:41:01 +08:00
9ec84c235f
HBASE-21704 The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect
2019-01-11 21:20:50 +08:00
a09dffd106
HBASE-21663 Add replica scan support
2019-01-11 14:19:17 +08:00
8b9bfa0df5
HBASE-21580 Support getting Hbck instance from AsyncConnection
2019-01-11 11:26:48 +08:00
d394d84420
HBASE-21297 ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION change
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-10 22:15:49 +08:00
2cf13d04a1
HBASE-21695 Fix flaky test TestRegionServerAbortTimeout
2019-01-10 10:23:47 +08:00
f0c0f3e6ec
HBASE-21691 Fix flaky test TestRecoveredEdits
2019-01-10 10:11:31 +08:00
14fb3af5fb
HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 22:22:47 +08:00
dfa86404dd
HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-09 20:03:30 +08:00
26e02e1c0b
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 11:05:16 +08:00
f02ac310d2
HBASE-21588 Procedure v2 wal splitting implementation
2019-01-08 17:26:58 +08:00
348c2dfe9b
HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region
2019-01-08 15:51:48 +08:00
d5fff9c256
HBASE-21682 Support getting from specific replica
2019-01-08 10:04:08 +08:00
c28e03e5df
HBASE-21159 Add shell command to switch throttle on or off
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-08 09:39:22 +08:00
77ca660389
HBASE-17356 Add replica get support
2019-01-03 08:38:53 +08:00
ba9a49b8a5
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor
2019-01-02 11:45:21 +08:00
a237d97f72
HBASE-21660 Apply the cell to right memstore for increment/append operation
2019-01-01 17:38:37 +08:00
f60e8b0b95
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time
2018-12-27 18:50:10 +08:00
cbc815cfb7
HBASE-21643 Introduce two new region coprocessor method and deprecated postMutationBeforeWAL
2018-12-27 18:29:38 +08:00
e24d0e0ae0
HBASE-21640 Remove the TODO when increment zero
2018-12-26 21:52:26 +08:00
e7bd69f9e9
HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sakthi
2018-12-23 22:02:16 -08:00
ad285eae4f
HBASE-21635 Use maven enforcer to ban imports from illegal packages
2018-12-24 11:30:13 +08:00
24f740c3d9
HBASE-21621 Reversed scan does not return expected number of rows
...
The unit test is contributed by Nihal Jain
2018-12-23 16:26:39 +08:00
b396051153
HBASE-21631: list_quotas should print human readable values for LIMIT
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-22 22:05:32 +08:00
406f44219f
HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-21 15:21:34 -08:00
46ba4591a4
HBASE-21401 Sanity check when constructing the KeyValue
2018-12-21 18:50:27 +08:00
1dd137b148
HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result
2018-12-21 09:50:23 +08:00
f47761f91c
HBASE-21610, numOpenConnections metric is set to -1 when zero server channel exist
2018-12-20 16:36:23 -08:00
83e12153d1
HBASE-21565 Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same server
2018-12-19 18:42:23 +08:00
d2832c1708
HBASE-21514 Refactor CacheConfig
2018-12-19 13:49:58 +08:00
fc7ca8a2ef
HBASE-21492 CellCodec Written To WAL Before It's Verified
2018-12-18 17:45:37 -08:00
99de534cc4
HBASE-21592 quota.addGetResult(r) throw NPE
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 16:51:46 +08:00
ee214cbe40
HBASE-21589 TestCleanupMetaWAL fails
2018-12-17 09:31:35 -08:00
56e7489625
HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type
2018-12-15 21:10:48 +08:00
aa36c3f6b6
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
...
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
2018-12-14 15:30:31 -06:00
c494e9ff20
HBASE-21578 Fix wrong throttling exception for capacity unit
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-14 18:22:34 +08:00
11193d7cc1
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit.
2018-12-13 11:56:39 -08:00
9b139ca011
HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time
2018-12-12 21:53:37 +08:00
b8405bfea4
HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
...
This includes removing the "old way" of disabling blockcache in favor of the
new API.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 11:37:35 -05:00
9981e3f843
HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator
2018-12-11 15:29:39 +08:00
0094335c52
HBASE-21560 Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptor
2018-12-08 16:03:30 +08:00
7b5b99e243
HBASE-21554 Show replication endpoint classname for replication peer on master web UI
2018-12-07 16:57:52 +08:00
f86d311f76
HBASE-21413 Empty meta log doesn't get split when restart whole cluster
...
Signed-off-by: stack <stack@apache.org>
2018-12-06 21:20:55 -08:00
2ebf5ab02f
Backport "HBASE-21126 Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes" to branch-2.0
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-06 21:20:51 -08:00
5cb8c3e9c7
HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-12-07 08:25:49 +08:00
1a1a65b565
HBASE-21551 Memory leak when use scan with STREAM at server side
2018-12-06 11:20:38 +08:00
96f8e0cbe9
HBASE-21534 TestAssignmentManager is flakey
2018-12-06 09:54:18 +08:00
7e8ce1c5cc
HBASE-21550 Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptor
2018-12-06 08:30:37 +08:00
5648337545
HBASE-21541 Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup module
2018-12-04 22:27:49 +08:00
4118bc688e
HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-01 09:48:19 +01:00
9d5df33be5
HBASE-21518 TestMasterFailoverWithProcedures is flaky
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-11-30 09:13:38 +01:00
1be42994a5
HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived.
2018-11-30 10:03:46 +08:00
ad8fbf3fd3
HBASE-18735 Provide an option to kill a MiniHBaseCluster without waiting on shutdown
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-11-29 17:05:04 -05:00
aaafafe63b
HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-29 13:57:33 +08:00
5688944721
HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster
2018-11-28 09:41:45 +08:00
3c043440a8
HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:58:24 +08:00
beeb38d4dc
Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method"
...
This reverts commit 6aa57f71f0
2018-11-27 20:58:14 +08:00
6aa57f71f0
HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:31:42 +08:00
958e84d023
HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache
2018-11-27 14:23:27 +08:00
33c4da5558
HBASE-21508 Ignore the reportRegionStateTransition call from a dead server
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-26 14:32:33 +08:00
7f02645741
HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles
2018-11-25 18:22:53 -08:00
1731666b43
HBASE-21387 Addendum fix TestSnapshotFileCache
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:00:31 +08:00
cc26c8716f
HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files
2018-11-23 11:51:58 +08:00
248b8a6f56
HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.
...
Found and analysed by Wellington Chevreuil
2018-11-21 17:59:06 +08:00
d590d6e472
HBASE-21034 Add new throttle type: read/write capacity unit
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:50:07 +08:00
6a64811f44
HBASE-21490 WALProcedure may remove proc wal files still with active procedures
...
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-19 08:21:09 -08:00
7d16cf0977
HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online
2018-11-18 21:07:27 +08:00
37540b541d
HBASE-21485 Add more debug logs for remote procedure execution
2018-11-16 14:47:24 +08:00
6ab0fbb1f1
HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:45:24 +08:00
17055cdc70
HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase
2018-11-15 09:41:43 +08:00
a765859131
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:13:04 +08:00
fbf5e9e0c4
HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors
2018-11-14 18:55:27 +08:00
a44515aea7
Revert "HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors"
...
This reverts commit a27eea0807
2018-11-13 22:24:02 +08:00
f8970bdf04
Revert "HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests"
...
This reverts commit 3153aae128
2018-11-13 22:23:25 +08:00
3153aae128
HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests
2018-11-13 14:59:48 +08:00
a27eea0807
HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors
2018-11-13 11:52:12 +08:00
ea3b2dfaeb
HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP
2018-11-13 11:17:52 +08:00
61f1d9735b
HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir
2018-11-12 17:02:45 -08:00
98ad5ca6e5
Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
...
This reverts commit b6d32e8a10
2018-11-12 11:42:04 +08:00
f1d9f59bfe
HBASE-21376 Add some verbose log to MasterProcedureScheduler
2018-11-10 17:17:24 +08:00
6f602db5f2
HBASE-21410 A helper page that help find all problematic regions and procedures
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-09 14:02:57 +08:00
f936a1045d
Revert "HBASE-21410 A helper page that help find all problematic regions and procedures"
...
This reverts commit a2f650a0ec
2018-11-09 14:02:38 +08:00
a2f650a0ec
HBASE-21410 A helper page that help find all problematic regions and procedures
2018-11-09 13:56:43 +08:00
13b68abb58
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2018-11-08 14:08:52 -08:00
dcdebbffdc
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:22:11 -08:00
b6d32e8a10
HBASE-21401 Sanity check in BaseDecoder#parseCell
2018-11-08 20:14:03 +08:00
399fbb2aa6
HBASE-21247 Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers
2018-11-06 12:35:31 -08:00
d544b7adea
HBASE-21421 Do not kill RS if reportOnlineRegions fails
2018-11-06 14:56:33 +08:00
a0bba8db46
HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned
2018-11-03 09:45:57 -07:00
4f22397ad4
HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back
2018-11-03 08:24:25 +08:00
1bd98bb608
HBASE-21407 Resolve NPE in backup Master UI
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:46:47 -07:00
943f65f3b5
HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR
2018-11-02 20:55:36 +08:00
3d3dd04651
HBASE-19682 Use Collections.emptyList() For Empty List Values
2018-11-01 08:59:14 -07:00
b9c9f1d61f
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (addendum for branch-2)
2018-11-01 18:05:01 +08:00
2d0810a006
HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table
2018-11-01 16:20:49 +08:00
857abfb082
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:56:11 -07:00
eb0f9e15d1
HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler
2018-10-29 20:01:53 +08:00
6fbd70a611
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
2018-10-29 10:12:21 +08:00
4ded55702d
HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing
2018-10-26 21:45:03 +08:00
f71768308c
HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:22:18 -07:00
8c1b534ee8
HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:24 -07:00
f3da04a552
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:44:45 -07:00
390c3227e2
HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 15:52:05 -05:00
d4ce9e534e
HBASE-21338 Warn if balancer is an ill-fit for cluster size
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:23:03 -07:00
bf2ce5488d
HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls
2018-10-23 10:25:06 +08:00
328555a374
HBASE-21336 Addendum remove unused code in HBTU
2018-10-22 20:27:11 +08:00
ff2b332aef
HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles
2018-10-22 19:33:36 +08:00
0cefe7312c
HBASE-21336 Simplify the implementation of WALProcedureMap
2018-10-22 18:36:16 +08:00
69e65f1bd7
HBASE-21334 TestMergeTableRegionsProcedure is flakey
2018-10-22 14:18:59 +08:00
6dce9cd218
HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split
2018-10-22 10:21:57 +08:00
46fe6c0e92
HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner.
2018-10-20 08:35:41 +09:00
444f15785c
HBASE-21073 Redo concept of maintenance mode
...
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
2018-10-19 10:04:35 -05:00
4a609db30c
HBASE-21269 Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
2018-10-18 06:22:22 -07:00
20a9b8ad00
HBASE-21055 NullPointerException when balanceOverall() but server balance info is null
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-10-18 14:06:08 +08:00
d7d3beb6bc
HBASE-21330 ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same time
2018-10-18 11:34:43 +08:00
3563f48900
HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module
2018-10-17 16:00:28 -07:00
f32d3e1e2c
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-17 09:38:26 -07:00
c67f7f14e2
HBASE-21320 [canary] Cleanup of usage and add commentary
...
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:19:34 -07:00
1a0e1039a2
HBASE-21311 Split TestRestoreSnapshotFromClient
2018-10-17 11:18:34 +08:00
6511dae07a
HBASE-21263 Mention compression algorithm along with other storefile details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-16 12:47:11 -07:00
26292ab3d6
HBASE-21310 Split TestCloneSnapshotFromClient
2018-10-16 15:33:43 +08:00
c79927bc22
HBASE-21278 Do not rollback successful sub procedures when rolling back a procedure
2018-10-16 15:12:55 +08:00
3097bbc730
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
2018-10-15 22:28:16 -07:00
5a6b68012d
HBASE-21290 No need to instantiate BlockCache for master which not carry table
2018-10-15 17:25:07 +08:00
287697bfdf
HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 15:54:25 +08:00
f01ea9b094
HBASE-21309 Increase the waiting timeout for TestProcedurePriority
2018-10-15 15:27:01 +08:00
9d6afa9d72
HBASE-21299 List counts of actual region states in master UI tables section
2018-10-12 11:02:16 -07:00
2ab7e13dfa
HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL
2018-10-12 20:38:19 +08:00
9da4c1393d
HBASE-21254 Need to find a way to limit the number of proc wal files
2018-10-12 11:05:21 +08:00
33d72e4db4
HBASE-21281 Upgrade bouncycastle to latest
...
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-11 10:53:02 -04:00
81adb704c8
HBASE-21287 Allow configuring test master initialization wait time.
2018-10-11 09:50:37 -05:00
91aceeb28d
HBASE-21251 Refactor RegionMover
2018-10-10 15:14:57 +08:00
701fe7a0c8
HBASE-21280 Add anchors for each heading in UI
...
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-09 22:49:54 -07:00
17bd935301
HBASE-21250 Addendum remove unused modification in hbase-server module
2018-10-08 14:56:25 +08:00
e1c89e5f8e
HBASE-21250 Refactor WALProcedureStore and add more comments for better understanding the implementation
2018-10-07 17:12:27 +08:00
9e3f3fdc1f
HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes
...
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-04 03:31:15 -07:00
8a5537b5f5
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:03 -07:00
44b01d5908
HBASE-19275 TestSnapshotFileCache never worked properly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:12:18 -07:00
1728a20be2
HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure
2018-09-29 13:35:04 +08:00
3d1a2dbe68
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:35:53 -07:00
f9e18cf31b
HBASE-20857 balancer status tag in jmx metrics
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:12:04 -07:00
40c1f072b4
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:29:49 -07:00
5fe40089f3
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:27:28 -07:00
c9c861dbb9
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request, fix logging
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:19 -07:00
1109ebb617
HBASE-21244 Skip persistence when retrying for assignment related procedures
2018-09-28 21:09:41 +08:00
7b71903baf
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later
2018-09-27 16:11:47 +08:00
38d6829a62
HBASE-21232 Show table state in Tables view on Master home page
2018-09-26 10:57:53 -07:00
51854a41fc
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217
2018-09-26 20:54:06 +08:00
f3c3c7c422
HBASE-21212 Wrong flush time when update flush metric
2018-09-26 19:17:35 +08:00
21fafbaf53
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Amending-Author: Reid Chan <reidchan@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:49:21 +08:00
0f514ab75a
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:15 -07:00
fa2888ebf0
HBASE-21217 Revisit the executeProcedure method for open/close region
2018-09-25 18:10:47 +08:00
20974513d9
Amend HBASE-20704 Sometimes some compacted storefiles are not archived on region close
...
Forward port small logging improvements from branch-1 version of this change.
2018-09-21 16:12:44 -07:00
fd68e7593e
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:34 -07:00
29214c77a6
HBASE-21214 [hbck2] setTableState just sets hbase:meta state, not in-memory state
2018-09-21 16:04:42 -07:00
648d58bc23
HBASE-21206 Scan with batch size may return incomplete cells
2018-09-20 22:24:17 +08:00
460cf6ff47
HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-20 06:58:53 -07:00
899fddb4e7
HBASE-21023 Added bypassProcedure() API to HbckService
2018-09-19 15:17:52 -07:00
8876f12c0c
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
...
Adds 'raw' assigns and unassigns methods to Hbck Service.
Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 09:47:32 -07:00
84896deb1c
HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region - addendum fixes NPE
2018-09-19 07:17:55 -07:00
13581e527d
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region - fix flaky test (Ram)
2018-09-18 11:30:49 +05:30
6616fd2e0f
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
...
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.
Incorporates bulk of patch made by Allan Yang over on HBASE-21035.
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java
Add a Constructor for case where retries are for ever.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move stuff around so that the first hbase:meta read is the AM#loadMeta.
Previously, checking table state and/or favored nodes could end up
trying to read a meta that was not onlined holding up master startup.
Do similar for the namespace table. Adds new methods isMeta and
isNamespace which check that the regions/tables are online.. if not,
we wait logging with a back-off that assigns need to be run.
Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:43:48 -07:00
7a1b4d449d
HBASE-20704 Sometimes some compacted storefiles are not archived on region close
2018-09-16 18:28:24 -07:00
966e3751c2
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
...
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-15 18:36:33 +08:00
e9d23d5d25
HBASE-21168 Insecure Randomness in BloomFilterUtil
...
Flagged by Fortify static analysis
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-12 09:51:57 -05:00
d40348e8cd
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 16:31:56 -07:00
c0acad92d2
HBASE-21021 Result returned by Append operation should be ordered
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:55:32 -07:00
6e699b0694
HBASE-21172 Addendum fix comment
2018-09-11 17:32:38 +08:00
55e1297d96
HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure
2018-09-11 15:14:02 +08:00
52d50cc426
HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 11:20:23 +08:00
1a7dba44ce
HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
2018-09-10 21:51:48 +08:00
2be9196ba7
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region (ram)
2018-09-10 13:31:36 +05:30
d35e2f35a4
HBASE-21144 AssignmentManager.waitForAssignment is not stable
2018-09-10 12:19:04 +08:00
49501cd5b5
HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck
2018-09-09 10:25:10 +09:00
1b65c2f161
HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0
2018-09-07 23:44:03 +08:00
3f8c15ad2b
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir; ADDENDUM
...
Address review comments.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-06 17:25:20 -07:00
62919a3791
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir
2018-09-06 16:45:53 -07:00
bbd9131c59
HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 15:01:19 -07:00
1798032ace
HBASE-21161 Enable the test added in HBASE-20741 that was removed
...
accidentally (Ram)
2018-09-06 16:53:16 +05:30
83c871add8
HBASE-21107 add a metrics for netty direct memory
2018-09-05 16:10:17 -07:00
dee13ea401
HBASE-20892 [UI] Start / End keys are empty on table.jsp
2018-09-05 09:21:38 +08:00
1a5aedab34
HBASE-20741 Split of a region with replicas creates all daughter regions
...
and its replica in same server (Ram)
Signed-off-by: Huaxiang Sun, Michael Stack, Duo Zhang
2018-09-04 16:26:11 +05:30
0409c54ba7
HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
...
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:15:57 +08:00
58365c8dd2
HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:35:28 -07:00
68c5313ca4
HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime
2018-09-02 18:32:24 +08:00
cf59f2a1d2
HBASE-21128 TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is broken
2018-08-30 10:09:49 +08:00
72a29211cc
HBASE-15728 Add Per-Table metrics back
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableSource.java
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregate.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableSourceImpl.java
hbase-hadoop2-compat/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperStub.java
hbase-hadoop2-compat/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsTableSourceImpl.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregateImpl.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsTableAggregate.java
2018-08-29 16:27:15 -07:00
737ac48473
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-28 20:19:55 -07:00
22254cf4ce
HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
...
Also makes the trace log message length configurable.
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:02:18 -04:00
fc21dc854b
HBASE-21017 Revisit the expected states for open/close
2018-08-28 14:49:47 +08:00
cdf5cfa396
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:10:33 -07:00
a0cbfb8ea6
HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:22:04 -07:00
f9790b01d9
HBASE-21088 HStoreFile should be closed in HStore#hasReferences
2018-08-27 09:38:03 -07:00
4f32883e95
HBASE-21072 Addendum do not write lock file when running TestHBaseFsckReplication
2018-08-27 21:04:48 +08:00
2369afd7e5
HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online
2018-08-27 09:58:52 +09:00
404d4d56cc
HBASE-21095 The timeout retry logic for several procedures are broken after master restarts
2018-08-26 18:17:20 +08:00
f533f01a3a
HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region
2018-08-26 18:08:06 +08:00
2b7ef2e623
HBASE-20772 Controlled shutdown fills Master log with the disturbing message 'No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSED'
...
Look for the particular case where RS does the close of region w/o
involving Master and log special message in this case. Dodgy. But
until we have Master run shutdown of all regions, better than
the message we currently show.
2018-08-25 14:30:27 +08:00
a83073aff0
HBASE-21078 [amv2] CODE-BUG NPE in RTP doing Unassign
2018-08-24 13:22:45 -07:00
6047fb05f5
HBASE-21113 Apply the branch-2 version of HBASE-21095, The timeout retry logic for several procedures are broken after master restarts
...
I applied the patch HBASE-21095 and then reverted it so could apply the
patch as HBASE-21113 (by reverting the HBASE-21095 revert but pushing
with this message!).
Revert "Revert "HBASE-21095 The timeout retry logic for several procedures are broken after master restarts""
This reverts commit a220566b98
2018-08-24 12:32:33 -07:00
a220566b98
Revert "HBASE-21095 The timeout retry logic for several procedures are broken after master restarts"
...
This reverts commit 09be1d0d57
2018-08-24 12:24:17 -07:00
09be1d0d57
HBASE-21095 The timeout retry logic for several procedures are broken after master restarts
2018-08-24 12:21:01 -07:00
2ea45e67d0
HBASE-21072 Block out HBCK1 in hbase2
...
Write the hbase-1.x hbck1 lock file to block out hbck1 instances writing
state to an hbase-2.x cluster (could do damage).
Set hbase.write.hbck1.lock.file to false to disable this writing.
2018-08-24 09:23:54 -07:00
c33af1e854
HBASE-21101 Remove the waitUntilAllRegionsAssigned call after split in TestTruncateTableProcedure
2018-08-24 10:35:05 +08:00
b318311dfd
HBASE-20193 Move TestCreateTableProcedure.testMRegions to a separated file
2018-08-24 10:09:23 +08:00
87f9b4accd
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
2018-08-23 11:49:47 -07:00
kpalanisamy
zhangduo
Beluga Behr
Nihal Jain
Sergey Shelukhin
huzheng
meiyi
wanghuan
Pankaj
Guanghao Zhang
Jingyun Tian
Wellington Chevreuil
Tommy Li
Allan Yang
Sakthi
meiyi
Andrey Elenskiy
xuqinya
stack
Sean Busbey
Lars Hofhansl
Josh Elser
David Manning
Peter Somogyi
Artem Ervits
lixiaobao
lixiaobao
Ted Yu
Reid Chan
Ben Lau
Esteban Gutierrez
xcang
mazhenlin
Toshihiro Suzuki
Mike Drob
haxiaolin
subrat.mishra
Andrew Purtell
Wellington Chevreuil
Kiran Kumar Maturi
Archana Katiyar
ramie-raufdeen
Zach York
Mingliang Liu
Guangxu Cheng
Umesh Agashe
Vasudevan
Francis Liu
Tyler Mi
Huaxiang Sun
krish.dey