253 Commits

Author SHA1 Message Date
Sergey Shelukhin
946bc19242 HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports
The original fix is provided by Sergey Shelukhin, the UT is added by Duo Zhang

Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-02-02 17:39:31 +08:00
Duo Zhang
405bf5e638 HBASE-21490 WALProcedure may remove proc wal files still with active procedures
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-19 08:21:28 -08:00
Duo Zhang
83dc38a1df HBASE-21377 Add debug log for procedure stack id related operations 2018-11-19 18:55:41 +08:00
Duo Zhang
b8271c06d5 Revert "HBASE-21377 Add debug log for catching the root cause"
This reverts commit 3fe8649b2c9ba1271c25e8f476548907e4c7a90d.
2018-11-19 17:08:41 +08:00
Duo Zhang
55fa8f4b33 HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP 2018-11-13 11:31:03 +08:00
tedyu
f770081129 HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir 2018-11-12 17:02:17 -08:00
jingyuntian
ccabf7310d HBASE-21437 Bypassed procedure throw IllegalArgumentException when its state is WAITING_TIMEOUT
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-09 23:03:19 +08:00
zhangduo
01603278a3 HBASE-21314 The implementation of BitSetNode is not efficient 2018-11-06 09:19:45 +08:00
tedyu
eaf0baf7d0 HBASE-21438 TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-06 09:15:44 +08:00
Duo Zhang
c8574ba3c5 HBASE-21420 Use procedure event to wake up the SyncReplicationReplayWALProcedures which wait for worker 2018-11-05 21:43:18 +08:00
zhangduo
62fe365934 HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:24:11 +08:00
zhangduo
e7f6c2972d HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR 2018-11-02 20:54:00 +08:00
zhangduo
d5e4faacc3 HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 19:56:49 +08:00
zhangduo
e5ba79816a
HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-26 12:36:33 -07:00
zhangduo
385e39810f Revert "HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure"
This reverts commit 3b68e5393edba011146962c7457faffc1e3c0ee7.
2018-10-26 21:27:19 +08:00
Allan Yang
66469733ec HBASE-21384 Procedure with holdlock=false should not be restored lock when restarts 2018-10-25 14:23:36 +08:00
Allan Yang
614612a9d8 HBASE-21364 Procedure holds the lock should put to front of the queue after restart 2018-10-25 12:05:28 +08:00
Duo Zhang
3fe8649b2c HBASE-21377 Add debug log for catching the root cause 2018-10-24 15:43:12 +08:00
Duo Zhang
b2fcf765ae HBASE-21363 Rewrite the buildingHoldCleanupTracker method in WALProcedureStore 2018-10-24 14:14:19 +08:00
Allan Yang
3b68e5393e HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure 2018-10-23 16:09:05 +08:00
Duo Zhang
603bf4c551 HBASE-21354 Addendum fix compile error 2018-10-23 14:39:53 +08:00
Allan Yang
86f23128b0 HBASE-21354 Procedure may be deleted improperly during master restarts resulting in 'Corrupt' 2018-10-23 10:55:18 +08:00
zhangduo
3b66b65b9f HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-22 18:36:11 +08:00
Duo Zhang
7d7293049a Revert "HBASE-21336 Simplify the implementation of WALProcedureMap"
This reverts commit 7adf590106826b9e4432cfeee06acdc0ccff8c6e.
2018-10-22 09:32:55 +08:00
zhangduo
7adf590106 HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-20 21:59:46 +08:00
jingyuntian
5fbb227deb
HBASE-21269 Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:52 -07:00
zhangduo
132bea9a1c HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished 2018-10-18 14:24:34 +08:00
Duo Zhang
5efa5f6de4 HBASE-21330 ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same time 2018-10-18 11:29:12 +08:00
Jingyun Tian
821e4d7de2 HBASE-21291 Add a test for bypassing stuck state-machine procedures
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-16 22:26:58 +08:00
Duo Zhang
fa652cc610 HBASE-21315 The getActiveMinProcId and getActiveMaxProcId of BitSetNode are incorrect if there are no active procedure 2018-10-16 15:42:01 +08:00
zhangduo
0d9982901a HBASE-21278 Do not rollback successful sub procedures when rolling back a procedure 2018-10-16 15:12:49 +08:00
Duo Zhang
9e9a1e0f0d HBASE-21254 Need to find a way to limit the number of proc wal files 2018-10-12 11:05:13 +08:00
zhangduo
118b074684 HBASE-21250 Refactor WALProcedureStore and add more comments for better understanding the implementation 2018-10-07 17:09:09 +08:00
meiyi
6bc7089f9e HBASE-21249 Add jitter for ProcedureUtil.getBackoffTimeMs
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-09-28 21:27:45 +08:00
zhangduo
22ac655704 HBASE-21233 Allow the procedure implementation to skip persistence of the state after a execution 2018-09-28 10:50:29 +08:00
Umesh Agashe
dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService 2018-09-19 15:18:16 -07:00
Michael Stack
76199a0a29 HBASE-21190 Log files and count of entries in each as we load from the MasterProcWAL store 2018-09-12 10:21:26 -07:00
TAK LON WU
7ecb435d9d
HBASE-21181 Use the same filesystem for wal archive directory and wal directory
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 15:32:51 -07:00
Duo Zhang
c59ecfb961 HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure 2018-09-11 15:13:58 +08:00
Michael Stack
b83613fdce HBASE-21171 [amv2] Tool to parse a directory of MasterProcWALs standalone
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-09 09:28:59 -07:00
Michael Stack
3ac3249423
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir 2018-09-06 16:52:47 -07:00
Allan Yang
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure 2018-08-30 12:23:24 -07:00
zhangduo
bb3494134e HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region 2018-08-21 06:12:09 +08:00
Allan Yang
159435ee40 HBASE-21050 Exclusive lock may be held by a SUCCESS state procedure forever
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-08-15 15:39:48 -07:00
subrat.mishra
49ae8549cf HBASE-21040 Replace call to printStackTrace() with proper logger call
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-15 08:29:54 -07:00
Allan Yang
1114a1a65e HBASE-20978 [amv2] Worker terminating UNNATURALLY during MoveRegionProcedure Signed-off-by: Michael Stack <stack@apache.org> Signed-off-by: Duo Zhang <zhangduo@apache.org> 2018-08-14 16:30:20 -07:00
Allan Yang
a07e755625 HBASE-20975 Lock may not be taken or released while rolling back procedure 2018-08-13 20:23:04 +08:00
jackbearden
953e5aa88c HBASE-20981. Rollback stateCount accounting thrown-off when exception out of rollbackState
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-11 11:58:38 -07:00
Michael Stack
c365c4084e HBASE-20989 Minor, miscellaneous logging fixes
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:59 -07:00
Alex Leblang
e963694259
HBASE-19369 Switch to Builder Pattern In WAL
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).

Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:42:33 -05:00