Commit Graph

7057 Commits

Author SHA1 Message Date
Guanghao Zhang 958e84d023 HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache 2018-11-27 14:23:27 +08:00
Duo Zhang 33c4da5558 HBASE-21508 Ignore the reportRegionStateTransition call from a dead server
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-26 14:32:33 +08:00
Ted Yu 7f02645741 HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 18:22:53 -08:00
Ted Yu 1731666b43 HBASE-21387 Addendum fix TestSnapshotFileCache
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:00:31 +08:00
huzheng cc26c8716f HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 11:51:58 +08:00
Duo Zhang 248b8a6f56 HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.
Found and analysed by Wellington Chevreuil
2018-11-21 17:59:06 +08:00
meiyi d590d6e472 HBASE-21034 Add new throttle type: read/write capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:50:07 +08:00
Duo Zhang 6a64811f44 HBASE-21490 WALProcedure may remove proc wal files still with active procedures
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-19 08:21:09 -08:00
zhangduo 7d16cf0977 HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online 2018-11-18 21:07:27 +08:00
zhangduo 37540b541d HBASE-21485 Add more debug logs for remote procedure execution 2018-11-16 14:47:24 +08:00
Reid Chan 6ab0fbb1f1 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:45:24 +08:00
zhangduo 17055cdc70 HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase 2018-11-15 09:41:43 +08:00
huzheng a765859131 HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:13:04 +08:00
zhangduo fbf5e9e0c4 HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-14 18:55:27 +08:00
zhangduo a44515aea7 Revert "HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors"
This reverts commit a27eea0807.
2018-11-13 22:24:02 +08:00
zhangduo f8970bdf04 Revert "HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests"
This reverts commit 3153aae128.
2018-11-13 22:23:25 +08:00
Duo Zhang 3153aae128 HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests 2018-11-13 14:59:48 +08:00
Duo Zhang a27eea0807 HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-13 11:52:12 +08:00
Duo Zhang ea3b2dfaeb HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP 2018-11-13 11:17:52 +08:00
tedyu 61f1d9735b HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir 2018-11-12 17:02:45 -08:00
huzheng 98ad5ca6e5 Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
This reverts commit b6d32e8a10.
2018-11-12 11:42:04 +08:00
Duo Zhang f1d9f59bfe HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-11-10 17:17:24 +08:00
jingyuntian 6f602db5f2 HBASE-21410 A helper page that help find all problematic regions and procedures
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-09 14:02:57 +08:00
Guanghao Zhang f936a1045d Revert "HBASE-21410 A helper page that help find all problematic regions and procedures"
This reverts commit a2f650a0ec.

missing sign-off.
2018-11-09 14:02:38 +08:00
jingyuntian a2f650a0ec HBASE-21410 A helper page that help find all problematic regions and procedures 2018-11-09 13:56:43 +08:00
Ben Lau 13b68abb58
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2018-11-08 14:08:52 -08:00
Esteban Gutierrez dcdebbffdc
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:22:11 -08:00
huzheng b6d32e8a10 HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:14:03 +08:00
tedyu 399fbb2aa6 HBASE-21247 Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers 2018-11-06 12:35:31 -08:00
Allan Yang d544b7adea HBASE-21421 Do not kill RS if reportOnlineRegions fails 2018-11-06 14:56:33 +08:00
Michael Stack a0bba8db46 HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned 2018-11-03 09:45:57 -07:00
zhangduo 4f22397ad4 HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:24:25 +08:00
jingyuntian 1bd98bb608
HBASE-21407 Resolve NPE in backup Master UI
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:46:47 -07:00
zhangduo 943f65f3b5 HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR 2018-11-02 20:55:36 +08:00
Beluga Behr 3d3dd04651 HBASE-19682 Use Collections.emptyList() For Empty List Values 2018-11-01 08:59:14 -07:00
jingyuntian b9c9f1d61f HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (addendum for branch-2) 2018-11-01 18:05:01 +08:00
Guanghao Zhang 2d0810a006 HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:20:49 +08:00
tianjingyun 857abfb082
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:56:11 -07:00
zhangduo eb0f9e15d1 HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 20:01:53 +08:00
Guanghao Zhang 6fbd70a611 HBASE-21325 Force to terminate regionserver when abort hang in somewhere 2018-10-29 10:12:21 +08:00
Duo Zhang 4ded55702d HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:45:03 +08:00
Guanghao Zhang f71768308c HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:22:18 -07:00
Michael Stack 8c1b534ee8 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:24 -07:00
xcang f3da04a552
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:44:45 -07:00
mazhenlin 390c3227e2
HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 15:52:05 -05:00
xcang d4ce9e534e
HBASE-21338 Warn if balancer is an ill-fit for cluster size
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:23:03 -07:00
huzheng bf2ce5488d HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls 2018-10-23 10:25:06 +08:00
zhangduo 328555a374 HBASE-21336 Addendum remove unused code in HBTU 2018-10-22 20:27:11 +08:00
huzheng ff2b332aef HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 19:33:36 +08:00
zhangduo 0cefe7312c HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-22 18:36:16 +08:00