Commit Graph

7015 Commits

Author SHA1 Message Date
jingyuntian 3836967e05
HBASE-21407 Resolve NPE in backup Master UI
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:46:15 -07:00
Guanghao Zhang 29e3eec703 HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:27:23 +08:00
Michael Stack 29d6eeb6e8
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
ADDENDUM
2018-10-31 10:15:04 -07:00
Duo Zhang bddd488c34 HBASE-21237 Use CompatRemoteProcedureResolver to dispatch open/close region requests to RS 2018-10-30 17:36:44 +08:00
tianjingyun 422e98957b
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:56:44 -07:00
zhangduo 2466032fdd HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 20:18:10 +08:00
Michael Stack 066082dff4
HBASE-21397 Set version to 2.1.1 on branch-2.1 in prep for first RC 2018-10-26 12:56:24 -07:00
Duo Zhang 24f5f7afa8 HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:45:08 +08:00
Michael Stack 940326d8f5
Revert "HBASE-21376 Add some verbose log to MasterProcedureScheduler"
This reverts commit 71224ee530.
2018-10-26 06:10:47 -07:00
Allan Yang 71224ee530
HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-10-26 05:54:50 -07:00
Mike Drob 127de9e637
HBASE-21380 Filter finished SCP at start 2018-10-25 20:28:51 -07:00
Michael Stack 7de5f1d60d
Revert "HBASE-21380 Completed SCPs shouldn't add to dead servers in processing"
This reverts commit 1add6e9ca4.
2018-10-25 20:26:43 -07:00
Mike Drob 1add6e9ca4
HBASE-21380 Completed SCPs shouldn't add to dead servers in processing
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 19:18:15 -07:00
Guanghao Zhang 7c3033d704 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:21:58 -07:00
Michael Stack 2e9381a839 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:01 -07:00
Allan Yang 6c9e3d0670 HBASE-21364 Procedure holds the lock should put to front of the queue after restart 2018-10-24 10:52:52 +08:00
mazhenlin d35f65f396 HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 16:46:28 -05:00
xcang ae13a5c6ea
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:44:22 -07:00
xcang 3979aebebf
HBASE-21338 Warn if balancer is an ill-fit for cluster size
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:22:41 -07:00
zhangduo 7c04a95f4a
HBASE-21321 Backport HBASE-21278 to branch-2.1 and branch-2.0 ("Do not rollback successful sub procedures when rolling back a procedure")
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-22 21:10:11 -07:00
huzheng 2173770305 HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls 2018-10-23 10:22:30 +08:00
Mike Drob 65d698439f HBASE-21073 Redo concept of maintenance mode
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
2018-10-22 20:12:38 -05:00
tedyu b232746d4c HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module 2018-10-22 17:12:11 -04:00
Josh Elser fedaedd6a1 HBASE-21281 Upgrade bouncycastle to latest
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-22 17:12:11 -04:00
zhangduo afa7d6ed43 HBASE-21336 Addendum remove unused code in HBTU 2018-10-22 20:27:24 +08:00
huzheng fc1ef790ac HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 19:31:02 +08:00
zhangduo 4ded75357b HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-22 18:36:39 +08:00
zhangduo 6e5d1a4896 HBASE-21334 TestMergeTableRegionsProcedure is flakey 2018-10-22 14:19:08 +08:00
huzheng 492172505a HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 10:12:52 +08:00
Michael Stack b3a11b78f7
HBASE-21348 Fix failing TestRegionBypass, broke by HBASE-21291 2018-10-19 21:27:54 -07:00
Michael Stack 4ad63d77be
HBASE-21345 [hbck2] Allow version check to proceed even though master is 'initializing'.
Just remove the check state from the getClusterStatus call.
2018-10-19 17:40:03 -07:00
Toshihiro Suzuki a08c2c269d HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner. 2018-10-20 08:36:41 +09:00
Allan Yang b3c3393c19 HBASE-21288 HostingServer in UnassignProcedure is not accurate
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-18 21:10:53 +08:00
haxiaolin 34a88fca76 HBASE-21055 NullPointerException when balanceOverall() but server balance info is null
Signed-off-by: huzheng <openinx@gmail.com>
2018-10-18 14:08:04 +08:00
Duo Zhang 46227c2275
HBASE-21310 & HBASE-21311 Addendum fix failed UTs, some UTs are not present on branch-2.1 and some are a bit different in the implementation 2018-10-17 10:53:13 -07:00
Michael Stack 47364d4db6
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-17 09:34:58 -07:00
Michael Stack 999a3c67d4
HBASE-21320 [canary] Cleanup of usage and add commentary
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:12:13 -07:00
zhangduo b0846fb762 HBASE-21311 Split TestRestoreSnapshotFromClient 2018-10-17 11:19:10 +08:00
subrat.mishra dd836aae12
HBASE-21263 Mention compression algorithm along with other storefile details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-16 12:47:18 -07:00
zhangduo cfe875d3d2 HBASE-21310 Split TestCloneSnapshotFromClient 2018-10-16 15:34:50 +08:00
Andrew Purtell 467323396a
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list 2018-10-15 22:27:52 -07:00
Guanghao Zhang a81d9be876 HBASE-21290 No need to instantiate BlockCache for master which not carry table 2018-10-15 17:30:29 +08:00
haxiaolin 31dec21538 HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 15:54:34 +08:00
zhangduo 3d0b253248 HBASE-21309 Increase the waiting timeout for TestProcedurePriority 2018-10-15 15:27:11 +08:00
Michael Stack ac31ebf53a
HBASE-21271 [amv2] Don't throw UnsupportedOperationException when rollback called on Assign/Unassign; spiral of death 2018-10-12 22:25:15 -07:00
Michael Stack 72af27b8c9
HBASE-21259 [amv2] Revived deadservers; recreated serverstatenode
Remove a bunch of places where we create ServerStateNode. We were
creating a SSN even though the server was long dead and processed.
The revived SSN was messing up the little dance we do unassigning
procedures. In particular, in UnassignProcedure, the check for a
dead server inside in isLogSplittingDone returns true -- we can
proceed because server is dead -- fails if an SSN exists.

We were creating SSN when we didn't need it as well as inadvertently.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 Print serverstatenode when reporting expiration. Helps debugging.
 Make moveFromOnlineToDeadServers return if server online or not.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Make do w/ serverName in place of serverNode in a few places.
 In waitServerReportEvent, create a ServerStateNode if none though we
 should not have to at this point; to figure out later: TODO.
 addRegionToServer no longer automatically calls create SSN
 so do explicit create processing load meta and the region
 is OPEN so we can associate OPEN regions with the SSN.
 Do not schedule an SCP if server is not online, not in fs, and not in
 dead servers. No point (and there may be cases where server is long
 gone but hbase:meta still refers to it though it has not carried
 regions in a long time; running an assign/unassign against such a
 server will fail because it is not there but SCP won't clean up
 the outstanding hung RPC because our region is not on the long-gone
 server).

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStates.java
 Just cleanup. Make it so addRegionToServer and remove can deal if no SSN.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterWalManager.java
 Add isWALDirectoryNameWithWALS utility.
2018-10-12 17:40:11 -07:00
Michael Stack 4d50f6db5a
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay 2018-10-12 16:22:10 -07:00
Michael Stack 266544370d
Revert "HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay"
This reverts commit 7f3ca4643d.

Bad commit.
2018-10-12 16:15:57 -07:00
Michael Stack 7f3ca4643d
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay 2018-10-12 16:09:54 -07:00
Michael Stack 5762f879d2
Revert "HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo"
This reverts commit a9d3ac23d84dcd728ee08f4262e3d9b31df26b7e.

Let me do a better fix, one that does TestHRegionInfo and
TestHRegionInfoDisplay
2018-10-12 16:09:53 -07:00