Commit Graph

15751 Commits

Author SHA1 Message Date
huzheng 189122f3fe HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:21:53 +08:00
jingyuntian c6090d4f04 HBASE-21437 Bypassed procedure throw IllegalArgumentException when its state is WAITING_TIMEOUT
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-09 22:52:14 +08:00
Ben Lau 0875fa0634
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2018-11-08 14:09:55 -08:00
Esteban Gutierrez 3a13088a2e
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:22:21 -08:00
huzheng 0ec9f81bc8 HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:28:48 +08:00
tedyu 0250b4b536 HBASE-21247 Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers 2018-11-06 12:36:29 -08:00
Sean Busbey 6f9084380b HBASE-21442 Update branch-2.1 for next development cycle
* update pom versions to 2.1.2-SNAPSHOT
* update CHANGES.md to mark release date (as of arriving in dist/release svn repo)
2018-11-06 14:19:47 -06:00
Allan Yang 5b8c767374 HBASE-21421 Do not kill RS if reportOnlineRegions fails 2018-11-06 14:51:54 +08:00
zhangduo d19e6dff2c HBASE-21314 The implementation of BitSetNode is not efficient 2018-11-06 09:20:06 +08:00
tedyu ed218554a9 HBASE-21438 TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-06 09:16:50 +08:00
Allan Yang 0b7c66642b HBASE-21423 Procedures for meta table/region should be able to execute in separate workers 2018-11-05 20:37:15 +08:00
Allan Yang 9e52e9eb7d HBASE-21395 Abort split/merge procedure if there is a table procedure of the same table going on 2018-11-05 20:12:00 +08:00
Michael Stack 8df5878932 HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned 2018-11-03 09:45:36 -07:00
zhangduo 46eb8f1d0d HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:25:43 +08:00
jingyuntian 3836967e05
HBASE-21407 Resolve NPE in backup Master UI
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:46:15 -07:00
Michael Stack 62d73d2068
HBASE-21424 Change flakies and nightlies so scheduled less often
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
2018-11-01 10:01:52 -07:00
Guanghao Zhang 29e3eec703 HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:27:23 +08:00
Duo Zhang 75d7b747d5 HBASE-21417 Pre commit build is broken due to surefire plugin crashes 2018-11-01 15:13:40 +08:00
Michael Stack 29d6eeb6e8
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
ADDENDUM
2018-10-31 10:15:04 -07:00
Duo Zhang bddd488c34 HBASE-21237 Use CompatRemoteProcedureResolver to dispatch open/close region requests to RS 2018-10-30 17:36:44 +08:00
tianjingyun 422e98957b
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:56:44 -07:00
Wei-Chiu Chuang 644ac13850
HBASE-21371. Hbase unable to compile against Hadoop trunk (3.3.0-SNAPSHOT) due to license error
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 14:27:38 -07:00
zhangduo 2466032fdd HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 20:18:10 +08:00
Michael Stack b60a92d686
HBASE-21399 Generate and commit 2.1.1 RELEASENOTES.md and CHANGES.md;
ADDENDUM
2018-10-26 16:14:21 -07:00
Michael Stack 92c1439a58
HBASE-21399 Generate and commit 2.1.1 RELEASENOTES.md and CHANGES.md 2018-10-26 13:33:32 -07:00
Michael Stack e867b1a338
HBASE-21054 Copy down docs, amend to suite branch-2.0, and then commit 2018-10-26 13:17:17 -07:00
Michael Stack 066082dff4
HBASE-21397 Set version to 2.1.1 on branch-2.1 in prep for first RC 2018-10-26 12:56:24 -07:00
zhangduo e0dfa4caf3
HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-26 12:35:11 -07:00
Duo Zhang 24f5f7afa8 HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:45:08 +08:00
zhangduo 9a151ec77b Revert "HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure"
This reverts commit e29ce9f937.
2018-10-26 21:30:10 +08:00
Michael Stack 940326d8f5
Revert "HBASE-21376 Add some verbose log to MasterProcedureScheduler"
This reverts commit 71224ee530.
2018-10-26 06:10:47 -07:00
Allan Yang 71224ee530
HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-10-26 05:54:50 -07:00
Mike Drob 127de9e637
HBASE-21380 Filter finished SCP at start 2018-10-25 20:28:51 -07:00
Michael Stack 7de5f1d60d
Revert "HBASE-21380 Completed SCPs shouldn't add to dead servers in processing"
This reverts commit 1add6e9ca4.
2018-10-25 20:26:43 -07:00
Mike Drob 1add6e9ca4
HBASE-21380 Completed SCPs shouldn't add to dead servers in processing
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 19:18:15 -07:00
Guanghao Zhang 7c3033d704 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:21:58 -07:00
Allan Yang e71c05707e HBASE-21384 Procedure with holdlock=false should not be restored lock when restarts 2018-10-25 13:58:50 +08:00
Michael Stack 5309c3389d
HBASE-21215 Figure how to invoke hbck2; make it easy to find
Adds option parameter to the bin/hbase hbck command that allows
passing the hbck2 jar.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-10-24 20:44:47 -07:00
Michael Stack 2e9381a839 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:01 -07:00
Duo Zhang 040ec2227e HBASE-21363 Rewrite the buildingHoldCleanupTracker method in WALProcedureStore 2018-10-24 14:37:26 +08:00
Allan Yang 6c9e3d0670 HBASE-21364 Procedure holds the lock should put to front of the queue after restart 2018-10-24 10:52:52 +08:00
mazhenlin d35f65f396 HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 16:46:28 -05:00
xcang ae13a5c6ea
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:44:22 -07:00
xcang 3979aebebf
HBASE-21338 Warn if balancer is an ill-fit for cluster size
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:22:41 -07:00
Allan Yang e29ce9f937 HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure 2018-10-23 16:13:24 +08:00
zhangduo 7c04a95f4a
HBASE-21321 Backport HBASE-21278 to branch-2.1 and branch-2.0 ("Do not rollback successful sub procedures when rolling back a procedure")
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-22 21:10:11 -07:00
Allan Yang c141547f3b HBASE-21354 Procedure may be deleted improperly during master restarts resulting in 'Corrupt' 2018-10-23 10:27:48 +08:00
huzheng 2173770305 HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls 2018-10-23 10:22:30 +08:00
Mike Drob 65d698439f HBASE-21073 Redo concept of maintenance mode
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
2018-10-22 20:12:38 -05:00
tedyu ef41b0fd2e HBASE-21281 Upgrade bouncycastle to latest - addendum adds test dependency 2018-10-22 17:12:11 -04:00