15523 Commits

Author SHA1 Message Date
Duo Zhang
24f5f7afa8 HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:45:08 +08:00
zhangduo
9a151ec77b Revert "HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure"
This reverts commit e29ce9f93753d79edfa4e8b864c31c34e33ea635.
2018-10-26 21:30:10 +08:00
Michael Stack
940326d8f5
Revert "HBASE-21376 Add some verbose log to MasterProcedureScheduler"
This reverts commit 71224ee530d281feab39e5721dc87b9ea01a1982.
2018-10-26 06:10:47 -07:00
Allan Yang
71224ee530
HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-10-26 05:54:50 -07:00
Mike Drob
127de9e637
HBASE-21380 Filter finished SCP at start 2018-10-25 20:28:51 -07:00
Michael Stack
7de5f1d60d
Revert "HBASE-21380 Completed SCPs shouldn't add to dead servers in processing"
This reverts commit 1add6e9ca4404590616d9c36db2699f7f68a7c00.
2018-10-25 20:26:43 -07:00
Mike Drob
1add6e9ca4
HBASE-21380 Completed SCPs shouldn't add to dead servers in processing
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 19:18:15 -07:00
Guanghao Zhang
7c3033d704 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:21:58 -07:00
Allan Yang
e71c05707e HBASE-21384 Procedure with holdlock=false should not be restored lock when restarts 2018-10-25 13:58:50 +08:00
Michael Stack
5309c3389d
HBASE-21215 Figure how to invoke hbck2; make it easy to find
Adds option parameter to the bin/hbase hbck command that allows
passing the hbck2 jar.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-10-24 20:44:47 -07:00
Michael Stack
2e9381a839 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:01 -07:00
Duo Zhang
040ec2227e HBASE-21363 Rewrite the buildingHoldCleanupTracker method in WALProcedureStore 2018-10-24 14:37:26 +08:00
Allan Yang
6c9e3d0670 HBASE-21364 Procedure holds the lock should put to front of the queue after restart 2018-10-24 10:52:52 +08:00
mazhenlin
d35f65f396 HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 16:46:28 -05:00
xcang
ae13a5c6ea
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:44:22 -07:00
xcang
3979aebebf
HBASE-21338 Warn if balancer is an ill-fit for cluster size
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:22:41 -07:00
Allan Yang
e29ce9f937 HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure 2018-10-23 16:13:24 +08:00
zhangduo
7c04a95f4a
HBASE-21321 Backport HBASE-21278 to branch-2.1 and branch-2.0 ("Do not rollback successful sub procedures when rolling back a procedure")
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-22 21:10:11 -07:00
Allan Yang
c141547f3b HBASE-21354 Procedure may be deleted improperly during master restarts resulting in 'Corrupt' 2018-10-23 10:27:48 +08:00
huzheng
2173770305 HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls 2018-10-23 10:22:30 +08:00
Mike Drob
65d698439f HBASE-21073 Redo concept of maintenance mode
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
2018-10-22 20:12:38 -05:00
tedyu
ef41b0fd2e HBASE-21281 Upgrade bouncycastle to latest - addendum adds test dependency 2018-10-22 17:12:11 -04:00
tedyu
b232746d4c HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module 2018-10-22 17:12:11 -04:00
Josh Elser
fedaedd6a1 HBASE-21281 Upgrade bouncycastle to latest
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-22 17:12:11 -04:00
zhangduo
afa7d6ed43 HBASE-21336 Addendum remove unused code in HBTU 2018-10-22 20:27:24 +08:00
huzheng
fc1ef790ac HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 19:31:02 +08:00
zhangduo
4ded75357b HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-22 18:36:39 +08:00
zhangduo
6e5d1a4896 HBASE-21334 TestMergeTableRegionsProcedure is flakey 2018-10-22 14:19:08 +08:00
huzheng
492172505a HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 10:12:52 +08:00
subrat.mishra
7fe8a4eadd HBASE-21178 [BC break] : Get and Scan operation with a custom converter_class not working
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-21 17:47:59 +08:00
Michael Stack
b3a11b78f7
HBASE-21348 Fix failing TestRegionBypass, broke by HBASE-21291 2018-10-19 21:27:54 -07:00
Michael Stack
4ad63d77be
HBASE-21345 [hbck2] Allow version check to proceed even though master is 'initializing'.
Just remove the check state from the getClusterStatus call.
2018-10-19 17:40:03 -07:00
Toshihiro Suzuki
a08c2c269d HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner. 2018-10-20 08:36:41 +09:00
zhangduo
7e4cb7d7ec
HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished
Reapplication after fixing failing test.
2018-10-19 15:25:15 -07:00
Duo Zhang
63f718974b
HBASE-21075 Confirm that we can (rolling) upgrade from 2.0.x and 2.1.x to 2.2.x after HBASE-20881
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-19 12:34:36 -07:00
Michael Stack
0cd23c3dda
Revert "HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished"
This reverts commit fffd9b9b6dd42c52f4a30e956313cdb4129c66be.

Revert till we figure why behavior between 2.1 and 2.2 is different.
2018-10-18 20:04:24 -07:00
Michael Stack
8fd3fd0e9c
Revert "HBASE-21323 Should not skip force updating for a sub procedure even if"
This reverts commit 30727764a3f9c30c41eaae4340ee7ea9723c1306.

Revert till we figure why behavior between 2.1 and 2.2 is different.
2018-10-18 20:03:57 -07:00
Allan Yang
1afedc608e
HBASE-21292 IdLock.getLockEntry() may hang if interrupted 2018-10-18 14:41:16 -07:00
tianjingyun
915e87ecf7
HBASE-21291 Add a test for bypassing stuck state-machine procedures
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-18 14:26:47 -07:00
Michael Stack
30727764a3
HBASE-21323 Should not skip force updating for a sub procedure even if
it has been finished; ADDENDUM

Fix broke unit test.
2018-10-18 13:48:02 -07:00
Allan Yang
b3c3393c19 HBASE-21288 HostingServer in UnassignProcedure is not accurate
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-18 21:10:53 +08:00
zhangduo
fffd9b9b6d HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished 2018-10-18 14:44:31 +08:00
haxiaolin
34a88fca76 HBASE-21055 NullPointerException when balanceOverall() but server balance info is null
Signed-off-by: huzheng <openinx@gmail.com>
2018-10-18 14:08:04 +08:00
Sahil Aggarwal
b972b9a2d9
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup. 2018-10-17 21:03:39 -07:00
Artem Ervits
c744dd84cc HBASE-21198 Exclude dependency on net.minidev:json-smart
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-17 11:34:12 -07:00
Duo Zhang
46227c2275
HBASE-21310 & HBASE-21311 Addendum fix failed UTs, some UTs are not present on branch-2.1 and some are a bit different in the implementation 2018-10-17 10:53:13 -07:00
Michael Stack
47364d4db6
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-17 09:34:58 -07:00
Michael Stack
999a3c67d4
HBASE-21320 [canary] Cleanup of usage and add commentary
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:12:13 -07:00
zhangduo
b0846fb762 HBASE-21311 Split TestRestoreSnapshotFromClient 2018-10-17 11:19:10 +08:00
subrat.mishra
dd836aae12
HBASE-21263 Mention compression algorithm along with other storefile details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-16 12:47:18 -07:00