c141547f3b
HBASE-21354 Procedure may be deleted improperly during master restarts resulting in 'Corrupt'
2018-10-23 10:27:48 +08:00
2173770305
HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls
2018-10-23 10:22:30 +08:00
65d698439f
HBASE-21073 Redo concept of maintenance mode
...
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
2018-10-22 20:12:38 -05:00
ef41b0fd2e
HBASE-21281 Upgrade bouncycastle to latest - addendum adds test dependency
2018-10-22 17:12:11 -04:00
b232746d4c
HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module
2018-10-22 17:12:11 -04:00
fedaedd6a1
HBASE-21281 Upgrade bouncycastle to latest
...
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-22 17:12:11 -04:00
afa7d6ed43
HBASE-21336 Addendum remove unused code in HBTU
2018-10-22 20:27:24 +08:00
fc1ef790ac
HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles
2018-10-22 19:31:02 +08:00
4ded75357b
HBASE-21336 Simplify the implementation of WALProcedureMap
2018-10-22 18:36:39 +08:00
6e5d1a4896
HBASE-21334 TestMergeTableRegionsProcedure is flakey
2018-10-22 14:19:08 +08:00
492172505a
HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split
2018-10-22 10:12:52 +08:00
7fe8a4eadd
HBASE-21178 [BC break] : Get and Scan operation with a custom converter_class not working
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-21 17:47:59 +08:00
b3a11b78f7
HBASE-21348 Fix failing TestRegionBypass, broke by HBASE-21291
2018-10-19 21:27:54 -07:00
4ad63d77be
HBASE-21345 [hbck2] Allow version check to proceed even though master is 'initializing'.
...
Just remove the check state from the getClusterStatus call.
2018-10-19 17:40:03 -07:00
a08c2c269d
HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner.
2018-10-20 08:36:41 +09:00
7e4cb7d7ec
HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished
...
Reapplication after fixing failing test.
2018-10-19 15:25:15 -07:00
63f718974b
HBASE-21075 Confirm that we can (rolling) upgrade from 2.0.x and 2.1.x to 2.2.x after HBASE-20881
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-19 12:34:36 -07:00
0cd23c3dda
Revert "HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished"
...
This reverts commit fffd9b9b6d
2018-10-18 20:04:24 -07:00
8fd3fd0e9c
Revert "HBASE-21323 Should not skip force updating for a sub procedure even if"
...
This reverts commit 30727764a3
2018-10-18 20:03:57 -07:00
1afedc608e
HBASE-21292 IdLock.getLockEntry() may hang if interrupted
2018-10-18 14:41:16 -07:00
915e87ecf7
HBASE-21291 Add a test for bypassing stuck state-machine procedures
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-18 14:26:47 -07:00
30727764a3
HBASE-21323 Should not skip force updating for a sub procedure even if
...
it has been finished; ADDENDUM
Fix broke unit test.
2018-10-18 13:48:02 -07:00
b3c3393c19
HBASE-21288 HostingServer in UnassignProcedure is not accurate
...
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-18 21:10:53 +08:00
fffd9b9b6d
HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished
2018-10-18 14:44:31 +08:00
34a88fca76
HBASE-21055 NullPointerException when balanceOverall() but server balance info is null
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-10-18 14:08:04 +08:00
b972b9a2d9
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup.
2018-10-17 21:03:39 -07:00
c744dd84cc
HBASE-21198 Exclude dependency on net.minidev:json-smart
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-17 11:34:12 -07:00
46227c2275
HBASE-21310 & HBASE-21311 Addendum fix failed UTs, some UTs are not present on branch-2.1 and some are a bit different in the implementation
2018-10-17 10:53:13 -07:00
47364d4db6
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-17 09:34:58 -07:00
999a3c67d4
HBASE-21320 [canary] Cleanup of usage and add commentary
...
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:12:13 -07:00
b0846fb762
HBASE-21311 Split TestRestoreSnapshotFromClient
2018-10-17 11:19:10 +08:00
dd836aae12
HBASE-21263 Mention compression algorithm along with other storefile details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-16 12:47:18 -07:00
85c3ec3fb4
HBASE-21315 The getActiveMinProcId and getActiveMaxProcId of BitSetNode are incorrect if there are no active procedure
2018-10-16 15:42:10 +08:00
cfe875d3d2
HBASE-21310 Split TestCloneSnapshotFromClient
2018-10-16 15:34:50 +08:00
467323396a
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
2018-10-15 22:27:52 -07:00
a81d9be876
HBASE-21290 No need to instantiate BlockCache for master which not carry table
2018-10-15 17:30:29 +08:00
31dec21538
HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 15:54:34 +08:00
3d0b253248
HBASE-21309 Increase the waiting timeout for TestProcedurePriority
2018-10-15 15:27:11 +08:00
ac31ebf53a
HBASE-21271 [amv2] Don't throw UnsupportedOperationException when rollback called on Assign/Unassign; spiral of death
2018-10-12 22:25:15 -07:00
72af27b8c9
HBASE-21259 [amv2] Revived deadservers; recreated serverstatenode
...
Remove a bunch of places where we create ServerStateNode. We were
creating a SSN even though the server was long dead and processed.
The revived SSN was messing up the little dance we do unassigning
procedures. In particular, in UnassignProcedure, the check for a
dead server inside in isLogSplittingDone returns true -- we can
proceed because server is dead -- fails if an SSN exists.
We were creating SSN when we didn't need it as well as inadvertently.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
Print serverstatenode when reporting expiration. Helps debugging.
Make moveFromOnlineToDeadServers return if server online or not.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Make do w/ serverName in place of serverNode in a few places.
In waitServerReportEvent, create a ServerStateNode if none though we
should not have to at this point; to figure out later: TODO.
addRegionToServer no longer automatically calls create SSN
so do explicit create processing load meta and the region
is OPEN so we can associate OPEN regions with the SSN.
Do not schedule an SCP if server is not online, not in fs, and not in
dead servers. No point (and there may be cases where server is long
gone but hbase:meta still refers to it though it has not carried
regions in a long time; running an assign/unassign against such a
server will fail because it is not there but SCP won't clean up
the outstanding hung RPC because our region is not on the long-gone
server).
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStates.java
Just cleanup. Make it so addRegionToServer and remove can deal if no SSN.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterWalManager.java
Add isWALDirectoryNameWithWALS utility.
2018-10-12 17:40:11 -07:00
4d50f6db5a
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay
2018-10-12 16:22:10 -07:00
266544370d
Revert "HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay"
...
This reverts commit 7f3ca4643d
2018-10-12 16:15:57 -07:00
7f3ca4643d
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay
2018-10-12 16:09:54 -07:00
5762f879d2
Revert "HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo"
...
This reverts commit a9d3ac23d84dcd728ee08f4262e3d9b31df26b7e.
Let me do a better fix, one that does TestHRegionInfo and
TestHRegionInfoDisplay
2018-10-12 16:09:53 -07:00
19cb105a7e
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo
2018-10-12 12:42:05 -07:00
fecaf4737c
HBASE-21303 [shell] clear_deadservers with no args fails
2018-10-12 11:19:24 -07:00
714127b4a5
HBASE-21299 List counts of actual region states in master UI tables section
2018-10-12 10:59:44 -07:00
9b38da685c
HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL
2018-10-12 21:22:31 +08:00
c3401d4327
HBASE-21254 Need to find a way to limit the number of proc wal files
2018-10-12 11:47:48 +08:00
c9c7436482
HBASE-21103 nightly job should make sure cached yetus will run.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 42d7ddc678
2018-10-11 10:30:33 -05:00
Allan Yang
huzheng
Mike Drob
tedyu
Josh Elser
zhangduo
subrat.mishra
Michael Stack
Toshihiro Suzuki
tianjingyun
haxiaolin
Sahil Aggarwal
Artem Ervits
Andrew Purtell
Guanghao Zhang
Sean Busbey