1b168cd6de
HBASE-22777 Add a multi-region merge (for fixing overlaps)
...
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.
Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.
Most of code below is undoing the assumption that there are two
parents on a merge only.
2019-08-07 15:22:07 -07:00
30805be078
HBASE-22771 [HBCK2] fixMeta method and server-side support
...
This is a first cut at this patch. Implements hold fixing only
currently.
Add a fixMeta method to Hbck Interface.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
Bug fix. If hole is on end of last table, I wasn't seeing it.
A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
Add a general meta fixer class. Explains up top why this stuff doesn't
belong inside MetaTableAccessor.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
Break out the filesystem messing so don't have to copy it nor do more
than is needed doing fixup for Region holes.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
Change behavious slightly. If directory exists, don't fail as we did
but try and keep going and create .regioninfo file if missing (or
overwrite if in place). This should make it idempotent. Can rerun
command. Lets see if any repercussions in test suite.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
Add test.
Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-05 22:08:31 -07:00
35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run ( #425 )
...
Signed-off-by: stack <stack@apache.org>
2019-08-01 08:54:47 +08:00
9615c644f5
HBASE-22648 Snapshot TTL ( #371 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-22 15:03:44 -07:00
1ad48c1ebc
HBASE-22622 WALKey Extended Attributes ( #352 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-19 15:30:38 -07:00
48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-19 08:03:06 +08:00
98a1552687
HBASE-22459 Expose store reader reference count ( #248 )
2019-05-30 15:04:16 -07:00
a30b186568
HBASE-22449 https everywhere in Maven metadata ( #247 )
2019-05-21 12:34:25 -07:00
a9de9f5f28
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions ( #225 )
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-14 11:56:16 -07:00
68f14c19ff
HBASE-22345 REST Server must have specific version of javax.annotations available at runtime
...
Rest Server throws NoClassDefFoundError : javax/annotation/Priority after buiding with JDK8 and running on JDK8
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-05-03 11:07:24 -05:00
bf140acd20
HBASE-22083 move eclipse settings into a profile.
...
Signed-off-by: stack <stack@apache.org>
2019-04-25 14:17:18 -05:00
bd2f04dd54
HBASE-21965 Fix failed split and merge transactions that have failed to roll back
2019-04-09 19:56:18 +08:00
d32f924ef4
HBASE-22117 Move hasPermission/checkPermissions from region server to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-09 17:01:01 +08:00
db305d595a
HBASE-22131 Delete the patches in hbase-protocol-shaded module
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-30 20:25:44 +08:00
7b3ff56202
HBASE-21911 Move getUserPermissions from regionserver to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-27 11:22:21 +08:00
5f6143ebde
HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition
2019-03-26 18:13:59 +08:00
386703811d
Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back"
...
This reverts commit 7e3ca7063c
2019-03-24 13:51:34 +08:00
c144c814b0
HBASE-21895 - Error prone upgrade
...
* Upgrades to error prone 2.3.3
* Moves to error prone plugin to support 9+ JDKs
* Removes custom error prone plugin due to no usage
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-24 13:13:07 +08:00
7e3ca7063c
HBASE-21965 Fix failed split and merge transactions that have failed to roll back
2019-03-22 17:11:50 +08:00
030b4d12fb
HBASE-21487 Concurrent modify table ops can lead to unexpected results
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 13:00:19 +08:00
929a8aa5e8
HBASE-21082 Reimplement assign/unassign related procedure metrics
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 21:08:13 +08:00
6e06a0d790
HBASE-20724 Sometimes some compacted storefiles are still opened after region failover
2019-02-27 15:45:42 +08:00
482b505796
HBASE-21505 - proposal for a more consistent report on status
...
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-22 12:08:38 +08:00
dfb95cfd83
HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 10:41:51 +08:00
9a55cbb2c1
HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-21 15:36:37 +08:00
eedc33dfd2
Revert "HBASE-21505 - proposal for a more consistent report on status"
...
This reverts commit c578020588
2019-02-20 18:06:42 +08:00
c578020588
HBASE-21505 - proposal for a more consistent report on status
...
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-19 10:51:05 +08:00
6f16836c20
HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-08 19:47:37 +08:00
5784a09fff
HBASE-21808 Ensure we can build with JDK11 targetting JDK8
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-02-01 16:26:57 -06:00
f997252344
HBASE-21739 Move grant/revoke from regionserver to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 11:16:57 +08:00
281558a3ab
HBASE-21713 Support set region server throttle quota
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 13:50:42 +08:00
281d6429e5
HBASE-21588 Procedure v2 wal splitting implementation
2019-01-07 15:58:15 +08:00
77db1fae09
HBASE-21159 Add shell command to switch throttle on or off
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-07 14:21:41 +08:00
766aa1bfcc
HBASE-21486 The current replication implementation for peer in STANDBY state breaks serial replication
2018-12-01 12:15:18 +08:00
1acbd36c90
HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta
2018-11-26 14:51:56 +08:00
5ded294419
HBASE-21034 Add new throttle type: read/write capacity unit
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:46:49 +08:00
9e42a9e310
HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase
2018-11-15 09:41:38 +08:00
55fa8f4b33
HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP
2018-11-13 11:31:03 +08:00
c8574ba3c5
HBASE-21420 Use procedure event to wake up the SyncReplicationReplayWALProcedures which wait for worker
2018-11-05 21:43:18 +08:00
116eee6747
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:55:37 -07:00
5fbb227deb
HBASE-21269 Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
2018-10-18 06:22:52 -07:00
cd161d976e
HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-20 06:57:50 -07:00
dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService
2018-09-19 15:18:16 -07:00
3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
...
Adds 'raw' assigns and unassigns methods to Hbck Service.
Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 10:06:16 -07:00
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-30 12:23:24 -07:00
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
bb3494134e
HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region
2018-08-21 06:12:09 +08:00
4bcaf495c2
HBASE-20894 Use proto for BucketCache persistence
2018-08-01 16:54:25 -05:00
f3f17fa111
HBASE-20846 Restore procedure locks when master restarts
2018-07-25 14:37:26 +08:00
b631727bdf
HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing
2018-07-24 10:00:28 +08:00
stack
Guanghao Zhang
Viraj Jasani
Geoffrey Jacoby
Andrew Purtell
Sakthi
Sean Busbey
Jingyun Tian
meiyi
pingsutw
zhangduo
Kevin Risden
Syeda
Wellington Chevreuil
Jingyun Tian
tianjingyun
Umesh Agashe
Allan Yang
Mike Drob