Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,274 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

212 Commits

Author SHA1 Message Date
stack 225c6cd5bc HBASE-22777 Add a multi-region merge (for fixing overlaps) 
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.

Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.

Most of code below is undoing the assumption that there are two
parents on a merge only.
 2019-08-07 16:58:06 -07:00
stack 2bc9526080 HBASE-22771 [HBCK2] fixMeta method and server-side support 
This is a first cut at this patch. Implements hold fixing only
currently.

Add a fixMeta method to Hbck Interface.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Bug fix. If hole is on end of last table, I wasn't seeing it.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
 Add a general meta fixer class. Explains up top why this stuff doesn't
 belong inside MetaTableAccessor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Break out the filesystem messing so don't have to copy it nor do more
 than is needed doing fixup for Region holes.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
 Change behavious slightly. If directory exists, don't fail as we did
 but try and keep going and create .regioninfo file if missing (or
 overwrite if in place). This should make it idempotent. Can rerun
 command. Lets see if any repercussions in test suite.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
 Add test.

Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-08-05 22:33:20 -07:00
Guanghao Zhang 6a20872e01 HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425) 
Signed-off-by: stack <stack@apache.org>
 2019-08-01 09:02:26 +08:00
Viraj Jasani 3a72ccefbd
HBASE-22648 Snapshot TTL (#371) 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotDescriptionUtils.java
 2019-07-22 15:08:20 -07:00
Geoffrey Jacoby 439da96a1c
HBASE-22622 WALKey Extended Attributes (#352) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-07-19 15:31:12 -07:00
Guanghao 4c89354f3b HBASE-22673 Avoid to expose protobuf stuff in Hbck interface 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-19 08:10:38 +08:00
Mike Drob 92fc520cb0 HBASE-20894 Use proto for BucketCache persistence 2019-06-25 22:00:58 +08:00
Andrew Purtell d06c3af980
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:08:32 -07:00
Andrew Purtell 2c55bd9344
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:38:42 -07:00
Andrew Purtell cc0b70db1f
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-05-14 12:51:51 -07:00
Sakthi 1e69d56dfb HBASE-22345 REST Server must have specific version of javax.annotations available at runtime 
Rest Server throws NoClassDefFoundError : javax/annotation/Priority after buiding with JDK8 and running on JDK8

Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 68f14c19ff)
 2019-05-03 11:08:02 -05:00
Sean Busbey 4862a596ef HBASE-22083 move eclipse settings into a profile. 
Signed-off-by: stack <stack@apache.org>

 Conflicts:
	hbase-backup/pom.xml
	hbase-hadoop-compat/pom.xml
	hbase-protocol/pom.xml
 2019-04-25 14:38:38 -05:00
Jingyun Tian 8a6b8e81aa HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-04-09 20:11:56 +08:00
meiyi 0e85571b39 HBASE-22117 Move hasPermission/checkPermissions from region server to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-09 17:06:09 +08:00
pingsutw c6e4984928 HBASE-22131 Delete the patches in hbase-protocol-shaded module 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-30 20:25:56 +08:00
zhangduo 359cd73e25 HBASE-22099 Backport HBASE-21895 "Error prone upgrade" to branch-2 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-03-30 14:28:15 +08:00
zhangduo 973c0cf293 HBASE-22098 Backport HBASE-18667 "Disable error-prone for hbase-protocol-shaded" to branch-2 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-03-28 12:00:47 +08:00
meiyi 89dbab7c9f HBASE-21911 Move getUserPermissions from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-27 11:22:57 +08:00
zhangduo bb52a6766a HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition 2019-03-26 18:14:17 +08:00
zhangduo 8fb8886e5c Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back" 
This reverts commit b2a4265992.
 2019-03-24 13:50:39 +08:00
Jingyun Tian b2a4265992 HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:12:34 +08:00
Syeda 5c03df5e50 HBASE-21487 Concurrent modify table ops can lead to unexpected results 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 13:07:35 +08:00
Duo Zhang 1138f72c18 HBASE-21082 Reimplement assign/unassign related procedure metrics 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-01 21:08:44 +08:00
Guanghao Zhang e412e036e1 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-28 09:51:29 +08:00
Wellington Chevreuil a8af0e5894 HBASE-21505 - proposal for a more consistent report on status 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-02-25 10:07:51 +08:00
meiyi 9e45752d6e HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-22 17:43:40 +08:00
meiyi 61621a33ce HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-22 10:45:35 +08:00
zhangduo 94c9aecea2 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-02-08 19:48:07 +08:00
Sean Busbey e8767ea495 HBASE-21808 Ensure we can build with JDK11 targetting JDK8 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit 5784a09fff)
 2019-02-01 16:28:39 -06:00
meiyi ec9029f77e HBASE-21739 Move grant/revoke from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 19:03:43 +08:00
Guanghao Zhang 16665b6e93 HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT 2019-01-29 21:53:21 +08:00
meiyi 1e7f306e17 HBASE-21713 Support set region server throttle quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 15:47:32 +08:00
Jingyun Tian f02ac310d2 HBASE-21588 Procedure v2 wal splitting implementation 2019-01-08 17:26:58 +08:00
meiyi c28e03e5df HBASE-21159 Add shell command to switch throttle on or off 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-08 09:39:22 +08:00
meiyi d590d6e472 HBASE-21034 Add new throttle type: read/write capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-21 09:50:07 +08:00
zhangduo 17055cdc70 HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase 2018-11-15 09:41:43 +08:00
Duo Zhang ea3b2dfaeb HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP 2018-11-13 11:17:52 +08:00
tianjingyun 857abfb082
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-29 20:56:11 -07:00
jingyuntian 4a609db30c
HBASE-21269　Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:22 -07:00
tianjingyun 460cf6ff47 HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-09-20 06:58:53 -07:00
Umesh Agashe 899fddb4e7
HBASE-21023 Added bypassProcedure() API to HbckService 2018-09-19 15:17:52 -07:00
Michael Stack 8876f12c0c
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign 
Adds 'raw' assigns and unassigns methods to Hbck Service.

Fixes HbckService so it works when cluster is Kerberized.
 2018-09-19 09:47:32 -07:00
Allan Yang 737ac48473
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure 2018-08-28 20:19:55 -07:00
Umesh Agashe cdf5cfa396 HBASE-20941 Created and implemented HbckService in master 
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
 2018-08-27 12:10:33 -07:00
zhangduo f533f01a3a HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region 2018-08-26 18:08:06 +08:00
zhangduo 0b283dae0d HBASE-20846 Restore procedure locks when master restarts 2018-07-25 14:37:31 +08:00
Allan Yang aaf5c78445 HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing 2018-07-24 09:57:47 +08:00
Allan Yang 786fd9137a HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing 2018-07-23 14:46:32 +08:00
Mohit Goel 35a3c605f2 HBASE-6028 Start/Stop compactions at region server level 
Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-19 06:20:12 -07:00
zhangduo dde042cc93 HBASE-20776 Update branch-2 version to 2.2.0-SNAPSHOT 2018-06-22 22:15:18 +08:00