Commit Graph

448 Commits

Author SHA1 Message Date
Viraj Jasani 63568854b6 HBASE-22760 : Pause/Resume/Query Snapshot Auto Cleanup Activity (#618) 2019-09-13 10:37:22 +05:30
meiyi 9d178cf575 HBASE-22879 user_permission command failed to show global permission (#511) 2019-08-21 09:53:21 +08:00
Viraj Jasani 918f7ca24a
HBASE-22735 list_regions show basic info for region currently in transition with error handling
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-31 18:52:24 -07:00
Guanghao Zhang 6a20872e01 HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425)
Signed-off-by: stack <stack@apache.org>
2019-08-01 09:02:26 +08:00
stack 4565e9f43b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:07:10 -07:00
Jan Hentschel b7cb9b350b HBASE-22692 Rubocop definition is not used in the /bin directory
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-24 11:17:28 +02:00
Viraj Jasani 3a72ccefbd
HBASE-22648 Snapshot TTL (#371)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotDescriptionUtils.java
2019-07-22 15:08:20 -07:00
Duo Zhang 76c080b339 HBASE-22661 list_regions command in hbase shell is broken
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-16 09:58:53 +08:00
Andrew Purtell 2c55bd9344
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:38:42 -07:00
Andrew Purtell cc0b70db1f
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225)
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-14 12:51:51 -07:00
Murtaza Hassan 9e47b39646
HBASE-22358 Change rubocop configuration for method length 2019-05-09 11:23:00 +02:00
Murtaza Hassan 6c511689b4
HBASE-20851 Change rubocop config for max line length of 100 2019-05-07 20:17:16 +02:00
Sean Busbey 4862a596ef HBASE-22083 move eclipse settings into a profile.
Signed-off-by: stack <stack@apache.org>

 Conflicts:
	hbase-backup/pom.xml
	hbase-hadoop-compat/pom.xml
	hbase-protocol/pom.xml
2019-04-25 14:38:38 -05:00
meiyi 61bc0b4741 HBASE-22084 Rename AccessControlLists to PermissionStorage
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-12 14:22:57 +08:00
xuqinya b26dcc9fa6 HBASE-21781 list_deadservers elapsed time is incorrect 2019-03-28 13:26:25 +01:00
Toshihiro Suzuki f470db3052 HBASE-22097 Modify the description of split command in shell
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-28 00:20:08 +09:00
yaojingyi 1926b86a8c HBASE-21964 unset Quota by Throttle Type
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-26 09:46:01 +08:00
meiyi ea0675eb96 HBASE-21820 Implement CLUSTER quota scope
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 18:24:03 +08:00
zhangduo e1716107f5 HBASE-21947 TestShell is broken after we remove the jackson dependencies 2019-02-26 20:07:46 +08:00
Wellington Chevreuil a8af0e5894 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-25 10:07:51 +08:00
meiyi 9e45752d6e HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 17:43:40 +08:00
Nihal Jain f671703c7f HBASE-17942 Disable region splits and merges per table
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-19 07:20:34 +08:00
zhangduo c3f0466336 HBASE-21857 Addendum fix broken UTs 2019-02-11 10:26:34 +08:00
Nihal Jain e0bf2b1dca HBASE-21636 Enhance the shell scan command to support missing scanner specifications like ReadType, IsolationLevel etc. 2019-02-09 21:03:22 -08:00
wanghuan 69c331efed HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:57:21 +08:00
Guanghao Zhang 16665b6e93 HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT 2019-01-29 21:53:21 +08:00
Sakthi ea1a3f481b HBASE-21689: Make table/namespace specific current quota info available in shell(describe_namespace & describe)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 15:47:49 +08:00
meiyi 1e7f306e17 HBASE-21713 Support set region server throttle quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 15:47:32 +08:00
Nihal Jain 46a53cac50 HBASE-17370 Fix or provide shell scripts to drain and decommission region server
Add shell support for the following:
- List decommissioned/draining region servers
- Decommission a list of region servers, optionally offload corresponding regions
- Recommission a region server, optionally load a list of passed regions

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-23 21:20:06 +08:00
Nihal Jain cf0cac1041 HBASE-21756 Backport HBASE-21279 (Split TestAdminShell into several tests) to branch-2
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-23 21:17:48 +08:00
Duo Zhang ebf4fe3bb9 HBASE-21710 Add quota related methods to the Admin interface
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 21:10:27 +08:00
Sakthi 1e91ae8f9e HBASE-21634: Print error message when user uses unacceptable values for LIMIT while setting quotas.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-15 09:55:59 +08:00
Guangxu Cheng fb91f64a04 HBASE-20220 [RSGroup] Check if table exists in the cluster before moving it to the specified regionserver group
Signed-off-by: tedyu <yuzhihong@gmail.com>
2019-01-14 11:29:09 +08:00
meiyi 14fb3af5fb HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 22:22:47 +08:00
meiyi c28e03e5df HBASE-21159 Add shell command to switch throttle on or off
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-08 09:39:22 +08:00
Sakthi 2bd1b28d5e HBASE-21361: Disable printing of stack-trace in shell when quotas are not enabled
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-07 18:07:46 -05:00
Sakthi eab243942f HBASE-21362: Disable printing of stack-trace in shell when quotas are violated
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-07 18:07:46 -05:00
Nihal Jain 97219f1ace HBASE-21630 [shell] Define ENDKEY == STOPROW (we have ENDROW) 2019-01-03 21:59:18 -08:00
meiyi 90b9ed1523 HBASE-21662 Add append_peer_exclude_namespaces and remove_peer_exclude_namespaces shell commands
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-03 10:35:30 +08:00
Sakthi 16b96826d9 HBASE-21631 (addendum) Fixed TestQuotasShell failure (quotas_test.rb)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-24 14:29:56 +08:00
Guanghao Zhang 868821f499 HBASE-21549 Add shell command for serial replication peer 2018-12-07 16:57:24 +08:00
meiyi d590d6e472 HBASE-21034 Add new throttle type: read/write capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:50:07 +08:00
Reid Chan 4713c4e162 HBASE-21489 TestShell is broken
Signed-off-by Duo Zhang <zhangduo@apache.org>
2018-11-18 12:19:19 +08:00
jingyuntian 4a609db30c
HBASE-21269 Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:22 -07:00
subrat.mishra b146e9fea6 HBASE-21178 [BC break] : Get and Scan operation with a custom converter_class not working
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-12 08:29:57 -07:00
Andrew Purtell 4b93f95af7
HBASE-21283 Add new shell command 'rit' for listing regions in transition 2018-10-10 10:03:15 -07:00
Michael Stack 2836f75625
HBASE-21223 [amv2] Remove abort_procedure from shell
Signed-off-by: Balazs Meszaros <balazs.meszaros@cloudera.com>
2018-09-25 11:28:54 -07:00
Sakthi 1cc62e9286 HBASE-20482 Printed a link to the ref guide chapter for the shell during startup
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-31 12:13:00 -05:00
zhangduo 7343da4178 HBASE-20968 list_procedures_test fails due to no matching regex 2018-08-28 14:23:29 +08:00
Mingliang Liu a0cbfb8ea6 HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:22:04 -07:00