Commit Graph

408 Commits

Author SHA1 Message Date
subrat.mishra 7fe8a4eadd HBASE-21178 [BC break] : Get and Scan operation with a custom converter_class not working
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-21 17:47:59 +08:00
Michael Stack 8fc90a23ae
HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
Adds override to assigns and unassigns. Changes bypass 'force'
to align calling the param 'override' instead.

Adds recursive to 'bypass', a means of calling bypass on
parent and its subprocedures (usually bypass works on
leaf nodes rippling the bypass up to parent -- recursive
has us work in the opposite direction): EXPERIMENTAL.

bypass on an assign/unassign leaves region in RIT and the
RegionStateNode loaded with the bypassed procedure. First
implementation had assign/unassign cleanup leftover state.
Second implementation, on feedback, keeps the state in place
as a fence against other Procedures assuming the region entity,
and instead adds an 'override' function that hbck2 can set on
assigns/unassigns to override the fencing.

Note that the below also converts ProcedureExceptions that
come out of the Pv2 system into DoNotRetryIOEs. It is a
little awkward because DNRIOE is in client-module, not
in procedure module. Previous, we'd just keep retrying
the bypass, etc.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
 Have bypass take an environment like all other methods so subclasses.
 Fix javadoc issues.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 Javadoc issues. Pass environment when we invoke bypass.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Rename waitUntilNamespace... etc. to align with how these method types
 are named elsehwere .. i.e. waitFor rather than waitUntil..

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 Cleanup message we emit when we find an exisitng procedure working
 against this entity.
 Add support for a force function which allows Assigns/Unassigns force
 ownership of the Region entity.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestRegionBypass.java
 Test bypass and force.

M hbase-shell/src/main/ruby/shell/commands/list_procedures.rb
 Minor cleanup of the json output... do iso8601 timestamps.
2018-10-04 16:37:37 -07:00
Michael Stack 259d12f739 Revert "Revert "Revert "HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign"""
This reverts commit 2174461cf7.

Revert because not ready to port to other branches.
2018-09-29 04:06:46 -07:00
Michael Stack 2174461cf7 Revert "Revert "HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign""
This reverts commit b96905d1df.

i.e. a revert of a revert so a reapplication!

Revert so I can add signed-off-by....

Signed-off-by: Allan Yang <allan163@apache.org>
2018-09-29 03:34:36 -07:00
Michael Stack b96905d1df Revert "HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign"
This reverts commit b42d7978cb.
2018-09-29 03:34:10 -07:00
Michael Stack b42d7978cb HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
bypass on an assign/unassign leaves region in RIT and the
RegionStateNode loaded with the bypassed procedure. First
implementation had assign/unassign cleanup leftover state.
Second implementation, on feedback, keeps the state in place
as a fence against other Procedures assuming the region entity,
and instead adds an 'override' function that hbck2 can set on
assigns/unassigns to override the fencing.

Note that the below also converts ProcedureExceptions that
come out of the Pv2 system into DoNotRetryIOEs. It is a
little awkward because DNRIOE is in client-module, not
in procedure module. Previous, we'd just keep retrying
the bypass, etc.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
 Have bypass take an environment like all other methods so subclasses.
 Fix javadoc issues.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 Javadoc issues. Pass environment when we invoke bypass.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Rename waitUntilNamespace... etc. to align with how these method types
 are named elsehwere .. i.e. waitFor rather than waitUntil..

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 Cleanup message we emit when we find an exisitng procedure working
 against this entity.
 Add support for a force function which allows Assigns/Unassigns force
 ownership of the Region entity.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestRegionBypass.java
 Test bypass and force.

M hbase-shell/src/main/ruby/shell/commands/list_procedures.rb
 Minor cleanup of the json output... do iso8601 timestamps.
2018-09-29 03:33:07 -07:00
Michael Stack 0d008b4792
HBASE-21223 [amv2] Remove abort_procedure from shell
Signed-off-by: Balazs Meszaros <balazs.meszaros@cloudera.com>
2018-09-25 10:07:32 -07:00
Sakthi 6e0c6271f6 HBASE-20482 Printed a link to the ref guide chapter for the shell during startup
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-31 12:13:19 -05:00
zhangduo b837b89e6b HBASE-20968 list_procedures_test fails due to no matching regex 2018-08-28 14:23:37 +08:00
Michael Stack 0d51d54726 HBASE-21044 Disable flakey TestShell list_procedures 2018-08-13 21:48:17 -07:00
jingyuntian 95e3dec510 HBASE-20985 add two attributes when we do normalization
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:55:19 +08:00
zhangduo 1777ea3aae HBASE-20938 Set version to 2.1.1-SNAPSHOT for branch-2.1 2018-07-25 21:45:09 +08:00
zhangduo a2db3d27ff HBASE-20849 Set version as 2.1.0 in branch-2.1 in prep for first RC 2018-07-06 15:32:23 +08:00
Sean Busbey ee84a8f243 HBASE-20332 shaded mapreduce module shouldn't include hadoop
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports

 Conflicts:
	hbase-backup/pom.xml
	hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-18 14:02:48 -07:00
Ankit Singhal 4ae1baef1a HBASE-20645 Pass stringified table name to exists? method
Signed-off-by: Josh Elser <elserj@apache.org>
2018-05-25 16:38:12 -04:00
Enis Soztutar aa8ceb8167 HBASE-16191 Add stop_regionserver and stop_master to shell
Amending-Author: Peter Somogyi <psomogyi@apache.org>
2018-05-14 09:38:22 +02:00
Sean Busbey 61f96b6ffa HBASE-20544 Make HBTU default to random ports.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>

 Conflicts:
	hbase-backup/src/test/resources/hbase-site.xml
	hbase-spark-it/src/test/resources/hbase-site.xml
	hbase-spark/src/test/resources/hbase-site.xml
2018-05-09 23:45:39 -07:00
Nihal Jain ce08826f0d HBASE-20327 When qualifier is not specified, append and incr operation do not work (shell)
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-04-28 12:47:45 +08:00
Sakthi 101055e343 HBASE-20270 Turned off command help that follows all errors in shell
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 152104ae1ba559c580ffaa083209fd2cfee1050b)
2018-04-25 15:37:32 -05:00
Thoralf Gutierrez 84afd69c63 HBASE-18842 Fix unknown namespace message in clone_snapshot
Signed-off-by: Jesse Yates <jyates@apache.org>
(cherry picked from commit 0ff4f5fba9)
2018-04-25 11:52:48 -05:00
Toshihiro Suzuki 68a9508e06 HBASE-20293 get_splits returns duplicate split points when region replication is on 2018-04-17 15:44:05 -07:00
Guangxu Cheng b0701434e3 HBASE-20243 [Shell] Add shell command to create a new table by cloning the existent table
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-11 19:34:30 -07:00
Gabor Bota bf7c631dee HBASE-20253. Error message is missing for restore_snapshot
Amending Author: Peter Somogyi <psomogyi@apache.org>
2018-04-11 17:25:32 +02:00
openinx fedf3ca923 HBASE-20165 Shell command to make a normal peer to be a serial replication peer 2018-04-09 15:18:44 +08:00
Peter Somogyi 2cfa344ab1 HBASE-20287 After cluster startup list_regions command fails on disabled table
Add is_enabled check for list_regions command

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-07 18:12:04 +02:00
Csaba Skrabak 17b84cfb9b HBASE-20286 Improving shell command compaction_state
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-06 15:34:19 -07:00
Balazs Meszaros a8994afbfe HBASE-20258 Shell hangs when scanning a disabled table
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-06 11:20:34 -07:00
Sean Busbey 4772a4ebdd HBASE-20276 restore original shell REPL functionality where commands can return results
* makes commands always pass any results back to hirb
* print warning if hirb is given the --return-values flag
* add some docs on how to avoid the console clutter that HBASE-15965 sought to address
* add an upgrade section note about this change.
* cleanup where the get_splits command does its printing so there's a building block that doesn't print
* some rubocop suggested tweaks and opt-out for classlength check on table and shell classes.

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	src/main/asciidoc/_chapters/upgrading.adoc

* backport leaves off refguide change about upgrading.
2018-04-06 13:08:00 -05:00
Toshihiro Suzuki c329a3438f HBASE-20292 Wrong URLs in the descriptions for update_all_config and update_config commands in shell 2018-03-27 09:33:13 +02:00
Peter Somogyi 1e57aadbe8 HBASE-20254 Incorrect help message for merge_region 2018-03-26 19:52:55 +02:00
Balazs Meszaros 72e6d7c073 HBASE-20245 HTrace commands do not work 2018-03-23 16:54:06 -07:00
Peter Somogyi 489e875a78 HBASE-16848 Usage for show_peer_tableCFs command doesn't include peer 2018-03-23 16:26:35 +01:00
Umesh Agashe 96d63fee11 HBASE-20224 Web UI is broken in standalone mode
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
2018-03-22 20:28:08 -07:00
Peter Somogyi c20a2a4673 HBASE-20241 splitormerge_enabled does not work
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-03-22 11:59:23 +01:00
Chia-Ping Tsai dd9e46bbf5 HBASE-20212 Make all Public classes have InterfaceAudience category
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-22 18:09:54 +08:00
Chia-Ping Tsai 95596e8ba7 HBASE-20119 Introduce a pojo class to carry coprocessor information in order to make TableDescriptorBuilder accept multiple cp at once
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-16 01:26:08 +08:00
Balazs Meszaros 5ea0db0b1f HBASE-20200 list_procedures fails in shell
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
2018-03-15 08:20:24 +01:00
Peter Somogyi e80ce3d91b HBASE-19802 Wrong usage messages on shell commands (grant/revoke namespace syntax) (Csaba Skrabak) 2018-03-13 10:58:52 +01:00
Guanghao Zhang 59cad95b58 HBASE-19579 Add peer lock test for shell command list_locks
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 20:55:48 +08:00
Sean Busbey 71cc7869db HBASE-20155 update branch-2 version to 2.1.0-SNAPSHOT
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-03-08 08:44:30 -08:00
Sean Busbey 9927c2e14a HBASE-20070 refactor website generation
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>

 Conflicts:
	hbase-backup/pom.xml
	hbase-spark-it/pom.xml
2018-03-02 09:51:43 -06:00
Michael Stack a2de29560f HBASE-20113 Move branch-2 version from 2.0.0-beta-2-SNAPSHOT to 2.0.0-beta-2 2018-03-01 15:46:38 -08:00
zhangduo 30dd595d3b HBASE-19903 Split TestShell so it will not time out 2018-02-16 00:17:30 +08:00
Reid Chan 41f1e5c79b HBASE-19844 Shell should support to flush by regionserver
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-13 08:21:27 -08:00
Balazs Meszaros 4d24b19822 HBASE-19886 Display maintenance mode in shell, web UI 2018-02-06 14:53:48 -08:00
zhangduo 28d13c54a9 HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules 2018-01-31 20:49:25 +08:00
Michael Stack 90a75fb052 HBASE-19888 Move branch-2 version from 2.0.0-beta-1 to 2.0.0-beta-2-SNAPSHOT 2018-01-29 14:17:54 -08:00
Duo Zhang bbf3bae72a
HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs 2018-01-29 12:41:14 -08:00
Chia-Ping Tsai 523d274c98 HBASE-19871 delete.rb should require user to provide the column 2018-01-29 16:37:43 +08:00
Josh Elser 3c808dc37b HBASE-19770 ADDENDUM Replace `if not` with `unless`
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-01-24 14:37:50 -05:00