Commit Graph

322 Commits

Author SHA1 Message Date
CHIA-PING TSAI 26928ff912 HBASE-17736 Some options can't be configured by the shell
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-03-09 16:53:34 -08:00
Andrew Purtell 1b5afc3395 HBASE-17729 Missing shortcuts for some useful HCD options 2017-03-08 10:05:05 -08:00
tedyu d2349c6f98 HBASE-17736 Some options can't be configured by the shell - revert premature commit 2017-03-05 16:38:13 -08:00
CHIA-PING TSAI 9d8dd6c474 HBASE-17736 Some options can't be configured by the shell
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-05 11:07:11 -08:00
Andrew Purtell 404a2883f2 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging 2017-03-03 12:40:06 -08:00
huzheng 335cde3415 HBASE-17672: "Grant should set access rights appropriately" test fails
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-22 20:08:12 -08:00
Michael Stack ae840c0ccd HBASE-17656 Move new Address class from util to net package 2017-02-16 12:17:50 -08:00
Michael Stack e019961150 HBASE-17624 Address late review of HBASE-6721, rsgroups feature
Addresses review comments by Sean Busbey and Appy that happened
to come in long after the commit of HBASE-6721, the original
rsgroup issue.

Also includes subsequent accommodation of Duo Zhang review.

Adds a new type to hold hostname and port. It is called
Address. It is a facade over Guava's HostAndPort. Replace
all instances of HostAndPort with Address. In particular,
those places where HostAndPort was part of the rsgroup
public API.

Fix licenses. Add audience annotations.

Cleanup and note concurrency expectation on a few core classes.
In particular, all access on RSGroupInfoManager is made
synchronized.

M hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java
 Host the hostname and port in an instance of the new type Address.
 Add a bunch of deprecation of exotic string parses that should never
 have been public.

M hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdmin.java
 Make this an Interface rather than abstract class. Creation was a
 static internal method that only chose one type.... Let it be free
 as a true Interface instead.
2017-02-14 09:29:17 -08:00
Guanghao Zhang 9a78d00884 HBASE-17389 Convert all internal usages from ReplicationAdmin to Admin 2017-02-07 10:18:59 +08:00
Michael Stack 9ec0ec4922 HBASE-17350 Fixup of regionserver group-based assignment
Renamed move_rsgroup_servers as move_servers_rsgroup
Renamed move_rsgroup_tables as move_tables_rsgroup

Minor changes to help text in rsgroup commands making them all same.
Made LOG from RSGroupAdminServer all talk of 'rsgroup' rather than
'group' to be consistent.

Fix for table.jsp where it would fail to display regions because no
type for the protobuf record specified.

Fix it so that move of an offline server to 'default' rsgroup is like
moving the reference to the server to trash (keeps the 'default' group
consistently 'dynamic' regards its server-list).

Fixed another issue where we were stuck in a loop because regions
were in FAILED_OPEN state because no server to assign too so we'd
never recover (a vagary of the current state of Master assignement
but no less a possibility in real world deploys).

Make it so servers are sorted when we list them; its what operator
would expect.
2017-02-06 13:09:57 -08:00
Huaxiang Sun 1159296541 HBASE-16981 Expand Mob Compaction Partition policy from daily to weekly, monthly
Support weekly and monthly mob compact partition policies in addition to the existing
daily partition policy.

Signed-off-by: Jingcheng Du <jingchengdu@apache.org>
2017-02-03 15:52:43 +08:00
Ajay Jadhav f8b1f57b05 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-01 22:16:01 -06:00
Sean Busbey 2c799fb70a Revert "Add mechanism to control hbase cleaner behavior"
This reverts commit ef052521cd.

Bad commit message.
2017-02-01 22:11:48 -06:00
Ajay Jadhav ef052521cd Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-01 19:33:06 -08:00
anastas aa5d9a9ad3 HBASE-17492 Fix the compacting memstore part in hbase shell ruby script
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-23 21:27:44 -08:00
Jan Hentschel 55a1aa1e73 HBASE-10699 Set capacity on ArrayList where possible and use isEmpty instead of size() == 0
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:58:20 -08:00
Michael Stack 31f3e8f833 HBASE-17496 RSGroup shell commands:get_server_rsgroup don't work and commands display an incorrect result size (Guangxu Cheng) 2017-01-20 09:20:31 -08:00
Yu Li f92a14ade6 HBASE-14061 Support CF-level Storage Policy 2017-01-09 09:52:58 +08:00
Guanghao Zhang 0e48665641 HBASE-17336 get/update replication peer config requests should be routed through master 2016-12-30 10:12:47 +08:00
Guanghao Zhang 8da7366fc2 HBASE-17348 Remove the unused hbase.replication from javadoc/comment/book completely 2016-12-25 08:46:29 +08:00
eshcar a9310436d5 HBASE-17294: External configuration for memory compaction
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-13 17:16:00 -08:00
tedyu 2333596279 HBASE-17296 Provide per peer throttling for replication (Guanghao Zhang) 2016-12-13 04:20:20 -08:00
Michael Stack 0b0e857465 HBASE-17160 Undo unnecessary inter-module dependency; spark to hbase-it and hbase-it to shell; ADDENDUM
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-23 11:45:37 -08:00
Esteban Gutierrez 5bc518b387 HBASE-16774 [shell] Add coverage to TestShell when ZooKeeper is not reachable 2016-10-18 09:08:33 -07:00
tedyu 76e7c05474 HBASE-16274 Add more peer tests to replication_admin_test (Guanghao Zhang) 2016-10-15 07:30:52 -07:00
tedyu f5abe17bc6 HBASE-16666 Add append and remove peer namespaces cmds for replication (Guanghao Zhang) 2016-10-09 21:22:50 -07:00
Apekshit Sharma 5f7e642fed HBASE-16682 Fix Shell tests failure. NoClassDefFoundError for MiniKdc.
Change-Id: I75b5dde104f716f173a5a41d43f7b4c2b8ba1f39
2016-09-26 02:05:21 -07:00
Jonathan M Hsieh a90d433a2c HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:45:03 -07:00
Jerry He edc0ef3fe4 HBASE-16598 Enable zookeeper useMulti always and clean up in HBase code 2016-09-17 16:51:26 -07:00
Enis Soztutar 1a1003a482 HBASE-16447 Replication by namespaces config in peer (Guanghao Zhang) 2016-09-16 11:47:42 -07:00
chenheng 1d6c90b496 HBASE-16381 Shell deleteall command should support row key prefixes (Yi Liang) 2016-09-15 19:20:29 +08:00
Umesh Agashe 422734e73d HBASE-15297 Correct handling of namespace existence checks in shell.
Changes namespace_exists? method in SecurityAdmin ruby code to catch NamespaceNotFoundException
and modified Admin.java file to document the exception.

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-09-12 23:29:42 -07:00
Geoffrey e1e0637200 HBASE-16576 Shell add_peer doesn't allow setting cluster_key for custom endpoints
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-09-09 14:54:20 -07:00
anoopsamjohn 32c21f4594 HBASE-14921 In-Memory MemStore Flush and Compaction : Memory optimizations. (Anastasia) 2016-08-24 09:25:21 +05:30
Stephen Yuan Jiang cd0b85e0a8 Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue) 2016-07-22 20:09:03 -07:00
Apekshit Sharma 28802decc8 HBASE-16227 [Shell] Column value formatter not working in scans.
Tested : manually using shell.

Change-Id: I9eef7efa68393a762ec872447f8e36dfc6d6f1bc
2016-07-13 14:14:06 -07:00
tedyu 7227c27fe8 HBASE-16184 Shell test fails due to rLoadSink being nil (Phil Yang) 2016-07-12 00:15:26 -07:00
Apekshit Sharma a396ae773a HBASE-16044 Fix 'hbase shell' output parsing in graceful_stop.sh
Change-Id: I94b2f665105837d31281be66d620b6152c3bc9d1
2016-07-11 11:28:33 -07:00
tedyu ffd3987c54 HBASE-16147 Add ruby wrapper for getting compaction state 2016-06-30 11:01:54 -07:00
chenheng e05f527991 HBASE-16111 Truncate preserve shell command is broken 2016-06-27 15:06:51 +08:00
chenheng 68c1b34dbc HBASE-16040 Remove configuration "hbase.replication" 2016-06-24 10:41:35 +08:00
Matteo Bertozzi d9463bcce0 HBASE-15989 Remove hbase.online.schema.update.enable 2016-06-08 13:09:31 -07:00
Apekshit Sharma 15c03fd1c9 HBASE-15965
- Testing by executing a command will cover the exact path users will trigger, so its better then directly calling library functions in tests. Changing the tests to use @shell.command(:<command>, args) to execute them like it's a command coming from shell.

Norm change:
Commands should print the output user would like to see, but in the end, should also return the relevant value. This way:
- Tests can use returned value to check that functionality works
- Tests can capture stdout to assert particular kind of output user should see.
- We do not print the return value in interactive mode and keep the output clean. See Shell.command() function.

Bugs found due to this change:
- Uncovered bug in major_compact.rb with this approach. It was calling admin.majorCompact() which doesn't exist but our tests didn't catch it since they directly tested admin.major_compact()
- Enabled TestReplicationShell. If it's bad, flaky infra will take care of it.

Change-Id: I5d8af16bf477a79a2f526a5bf11c245b02b7d276
2016-06-06 17:50:22 -07:00
Apekshit Sharma 70762faa98 HBASE-15849 Simplify the way we handle runtime of commands.
Functions format_simple_command and format_and_return_simple_command are used to print runtimes right now. They are called from within every single command and use Ruby's 'yield' magic.  Instead, we can simplify it using 'command_safe' function. Since command_safe wraps all commands, we can simply time before and after we call individual command.
If a command only wants to time a part of its logic, it can set instance variables start_time and end_time accordingly which is far more simpler to understand and work with than 'yield'.

Change-Id: Ibfacf3593175af22fc4f7d80896dd2f6d7c5dde3
2016-06-03 15:50:03 -07:00
Apekshit bdb46f01b9 HBASE-15845 Changes:
- Renaming hbase.rb to hbase_constants.rb because there are two hbase.rb files right now which is confusing.
- Remove omnipresence of formatter object since it is kind of a use-and-throw class. Commands should create
  an instance, use it to format the output and discard it.
- Some refactoring

Change-Id: If9ea9873904e0a39d199a6aa10e23864b86a2f09
2016-06-03 13:37:38 -07:00
tedyu 72d3f2a868 HBASE-15939 Two shell test failures on master (Talat and Ted) 2016-06-02 15:44:18 -07:00
tedyu a0f49c9884 HBASE-15858 Some region server group shell commands don't work 2016-06-01 21:13:33 -07:00
tedyu cbb95cd3a9 HBASE-15932 Shell test fails due to uninitialized constant 2016-06-01 10:35:00 -07:00
tedyu 015f2ef629 HBASE-15923 Shell rows counter test fails 2016-05-31 14:21:32 -07:00
Daniel Vimont e6d613de70 HBASE-15835 - Prevent HBaseTestingUtility#startMiniCluster from throwing _HMasterAddress already in use_ RuntimeException when another HBase thread is running
Signed-off-by: stack <stack@apache.org>
2016-05-30 20:05:19 -07:00
Enis Soztutar b89d88a193 HBASE-10358 Shell changes for setting consistency per request (yi liang) 2016-05-26 17:01:03 -07:00
stack 2515b0974d HBASE-4368 Expose processlist in shell (per regionserver and perhaps by cluster) (Talat Uyarer) 2016-05-23 15:49:17 -07:00
Jerry He 56e4b85d06 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:06:05 -07:00
eshcar a27504c701 HBASE-14920: Compacting memstore
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
Matteo Bertozzi 5ac54e6abb HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:48:26 -07:00
tedyu 838c306c0a HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 11:01:26 -07:00
tedyu 3b74b6f329 HBASE-15799 Two Shell 'close_region' Example Syntaxes Don't Work (Matt Warhaftig) 2016-05-09 20:58:55 -07:00
tedyu 387c7e6b08 HBASE-15782 TestShell fails due to some moved types 2016-05-06 06:11:12 -07:00
Li Fanxi e512c40ad5 HBASE-15680 Examples in shell help message for TIMERANGE scanner specifications should use milliseconds instead of seconds
Signed-off-by: stack <stack@apache.org>
2016-04-26 12:00:06 -07:00
tedyu ef47e1b68c HBASE-15641 Shell "alter" should do a single modifyTable operation (Matt Warhaftig) 2016-04-21 08:20:06 -07:00
chenheng a9f1c4a871 HBASE-15406 Split / merge switch left disabled after early termination of hbck 2016-04-15 14:09:52 +08:00
tedyu e0f31ba6e6 HBASE-15507 Online modification of enabled ReplicationPeerConfig (Geoffrey Jacoby) 2016-04-08 21:26:31 -07:00
Enis Soztutar bcc4444420 HBASE-15567 TestReplicationShell broken by recent replication changes (Geoffrey Jacoby) 2016-03-31 11:37:09 -07:00
chenheng 7f39baf0f4 HBASE-11393 Replication TableCfs should be a PB object rather than a string 2016-03-29 10:25:29 +08:00
tedyu 448ac5b37c HBASE-12940 Expose listPeerConfigs and getPeerConfig to the HBase shell (Geoffrey Jacoby) 2016-03-16 18:42:52 -07:00
Enis Soztutar ca816f0780 HBASE-6721 RegionServer Group based Assignment (Francis Liu) 2016-03-14 18:28:50 -07:00
chenheng 99955a3240 HBASE-15128 Disable region splits and merges switch in master 2016-02-27 08:36:59 +08:00
chenheng bf4fcc30c6 Revert "HBASE-15128 Disable region splits and merges switch in master"
This reverts commit 24d481c580.
2016-02-26 08:52:12 +08:00
chenheng 24d481c580 HBASE-15128 Disable region splits and merges switch in master 2016-02-26 08:11:16 +08:00
Phil Yang 30cec72f9a HBASE-15302 Reenable the other tests disabled by HBASE-14678
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:14:01 -08:00
Enis Soztutar 110274b335 HBASE-15147 Shell should use Admin.listTableNames() instead of Admin.listTables() 2016-01-21 11:09:02 -08:00
tedyu eb17f74b9e HBASE-15073 Revert due to different opinion on usefulness 2016-01-18 17:51:21 -08:00
tedyu d65978fceb HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 17:25:41 -08:00
stack 2fba25b66a HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer 2015-12-28 13:27:17 -08:00
tedyu e15c48ed2c HBASE-15032 hbase shell scan filter string assumes UTF-8 encoding (huaxiang sun) 2015-12-24 07:00:22 -08:00
Matteo Bertozzi 9a297ef0a5 HBASE-15022 replication_admin.rb throws undefined method `getZooKeeperClusterKey' for ZKUtil 2015-12-21 13:20:26 -08:00
Mikhail Antonov abe30b52a8 HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version 2015-12-15 12:11:27 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
Matteo Bertozzi 6f8d5e86ce HBASE-14941 locate_region shell command 2015-12-10 13:22:48 -08:00
Enis Soztutar 63f2ebca13 HBASE-14804 HBase shell's create table command ignores 'NORMALIZATION_ENABLED' attribute (Jean-Marc Spaggiari) 2015-12-08 11:13:39 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
Matteo Bertozzi 55087ce888 HBASE-14863 Add missing test/resources/log4j files in hbase modules 2015-11-22 07:31:16 -08:00
Enis Soztutar b2c20cebb0 HBASE-14805 status should show the master in shell 2015-11-18 15:25:48 -08:00
Apekshit(Appy) Sharma 08963189a2 HBASE-14767 - Remove deprecated functions from HBaseAdmin Deprecated in HBASE-12083 (1.0.0, 2.0.0, 0.99.2) - HBaseAdmin(Configuration)
Deprecated in HBASE-10479 (0.99.0, hbase-10070)
  - HBaseAdmin(Connection)

  Deprecated in HBASE-11826 (0.99.0, 1.0.0, 2.0.0)
  - flush()
  - compact()
  - majorCompact()
  - split()
  - getCompactionState()

- Changes many declarations from HBaseAdmin to Admin
(Apekshit)

Signed-off-by: stack <stack@apache.org>
2015-11-06 16:23:55 -10:00
Elliott Clark 68b94886a5 HBASE-14773 Fix HBase shell tests are skipped when skipping server tests. 2015-11-05 16:27:14 -08:00
Elliott Clark 86da57f498 HBASE-14765 Remove snappy profile 2015-11-05 10:20:40 -08:00
Enis Soztutar 4534f8ed0c HBASE-14733 Minor typo in alter_namespace.rb 2015-10-30 17:52:28 -07:00
Jonathan M Hsieh 094d65e6f5 HBASE-14673 Exorcise deprecated Delete#delete* api 2015-10-29 11:15:34 -07:00
Jonathan M Hsieh de9555cec4 HBASE-14675 Exorcise deprecated Put#add(...) and replace with Put#addColumn(...) 2015-10-29 11:15:31 -07:00
stack 93023f544b HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs 2015-10-22 12:31:04 -07:00
Dima Spivak 04bdf97311 HBASE-14577 HBase shell help for scan and returning a column family has a typo
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-10-12 13:34:48 -07:00
stack fd6acbbf51 HBASE-14561 Disable zombie TestReplicationShell 2015-10-06 12:57:49 -07:00
Mikhail Antonov 19045a5ea7 HBASE-14367 Add normalization support to shell 2015-10-04 00:29:39 -07:00
Josh Elser 4da3c935d4 HBASE-14494 Add missing commas on shell command usages
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-01 12:04:36 -07:00
stack e0929bbc5a HBASE-14510 Fix coprocessor handling of duplicate classes (Yerui Sun) 2015-09-29 15:01:10 -07:00
Stephen Yuan Jiang f6be2f9bf3 HBASE-14488 Procedure V2 - shell command to abort a procedure (Stephen Yuan Jiang) 2015-09-28 18:01:36 -07:00
Esteban Gutierrez 54b86b3394 HBASE-14500 Remove load of deprecated MOB ruby scripts after HBASE-14227 2015-09-28 10:49:08 -07:00
chenheng 02699fe967 HBASE-14227 Fold special cased MOB APIs into existing APIs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-25 18:28:13 -07:00