Commit Graph

313 Commits

Author SHA1 Message Date
Michael Stack 9ec0ec4922 HBASE-17350 Fixup of regionserver group-based assignment
Renamed move_rsgroup_servers as move_servers_rsgroup
Renamed move_rsgroup_tables as move_tables_rsgroup

Minor changes to help text in rsgroup commands making them all same.
Made LOG from RSGroupAdminServer all talk of 'rsgroup' rather than
'group' to be consistent.

Fix for table.jsp where it would fail to display regions because no
type for the protobuf record specified.

Fix it so that move of an offline server to 'default' rsgroup is like
moving the reference to the server to trash (keeps the 'default' group
consistently 'dynamic' regards its server-list).

Fixed another issue where we were stuck in a loop because regions
were in FAILED_OPEN state because no server to assign too so we'd
never recover (a vagary of the current state of Master assignement
but no less a possibility in real world deploys).

Make it so servers are sorted when we list them; its what operator
would expect.
2017-02-06 13:09:57 -08:00
Huaxiang Sun 1159296541 HBASE-16981 Expand Mob Compaction Partition policy from daily to weekly, monthly
Support weekly and monthly mob compact partition policies in addition to the existing
daily partition policy.

Signed-off-by: Jingcheng Du <jingchengdu@apache.org>
2017-02-03 15:52:43 +08:00
Ajay Jadhav f8b1f57b05 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-01 22:16:01 -06:00
Sean Busbey 2c799fb70a Revert "Add mechanism to control hbase cleaner behavior"
This reverts commit ef052521cd.

Bad commit message.
2017-02-01 22:11:48 -06:00
Ajay Jadhav ef052521cd Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-01 19:33:06 -08:00
anastas aa5d9a9ad3 HBASE-17492 Fix the compacting memstore part in hbase shell ruby script
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-23 21:27:44 -08:00
Jan Hentschel 55a1aa1e73 HBASE-10699 Set capacity on ArrayList where possible and use isEmpty instead of size() == 0
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:58:20 -08:00
Michael Stack 31f3e8f833 HBASE-17496 RSGroup shell commands:get_server_rsgroup don't work and commands display an incorrect result size (Guangxu Cheng) 2017-01-20 09:20:31 -08:00
Yu Li f92a14ade6 HBASE-14061 Support CF-level Storage Policy 2017-01-09 09:52:58 +08:00
Guanghao Zhang 0e48665641 HBASE-17336 get/update replication peer config requests should be routed through master 2016-12-30 10:12:47 +08:00
Guanghao Zhang 8da7366fc2 HBASE-17348 Remove the unused hbase.replication from javadoc/comment/book completely 2016-12-25 08:46:29 +08:00
eshcar a9310436d5 HBASE-17294: External configuration for memory compaction
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-13 17:16:00 -08:00
tedyu 2333596279 HBASE-17296 Provide per peer throttling for replication (Guanghao Zhang) 2016-12-13 04:20:20 -08:00
Michael Stack 0b0e857465 HBASE-17160 Undo unnecessary inter-module dependency; spark to hbase-it and hbase-it to shell; ADDENDUM
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-23 11:45:37 -08:00
Esteban Gutierrez 5bc518b387 HBASE-16774 [shell] Add coverage to TestShell when ZooKeeper is not reachable 2016-10-18 09:08:33 -07:00
tedyu 76e7c05474 HBASE-16274 Add more peer tests to replication_admin_test (Guanghao Zhang) 2016-10-15 07:30:52 -07:00
tedyu f5abe17bc6 HBASE-16666 Add append and remove peer namespaces cmds for replication (Guanghao Zhang) 2016-10-09 21:22:50 -07:00
Apekshit Sharma 5f7e642fed HBASE-16682 Fix Shell tests failure. NoClassDefFoundError for MiniKdc.
Change-Id: I75b5dde104f716f173a5a41d43f7b4c2b8ba1f39
2016-09-26 02:05:21 -07:00
Jonathan M Hsieh a90d433a2c HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:45:03 -07:00
Jerry He edc0ef3fe4 HBASE-16598 Enable zookeeper useMulti always and clean up in HBase code 2016-09-17 16:51:26 -07:00
Enis Soztutar 1a1003a482 HBASE-16447 Replication by namespaces config in peer (Guanghao Zhang) 2016-09-16 11:47:42 -07:00
chenheng 1d6c90b496 HBASE-16381 Shell deleteall command should support row key prefixes (Yi Liang) 2016-09-15 19:20:29 +08:00
Umesh Agashe 422734e73d HBASE-15297 Correct handling of namespace existence checks in shell.
Changes namespace_exists? method in SecurityAdmin ruby code to catch NamespaceNotFoundException
and modified Admin.java file to document the exception.

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-09-12 23:29:42 -07:00
Geoffrey e1e0637200 HBASE-16576 Shell add_peer doesn't allow setting cluster_key for custom endpoints
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-09-09 14:54:20 -07:00
anoopsamjohn 32c21f4594 HBASE-14921 In-Memory MemStore Flush and Compaction : Memory optimizations. (Anastasia) 2016-08-24 09:25:21 +05:30
Stephen Yuan Jiang cd0b85e0a8 Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue) 2016-07-22 20:09:03 -07:00
Apekshit Sharma 28802decc8 HBASE-16227 [Shell] Column value formatter not working in scans.
Tested : manually using shell.

Change-Id: I9eef7efa68393a762ec872447f8e36dfc6d6f1bc
2016-07-13 14:14:06 -07:00
tedyu 7227c27fe8 HBASE-16184 Shell test fails due to rLoadSink being nil (Phil Yang) 2016-07-12 00:15:26 -07:00
Apekshit Sharma a396ae773a HBASE-16044 Fix 'hbase shell' output parsing in graceful_stop.sh
Change-Id: I94b2f665105837d31281be66d620b6152c3bc9d1
2016-07-11 11:28:33 -07:00
tedyu ffd3987c54 HBASE-16147 Add ruby wrapper for getting compaction state 2016-06-30 11:01:54 -07:00
chenheng e05f527991 HBASE-16111 Truncate preserve shell command is broken 2016-06-27 15:06:51 +08:00
chenheng 68c1b34dbc HBASE-16040 Remove configuration "hbase.replication" 2016-06-24 10:41:35 +08:00
Matteo Bertozzi d9463bcce0 HBASE-15989 Remove hbase.online.schema.update.enable 2016-06-08 13:09:31 -07:00
Apekshit Sharma 15c03fd1c9 HBASE-15965
- Testing by executing a command will cover the exact path users will trigger, so its better then directly calling library functions in tests. Changing the tests to use @shell.command(:<command>, args) to execute them like it's a command coming from shell.

Norm change:
Commands should print the output user would like to see, but in the end, should also return the relevant value. This way:
- Tests can use returned value to check that functionality works
- Tests can capture stdout to assert particular kind of output user should see.
- We do not print the return value in interactive mode and keep the output clean. See Shell.command() function.

Bugs found due to this change:
- Uncovered bug in major_compact.rb with this approach. It was calling admin.majorCompact() which doesn't exist but our tests didn't catch it since they directly tested admin.major_compact()
- Enabled TestReplicationShell. If it's bad, flaky infra will take care of it.

Change-Id: I5d8af16bf477a79a2f526a5bf11c245b02b7d276
2016-06-06 17:50:22 -07:00
Apekshit Sharma 70762faa98 HBASE-15849 Simplify the way we handle runtime of commands.
Functions format_simple_command and format_and_return_simple_command are used to print runtimes right now. They are called from within every single command and use Ruby's 'yield' magic.  Instead, we can simplify it using 'command_safe' function. Since command_safe wraps all commands, we can simply time before and after we call individual command.
If a command only wants to time a part of its logic, it can set instance variables start_time and end_time accordingly which is far more simpler to understand and work with than 'yield'.

Change-Id: Ibfacf3593175af22fc4f7d80896dd2f6d7c5dde3
2016-06-03 15:50:03 -07:00
Apekshit bdb46f01b9 HBASE-15845 Changes:
- Renaming hbase.rb to hbase_constants.rb because there are two hbase.rb files right now which is confusing.
- Remove omnipresence of formatter object since it is kind of a use-and-throw class. Commands should create
  an instance, use it to format the output and discard it.
- Some refactoring

Change-Id: If9ea9873904e0a39d199a6aa10e23864b86a2f09
2016-06-03 13:37:38 -07:00
tedyu 72d3f2a868 HBASE-15939 Two shell test failures on master (Talat and Ted) 2016-06-02 15:44:18 -07:00
tedyu a0f49c9884 HBASE-15858 Some region server group shell commands don't work 2016-06-01 21:13:33 -07:00
tedyu cbb95cd3a9 HBASE-15932 Shell test fails due to uninitialized constant 2016-06-01 10:35:00 -07:00
tedyu 015f2ef629 HBASE-15923 Shell rows counter test fails 2016-05-31 14:21:32 -07:00
Daniel Vimont e6d613de70 HBASE-15835 - Prevent HBaseTestingUtility#startMiniCluster from throwing _HMasterAddress already in use_ RuntimeException when another HBase thread is running
Signed-off-by: stack <stack@apache.org>
2016-05-30 20:05:19 -07:00
Enis Soztutar b89d88a193 HBASE-10358 Shell changes for setting consistency per request (yi liang) 2016-05-26 17:01:03 -07:00
stack 2515b0974d HBASE-4368 Expose processlist in shell (per regionserver and perhaps by cluster) (Talat Uyarer) 2016-05-23 15:49:17 -07:00
Jerry He 56e4b85d06 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:06:05 -07:00
eshcar a27504c701 HBASE-14920: Compacting memstore
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
Matteo Bertozzi 5ac54e6abb HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:48:26 -07:00
tedyu 838c306c0a HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 11:01:26 -07:00
tedyu 3b74b6f329 HBASE-15799 Two Shell 'close_region' Example Syntaxes Don't Work (Matt Warhaftig) 2016-05-09 20:58:55 -07:00
tedyu 387c7e6b08 HBASE-15782 TestShell fails due to some moved types 2016-05-06 06:11:12 -07:00
Li Fanxi e512c40ad5 HBASE-15680 Examples in shell help message for TIMERANGE scanner specifications should use milliseconds instead of seconds
Signed-off-by: stack <stack@apache.org>
2016-04-26 12:00:06 -07:00
tedyu ef47e1b68c HBASE-15641 Shell "alter" should do a single modifyTable operation (Matt Warhaftig) 2016-04-21 08:20:06 -07:00
chenheng a9f1c4a871 HBASE-15406 Split / merge switch left disabled after early termination of hbck 2016-04-15 14:09:52 +08:00
tedyu e0f31ba6e6 HBASE-15507 Online modification of enabled ReplicationPeerConfig (Geoffrey Jacoby) 2016-04-08 21:26:31 -07:00
Enis Soztutar bcc4444420 HBASE-15567 TestReplicationShell broken by recent replication changes (Geoffrey Jacoby) 2016-03-31 11:37:09 -07:00
chenheng 7f39baf0f4 HBASE-11393 Replication TableCfs should be a PB object rather than a string 2016-03-29 10:25:29 +08:00
tedyu 448ac5b37c HBASE-12940 Expose listPeerConfigs and getPeerConfig to the HBase shell (Geoffrey Jacoby) 2016-03-16 18:42:52 -07:00
Enis Soztutar ca816f0780 HBASE-6721 RegionServer Group based Assignment (Francis Liu) 2016-03-14 18:28:50 -07:00
chenheng 99955a3240 HBASE-15128 Disable region splits and merges switch in master 2016-02-27 08:36:59 +08:00
chenheng bf4fcc30c6 Revert "HBASE-15128 Disable region splits and merges switch in master"
This reverts commit 24d481c580.
2016-02-26 08:52:12 +08:00
chenheng 24d481c580 HBASE-15128 Disable region splits and merges switch in master 2016-02-26 08:11:16 +08:00
Phil Yang 30cec72f9a HBASE-15302 Reenable the other tests disabled by HBASE-14678
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:14:01 -08:00
Enis Soztutar 110274b335 HBASE-15147 Shell should use Admin.listTableNames() instead of Admin.listTables() 2016-01-21 11:09:02 -08:00
tedyu eb17f74b9e HBASE-15073 Revert due to different opinion on usefulness 2016-01-18 17:51:21 -08:00
tedyu d65978fceb HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 17:25:41 -08:00
stack 2fba25b66a HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer 2015-12-28 13:27:17 -08:00
tedyu e15c48ed2c HBASE-15032 hbase shell scan filter string assumes UTF-8 encoding (huaxiang sun) 2015-12-24 07:00:22 -08:00
Matteo Bertozzi 9a297ef0a5 HBASE-15022 replication_admin.rb throws undefined method `getZooKeeperClusterKey' for ZKUtil 2015-12-21 13:20:26 -08:00
Mikhail Antonov abe30b52a8 HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version 2015-12-15 12:11:27 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
Matteo Bertozzi 6f8d5e86ce HBASE-14941 locate_region shell command 2015-12-10 13:22:48 -08:00
Enis Soztutar 63f2ebca13 HBASE-14804 HBase shell's create table command ignores 'NORMALIZATION_ENABLED' attribute (Jean-Marc Spaggiari) 2015-12-08 11:13:39 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
Matteo Bertozzi 55087ce888 HBASE-14863 Add missing test/resources/log4j files in hbase modules 2015-11-22 07:31:16 -08:00
Enis Soztutar b2c20cebb0 HBASE-14805 status should show the master in shell 2015-11-18 15:25:48 -08:00
Apekshit(Appy) Sharma 08963189a2 HBASE-14767 - Remove deprecated functions from HBaseAdmin Deprecated in HBASE-12083 (1.0.0, 2.0.0, 0.99.2) - HBaseAdmin(Configuration)
Deprecated in HBASE-10479 (0.99.0, hbase-10070)
  - HBaseAdmin(Connection)

  Deprecated in HBASE-11826 (0.99.0, 1.0.0, 2.0.0)
  - flush()
  - compact()
  - majorCompact()
  - split()
  - getCompactionState()

- Changes many declarations from HBaseAdmin to Admin
(Apekshit)

Signed-off-by: stack <stack@apache.org>
2015-11-06 16:23:55 -10:00
Elliott Clark 68b94886a5 HBASE-14773 Fix HBase shell tests are skipped when skipping server tests. 2015-11-05 16:27:14 -08:00
Elliott Clark 86da57f498 HBASE-14765 Remove snappy profile 2015-11-05 10:20:40 -08:00
Enis Soztutar 4534f8ed0c HBASE-14733 Minor typo in alter_namespace.rb 2015-10-30 17:52:28 -07:00
Jonathan M Hsieh 094d65e6f5 HBASE-14673 Exorcise deprecated Delete#delete* api 2015-10-29 11:15:34 -07:00
Jonathan M Hsieh de9555cec4 HBASE-14675 Exorcise deprecated Put#add(...) and replace with Put#addColumn(...) 2015-10-29 11:15:31 -07:00
stack 93023f544b HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs 2015-10-22 12:31:04 -07:00
Dima Spivak 04bdf97311 HBASE-14577 HBase shell help for scan and returning a column family has a typo
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-10-12 13:34:48 -07:00
stack fd6acbbf51 HBASE-14561 Disable zombie TestReplicationShell 2015-10-06 12:57:49 -07:00
Mikhail Antonov 19045a5ea7 HBASE-14367 Add normalization support to shell 2015-10-04 00:29:39 -07:00
Josh Elser 4da3c935d4 HBASE-14494 Add missing commas on shell command usages
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-01 12:04:36 -07:00
stack e0929bbc5a HBASE-14510 Fix coprocessor handling of duplicate classes (Yerui Sun) 2015-09-29 15:01:10 -07:00
Stephen Yuan Jiang f6be2f9bf3 HBASE-14488 Procedure V2 - shell command to abort a procedure (Stephen Yuan Jiang) 2015-09-28 18:01:36 -07:00
Esteban Gutierrez 54b86b3394 HBASE-14500 Remove load of deprecated MOB ruby scripts after HBASE-14227 2015-09-28 10:49:08 -07:00
chenheng 02699fe967 HBASE-14227 Fold special cased MOB APIs into existing APIs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-25 18:28:13 -07:00
Stephen Yuan Jiang 23506454cf HBASE-14487 Procedure V2 - shell command to list all procedures (Stephen Yuan Jiang) 2015-09-24 20:39:17 -07:00
tedyu df341c4299 HBASE-14309 Allow load balancer to operate when there is region in transition by adding force flag 2015-08-29 13:15:53 -07:00
stack d0873f5a8c HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 13:47:19 -07:00
anoopsjohn 9c69bf766f HBASE-14214 list_labels shouldn't raise ArgumentError if no labels are defined. 2015-08-13 14:32:59 +05:30
Andrew Purtell 5e5bcceb53 HBASE-14122 Client API for determining if server side supports cell level security 2015-08-12 13:26:55 -07:00
Ashish Singhi 9ea7ab849c HBASE-14105 Add shell tests for Snapshot
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-08-07 11:14:38 -07:00
anoopsjohn 18c9bb8b54 HBASE-14183 Scanning hbase meta table is failing in master branch.(Ashish) 2015-08-05 10:08:24 +05:30
Sean Busbey 1b0b67fb7c HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
tedyu 4b6598e394 HBASE-13864 HColumnDescriptor should parse the output from master and from describe for TTL (Ashu Pachauri) 2015-08-01 02:15:02 -07:00