Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,759 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

354 Commits

Author SHA1 Message Date
Guangxu Cheng 619d6a50f6 HBASE-16120 Add shell test for truncate_preserve 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-07-05 12:51:36 -07:00
Peter Somogyi f2731fc241 HBASE-18264 Update pom plugins 
Update plugins in main and subprojects
Unified versions to use variable instead of direct values

Affected plugins:
- apache-rat-plugin 0.11 -> 0.12
- asciidoctor-maven-plugin 1.5.2.1 -> 1.5.5
- asciidoctorj-pdf 1.5.0-alpha.6 -> 1.5.0-alpha.15
- build-helper-maven-plugin 1.9.1 -> 3.0.0
- buildnumber-maven-plugin 1.3 -> 1.4
- exec-maven-plugin 1.2.1/1.4.0 -> 1.6.0
- extra-enforcer-rules 1.0-beta-3 -> 1.0-beta-6
- findbugs-maven-plugin 3.0.0 -> 3.0.4
- jamon-maven-plugin 2.4.1 -> 2.4.2
- maven-bundle-plugin 2.5.3 -> 3.3.0
- maven-compiler-plugin 3.2/3.5.1 -> 3.6.1
- maven-eclipse-plugin 2.9 -> 2.10
- maven-shade-plugin 2.4.1 -> 3.0.0
- maven-surefire-plugin 2.18.1 -> 2.20
- maven-surefire-report-plugin 2.7.2 -> 2.20
- scala-maven-plugin 3.2.0 -> 3.2.2
- spotbugs 3.1.0-RC1 -> 3.1.0-RC3
- wagon-ssh 2.2 -> 2.12
- xml-maven-plugin 1.0 -> 1.0.1

- maven-assembly-plugin 2.4 -> 2.6(inherited)
- maven-dependency-plugin 2.4 -> 2.10 (inherited)
- maven-enforcer-plugin 1.3.1 -> 1.4.1 (inherited)
- maven-javadoc-plugin 2.10.3 -> 2.10.4 (inherited)
- maven-resources-plugin 2.7 (inherited)
- maven-site-plugin 3.4 -> 3.5.1 (inherited)

Change-Id: I84539f555be498dff18caed1e3eea1e1aeb2143a

Signed-off-by: Michael Stack <stack@apache.org>
 2017-07-03 19:42:46 -07:00
Mike Drob 2115d4b50e HBASE-18239 rubocop autocorrect for shell 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-06-30 10:23:12 -07:00
Josh Elser a19e5673d6 HBASE-18244 Temporarily disable TestShellRSGroups 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-06-28 11:55:18 -07:00
Josh Elser 5b485d14cd HBASE-17752 Shell command to list snapshot sizes WRT quotas 2017-06-20 14:17:00 -04:00
Guangxu Cheng 492c3f8e20 HBASE-18149 The setting rules for table-scope attributes and family-scope attributes should keep consistent 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-07 08:30:27 -07:00
Michael Stack 929c9dab14 HBASE-18181 Move master branch to version 3.0.0-SNAPSHOT post creation of branch-2 2017-06-06 22:04:39 -07:00
Mike Drob 140ce1453e HBASE-16196 Update to JRuby 9.1.9.0 
* Get hbase-shell to use latest current JRuby release.
* Update license information to reflect the changes to jruby-complete.jar
* Update shell scripts for Ruby 1.8->2.x incompatabilities
* Update joni and jcodings to compatible versions

Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-05-31 11:09:07 -05:00
Guangxu Cheng dda9ae0295 HBASE-18129 truncate_preserve fails when the truncate method doesn't exist on the master 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-05-31 02:31:29 -07:00
Guangxu Cheng 64c701768b HBASE-18001 Extend the "count" shell command to support specified conditions 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-05-24 17:06:36 +08:00
Guangxu Cheng ebe92c8fb3 HBASE-18094 Display the return value of the command append 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-05-23 08:59:05 -07:00
Josh Elser ed618da906 HBASE-17981 Consolidate the space quota shell commands 2017-05-22 13:41:36 -04:00
Josh Elser 80a1f8fa2a HBASE-17428 Implement informational RPCs for space quotas 
Create some RPCs that can expose the in-memory state that the
RegionServers and Master hold to drive the space quota "state machine".
Then, create some hbase shell commands to interact with those.
 2017-05-22 13:41:35 -04:00
Josh Elser f1066cd774 HBASE-17025 Add shell commands for space quotas 2017-05-22 13:41:35 -04:00
Josh Elser f1544c3466 HBASE-18067 Allow default FORMATTER for shell put/get commands 2017-05-21 22:24:12 -04:00
huzheng 37dd8ff722 HBASE-11013: Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2017-05-18 17:39:50 +08:00
tedyu 5e046151d6 HBASE-11013: Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions - revert, pending work in snapshot descriptor 2017-05-11 18:53:14 -07:00
tedyu b3dcfb659e HBASE-17928 Shell tool to clear compaction queues (Guangxu Cheng) 2017-05-11 18:47:12 -07:00
tedyu d8d4ba7c59 HBASE-17928 Shell tool to clear compaction queues - revert pending work in snapshot descriptor 2017-05-11 18:43:59 -07:00
tedyu 815b0f853b HBASE-17928 Shell tool to clear compaction queues (Guangxu Cheng) 2017-05-09 18:32:38 -07:00
huzheng 951b23a44c HBASE-11013: Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-05-09 09:32:48 -07:00
Karan Mehta 7d819eb722 HBASE-14925 (Addendum) Develop HBase shell command/tool to list table's region info through command line 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2017-05-05 23:33:30 +05:30
Josh Elser de78c11893 HBASE-17973 Fix incorrect method call in list_regions and expand tests (addendum) 2017-05-02 17:42:47 -04:00
Enis Soztutar a171b7feaf HBASE-17979 HBase Shell 'list' Command Help Doc Improvements (Hugo Louro) 2017-05-01 16:36:53 -07:00
Josh Elser 13b6fdf8ad HBASE-17973 Expand list_regions to filter on data locality 2017-05-01 13:46:41 -04:00
Karan Mehta 68b2e0f7d9 HBase-14925 Develop HBase shell command/tool to list table's region info through command line 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2017-04-28 14:06:03 +05:30
Chia-Ping Tsai 053e61541e HBASE-15583 Any HTableDescriptor we give out should be immutable 2017-04-27 03:22:29 +08:00
Balazs Meszaros 2557506415 HBASE-15143 Procedure v2 - Web UI displaying queues 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-04-25 09:39:28 -07:00
tedyu 68e48c456d HBASE-17946 Shell command compact_rs don't work (Guangxu Cheng) 2017-04-21 06:54:44 -07:00
Umesh Agashe c8461456d0 HBASE-17888: Added generic methods for updating metrics on submit and finish of a procedure execution 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-04-14 11:51:08 -07:00
tedyu 8e5eeb4db3 HBASE-17758 [RSGROUP] Add shell command to move servers and tables at the same time (Guangxu Cheng) - addendum with move_servers_tables_rsgroup.rb 2017-03-17 13:55:36 -07:00
Andrew Purtell 7f0e6f1c9e HBASE-17758 [RSGROUP] Add shell command to move servers and tables at the same time (Guangxu Cheng) 2017-03-16 18:37:40 -07:00
CHIA-PING TSAI 26928ff912 HBASE-17736 Some options can't be configured by the shell 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-03-09 16:53:34 -08:00
Andrew Purtell 1b5afc3395 HBASE-17729 Missing shortcuts for some useful HCD options 2017-03-08 10:05:05 -08:00
tedyu d2349c6f98 HBASE-17736 Some options can't be configured by the shell - revert premature commit 2017-03-05 16:38:13 -08:00
CHIA-PING TSAI 9d8dd6c474 HBASE-17736 Some options can't be configured by the shell 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-03-05 11:07:11 -08:00
Andrew Purtell 404a2883f2 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging 2017-03-03 12:40:06 -08:00
huzheng 335cde3415 HBASE-17672: "Grant should set access rights appropriately" test fails 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-02-22 20:08:12 -08:00
Michael Stack ae840c0ccd HBASE-17656 Move new Address class from util to net package 2017-02-16 12:17:50 -08:00
Michael Stack e019961150 HBASE-17624 Address late review of HBASE-6721, rsgroups feature 
Addresses review comments by Sean Busbey and Appy that happened
to come in long after the commit of HBASE-6721, the original
rsgroup issue.

Also includes subsequent accommodation of Duo Zhang review.

Adds a new type to hold hostname and port. It is called
Address. It is a facade over Guava's HostAndPort. Replace
all instances of HostAndPort with Address. In particular,
those places where HostAndPort was part of the rsgroup
public API.

Fix licenses. Add audience annotations.

Cleanup and note concurrency expectation on a few core classes.
In particular, all access on RSGroupInfoManager is made
synchronized.

M hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java
 Host the hostname and port in an instance of the new type Address.
 Add a bunch of deprecation of exotic string parses that should never
 have been public.

M hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdmin.java
 Make this an Interface rather than abstract class. Creation was a
 static internal method that only chose one type.... Let it be free
 as a true Interface instead.
 2017-02-14 09:29:17 -08:00
Guanghao Zhang 9a78d00884 HBASE-17389 Convert all internal usages from ReplicationAdmin to Admin 2017-02-07 10:18:59 +08:00
Michael Stack 9ec0ec4922 HBASE-17350 Fixup of regionserver group-based assignment 
Renamed move_rsgroup_servers as move_servers_rsgroup
Renamed move_rsgroup_tables as move_tables_rsgroup

Minor changes to help text in rsgroup commands making them all same.
Made LOG from RSGroupAdminServer all talk of 'rsgroup' rather than
'group' to be consistent.

Fix for table.jsp where it would fail to display regions because no
type for the protobuf record specified.

Fix it so that move of an offline server to 'default' rsgroup is like
moving the reference to the server to trash (keeps the 'default' group
consistently 'dynamic' regards its server-list).

Fixed another issue where we were stuck in a loop because regions
were in FAILED_OPEN state because no server to assign too so we'd
never recover (a vagary of the current state of Master assignement
but no less a possibility in real world deploys).

Make it so servers are sorted when we list them; its what operator
would expect.
 2017-02-06 13:09:57 -08:00
Huaxiang Sun 1159296541 HBASE-16981 Expand Mob Compaction Partition policy from daily to weekly, monthly 
Support weekly and monthly mob compact partition policies in addition to the existing
daily partition policy.

Signed-off-by: Jingcheng Du <jingchengdu@apache.org>
 2017-02-03 15:52:43 +08:00
Ajay Jadhav f8b1f57b05 HBASE-17280 Add mechanism to control hbase cleaner behavior 
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-02-01 22:16:01 -06:00
Sean Busbey 2c799fb70a Revert "Add mechanism to control hbase cleaner behavior" 
This reverts commit ef052521cd.

Bad commit message.
 2017-02-01 22:11:48 -06:00
Ajay Jadhav ef052521cd Add mechanism to control hbase cleaner behavior 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-02-01 19:33:06 -08:00
anastas aa5d9a9ad3 HBASE-17492 Fix the compacting memstore part in hbase shell ruby script 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-23 21:27:44 -08:00
Jan Hentschel 55a1aa1e73 HBASE-10699 Set capacity on ArrayList where possible and use isEmpty instead of size() == 0 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-20 22:58:20 -08:00
Michael Stack 31f3e8f833 HBASE-17496 RSGroup shell commands:get_server_rsgroup don't work and commands display an incorrect result size (Guangxu Cheng) 2017-01-20 09:20:31 -08:00
Yu Li f92a14ade6 HBASE-14061 Support CF-level Storage Policy 2017-01-09 09:52:58 +08:00
Guanghao Zhang 0e48665641 HBASE-17336 get/update replication peer config requests should be routed through master 2016-12-30 10:12:47 +08:00
Guanghao Zhang 8da7366fc2 HBASE-17348 Remove the unused hbase.replication from javadoc/comment/book completely 2016-12-25 08:46:29 +08:00
eshcar a9310436d5 HBASE-17294: External configuration for memory compaction 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-12-13 17:16:00 -08:00
tedyu 2333596279 HBASE-17296 Provide per peer throttling for replication (Guanghao Zhang) 2016-12-13 04:20:20 -08:00
Michael Stack 0b0e857465 HBASE-17160 Undo unnecessary inter-module dependency; spark to hbase-it and hbase-it to shell; ADDENDUM 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-11-23 11:45:37 -08:00
Esteban Gutierrez 5bc518b387 HBASE-16774 [shell] Add coverage to TestShell when ZooKeeper is not reachable 2016-10-18 09:08:33 -07:00
tedyu 76e7c05474 HBASE-16274 Add more peer tests to replication_admin_test (Guanghao Zhang) 2016-10-15 07:30:52 -07:00
tedyu f5abe17bc6 HBASE-16666 Add append and remove peer namespaces cmds for replication (Guanghao Zhang) 2016-10-09 21:22:50 -07:00
Apekshit Sharma 5f7e642fed HBASE-16682 Fix Shell tests failure. NoClassDefFoundError for MiniKdc. 
Change-Id: I75b5dde104f716f173a5a41d43f7b4c2b8ba1f39
 2016-09-26 02:05:21 -07:00
Jonathan M Hsieh a90d433a2c HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:45:03 -07:00
Jerry He edc0ef3fe4 HBASE-16598 Enable zookeeper useMulti always and clean up in HBase code 2016-09-17 16:51:26 -07:00
Enis Soztutar 1a1003a482 HBASE-16447 Replication by namespaces config in peer (Guanghao Zhang) 2016-09-16 11:47:42 -07:00
chenheng 1d6c90b496 HBASE-16381 Shell deleteall command should support row key prefixes (Yi Liang) 2016-09-15 19:20:29 +08:00
Umesh Agashe 422734e73d HBASE-15297 Correct handling of namespace existence checks in shell. 
Changes namespace_exists? method in SecurityAdmin ruby code to catch NamespaceNotFoundException
and modified Admin.java file to document the exception.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-09-12 23:29:42 -07:00
Geoffrey e1e0637200 HBASE-16576 Shell add_peer doesn't allow setting cluster_key for custom endpoints 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2016-09-09 14:54:20 -07:00
anoopsamjohn 32c21f4594 HBASE-14921 In-Memory MemStore Flush and Compaction : Memory optimizations. (Anastasia) 2016-08-24 09:25:21 +05:30
Stephen Yuan Jiang cd0b85e0a8 Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue) 2016-07-22 20:09:03 -07:00
Apekshit Sharma 28802decc8 HBASE-16227 [Shell] Column value formatter not working in scans. 
Tested : manually using shell.

Change-Id: I9eef7efa68393a762ec872447f8e36dfc6d6f1bc
 2016-07-13 14:14:06 -07:00
tedyu 7227c27fe8 HBASE-16184 Shell test fails due to rLoadSink being nil (Phil Yang) 2016-07-12 00:15:26 -07:00
Apekshit Sharma a396ae773a HBASE-16044 Fix 'hbase shell' output parsing in graceful_stop.sh 
Change-Id: I94b2f665105837d31281be66d620b6152c3bc9d1
 2016-07-11 11:28:33 -07:00
tedyu ffd3987c54 HBASE-16147 Add ruby wrapper for getting compaction state 2016-06-30 11:01:54 -07:00
chenheng e05f527991 HBASE-16111 Truncate preserve shell command is broken 2016-06-27 15:06:51 +08:00
chenheng 68c1b34dbc HBASE-16040 Remove configuration "hbase.replication" 2016-06-24 10:41:35 +08:00
Matteo Bertozzi d9463bcce0 HBASE-15989 Remove hbase.online.schema.update.enable 2016-06-08 13:09:31 -07:00
Apekshit Sharma 15c03fd1c9 HBASE-15965 
- Testing by executing a command will cover the exact path users will trigger, so its better then directly calling library functions in tests. Changing the tests to use @shell.command(:<command>, args) to execute them like it's a command coming from shell.

Norm change:
Commands should print the output user would like to see, but in the end, should also return the relevant value. This way:
- Tests can use returned value to check that functionality works
- Tests can capture stdout to assert particular kind of output user should see.
- We do not print the return value in interactive mode and keep the output clean. See Shell.command() function.

Bugs found due to this change:
- Uncovered bug in major_compact.rb with this approach. It was calling admin.majorCompact() which doesn't exist but our tests didn't catch it since they directly tested admin.major_compact()
- Enabled TestReplicationShell. If it's bad, flaky infra will take care of it.

Change-Id: I5d8af16bf477a79a2f526a5bf11c245b02b7d276
 2016-06-06 17:50:22 -07:00
Apekshit Sharma 70762faa98 HBASE-15849 Simplify the way we handle runtime of commands. 
Functions format_simple_command and format_and_return_simple_command are used to print runtimes right now. They are called from within every single command and use Ruby's 'yield' magic.  Instead, we can simplify it using 'command_safe' function. Since command_safe wraps all commands, we can simply time before and after we call individual command.
If a command only wants to time a part of its logic, it can set instance variables start_time and end_time accordingly which is far more simpler to understand and work with than 'yield'.

Change-Id: Ibfacf3593175af22fc4f7d80896dd2f6d7c5dde3
 2016-06-03 15:50:03 -07:00
Apekshit bdb46f01b9 HBASE-15845 Changes: 
- Renaming hbase.rb to hbase_constants.rb because there are two hbase.rb files right now which is confusing.
- Remove omnipresence of formatter object since it is kind of a use-and-throw class. Commands should create
  an instance, use it to format the output and discard it.
- Some refactoring

Change-Id: If9ea9873904e0a39d199a6aa10e23864b86a2f09
 2016-06-03 13:37:38 -07:00
tedyu 72d3f2a868 HBASE-15939 Two shell test failures on master (Talat and Ted) 2016-06-02 15:44:18 -07:00
tedyu a0f49c9884 HBASE-15858 Some region server group shell commands don't work 2016-06-01 21:13:33 -07:00
tedyu cbb95cd3a9 HBASE-15932 Shell test fails due to uninitialized constant 2016-06-01 10:35:00 -07:00
tedyu 015f2ef629 HBASE-15923 Shell rows counter test fails 2016-05-31 14:21:32 -07:00
Daniel Vimont e6d613de70 HBASE-15835 - Prevent HBaseTestingUtility#startMiniCluster from throwing _HMasterAddress already in use_ RuntimeException when another HBase thread is running 
Signed-off-by: stack <stack@apache.org>
 2016-05-30 20:05:19 -07:00
Enis Soztutar b89d88a193 HBASE-10358 Shell changes for setting consistency per request (yi liang) 2016-05-26 17:01:03 -07:00
stack 2515b0974d HBASE-4368 Expose processlist in shell (per regionserver and perhaps by cluster) (Talat Uyarer) 2016-05-23 15:49:17 -07:00
Jerry He 56e4b85d06 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:06:05 -07:00
eshcar a27504c701 HBASE-14920: Compacting memstore 
Signed-off-by: stack <stack@apache.org>
 2016-05-20 03:41:43 -07:00
Matteo Bertozzi 5ac54e6abb HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:48:26 -07:00
tedyu 838c306c0a HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 11:01:26 -07:00
tedyu 3b74b6f329 HBASE-15799 Two Shell 'close_region' Example Syntaxes Don't Work (Matt Warhaftig) 2016-05-09 20:58:55 -07:00
tedyu 387c7e6b08 HBASE-15782 TestShell fails due to some moved types 2016-05-06 06:11:12 -07:00
Li Fanxi e512c40ad5 HBASE-15680 Examples in shell help message for TIMERANGE scanner specifications should use milliseconds instead of seconds 
Signed-off-by: stack <stack@apache.org>
 2016-04-26 12:00:06 -07:00
tedyu ef47e1b68c HBASE-15641 Shell "alter" should do a single modifyTable operation (Matt Warhaftig) 2016-04-21 08:20:06 -07:00
chenheng a9f1c4a871 HBASE-15406 Split / merge switch left disabled after early termination of hbck 2016-04-15 14:09:52 +08:00
tedyu e0f31ba6e6 HBASE-15507 Online modification of enabled ReplicationPeerConfig (Geoffrey Jacoby) 2016-04-08 21:26:31 -07:00
Enis Soztutar bcc4444420 HBASE-15567 TestReplicationShell broken by recent replication changes (Geoffrey Jacoby) 2016-03-31 11:37:09 -07:00
chenheng 7f39baf0f4 HBASE-11393 Replication TableCfs should be a PB object rather than a string 2016-03-29 10:25:29 +08:00
tedyu 448ac5b37c HBASE-12940 Expose listPeerConfigs and getPeerConfig to the HBase shell (Geoffrey Jacoby) 2016-03-16 18:42:52 -07:00
Enis Soztutar ca816f0780 HBASE-6721 RegionServer Group based Assignment (Francis Liu) 2016-03-14 18:28:50 -07:00
chenheng 99955a3240 HBASE-15128 Disable region splits and merges switch in master 2016-02-27 08:36:59 +08:00
chenheng bf4fcc30c6 Revert "HBASE-15128 Disable region splits and merges switch in master" 
This reverts commit 24d481c580.
 2016-02-26 08:52:12 +08:00