Commit Graph

580 Commits

Author SHA1 Message Date
Sean Busbey d1149f7e20
HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)
- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-06-05 00:15:59 -05:00
litao ac8b51718f
HBASE-27036 Displays the number of decommissioned region server for status command (#4431)
add decommissionedServers to cluster metric

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org
2022-06-02 23:51:39 +08:00
Andrew Purtell 9fcaf854ed
HBASE-26854 Shell startup logs a bunch of noise (#4469)
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:00:41 -07:00
litao c7eb30d910
HBASE-27018 Add a tool command list_liveservers (#4416)
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-19 15:47:16 -07:00
Duo Zhang 9c8c9e7fbf HBASE-26899 Run spotless:apply
Closes #4312
2022-05-01 22:15:09 +08:00
xicm ec78c2677b
HBASE-25694 Improve the shell's 'status replication' command output (#4272)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-28 23:10:46 +08:00
liangxs 41ae90d63f
HBASE-26964: Fix MobCompactPartitionPolicy import in admin.rb (#4362)
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-04-21 23:12:47 +05:30
eomiks ea9bc92ce2
HBASE-26895 on hbase shell, 'delete/deleteall' for a columnfamily is not working (#4283)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-12 20:46:21 +08:00
Peter Somogyi 1d8a5bf0e3
HBASE-26880 Misspelling commands in hbase shell will crash the shell (#4325)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-11 10:01:24 +02:00
Istvan Toth 19da537a7b
HBASE-26896 list_quota_snapshots fails with ‘ERROR NameError: uninitialized constant Shell::Commands::ListQuotaSnapshots::TABLE’ (#4284)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-28 20:46:16 +02:00
xicm b9c59438a4
Hbase 26275 update error message when executing deleteall with ROWPREFIXFILTER in meta table (#4205)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 20:02:38 +08:00
Duo Zhang cc2c22072f
HBASE-26831 TestAdminShell2 is failing because of we referenced a deleted method (#4217)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-15 14:26:07 +08:00
Niels Basjes f6b74b3083
HBASE-26762 Un-Deprecate and improve documentation for Scan#setRowPrefixFilter (#4119)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-02 20:19:13 +08:00
Peter Somogyi 1f2ddbe7cd
HBASE-26772 Shell suspended in background (#4137)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-03-01 11:52:07 +01:00
LiangJun He 55ea2ef3aa
HBASE-26673 Implement a shell command for change SFT implementation (#4113)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-19 23:00:04 +08:00
Andrew Purtell 407c6e7b22
HBASE-26730 Extend hbase shell 'status' command to support an option 'tasks' (#4095)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-02-15 18:38:18 -08:00
Peter Somogyi 85fadfde26
HBASE-26741 Incorrect exception handling in shell (#4101)
Override eval_input in HIRB to modify exception handling logic.

Signed-off-by: Josh Elser <elserj@apache.org>
2022-02-10 12:14:46 +01:00
Nick Dimiduk 625d610bcc
HBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969)
The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-24 11:33:18 -08:00
Sean Busbey 821e6a36cc HBASE-26469 correct HBase shell exit behavior to match code passed to exit (#4018)
* refactors how we handle running the passed in initialization script to make use of IRB sessions
  directly instead of reimplementing things ourselves
* simplify how we initialize our IRB config
* insert a shim for capturing exit codes passed via user calls to exit
* make use of user provided exit code unless we're reading stdin in interactive mode

This changes the exit code of the shell
* a 0 return code, or no return code, passed to a call to exit from stdin in non-interactive mode
  will now exit cleanly. in prior versions this would have exitted with an error and non-zero exit
  code.
* for other combinations of passing in an initilization script or reading from stdin with using the
  non-interactive flag, the exit code being 0 or non-0 should now line up with releases prior to
  2.4.z, which is a change in behavior compared to 2.4.z.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-01-14 16:31:37 -06:00
Sean Busbey dda337fd9e HBASE-26543 correct parsing of shell args with GetoptLong (#4000)
Signed-off-by: Mike Drob <mdrob@apache.org>
2022-01-07 21:59:20 -06:00
Duo Zhang 3f59f21be0
HBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master (#3978)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-24 14:20:32 +08:00
BukrosSzabolcs 771e552cf4 HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot
Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
Duo Zhang 8bca21b47d
HBASE-26558 Set version as 3.0.0-alpha-2 in master in prep for first RC of 3.0.0-alpha-2 (#3935)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-12-11 20:52:35 +08:00
Tak Lon (Stephen) Wu 19b0b2e8fc
HBASE-26524 Support remove coprocessor by class name via alter table command (#3902)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-01 14:47:59 -08:00
Istvan Toth 7845d006e6 HBASE-26512 Make timestamp format configurable in HBase shell scan output
Signed-off-by: Josh Elser <elserj@apache.org
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-01 14:15:46 -05:00
mkkumar e1ce414b1b
HBASE-26432 enabled tracing from shell (#3824)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-11-12 22:49:34 +08:00
xicm 7832518d8a
HBASE-26312 Shell scan fails with timestamp (#3734)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-09 10:28:25 +08:00
Bryan Beaudreault a15e94a47f HBASE-26147 Add a dry run mode to the balancer, where moves are calculated but not actually executed
Closes #3630

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org
2021-09-01 18:01:13 -04:00
Duo Zhang 16721239e7
HBASE-26100 Set version as 3.0.0-alpha-2-SNAPSHOT in master (#3508)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-20 23:04:08 +08:00
Duo Zhang d30cc27097
HBASE-26081 Copy HBTU to hbase-testing-util, rename the HBTU related classes in hbase-server and mark them as IA.LimitedPrivate (#3478)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-19 09:29:08 +08:00
Duo Zhang 5118321ec9
HBASE-26059 Set version as 3.0.0-alpha-1 in master in prep for first RC of 3.0.0-alpha-1 (#3453)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-07-02 07:50:41 +08:00
Rahul Kumar 560297d189
HBASE-25651 NORMALIZER_TARGET_REGION_SIZE needs a unit in its name (#3063)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Baiqiang Zhao <ZhaoBQ>
2021-05-28 19:32:22 +08:00
Baiqiang Zhao a1177b3e91
HBASE-25682 Add a new command to update the configuration of all RSs in a RSGroup (#3080)
* HBASE-25682 Add a new command to update the configuration of all RSs in a RSGroup

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2021-05-21 22:49:25 +05:30
GeorryHuang 00fec24c90
HBASE-25790 NamedQueue 'BalancerRejection' for recent history of balancer skipping (#3182)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-02 21:30:48 +05:30
Duo Zhang 302d9ea8b8 HBASE-25373 Remove HTrace completely in code base and try to make use of OpenTelemetry
Signed-off-by: stack <stack@apache.org>
2021-04-25 09:23:23 +08:00
Andrew Purtell 9895b2dfdf
HBASE-25756 Support alternate compression for major and minor compactions (#3142)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-04-23 15:45:26 -07:00
Duo Zhang ba3610d097
HBASE-19577 Use log4j2 instead of log4j for logging (#1708)
Signed-off-by: stack <stack@apache.org>
2021-03-20 09:21:25 +08:00
Wellington Ramos Chevreuil 373dc7788d
HBASE-25548 Optionally allow snapshots to preserve cluster's max file… (#2923)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-03-10 10:20:10 +00:00
申胜利 190c253c4e
HBASE-25609 There is a problem with the SPLITS_FILE in the HBase shell statement(#2992)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-03-07 22:01:01 +08:00
Duo Zhang ed2693f123
HBASE-25602 Fix broken TestReplicationShell on master (#2981)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-02-25 08:39:34 +08:00
Laxman Goswami f09e420e5c
HBASE-24772 Use GetoptLong or OptionParser in hbase-shell (#2918)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
2021-02-08 21:14:23 -08:00
Baiqiang Zhao ca672aceee
HBASE-25519 BLOCKSIZE needs to support pretty print (#2894)
Signed-off-by: stack <stack@apache.org>
2021-02-08 13:22:45 -08:00
Baiqiang Zhao e8775060dd
HBASE-25533 The metadata of the table and family should not be an empty string (#2906)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-01-29 20:57:31 +05:30
xijiawen 6c3861f65d
HBASE-25496 add get_namespace_rsgroup command (#2874)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-01-19 14:51:01 +05:30
xijiawen 9e9bec24d2
HBASE-25497 move_namespaces_rsgroup should change hbase.rsgroup.name … (#2875)
* HBASE-25497 move_namespaces_rsgroup should change hbase.rsgroup.name config in NamespaceDescriptor

Signed-off-by: Zheng Wang <wangzheng@apache.org>
2021-01-18 18:57:02 +08:00
xijiawen 4caab90aa7
HBASE-25495 fix comment error of admin.rb (#2873)
Co-authored-by: stevenxi <stevenxi@tencent.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2021-01-13 11:26:32 -08:00
Gary Wang 90ff550000
HBASE-25463 fix comment error of append.rb (#2845)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-01-05 20:09:19 +05:30
Baiqiang Zhao 8ecfcede96
HBASE-25439 Add BYTE unit in PrettyPrinter.Unit (#2812)
Signed-off-by: stack <stack@apache.org>
2021-01-03 09:34:00 -08:00
Mate Szalay-Beko 451a4b06b1 HBASE-25263 Various improvements of column family encryption
This PR is a follow-up of HBASE-25181 (#2539), where several issues were
discussed on the PR:

1. Currently we use PBKDF2WithHmacSHA1 key generation algorithm to generate a
secret key for HFile / WalFile encryption, when the user is defining a string
encryption key in the hbase shell. This algorithm is not secure enough and
not allowed in certain environments (e.g. on FIPS compliant clusters). We are
changing it to PBKDF2WithHmacSHA384. It will not break backward-compatibility,
as even the tables created by the shell using the new algorithm will be able
to load (e.g. during bulkload / replication) the HFiles serialized with the
key generated by an old algorithm, as the HFiles themselves already contain
the key necessary for their decryption.

Smaller issues fixed by this commit:

2. Improve the documentation e.g. with the changes introduced by HBASE-25181
and also by some points discussed on the Jira ticket of HBASE-25263.

3. In EncryptionUtil.createEncryptionContext the various encryption config
checks should throw IllegalStateExceptions instead of RuntimeExceptions.

4. Test cases in TestEncryptionTest.java should be broken down into smaller
tests.

5. TestEncryptionDisabled.java should use ExpectedException JUnit rule to
validate exceptions.

closes #2676

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-11-26 16:44:34 +01:00
Josh Elser 1c09f24b2d HBASE-25278 Add CACHE_BLOCKS option to count shell command
Expose an argument on the `count` command which is passed to the
`setCacheBlocks` method on the Scan which the count command uses.

This is a quick and dirty approach to read all of the blocks for a table
into the block cache.

* Raise an error when the value isn't a boolean or the expected string

Closes #2650

Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-11-24 10:04:18 -05:00