Commit Graph

18285 Commits

Author SHA1 Message Date
Duo Zhang 0bc8671cec HBASE-26747 Addendum remove python from Jenkinsfile and Jenkinsfile_Github 2022-02-09 21:41:10 +08:00
Duo Zhang 2dd3d604a8 HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase (#4053)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-02-09 16:20:42 +08:00
Duo Zhang 081ea2d6ea HBASE-26747 Use python2 instead of python in our python scripts (#4102)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-02-09 16:20:31 +08:00
Rushabh Shah 7882bc72fa
HBASE-26702 Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram. (#4098)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-09 10:08:34 +08:00
Tak Lon (Stephen) Wu f637a60bdd
HBASE-26729 Backport "HBASE-26714 Introduce path configuration for system coprocessors" to branch-2 (#4093)
- rename from HBaseCommonTestingUtil to HBaseCommonTestingUtility

Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-02-04 05:56:23 -08:00
Andrew Purtell 08c2c65957
HBASE-26726 Allow disable of region warmup before graceful move (#4086)
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2022-02-01 15:38:31 -08:00
Nick Dimiduk 94e126fecb HBASE-26472 Adhere to semantic conventions regarding table data operations (addendum)
Ensure table data operations emit one and only one span.
2022-02-01 11:45:25 -08:00
Nick Dimiduk 5e01534494
HBASE-26473 Introduce `db.hbase.container_operations` span attribute
For batch operations, collect and annotate the associated span with the set of all operations
contained in the batch.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-31 16:54:01 -08:00
Duo Zhang dffeb8e63e
HBASE-26587 Introduce a new Admin API to change SFT implementation (#4030) (#4080)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
2022-01-30 20:43:23 +08:00
Bryan Beaudreault 76eb1b091d
HBASE-26713 Default to LATEST_TIMESTAMP if no timestamp sent along on Increment/Append (#4075)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-01-28 12:55:51 -08:00
Duo Zhang 836f9be0cf Revert "HBASE-26473 Introduce `db.hbase.container_operations` span attribute"
This reverts commit 4748707499.
2022-01-28 21:33:13 +08:00
chenglei 4bdc052faa HBASE-26679 Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would stuck (#4039)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-28 14:02:02 +08:00
Andrew Purtell 6276700de9 HBASE-26719 Remove 'patch' file added as part of commit for HBASE-25973
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-01-27 16:47:17 -08:00
Nick Dimiduk 4748707499 HBASE-26473 Introduce `db.hbase.container_operations` span attribute
For batch operations, collect and annotate the associated span with the set of all operations
contained in the batch.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-27 08:15:20 -08:00
Duo Zhang a8b68c9b88 HBASE-26690 Modify FSTableDescriptors to not rely on renaming when writing TableDescriptor (#4054)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-27 13:38:11 +08:00
Duo Zhang 0ca2307b77 Revert "HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)"
This reverts commit 087bb1342a.
2022-01-26 13:39:58 +08:00
Nick Dimiduk d8085b43fc HBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969)
The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-25 09:08:35 -08:00
Duo Zhang 3021c58513 HBASE-26700 The way we bypass broken track file is not enough in StoreFileListFile (#4055)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-25 15:12:38 +08:00
Yutong Xiao 087bb1342a HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-25 15:03:28 +08:00
Nick Dimiduk 26d768243b HBASE-26474 Implement connection-level attributes (addendum)
Addressing additional comments raised in branch-2 backport PR #4014
2022-01-24 14:19:50 -08:00
Duo Zhang 5aa0fd2651 HBASE-26675 Data race on Compactor.writer (#4035)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-01-24 19:52:31 +08:00
Peter Somogyi d9a20630b0
HBASE-26689 Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider (#4049)
Duo Zhang <zhangduo@apache.org>
2022-01-20 15:04:31 +01:00
Nick Dimiduk c2b4ccdc1d HBASE-26520 Remove use of `db.hbase.namespance` tracing attribute (#4015)
The HBase-specific attribute `db.hbase.namespace` has been deprecated in favor of the generic
`db.name`. See also https://github.com/open-telemetry/opentelemetry-specification/issues/1760

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-01-19 10:20:02 -08:00
Duo Zhang 8fbc9a2606 HBASE-26674 Should modify filesCompacting under storeWriteLock (#4040)
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-19 16:53:00 +08:00
Nick Dimiduk d4f2b66a43
HBASE-26474 Implement connection-level attributes (#4014)
Add support for `db.system`, `db.connection_string`, `db.user`.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Co-authored-by: Josh Elser <josh.elser@gmail.com>
2022-01-18 12:29:35 -08:00
Wellington Ramos Chevreuil e3e42df7f2 HBASE-26662 User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is true (#4029)
Signed-off-by: Josh Elser <elserj@apache.org>
Signrd-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-18 12:35:14 +00:00
Duo Zhang f1dd865c35 HBASE-26654 ModifyTableDescriptorProcedure shoud load TableDescriptor while executing (#4034)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-16 16:44:08 +08:00
xianjingfeng cf4a8266eb HBASE-26671 Misspellings of hbck usage (#4033)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-16 16:34:24 +08:00
Yutong Xiao 933fcdbe7c
Backport HBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor to branch-2 (#4027)
Signed-off-by: Reid Chan <reidchan@apache.org>
2022-01-15 17:12:07 +08:00
Sean Busbey 7d930a563c HBASE-26469 correct HBase shell exit behavior to match code passed to exit (#4018)
* refactors how we handle running the passed in initialization script to make use of IRB sessions
  directly instead of reimplementing things ourselves
* simplify how we initialize our IRB config
* insert a shim for capturing exit codes passed via user calls to exit
* make use of user provided exit code unless we're reading stdin in interactive mode

This changes the exit code of the shell
* a 0 return code, or no return code, passed to a call to exit from stdin in non-interactive mode
  will now exit cleanly. in prior versions this would have exitted with an error and non-zero exit
  code.
* for other combinations of passing in an initilization script or reading from stdin with using the
  non-interactive flag, the exit code being 0 or non-0 should now line up with releases prior to
  2.4.z, which is a change in behavior compared to 2.4.z.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 821e6a36cc)
2022-01-14 16:46:25 -06:00
Viraj Jasani de84082391
HBASE-26657 ProfileServlet should move the output location to hbase specific directory (#4022)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-01-11 16:01:38 +05:30
Nick Dimiduk 2a42e8ed7a HBASE-26616 Refactor code related to ZooKeeper authentication (#3973)
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 10:11:10 -08:00
Xiaolin Ha d9fae5cb67 HBASE-26397 Display the excluded datanodes on regionserver UI (#3990)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 13:02:31 +08:00
Sean Busbey 9048507319 HBASE-26543 correct parsing of shell args with GetoptLong (#4000)
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit dda337fd9e)
2022-01-07 22:04:19 -06:00
Duo Zhang 2f0b5ae59b HBASE-26643 LoadBalancer should not return empty map (#4005)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-08 00:39:45 +08:00
Duo Zhang 6e1f5b7fec HBASE-26586 Should not rely on the global config when setting SFT implementation for a table while upgrading (#4006)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-07 23:47:38 +08:00
Duo Zhang 39c42c7dc2 HBASE-26639 The implementation of TestMergesSplitsAddToTracker is problematic (#4010)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-07 23:14:57 +08:00
meiyi d25fa46c8f HBASE-26646 WALPlayer should obtain token from filesystem (#4003)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-07 17:44:41 +08:00
huaxiangsun c897ce904a
HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008)
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 10:31:21 -08:00
Xiaolin Ha 7db277737a
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 11:45:38 +08:00
Wellington Ramos Chevreuil 755b3b4cb8 HBASE-26585 Add SFT configuration to META table descriptor when creating META (#3998)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(cherry picked from commit baeb51ff8a)
2022-01-05 13:08:31 +00:00
Xiaolin Ha b2e65b7ce3
HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver (#4001)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 15:26:49 +08:00
chenglei fb1c88adac HBASE-26567 Remove IndexType from ChunkCreator (#3947)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:08:16 +08:00
fcb-xiaobo 10eea31ca9 HBASE-26631 Upgrade junit to 4.13.2 (#3997)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:01:02 +08:00
BukrosSzabolcs 53285d8e2a HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot
Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-04 22:58:03 +08:00
Wellington Ramos Chevreuil 48e28917e0 HBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-04 22:58:03 +08:00
BukrosSzabolcs 68252e17cb HBASE-26271 Cleanup the broken store files under data directory (#3786)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-04 22:58:03 +08:00
GeorryHuang c4325ff088 HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-04 22:58:03 +08:00
Wellington Ramos Chevreuil 80b04229a2 HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-04 22:58:03 +08:00
Duo Zhang ca07fb869f HBASE-26386 Refactor StoreFileTracker implementations to expose the set method (#3774)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-01-04 22:58:03 +08:00