Commit Graph

18981 Commits

Author SHA1 Message Date
Nick Dimiduk 625d610bcc
HBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969)
The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-24 11:33:18 -08:00
Duo Zhang 97f3c1cf7f
HBASE-26675 Data race on Compactor.writer (#4035)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-01-24 19:45:50 +08:00
Duo Zhang 6cd092b685 Revert "HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase (#4053)"
This reverts commit a42d6dbbf7.
2022-01-22 19:35:44 +08:00
Duo Zhang a42d6dbbf7
HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase (#4053)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-22 14:16:34 +08:00
sunyuting1 1d2b8a033d
HBASE-26661 Remove deprecated methods in MasterObserver (#4031)
Signrd-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-19 19:25:06 +08:00
Duo Zhang d63ca4febe
HBASE-26674 Should modify filesCompacting under storeWriteLock (#4040)
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-19 13:59:35 +08:00
Wellington Ramos Chevreuil 4a94cfccc9
HBASE-26662 User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is true (#4029)
Signed-off-by: Josh Elser <elserj@apache.org>
Signrd-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-18 12:32:27 +00:00
Duo Zhang c9bcd87b34
HBASE-26654 ModifyTableDescriptorProcedure shoud load TableDescriptor while executing (#4034)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-16 16:25:28 +08:00
xianjingfeng bc5a5af1bc
HBASE-26671 Misspellings of hbck usage (#4033)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-16 16:23:23 +08:00
Sean Busbey 821e6a36cc HBASE-26469 correct HBase shell exit behavior to match code passed to exit (#4018)
* refactors how we handle running the passed in initialization script to make use of IRB sessions
  directly instead of reimplementing things ourselves
* simplify how we initialize our IRB config
* insert a shim for capturing exit codes passed via user calls to exit
* make use of user provided exit code unless we're reading stdin in interactive mode

This changes the exit code of the shell
* a 0 return code, or no return code, passed to a call to exit from stdin in non-interactive mode
  will now exit cleanly. in prior versions this would have exitted with an error and non-zero exit
  code.
* for other combinations of passing in an initilization script or reading from stdin with using the
  non-interactive flag, the exit code being 0 or non-0 should now line up with releases prior to
  2.4.z, which is a change in behavior compared to 2.4.z.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-01-14 16:31:37 -06:00
Yutong Xiao 3a14cfc6f9
HBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor (#3929)
Signed-off-by: Reid Chan <reidchan@apache.org>
2022-01-13 11:11:12 +08:00
Viraj Jasani 1388ca3270
HBASE-26657 ProfileServlet should move the output location to hbase specific directory (#4022)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-01-11 15:59:44 +05:30
Nick Dimiduk 9f47ab568a
HBASE-26520 Remove use of `db.hbase.namespance` tracing attribute (#4015)
The HBase-specific attribute `db.hbase.namespace` has been deprecated in favor of the generic
`db.name`. See also https://github.com/open-telemetry/opentelemetry-specification/issues/1760

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-01-10 17:02:50 -08:00
Xiaolin Ha 803afee777
HBASE-26397 Display the excluded datanodes on regionserver UI (#3990)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 12:53:05 +08:00
Duo Zhang 3ec3df5887
HBASE-26006 Update ref guide about the 2.4.x release line (#3992)
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Reviewed-by: Nick Dimiduk <ndimiduk@apache.org>
2022-01-09 00:29:25 +08:00
Sean Busbey dda337fd9e HBASE-26543 correct parsing of shell args with GetoptLong (#4000)
Signed-off-by: Mike Drob <mdrob@apache.org>
2022-01-07 21:59:20 -06:00
Duo Zhang 24b9876edf HBASE-26643 Addendum align the test code with branch-2 2022-01-08 00:39:06 +08:00
Duo Zhang 69520ad199 HBASE-26643 Addendum align the test code with branch-2 2022-01-08 00:37:25 +08:00
Duo Zhang 443bf30a5d
HBASE-26643 LoadBalancer should not return empty map (#4005)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-07 23:50:37 +08:00
Duo Zhang 436fb7875c
HBASE-26586 Should not rely on the global config when setting SFT implementation for a table while upgrading (#4006)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-07 23:39:18 +08:00
Duo Zhang 47983cf790
HBASE-26639 The implementation of TestMergesSplitsAddToTracker is problematic (#4010)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-07 23:05:47 +08:00
meiyi f1e263a8fd
HBASE-26646 WALPlayer should obtain token from filesystem (#4003)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-07 17:37:29 +08:00
Nick Dimiduk 5e263dac38
HBASE-26616 Refactor code related to ZooKeeper authentication (#3973)
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 17:04:15 -08:00
fcb-xiaobo 7972b2ebbb
HBASE-26632 Should use downloads.apache.org for checksum, signature, changes.md and releasenote.md (#4002)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 20:34:52 +08:00
Nick Dimiduk 5cb7ed8005
HBASE-26474 Implement connection-level attributes (#3952)
Add support for `db.system`, `db.connection_string`, `db.user`.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 15:32:12 -08:00
Wellington Ramos Chevreuil baeb51ff8a
HBASE-26585 Add SFT configuration to META table descriptor when creating META (#3998)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-05 12:20:07 +00:00
Xiaolin Ha ce2bbaf30a
HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver (#3946)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 11:10:16 +08:00
chenglei 70cb9b0ba9
HBASE-26567 Remove IndexType from ChunkCreator (#3947)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:05:54 +08:00
fcb-xiaobo 39a8e3b835
HBASE-26631 Upgrade junit to 4.13.2 (#3997)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-04 23:58:06 +08:00
xiaozhang0319 1043337314
HBASE-26634 Upgrade log4j to 2.17.1 (#3996)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-04 23:56:56 +08:00
Duo Zhang e96df8bf40
HBASE-26641 Split TestMasterFailoverWithProcedures (#3994)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-03 00:35:14 +08:00
Yutong Xiao c811acdcab
HBASE-26629 Add expiration for long time vacant scanners in Thrift2 (#3984)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-02 21:19:31 +08:00
chenglei 1b8e577cc6
HBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl (#3983)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-01 20:50:52 +08:00
Yutong Xiao 96be585324
HBASE-26635 Optimize decodeNumeric in OrderedBytes (#3986)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-01 20:42:57 +08:00
Duo Zhang 9e469e4a2a HBASE-26540 Implement a tool to verify the lag of region replication (#3950)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 5ac76c1c00 HBASE-26539 The default rpc timeout 200ms is too small for replicating meta edits (#3919)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 1fdd0a4cfd HBASE-26538 Should find a way to clear the replication queue for a legacy region_replica_replication peer (#3918)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang a62e071bf7 HBASE-26486 Attach the new region replication framework design doc to git repo (#3884)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 2a43cc63be HBASE-26478 Update ref guide about the new region replication framework (#3885)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang fa37aed8f6 HBASE-26481 Consider rolling upgrading from old region replication framework (#3880)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Reviewed-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
林尚泉 9f6dfe6d3f HBASE-26417 Remove NoopReplicationQueueStorage (#3882)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 70259a2a4c HBASE-26456 Limit the size for one replicating (#3873)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 529c36e7ad HBASE-26416 Implement a new method for region replication instead of using replay (#3864)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 67306e74b1 HBASE-26457 Should not always clear all the failed replicas when getting a flush all request (#3850)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang a8d46db416 HBASE-26448 Make sure we do not flush a region too frequently (#3847)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 1b0d9ceaba HBASE-26449 The way we add or clear failedReplicas may have race (#3846)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-12-31 12:29:48 +08:00
Duo Zhang 0b29a7934a HBASE-26413 Limit the total size of buffered region replication entries (#3844)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 2ee18988e6 HBASE-26412 Handle sink failure in RegionReplicationSink (#3815)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 7286cc0035 HBASE-26407 Introduce a region replication sink for sinking WAL edits to secondary replicas directly (#3807)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang c14a76c4fd
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3987)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:08:01 +08:00