Commit Graph

18321 Commits

Author SHA1 Message Date
Bryan Beaudreault d13cc385bf HBASE-26546 hbase-shaded-client missing required thirdparty classes under hadoop 3.3.1 (#3926)
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit cd45cadbc1)
2022-02-22 00:47:15 -06:00
Bryan Beaudreault 5f11bc4e50 HBASE-26703 Allow configuration of IPC queue balancer (#4063)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
2022-02-18 17:55:06 -08:00
Bryan Beaudreault 1fb4ee37be HBASE-26727 Fix CallDroppedException reporting (#4088)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 17:27:59 -08:00
Richard Marscher 2be2072704 HBASE-26576 Allow pluggable queue to be used with the fast path executor or normal balanced executor (#3944)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 10:26:35 -08:00
Yutong Xiao 932bf591b3 HBASE-26659 The ByteBuffer of metadata in RAMQueueEntry in BucketCache could be reused. (#4026)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-19 00:42:04 +08:00
chenglei af338d2c99
HBASE-26712 Balancer encounters NPE in rare case (#4112) (#4092)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-02-16 12:15:12 +05:30
Xiaolin Ha 42bb0afaf8 HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate (#4105)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-16 11:23:48 +08:00
Andrew Purtell a19dcc3be0 HBASE-26730 Extend hbase shell 'status' command to support an option 'tasks' (#4094)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-02-15 18:39:03 -08:00
Xiaolin Ha 40882b5681 HBASE-26434 Do compact when all L0 files are expired (#3830)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 22:39:14 +08:00
Yutong Xiao 3803b8be2c HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down (#4073)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 20:31:19 +08:00
Duo Zhang 9282c8e796 HBASE-26749 Migrate HBase main pre commit job to ci-hbase (#4107)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-02-11 11:44:28 +08:00
Duo Zhang e77799b2be HBASE-26747 Addendum use python2 directly in Jenkinsfile and Jenkinsfile_Github 2022-02-11 00:21:40 +08:00
Nick Dimiduk 600a6a8faf HBASE-26521 Name RPC spans as `$package.$service/$method` (#4024)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-10 12:58:01 +01:00
Peter Somogyi 2d25613e34 HBASE-26741 Incorrect exception handling in shell (#4101)
Override eval_input in HIRB to modify exception handling logic.

Signed-off-by: Josh Elser <elserj@apache.org>
2022-02-10 12:24:06 +01:00
Duo Zhang b64a507340 HBASE-26709 Ban the usage of junit 3 TestCase (#4065)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-02-10 01:06:21 +08:00
Duo Zhang 12002e6a79 HBASE-26724 Backport the UT changes in HBASE-24510 to branch-2.x (#4081)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-02-10 00:53:14 +08:00
Duo Zhang 4e15101fa1 HBASE-26747 Addendum remove python from Jenkinsfile and Jenkinsfile_Github 2022-02-09 21:42:56 +08:00
Duo Zhang 64a7c7b9a0 HBASE-26747 Use python2 instead of python in our python scripts (#4102)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-02-09 16:31:31 +08:00
Duo Zhang b7b704abc4 HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase (#4053)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-02-09 16:31:23 +08:00
Rushabh Shah 409b175216 HBASE-26702 Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram. (#4098)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-09 10:24:19 +08:00
Andrew Purtell d091751ab0 HBASE-26726 Allow disable of region warmup before graceful move (#4086)
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2022-02-01 15:39:56 -08:00
Nick Dimiduk ec9865947c HBASE-26472 Adhere to semantic conventions regarding table data operations (addendum)
Ensure table data operations emit one and only one span.
2022-02-01 13:53:14 -08:00
Nick Dimiduk 08b0c3c348
HBASE-26473 Introduce db.hbase.container_operations span attribute
For batch operations, collect and annotate the associated span with the set of all operations
contained in the batch.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-31 16:55:22 -08:00
Bryan Beaudreault 59d60fd421 HBASE-26713 Default to LATEST_TIMESTAMP if no timestamp sent along on Increment/Append (#4075)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-01-28 12:57:59 -08:00
Duo Zhang f7f1a48c8f Revert "HBASE-26473 Introduce `db.hbase.container_operations` span attribute"
This reverts commit 429f242294.
2022-01-28 21:33:42 +08:00
chenglei 4610c75489 HBASE-26679 Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would stuck (#4039)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-28 16:18:53 +08:00
Duo Zhang 9f1f705686 HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-27 17:33:37 -08:00
Andrew Purtell 86e51da2b8 HBASE-26719 Remove 'patch' file added as part of commit for HBASE-25973
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-01-27 16:47:39 -08:00
Nick Dimiduk 429f242294 HBASE-26473 Introduce `db.hbase.container_operations` span attribute
For batch operations, collect and annotate the associated span with the set of all operations
contained in the batch.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-27 08:15:42 -08:00
Nick Dimiduk 4d86d3be08 HBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969)
The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-26 09:00:52 -08:00
Duo Zhang 7e8422304d Revert "HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)"
This reverts commit 0771c04a32.
2022-01-26 13:40:23 +08:00
Yutong Xiao 0771c04a32 HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-25 15:03:35 +08:00
Nick Dimiduk 4aa31ce0cd HBASE-26474 Implement connection-level attributes (addendum)
Addressing additional comments raised in branch-2 backport PR #4014
2022-01-24 14:20:08 -08:00
Nick Dimiduk 6d739de5be HBASE-26520 Remove use of `db.hbase.namespance` tracing attribute (#4015)
The HBase-specific attribute `db.hbase.namespace` has been deprecated in favor of the generic
`db.name`. See also https://github.com/open-telemetry/opentelemetry-specification/issues/1760

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-01-24 12:46:49 -08:00
Peter Somogyi 2c82cf3207 HBASE-26689 Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider (#4049)
Duo Zhang <zhangduo@apache.org>
2022-01-20 15:05:45 +01:00
Nick Dimiduk 0ee15e0865 HBASE-26474 Implement connection-level attributes (#4014)
Add support for `db.system`, `db.connection_string`, `db.user`.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Co-authored-by: Josh Elser <josh.elser@gmail.com>
2022-01-18 16:09:08 -08:00
Wellington Ramos Chevreuil 5d14589314 HBASE-26662 User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is true (#4029)
Signed-off-by: Josh Elser <elserj@apache.org>
Signrd-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-18 12:54:44 +00:00
Yutong Xiao 540fbe51b0
HBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor (#4036)
Signed-off-by: Reid Chan <reidchan@apache.org>
2022-01-18 11:13:13 +08:00
xianjingfeng b840ed68f5 HBASE-26671 Misspellings of hbck usage (#4033)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-16 16:34:34 +08:00
Sean Busbey 2033fc94d1 HBASE-26469 correct HBase shell exit behavior to match code passed to exit (#4018)
* refactors how we handle running the passed in initialization script to make use of IRB sessions
  directly instead of reimplementing things ourselves
* simplify how we initialize our IRB config
* insert a shim for capturing exit codes passed via user calls to exit
* make use of user provided exit code unless we're reading stdin in interactive mode

This changes the exit code of the shell
* a 0 return code, or no return code, passed to a call to exit from stdin in non-interactive mode
  will now exit cleanly. in prior versions this would have exitted with an error and non-zero exit
  code.
* for other combinations of passing in an initilization script or reading from stdin with using the
  non-interactive flag, the exit code being 0 or non-0 should now line up with releases prior to
  2.4.z, which is a change in behavior compared to 2.4.z.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 821e6a36cc)
2022-01-14 20:57:36 -06:00
Viraj Jasani d3680d3148
HBASE-26657 ProfileServlet should move the output location to hbase specific directory (#4022)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-01-11 16:02:47 +05:30
Nick Dimiduk 9ef7f5977e HBASE-26616 Refactor code related to ZooKeeper authentication (#3973)
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 16:08:17 -08:00
Xiaolin Ha 6a060adc8b HBASE-26397 Display the excluded datanodes on regionserver UI (#3990)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 13:03:49 +08:00
Sean Busbey 65c5ea63e8 HBASE-26543 correct parsing of shell args with GetoptLong (#4000)
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit dda337fd9e)
2022-01-07 22:23:23 -06:00
Duo Zhang 2abd09f6ac HBASE-26643 LoadBalancer should not return empty map (#4005)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-08 00:39:59 +08:00
huaxiangsun a6b0e2dc85
HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008) (#4011)
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 11:54:53 -08:00
Xiaolin Ha 76bc412fc4 HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 11:48:50 +08:00
Xiaolin Ha 2b05e68ae1 HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver (#4001)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 16:33:59 +08:00
chenglei e50f4991da HBASE-26567 Remove IndexType from ChunkCreator (#3947)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:08:29 +08:00
fcb-xiaobo b77fb0f213 HBASE-26631 Upgrade junit to 4.13.2 (#3997)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:01:15 +08:00