Commit Graph

18350 Commits

Author SHA1 Message Date
Nick Dimiduk ec9865947c HBASE-26472 Adhere to semantic conventions regarding table data operations (addendum)
Ensure table data operations emit one and only one span.
2022-02-01 13:53:14 -08:00
Nick Dimiduk 08b0c3c348
HBASE-26473 Introduce db.hbase.container_operations span attribute
For batch operations, collect and annotate the associated span with the set of all operations
contained in the batch.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-31 16:55:22 -08:00
Bryan Beaudreault 59d60fd421 HBASE-26713 Default to LATEST_TIMESTAMP if no timestamp sent along on Increment/Append (#4075)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-01-28 12:57:59 -08:00
Duo Zhang f7f1a48c8f Revert "HBASE-26473 Introduce `db.hbase.container_operations` span attribute"
This reverts commit 429f242294.
2022-01-28 21:33:42 +08:00
chenglei 4610c75489 HBASE-26679 Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would stuck (#4039)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-28 16:18:53 +08:00
Duo Zhang 9f1f705686 HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-27 17:33:37 -08:00
Andrew Purtell 86e51da2b8 HBASE-26719 Remove 'patch' file added as part of commit for HBASE-25973
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-01-27 16:47:39 -08:00
Nick Dimiduk 429f242294 HBASE-26473 Introduce `db.hbase.container_operations` span attribute
For batch operations, collect and annotate the associated span with the set of all operations
contained in the batch.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-27 08:15:42 -08:00
Nick Dimiduk 4d86d3be08 HBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969)
The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-26 09:00:52 -08:00
Duo Zhang 7e8422304d Revert "HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)"
This reverts commit 0771c04a32.
2022-01-26 13:40:23 +08:00
Yutong Xiao 0771c04a32 HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-25 15:03:35 +08:00
Nick Dimiduk 4aa31ce0cd HBASE-26474 Implement connection-level attributes (addendum)
Addressing additional comments raised in branch-2 backport PR #4014
2022-01-24 14:20:08 -08:00
Nick Dimiduk 6d739de5be HBASE-26520 Remove use of `db.hbase.namespance` tracing attribute (#4015)
The HBase-specific attribute `db.hbase.namespace` has been deprecated in favor of the generic
`db.name`. See also https://github.com/open-telemetry/opentelemetry-specification/issues/1760

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-01-24 12:46:49 -08:00
Peter Somogyi 2c82cf3207 HBASE-26689 Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider (#4049)
Duo Zhang <zhangduo@apache.org>
2022-01-20 15:05:45 +01:00
Nick Dimiduk 0ee15e0865 HBASE-26474 Implement connection-level attributes (#4014)
Add support for `db.system`, `db.connection_string`, `db.user`.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Co-authored-by: Josh Elser <josh.elser@gmail.com>
2022-01-18 16:09:08 -08:00
Wellington Ramos Chevreuil 5d14589314 HBASE-26662 User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is true (#4029)
Signed-off-by: Josh Elser <elserj@apache.org>
Signrd-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-18 12:54:44 +00:00
Yutong Xiao 540fbe51b0
HBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor (#4036)
Signed-off-by: Reid Chan <reidchan@apache.org>
2022-01-18 11:13:13 +08:00
xianjingfeng b840ed68f5 HBASE-26671 Misspellings of hbck usage (#4033)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-16 16:34:34 +08:00
Sean Busbey 2033fc94d1 HBASE-26469 correct HBase shell exit behavior to match code passed to exit (#4018)
* refactors how we handle running the passed in initialization script to make use of IRB sessions
  directly instead of reimplementing things ourselves
* simplify how we initialize our IRB config
* insert a shim for capturing exit codes passed via user calls to exit
* make use of user provided exit code unless we're reading stdin in interactive mode

This changes the exit code of the shell
* a 0 return code, or no return code, passed to a call to exit from stdin in non-interactive mode
  will now exit cleanly. in prior versions this would have exitted with an error and non-zero exit
  code.
* for other combinations of passing in an initilization script or reading from stdin with using the
  non-interactive flag, the exit code being 0 or non-0 should now line up with releases prior to
  2.4.z, which is a change in behavior compared to 2.4.z.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 821e6a36cc)
2022-01-14 20:57:36 -06:00
Viraj Jasani d3680d3148
HBASE-26657 ProfileServlet should move the output location to hbase specific directory (#4022)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-01-11 16:02:47 +05:30
Nick Dimiduk 9ef7f5977e HBASE-26616 Refactor code related to ZooKeeper authentication (#3973)
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 16:08:17 -08:00
Xiaolin Ha 6a060adc8b HBASE-26397 Display the excluded datanodes on regionserver UI (#3990)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 13:03:49 +08:00
Sean Busbey 65c5ea63e8 HBASE-26543 correct parsing of shell args with GetoptLong (#4000)
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit dda337fd9e)
2022-01-07 22:23:23 -06:00
Duo Zhang 2abd09f6ac HBASE-26643 LoadBalancer should not return empty map (#4005)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-08 00:39:59 +08:00
huaxiangsun a6b0e2dc85
HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008) (#4011)
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 11:54:53 -08:00
Xiaolin Ha 76bc412fc4 HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 11:48:50 +08:00
Xiaolin Ha 2b05e68ae1 HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver (#4001)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 16:33:59 +08:00
chenglei e50f4991da HBASE-26567 Remove IndexType from ChunkCreator (#3947)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:08:29 +08:00
fcb-xiaobo b77fb0f213 HBASE-26631 Upgrade junit to 4.13.2 (#3997)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:01:15 +08:00
Duo Zhang deec701475 HBASE-26641 Split TestMasterFailoverWithProcedures (#3994)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-03 00:41:36 +08:00
Yutong Xiao 9059f90ca3 HBASE-26629 Add expiration for long time vacant scanners in Thrift2 (#3984)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-02 21:27:46 +08:00
Duo Zhang 4d5fe404f4 HBASE-26638 Cherry-pick the ReflectionUtils improvements in HBASE-21515 to branch-2 (#3993)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-02 17:33:59 +08:00
chenglei efeec919de HBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl (#3983)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-01 20:57:36 +08:00
Yutong Xiao ede518c295 HBASE-26635 Optimize decodeNumeric in OrderedBytes (#3986)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-01 20:51:14 +08:00
Richard Marscher 0001ad6b8b HBASE-26623 Report CallDroppedException in exception metrics (#3980)
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-30 00:05:12 +08:00
Yutong Xiao be1d3d856f HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner (#3985)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-28 21:55:56 +08:00
Yutong Xiao 93a68f9445 HBASE-26566 Optimize encodeNumeric in OrderedBytes (#3940)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-12-27 23:59:50 +08:00
meiyi afabefb051 HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3976)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-25 22:32:15 -08:00
Duo Zhang 51d38b5e4f HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-23 11:58:35 +08:00
Samir Khan a57f4976c1 HBASE-26598 Fix excessive connections in MajorCompactor (#3961)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 11:55:31 +08:00
Yutong Xiao f239886435 HBASE-26613 The logic of the method incrementIV in Encryption class has problem (#3968)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 00:09:26 +08:00
zhengzhuobinzzb e28ccf092b HBASE-26580 The message of StoreTooBusy is confused (#3949)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-18 23:34:08 +08:00
zhengzhuobinzzb ef3854225a HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-18 23:27:54 +08:00
chenglei 482ef6904e HBASE-26488 Memory leak when MemStore retry flushing (#3899)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 12:22:52 +08:00
Norbert Kalmar d072a2e694 HBASE-26340 TableSplit returns false size under 1MB (#3872)
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 12:21:51 +08:00
Andrew Purtell 5d56c8005b HBASE-26601 maven-gpg-plugin failing with "Inappropriate ioctl for device"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:38:47 -08:00
Nick Dimiduk 37397637ad HBASE-26542 Apply a `package` to test protobuf files (addendum)
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-16 16:39:48 -08:00
Nick Dimiduk f1add382bd HBASE-26542 Apply a `package` to test protobuf files
This is needed in a couple places in order to test that traces over the IPC layer carry correct
span names, and it's good hygiene anyway.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-15 16:29:23 -08:00
Nick Dimiduk 00e91e811f HBASE-26472 Adhere to semantic conventions regarding table data operations
Follows the guidance outlined in https://github.com/open-telemetry/opentelemetry-specification/blob/3e380e2/specification/trace/semantic_conventions/database.dm

* all table data operations are assumed to be of type CLIENT
* populate `db.name` and `db.operation` attributes
* name table data operation spans as `db.operation` `db.name`:`db.hbase.table`
  note: this implementation deviates from the recommended `db.name`.`db.sql.table` and instead
  uses HBase's native String representation of namespace:tablename.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-15 10:22:20 -08:00
Wellington Ramos Chevreuil 55fdff50ca HBASE-26556 IT and Chaos Monkey improvements (#3932)
Signed-off-by: Josh Elser <elserj@apache.org>
Reviewed-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
(cherry picked from commit a36d41af73)
2021-12-14 21:41:30 +00:00