Commit Graph

18892 Commits

Author SHA1 Message Date
Nick Dimiduk c93e4572c1 HBASE-26542 Apply a `package` to test protobuf files
This is needed in a couple places in order to test that traces over the IPC layer carry correct
span names, and it's good hygiene anyway.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-15 15:52:43 -08:00
Nick Dimiduk 8f5a12f794
HBASE-26472 Adhere to semantic conventions regarding table data operations
Follows the guidance outlined in https://github.com/open-telemetry/opentelemetry-specification/blob/3e380e2/specification/trace/semantic_conventions/database.dm

* all table data operations are assumed to be of type CLIENT
* populate `db.name` and `db.operation` attributes
* name table data operation spans as `db.operation` `db.name`:`db.hbase.table`
  note: this implementation deviates from the recommended `db.name`.`db.sql.table` and instead
  uses HBase's native String representation of namespace:tablename.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-14 15:23:16 -08:00
Wellington Ramos Chevreuil a36d41af73
HBASE-26556 IT and Chaos Monkey improvements (#3932)
Signed-off-by: Josh Elser <elserj@apache.org>
Reviewed-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-14 21:22:28 +00:00
Peter Somogyi 0f94ab5e09
HBASE-26572 Upgrade to log4j 2.16.0 (#3943)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-12-14 21:36:27 +01:00
Josh Elser 13f3b17870
HBASE-26550 Make sure the master is running normally before accepting a balance command (#3928)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 23:17:34 +08:00
Nick Dimiduk 96c971f18b
HBASE-26549 hbaseprotoc plugin should initialize maven (#3927)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 23:01:14 +08:00
Ruanhui 136b1ea7ab
HBASE-26554 Introduce a new parameter in jmx servlet to exclude the specific mbean (#3930)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 22:50:58 +08:00
Josh Elser a3ff8e4c81
HBASE-26557 Correct export to set log4j2.formatMsgNoLookups in HBASE_OPTS (#3941)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Nick Dimiduk <ndimiduk@apache.org>
2021-12-14 08:12:33 +08:00
Duo Zhang 8bca21b47d
HBASE-26558 Set version as 3.0.0-alpha-2 in master in prep for first RC of 3.0.0-alpha-2 (#3935)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-12-11 20:52:35 +08:00
Yutong Xiao 02c044484d
HBASE-26557 log4j2 has a critical RCE vulnerability (#3933)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-12-10 23:52:28 +08:00
Andrew Purtell b5cf3cdc5c HBASE-26541 hbase-shaded-protobuf not buildable on M1 MacOSX
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-08 16:57:39 -08:00
Xiaolin Ha ca3ba494cb
HBASE-26526 Introduce a timeout to shutdown of WAL (#3297)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-07 12:26:59 +08:00
Xiaolin Ha bdbb4fa087
HBASE-26525 Use unique thread name for group WALs (#3903)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-07 12:19:33 +08:00
Tak Lon (Stephen) Wu 1004e43a44
HBASE-26529 Document HBASE-26524 to section of Dynamic Unloading (#3909)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-06 14:16:21 -08:00
Istvan Toth d9315fa043
HBASE-26527 ArrayIndexOutOfBoundsException in KeyValueUtil.copyToNewKeyValue() (#3904)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-06 23:56:00 +08:00
LiangJun He 9cf224d4fe
HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure (#3921)
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-06 22:58:38 +08:00
Duo Zhang dcd622d702 HBASE-26535 Addendum fix report names 2021-12-05 22:57:02 +08:00
RamanChodzka 554580f966
HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() (#3917)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-05 22:34:30 +08:00
Yutong Xiao b5b286d793
HBASE-26490 Add builder for class ReplicationLoadSink (#3883)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 23:00:22 +08:00
Tomu Tsuruhara cf5bc6afca
HBASE-26517 Add auth method information to AccessChecker audit log (#3897)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 22:59:29 +08:00
Andrew Purtell 4d929d7929
HBASE-26535 [site, branch-2] DependencyManagement report is broken (#3914)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 11:59:11 +08:00
Tak Lon (Stephen) Wu 6d28bc6dd9
HBASE-26524 Addendum fix TestConstraints (#3912) 2021-12-02 12:55:41 -08:00
Tak Lon (Stephen) Wu 19b0b2e8fc
HBASE-26524 Support remove coprocessor by class name via alter table command (#3902)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-01 14:47:59 -08:00
Istvan Toth 7845d006e6 HBASE-26512 Make timestamp format configurable in HBase shell scan output
Signed-off-by: Josh Elser <elserj@apache.org
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-01 14:15:46 -05:00
Nick Dimiduk ea824df571
HBASE-26471 Move tracing semantic attributes to their own class (#3896)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-01 09:21:20 -08:00
Rushabh Shah d1762f5209
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. (#3862)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-12-01 11:04:35 +05:30
Duo Zhang 358c4dc902
HBASE-25905 Shutdown of WAL stuck at waitForSafePoint (#3898)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-01 08:24:46 +08:00
Duo Zhang f1089970cf
HBASE-26403 Remove 1.4.x from our download page (#3881)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-11-28 23:36:13 +08:00
Ruanhui 32cb580ba2
HBASE-26485 Introduce a method to clean restore directory after Snapshot Scan (#3877)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 20:35:24 +08:00
liuzhuang2017 7b0a61fb0f
HBASE-26484 Update vote.tmpl in our create-release scripts to link KEYS from downloads.a.o instead of dist.a.o (#3889)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 20:16:37 +08:00
chenglei e311e23ac6
HBASE-26476 Make DefaultMemStore extensible for HStore.memstore (#3869)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:05:47 +08:00
Bryan Beaudreault 1b27124c61
HBASE-26304 Reflect out of band locality improvements in metrics and balancer (#3803)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:01:46 +08:00
Duo Zhang 33287ac502
HBASE-26455 TestStochasticLoadBalancerRegionReplicaWithRacks fails consistently (#3879)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-11-25 21:40:46 +08:00
chenglei 9fd58fecf0
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning (#3859)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-11-25 20:32:28 +08:00
zhengzhuobinzzb 25fc701752
HBASE-26482 HMaster may clean wals that is replicating in rare cases (#3876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:35:54 +08:00
liangxs c148d5bb3f
HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:35:00 +08:00
Joel Swiatek e702aaee6d
HBASE-26458 Update Snapshot TTL doc (#3852)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-24 12:14:01 +05:30
Yutong Xiao 96d699a8f0
HBASE-26477 Fix MiniMapReduceCluster failure under Java17 (#3867)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 18:39:38 +08:00
Duo Zhang 1c48248ef8
HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas (#3868)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-23 18:31:18 +08:00
Xiaolin Ha b870b6d9ac HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 11:15:49 +08:00
haxiaolin 2aafd31ff5 Revert "HBASE-26249 Ameliorate compaction made by bul… (#3831)"
This reverts commit 5e62e2aa8d.
2021-11-23 11:15:14 +08:00
Xiaolin Ha 5e62e2aa8d
HBASE-26249 Ameliorate compaction made by bul… (#3831)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 11:14:26 +08:00
zhengzhuobinzzb 04635f405a
HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) (#3858)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-11-21 20:59:11 +08:00
ss77892 7a80b3a4f7
HBASE-26463 Unreadable table names after HBASE-24605 (#3853)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-21 20:44:57 +08:00
Xiaolin Ha b2571df7ae
HBASE-26421 Use HFileLink file to replace entire file's reference when splitting (#3842)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-18 21:36:36 +08:00
Josh Elser 1c47f80d83
HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist (#3679)
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
2021-11-16 16:26:55 -05:00
Andrew Purtell cda5a87d85
HBASE-26446 CellCounter should report serialized cell size counts too (#3841)
Add the following stats for a given table:
 - 7. Total size of serialized cells of each CF.
 - 8. Total size of serialized cells of each qualifier.
 - 9. Total size of serialized cells across all rows.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-15 16:43:05 -08:00
Andrew Purtell d92e9089de
HBASE-26444 BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace (#3840)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-11-15 16:11:53 -08:00
Andrew Purtell 69a4eda35f
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level (#3838)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-15 16:05:27 -08:00
chenglei 8458e44a1a
HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize (#3834)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-12 22:51:40 +08:00