Commit Graph

18930 Commits

Author SHA1 Message Date
Xiaolin Ha b948ddbf21
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 17:04:01 +08:00
meiyi 8f0c2dabbb
HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 10:40:33 +08:00
Richard Marscher c8b014866a
HBASE-26623 Report CallDroppedException in exception metrics (#3980)
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-30 00:02:50 +08:00
Yutong Xiao a599d52820
HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner (#3938)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-27 23:59:13 +08:00
Yutong Xiao 543582e7eb
HBASE-26566 Optimize encodeNumeric in OrderedBytes (#3940)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-12-27 23:57:30 +08:00
Guangxu Cheng 92ff404059
HBASE-26626 Update download page for HBase Operator Tools to 1.2.0 (#3982) 2021-12-25 14:25:48 +08:00
Andrew Purtell 1f44b3d5a1 HBASE-26628 Update downloads.xml for release 2.4.9
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-24 14:58:52 -08:00
Duo Zhang 3f59f21be0
HBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master (#3978)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-24 14:20:32 +08:00
Duo Zhang 70703ca81c
HBASE-26620 Add 3.0.0-alpha-2 to download page (#3977)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-23 22:25:16 +08:00
meiyi a67490abd3
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3971)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 16:45:36 +08:00
Duo Zhang dbdef5982a
HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-23 10:37:17 +08:00
Samir Khan bf258cd68f
HBASE-26598 Fix excessive connections in MajorCompactor (#3961)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 10:29:48 +08:00
Wellington Ramos Chevreuil f16b7b1bfa HBASE-26265 Update ref guide to mention the new store file tracker im… (#3942) 2021-12-22 15:05:59 -05:00
BukrosSzabolcs 771e552cf4 HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot
Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil d00b5faade HBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:59 -05:00
BukrosSzabolcs a288365f92 HBASE-26271 Cleanup the broken store files under data directory (#3786)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
GeorryHuang 8bec26ea91 HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil 08d117197c HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:59 -05:00
Duo Zhang e4e7cf80b7 HBASE-26386 Refactor StoreFileTracker implementations to expose the set method (#3774)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil 06db852aa0 HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
Duo Zhang fc4f6d10e3 HBASE-26280 Use store file tracker when snapshoting (#3685)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
Duo Zhang 5ff0f98a53 HBASE-26264 Add more checks to prevent misconfiguration on store file tracker (#3681)
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 2052e80e5d HBASE-26248 Should find a suitable way to let users specify the store file tracker implementation (#3665)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil 0ee1689332 HBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creating table (#3666)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 090b2fecf4 HBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations (#3656)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil 6e053765e8 HBASE-26079 Use StoreFileTracker when splitting and merging (#3617)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 43b40e9374 HBASE-25988 Store the store file list by a file (#3578)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 6aaef89789 HBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:57 -05:00
Yutong Xiao 6818ec23b8
HBASE-26613 The logic of the method incrementIV in Encryption class has problem (#3968)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 00:00:12 +08:00
Duo Zhang 314e924e96
HBASE-26606 Upgrade log4j2 to 2.17.0 (#3965)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-19 16:31:57 +08:00
zhengzhuobinzzb d399799c29
HBASE-26580 The message of StoreTooBusy is confused (#3949)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-18 23:22:14 +08:00
zhengzhuobinzzb ea0fe2222d
HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-18 23:17:40 +08:00
chenglei da616c00c7
HBASE-26488 Memory leak when MemStore retry flushing (#3899)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 12:17:19 +08:00
Norbert Kalmar 77b6b4dee3
HBASE-26340 TableSplit returns false size under 1MB (#3872)
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 11:58:16 +08:00
Andrew Purtell a0acf8cb42 HBASE-26601 maven-gpg-plugin failing with "Inappropriate ioctl for device"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:38:13 -08:00
Duo Zhang e598f2c663 Revert "HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)"
Need a new 4.0.1 release

This reverts commit 139f08587a.
2021-12-17 12:25:27 +08:00
Duo Zhang 139f08587a
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-17 10:22:48 +08:00
Nick Dimiduk 006433b066 HBASE-26542 Apply a `package` to test protobuf files (addendum)
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-16 16:23:43 -08:00
Nick Dimiduk c93e4572c1 HBASE-26542 Apply a `package` to test protobuf files
This is needed in a couple places in order to test that traces over the IPC layer carry correct
span names, and it's good hygiene anyway.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-15 15:52:43 -08:00
Nick Dimiduk 8f5a12f794
HBASE-26472 Adhere to semantic conventions regarding table data operations
Follows the guidance outlined in https://github.com/open-telemetry/opentelemetry-specification/blob/3e380e2/specification/trace/semantic_conventions/database.dm

* all table data operations are assumed to be of type CLIENT
* populate `db.name` and `db.operation` attributes
* name table data operation spans as `db.operation` `db.name`:`db.hbase.table`
  note: this implementation deviates from the recommended `db.name`.`db.sql.table` and instead
  uses HBase's native String representation of namespace:tablename.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-14 15:23:16 -08:00
Wellington Ramos Chevreuil a36d41af73
HBASE-26556 IT and Chaos Monkey improvements (#3932)
Signed-off-by: Josh Elser <elserj@apache.org>
Reviewed-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-14 21:22:28 +00:00
Peter Somogyi 0f94ab5e09
HBASE-26572 Upgrade to log4j 2.16.0 (#3943)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-12-14 21:36:27 +01:00
Josh Elser 13f3b17870
HBASE-26550 Make sure the master is running normally before accepting a balance command (#3928)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 23:17:34 +08:00
Nick Dimiduk 96c971f18b
HBASE-26549 hbaseprotoc plugin should initialize maven (#3927)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 23:01:14 +08:00
Ruanhui 136b1ea7ab
HBASE-26554 Introduce a new parameter in jmx servlet to exclude the specific mbean (#3930)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 22:50:58 +08:00
Josh Elser a3ff8e4c81
HBASE-26557 Correct export to set log4j2.formatMsgNoLookups in HBASE_OPTS (#3941)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Nick Dimiduk <ndimiduk@apache.org>
2021-12-14 08:12:33 +08:00
Duo Zhang 8bca21b47d
HBASE-26558 Set version as 3.0.0-alpha-2 in master in prep for first RC of 3.0.0-alpha-2 (#3935)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-12-11 20:52:35 +08:00
Yutong Xiao 02c044484d
HBASE-26557 log4j2 has a critical RCE vulnerability (#3933)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-12-10 23:52:28 +08:00
Andrew Purtell b5cf3cdc5c HBASE-26541 hbase-shaded-protobuf not buildable on M1 MacOSX
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-08 16:57:39 -08:00
Xiaolin Ha ca3ba494cb
HBASE-26526 Introduce a timeout to shutdown of WAL (#3297)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-07 12:26:59 +08:00