Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,202 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18202 Commits

Author SHA1 Message Date
Sean Busbey 9048507319 HBASE-26543 correct parsing of shell args with GetoptLong (#4000) 
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit dda337fd9e)
 2022-01-07 22:04:19 -06:00
Duo Zhang 2f0b5ae59b HBASE-26643 LoadBalancer should not return empty map (#4005) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-01-08 00:39:45 +08:00
Duo Zhang 6e1f5b7fec HBASE-26586 Should not rely on the global config when setting SFT implementation for a table while upgrading (#4006) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-01-07 23:47:38 +08:00
Duo Zhang 39c42c7dc2 HBASE-26639 The implementation of TestMergesSplitsAddToTracker is problematic (#4010) 
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-01-07 23:14:57 +08:00
meiyi d25fa46c8f HBASE-26646 WALPlayer should obtain token from filesystem (#4003) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-07 17:44:41 +08:00
huaxiangsun c897ce904a
HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008) 
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-06 10:31:21 -08:00
Xiaolin Ha 7db277737a
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-06 11:45:38 +08:00
Wellington Ramos Chevreuil 755b3b4cb8 HBASE-26585 Add SFT configuration to META table descriptor when creating META (#3998) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(cherry picked from commit baeb51ff8a)
 2022-01-05 13:08:31 +00:00
Xiaolin Ha b2e65b7ce3
HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver (#4001) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-05 15:26:49 +08:00
chenglei fb1c88adac HBASE-26567 Remove IndexType from ChunkCreator (#3947) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-05 00:08:16 +08:00
fcb-xiaobo 10eea31ca9 HBASE-26631 Upgrade junit to 4.13.2 (#3997) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-05 00:01:02 +08:00
BukrosSzabolcs 53285d8e2a HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot 
Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-01-04 22:58:03 +08:00
Wellington Ramos Chevreuil 48e28917e0 HBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-04 22:58:03 +08:00
BukrosSzabolcs 68252e17cb HBASE-26271 Cleanup the broken store files under data directory (#3786) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-01-04 22:58:03 +08:00
GeorryHuang c4325ff088 HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-01-04 22:58:03 +08:00
Wellington Ramos Chevreuil 80b04229a2 HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang ca07fb869f HBASE-26386 Refactor StoreFileTracker implementations to expose the set method (#3774) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-01-04 22:58:03 +08:00
Wellington Ramos Chevreuil 030a2a83ca HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang b812a277ab HBASE-26280 Use store file tracker when snapshoting (#3685) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang dcaea11a52 HBASE-26264 Add more checks to prevent misconfiguration on store file tracker (#3681) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang 49c40998ef HBASE-26248 Should find a suitable way to let users specify the store file tracker implementation (#3665) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-01-04 22:58:03 +08:00
Wellington Ramos Chevreuil 26f263b792 HBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creating table (#3666) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang f298f9cacd HBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations (#3656) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-01-04 22:58:03 +08:00
Wellington Ramos Chevreuil e89afdfa08 HBASE-26079 Use StoreFileTracker when splitting and merging (#3617) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang 826e54ce78 HBASE-25988 Store the store file list by a file (#3578) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang 04e1980dea HBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-01-04 22:58:03 +08:00
Duo Zhang fff59ac083
HBASE-26642 Increase the timeout for TestStochasticLoadBalancerRegionReplicaLargeCluster (#3995) 
Signed-off-by: Yulin Niu <niuyulin@apache.org
 2022-01-03 23:13:05 +08:00
Duo Zhang 49e64ffa9b HBASE-26641 Split TestMasterFailoverWithProcedures (#3994) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2022-01-03 00:41:19 +08:00
Yutong Xiao a478d02a15 HBASE-26629 Add expiration for long time vacant scanners in Thrift2 (#3984) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-02 21:27:35 +08:00
Duo Zhang cd87e10081
HBASE-26638 Cherry-pick the ReflectionUtils improvements in HBASE-21515 to branch-2 (#3993) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-01-02 17:32:45 +08:00
chenglei a67fb0a85c HBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl (#3983) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-01 20:57:25 +08:00
Yutong Xiao 523848e033 HBASE-26635 Optimize decodeNumeric in OrderedBytes (#3986) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-01 20:51:05 +08:00
Duo Zhang e53712ae99
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:10:08 +08:00
meiyi 5b08db92c7 HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-30 11:08:36 +08:00
Richard Marscher 9890ac9639 HBASE-26623 Report CallDroppedException in exception metrics (#3980) 
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-30 00:05:04 +08:00
Yutong Xiao c6a287930b
HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner (#3985) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-28 21:42:00 +08:00
Yutong Xiao c28a266613 HBASE-26566 Optimize encodeNumeric in OrderedBytes (#3940) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-12-27 23:59:38 +08:00
meiyi 7fcf8e84a5
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3976) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-23 18:51:28 +08:00
Duo Zhang c6ac99684c HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-23 11:58:29 +08:00
Samir Khan 55ddcbaaf5 HBASE-26598 Fix excessive connections in MajorCompactor (#3961) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 11:55:21 +08:00
Yutong Xiao c6aac613a0 HBASE-26613 The logic of the method incrementIV in Encryption class has problem (#3968) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 00:09:19 +08:00
zhengzhuobinzzb 68d8573c09 HBASE-26580 The message of StoreTooBusy is confused (#3949) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-18 23:33:58 +08:00
zhengzhuobinzzb 12a286ca66 HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-18 23:27:42 +08:00
chenglei 2d5d5b2011 HBASE-26488 Memory leak when MemStore retry flushing (#3899) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:22:42 +08:00
Norbert Kalmar 471e398df0 HBASE-26340 TableSplit returns false size under 1MB (#3872) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:21:45 +08:00
Andrew Purtell 29e37439f7 HBASE-26601 maven-gpg-plugin failing with "Inappropriate ioctl for device" 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 18:38:40 -08:00
Nick Dimiduk 9d6823236d HBASE-26542 Apply a `package` to test protobuf files (addendum) 
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-16 16:39:40 -08:00
Nick Dimiduk 555fcf42b0 HBASE-26542 Apply a `package` to test protobuf files 
This is needed in a couple places in order to test that traces over the IPC layer carry correct
span names, and it's good hygiene anyway.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-15 16:29:01 -08:00
Nick Dimiduk c7a8e428df
HBASE-26472 Adhere to semantic conventions regarding table data operations 
Follows the guidance outlined in https://github.com/open-telemetry/opentelemetry-specification/blob/3e380e2/specification/trace/semantic_conventions/database.dm

* all table data operations are assumed to be of type CLIENT
* populate `db.name` and `db.operation` attributes
* name table data operation spans as `db.operation` `db.name`:`db.hbase.table`
  note: this implementation deviates from the recommended `db.name`.`db.sql.table` and instead
  uses HBase's native String representation of namespace:tablename.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2021-12-14 15:55:53 -08:00
Wellington Ramos Chevreuil 5defd8c35f HBASE-26556 IT and Chaos Monkey improvements (#3932) 
Signed-off-by: Josh Elser <elserj@apache.org>
Reviewed-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
(cherry picked from commit a36d41af73)
 2021-12-14 21:26:53 +00:00