d542f471d1
HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled ( #4032 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 11:47:23 +08:00
c3d0cc7040
HBASE-26830 Rewrite TestLruBlockCache to make it more stable ( #4212 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-14 11:04:15 +08:00
fd301ad55f
HBASE-26323 Introduce a Snapshot Procedure ( #4115 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-12 23:21:22 +08:00
c2485215de
HBASE-25465 Use javac --release option for supporting cross version compilation ( #4164 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-12 16:51:49 +08:00
71ff3ec323
HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME ( #4204 )
...
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-11 14:44:42 +08:00
f3faa26047
HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 ( #4203 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-11 14:43:00 +08:00
dbf56819c3
HBASE-26816 Fix CME in ReplicationSourceManager ( #4187 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-11 11:06:14 +08:00
e5dbbd20ac
HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write ( #4184 )
...
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-10 11:55:38 -08:00
4da53efcf9
HBASE-26814 Addendum: Fix spotbugs warning and clarify intent ( #4201 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-10 10:09:51 -08:00
be0afbf23a
HBASE-25895 Implement a Cluster Metrics JSON endpoint
...
Publishes a set of JSON endpoints following a RESTful structure, which expose a subset of the
`o.a.h.h.ClusterMetrics` object tree. The URI structure is as follows
/api/v1/admin/cluster_metrics
/api/v1/admin/cluster_metrics/live_servers
/api/v1/admin/cluster_metrics/dead_servers
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-10 14:58:05 +01:00
5851400a46
HBASE-26819 Minor code cleanup in and around RpcScheduler
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-10 14:45:04 +01:00
068031ea82
HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-10 14:36:39 +01:00
1057da8be6
HBASE-26768 Avoid unnecessary replication suspending in RegionReplica… ( #4127 )
2022-03-10 10:58:47 +08:00
1dd29dba5c
HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on ( #4194 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-09 14:43:58 -08:00
10471944bd
HBASE-26582 Prune use of Random and SecureRandom objects ( #4118 )
...
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.
Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.
Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 13:49:02 -08:00
39ecaa1975
HBASE-26784 Use HIGH_QOS for ResultScanner.close requests ( #4146 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-08 10:48:57 +08:00
f3f2aa9631
HBASE-26782 Minor code cleanup in and around RpcExecutor
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-07 11:55:36 +01:00
591f7819f3
HBASE-26552 Introduce retry to logroller to avoid abort ( #4038 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 12:20:01 +08:00
f3a48d1910
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #3117 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 11:21:39 +08:00
2b205d2230
HBASE-26792 Implement ScanInfo#toString ( #4153 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-05 17:45:37 +08:00
2b9ab90a03
HBASE-26759 Fix trace continuity through CallRunner ( #4126 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-04 15:23:25 -08:00
be59eb7e8d
HBASE-26731 Add metrics for active and expired scanners ( #4145 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 14:03:32 -08:00
7d2457e075
HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… ( #4139 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 13:49:19 -08:00
f4b05a8364
HBASE-26242 Allow split when store file count larger than the configed blocking file count ( #3652 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 20:18:38 +08:00
9c037b1be7
HBASE-26764 Implement generic exception support for TraceUtil methods over Callables and Runnables
...
For the `TraceUtil` methods that accept `Callable` and `Runnable` types, make them generic over a
child of `Throwable`. This allows us to consolidate the two method signatures into a single more
flexible definition.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-03 12:18:33 +01:00
1b994a179b
HBASE-26787 TestRegionReplicaReplicationError should inject error in replicateToReplica method ( #4148 )
2022-03-03 12:00:45 +08:00
06f06cbd86
HBASE-26622 Update error-prone to 2.10
...
Author: Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-02 16:07:23 +01:00
f6b74b3083
HBASE-26762 Un-Deprecate and improve documentation for Scan#setRowPrefixFilter ( #4119 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-02 20:19:13 +08:00
e85bf414ab
HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log ( #4138 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-03-01 14:33:02 +01:00
c8662ed575
HBASE-26640 Reimplement master local region initialization to better work with SFT ( #4111 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-02-24 10:10:02 +08:00
a49c758f58
HBASE-26727 Fix CallDroppedException reporting ( #4088 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 17:27:09 -08:00
8fb3d4666a
HBASE-26703 Allow configuration of IPC queue balancer ( #4063 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 17:21:40 -08:00
b3b4405d61
HBASE-26576 Allow pluggable queue to be used with the fast path executor or normal balanced executor ( #3944 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 10:00:10 -08:00
e100198ab5
HBASE-26659 The ByteBuffer of metadata in RAMQueueEntry in BucketCache could be reused. ( #4026 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-18 22:24:51 +08:00
4829806220
HBASE-26707: Reduce number of renames during bulkload ( #4066 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-02-17 19:34:48 +00:00
8ddd1d0f9e
HBASE-26712 Balancer encounters NPE in rare case ( #4092 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-02-16 12:12:18 +05:30
1b47575214
HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate ( #4105 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-16 11:08:33 +08:00
407c6e7b22
HBASE-26730 Extend hbase shell 'status' command to support an option 'tasks' ( #4095 )
...
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-02-15 18:38:18 -08:00
7c52895e8c
HBASE-26434 Do compact when all L0 files are expired ( #3830 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 22:08:52 +08:00
1af22625e9
HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down ( #4073 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 20:28:00 +08:00
8bb36d6317
HBASE-26753 RegionReplicationSink.send set timeout for replicating meta edits error ( #4110 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-14 17:12:29 +08:00
6c3c53a81c
HBASE-26521 Name RPC spans as `$package.$service/$method` ( #4024 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-09 15:22:31 +01:00
e848d3b9d9
HBASE-26714 Introduce path configuration for system coprocessors ( #4069 )
...
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-02-03 20:19:38 -08:00
3da23c22c5
HBASE-26726 Allow disable of region warmup before graceful move ( #4085 )
...
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2022-02-01 15:38:23 -08:00
351caa5bcc
Revert "HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() ( #4044 )"
...
This reverts commit 8c607397c1
2022-01-31 09:48:46 -08:00
8c607397c1
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() ( #4044 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-28 10:18:48 -08:00
f278a4c98d
HBASE-26587 Introduce a new Admin API to change SFT implementation ( #4030 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
2022-01-28 21:07:55 +08:00
f6348d4100
HBASE-26709 Ban the usage of junit 3 TestCase ( #4065 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-01-27 13:41:48 +08:00
e1c2c16214
HBASE-26690 Modify FSTableDescriptors to not rely on renaming when writing TableDescriptor ( #4054 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-27 13:28:56 +08:00
8251bd566a
HBASE-26700 The way we bypass broken track file is not enough in StoreFileListFile ( #4055 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-25 14:51:11 +08:00
625d610bcc
HBASE-26614 Refactor code related to "dump"ing ZK nodes ( #3969 )
...
The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-24 11:33:18 -08:00
97f3c1cf7f
HBASE-26675 Data race on Compactor.writer ( #4035 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-01-24 19:45:50 +08:00
1d2b8a033d
HBASE-26661 Remove deprecated methods in MasterObserver ( #4031 )
...
Signrd-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-19 19:25:06 +08:00
d63ca4febe
HBASE-26674 Should modify filesCompacting under storeWriteLock ( #4040 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-19 13:59:35 +08:00
c9bcd87b34
HBASE-26654 ModifyTableDescriptorProcedure shoud load TableDescriptor while executing ( #4034 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-16 16:25:28 +08:00
bc5a5af1bc
HBASE-26671 Misspellings of hbck usage ( #4033 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-16 16:23:23 +08:00
3a14cfc6f9
HBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor ( #3929 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2022-01-13 11:11:12 +08:00
803afee777
HBASE-26397 Display the excluded datanodes on regionserver UI ( #3990 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-10 12:53:05 +08:00
24b9876edf
HBASE-26643 Addendum align the test code with branch-2
2022-01-08 00:39:06 +08:00
69520ad199
HBASE-26643 Addendum align the test code with branch-2
2022-01-08 00:37:25 +08:00
443bf30a5d
HBASE-26643 LoadBalancer should not return empty map ( #4005 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-07 23:50:37 +08:00
436fb7875c
HBASE-26586 Should not rely on the global config when setting SFT implementation for a table while upgrading ( #4006 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-07 23:39:18 +08:00
47983cf790
HBASE-26639 The implementation of TestMergesSplitsAddToTracker is problematic ( #4010 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-01-07 23:05:47 +08:00
5e263dac38
HBASE-26616 Refactor code related to ZooKeeper authentication ( #3973 )
...
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-06 17:04:15 -08:00
5cb7ed8005
HBASE-26474 Implement connection-level attributes ( #3952 )
...
Add support for `db.system`, `db.connection_string`, `db.user`.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 15:32:12 -08:00
baeb51ff8a
HBASE-26585 Add SFT configuration to META table descriptor when creating META ( #3998 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-01-05 12:20:07 +00:00
ce2bbaf30a
HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver ( #3946 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 11:10:16 +08:00
70cb9b0ba9
HBASE-26567 Remove IndexType from ChunkCreator ( #3947 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:05:54 +08:00
e96df8bf40
HBASE-26641 Split TestMasterFailoverWithProcedures ( #3994 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-03 00:35:14 +08:00
1b8e577cc6
HBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl ( #3983 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-01 20:50:52 +08:00
9e469e4a2a
HBASE-26540 Implement a tool to verify the lag of region replication ( #3950 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
5ac76c1c00
HBASE-26539 The default rpc timeout 200ms is too small for replicating meta edits ( #3919 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
1fdd0a4cfd
HBASE-26538 Should find a way to clear the replication queue for a legacy region_replica_replication peer ( #3918 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
fa37aed8f6
HBASE-26481 Consider rolling upgrading from old region replication framework ( #3880 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Reviewed-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
9f6dfe6d3f
HBASE-26417 Remove NoopReplicationQueueStorage ( #3882 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-31 12:29:48 +08:00
70259a2a4c
HBASE-26456 Limit the size for one replicating ( #3873 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
529c36e7ad
HBASE-26416 Implement a new method for region replication instead of using replay ( #3864 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
67306e74b1
HBASE-26457 Should not always clear all the failed replicas when getting a flush all request ( #3850 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
a8d46db416
HBASE-26448 Make sure we do not flush a region too frequently ( #3847 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
1b0d9ceaba
HBASE-26449 The way we add or clear failedReplicas may have race ( #3846 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-12-31 12:29:48 +08:00
0b29a7934a
HBASE-26413 Limit the total size of buffered region replication entries ( #3844 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
2ee18988e6
HBASE-26412 Handle sink failure in RegionReplicationSink ( #3815 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
7286cc0035
HBASE-26407 Introduce a region replication sink for sinking WAL edits to secondary replicas directly ( #3807 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
c14a76c4fd
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 ( #3987 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:08:01 +08:00
b948ddbf21
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL ( #3800 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 17:04:01 +08:00
8f0c2dabbb
HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region ( #3981 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 10:40:33 +08:00
c8b014866a
HBASE-26623 Report CallDroppedException in exception metrics ( #3980 )
...
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-30 00:02:50 +08:00
a599d52820
HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner ( #3938 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-27 23:59:13 +08:00
3f59f21be0
HBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master ( #3978 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-24 14:20:32 +08:00
a67490abd3
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions ( #3971 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 16:45:36 +08:00
dbdef5982a
HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad ( #3967 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-23 10:37:17 +08:00
bf258cd68f
HBASE-26598 Fix excessive connections in MajorCompactor ( #3961 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 10:29:48 +08:00
771e552cf4
HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot
...
Closes #3851
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
d00b5faade
HBASE-26454 CreateTableProcedure still relies on temp dir and renames… ( #3845 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:59 -05:00
a288365f92
HBASE-26271 Cleanup the broken store files under data directory ( #3786 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
8bec26ea91
HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables ( #3700 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
08d117197c
HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl ( #3749 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:59 -05:00
e4e7cf80b7
HBASE-26386 Refactor StoreFileTracker implementations to expose the set method ( #3774 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
06db852aa0
HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… ( #3721 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
fc4f6d10e3
HBASE-26280 Use store file tracker when snapshoting ( #3685 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
5ff0f98a53
HBASE-26264 Add more checks to prevent misconfiguration on store file tracker ( #3681 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:58 -05:00
2052e80e5d
HBASE-26248 Should find a suitable way to let users specify the store file tracker implementation ( #3665 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
0ee1689332
HBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creating table ( #3666 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:58 -05:00
090b2fecf4
HBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations ( #3656 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
6e053765e8
HBASE-26079 Use StoreFileTracker when splitting and merging ( #3617 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:58 -05:00
43b40e9374
HBASE-25988 Store the store file list by a file ( #3578 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
6aaef89789
HBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:57 -05:00
d399799c29
HBASE-26580 The message of StoreTooBusy is confused ( #3949 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-18 23:22:14 +08:00
ea0fe2222d
HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured ( #3948 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-18 23:17:40 +08:00
da616c00c7
HBASE-26488 Memory leak when MemStore retry flushing ( #3899 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 12:17:19 +08:00
77b6b4dee3
HBASE-26340 TableSplit returns false size under 1MB ( #3872 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 11:58:16 +08:00
e598f2c663
Revert "HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 ( #3910 )"
...
Need a new 4.0.1 release
This reverts commit 139f08587a
2021-12-17 12:25:27 +08:00
139f08587a
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 ( #3910 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-17 10:22:48 +08:00
006433b066
HBASE-26542 Apply a `package` to test protobuf files (addendum)
...
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-16 16:23:43 -08:00
13f3b17870
HBASE-26550 Make sure the master is running normally before accepting a balance command ( #3928 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 23:17:34 +08:00
8bca21b47d
HBASE-26558 Set version as 3.0.0-alpha-2 in master in prep for first RC of 3.0.0-alpha-2 ( #3935 )
...
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-12-11 20:52:35 +08:00
ca3ba494cb
HBASE-26526 Introduce a timeout to shutdown of WAL ( #3297 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-07 12:26:59 +08:00
bdbb4fa087
HBASE-26525 Use unique thread name for group WALs ( #3903 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-07 12:19:33 +08:00
9cf224d4fe
HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure ( #3921 )
...
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-06 22:58:38 +08:00
554580f966
HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() ( #3917 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-05 22:34:30 +08:00
cf5bc6afca
HBASE-26517 Add auth method information to AccessChecker audit log ( #3897 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 22:59:29 +08:00
6d28bc6dd9
HBASE-26524 Addendum fix TestConstraints ( #3912 )
2021-12-02 12:55:41 -08:00
ea824df571
HBASE-26471 Move tracing semantic attributes to their own class ( #3896 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-01 09:21:20 -08:00
d1762f5209
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. ( #3862 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-12-01 11:04:35 +05:30
358c4dc902
HBASE-25905 Shutdown of WAL stuck at waitForSafePoint ( #3898 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-01 08:24:46 +08:00
e311e23ac6
HBASE-26476 Make DefaultMemStore extensible for HStore.memstore ( #3869 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:05:47 +08:00
1b27124c61
HBASE-26304 Reflect out of band locality improvements in metrics and balancer ( #3803 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:01:46 +08:00
9fd58fecf0
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning ( #3859 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-11-25 20:32:28 +08:00
c148d5bb3f
HBASE-26479 Print too slow/big scan's operation_id in region server log ( #3870 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:35:00 +08:00
96d699a8f0
HBASE-26477 Fix MiniMapReduceCluster failure under Java17 ( #3867 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 18:39:38 +08:00
1c48248ef8
HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas ( #3868 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-23 18:31:18 +08:00
b870b6d9ac
HBASE-26249 Ameliorate compaction made by bulk-loading files ( #3831 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 11:15:49 +08:00
2aafd31ff5
Revert "HBASE-26249 Ameliorate compaction made by bul… ( #3831 )"
...
This reverts commit 5e62e2aa8d
2021-11-23 11:15:14 +08:00
5e62e2aa8d
HBASE-26249 Ameliorate compaction made by bul… ( #3831 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 11:14:26 +08:00
04635f405a
HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) ( #3858 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-11-21 20:59:11 +08:00
7a80b3a4f7
HBASE-26463 Unreadable table names after HBASE-24605 ( #3853 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-21 20:44:57 +08:00
b2571df7ae
HBASE-26421 Use HFileLink file to replace entire file's reference when splitting ( #3842 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-18 21:36:36 +08:00
1c47f80d83
HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist ( #3679 )
...
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
2021-11-16 16:26:55 -05:00
d92e9089de
HBASE-26444 BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace ( #3840 )
...
Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-11-15 16:11:53 -08:00
69a4eda35f
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level ( #3838 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-15 16:05:27 -08:00
8458e44a1a
HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize ( #3834 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-12 22:51:40 +08:00
539e161e74
HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' ( #3843 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-11-12 11:40:55 +08:00
058d3a45b4
Revert "HBASE-26450 Server configuration will overwrite HStore configuration … ( #3843 )"
...
This reverts commit 628b8b7f65
2021-11-12 11:34:38 +08:00
628b8b7f65
HBASE-26450 Server configuration will overwrite HStore configuration … ( #3843 )
...
* HBASE-26450 Server configuration will overwrite HStore configuration After using shell command 'updateConfiguration'
2021-11-12 11:10:38 +08:00
e1ca056676
HBASE-26410 Fix HBase TestCanaryTool for Java17 ( #3809 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-09 22:11:21 +08:00
407a5bd812
HBASE-26430 Increase log level in DefaultHeapMemoryTuner from DEBUG to INFO ( #3820 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:34:14 -08:00
b03ed8bae0
HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled ( #3819 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:31:21 -08:00
a6c09a84a7
HBASE-25322 Redundant Reference file in bottom region of split ( #3814 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-05 18:16:14 +08:00
cd7a5099d4
HBASE-26311 Balancer gets stuck in cohosted replica distribution ( #3724 )
...
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-11-03 11:57:37 -07:00
b9b7fec57f
HBASE-26406 Can not add peer replicating to non-HBase ( #3806 )
...
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-02 14:26:25 +08:00
558ab925ed
HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore ( #3777 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-01 23:05:15 +08:00
45f76a4104
HBASE-26353 Support loadable dictionaries in hbase-compression-zstd ( #3787 )
...
ZStandard supports initialization of compressors and decompressors with a
precomputed dictionary, which can dramatically improve and speed up compression
of tables with small values. For more details, please see
The Case For Small Data Compression
https://github.com/facebook/zstd#the-case-for-small-data-compression
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-27 07:39:55 -07:00
8e7f78cb44
HBASE-26396 Remove duplicate thread creation during migrating rsgroup ( #3795 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-27 22:01:15 +08:00
773ff28967
HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect ( #3794 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-26 14:44:33 +08:00
84a527bdcc
HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum ( #3792 )
2021-10-24 09:19:10 +05:30
0d8e5e5219
HBASE-26368 Fix checkstyle issues for HRegionServer ( #3764 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-22 12:50:45 +05:30
4838246ba3
HBASE-26385 Clear CellScanner when replay ( #3773 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-10-21 21:30:19 +08:00
64eb237120
HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover ( #3775 )
...
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-20 15:48:36 -07:00
856d08e863
HBASE-26371 Prioritize meta region move over other region moves in region_mover ( #3767 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 23:05:12 +05:30
8a6fed7b19
HBASE-26316 Per-table or per-CF compression codec setting overrides ( #3730 )
...
We get and retain Compressor instances in HFileBlockDefaultEncodingContext,
and could in theory call Compressor#reinit when setting up the context,
to update compression parameters like level and buffer size, but we do
not plumb through the CompoundConfiguration from the Store into the
encoding context. As a consequence we can only update codec parameters
globally in system site conf files.
Fine grained configurability is important for algorithms like ZStandard
(ZSTD), which offers more than 20 compression levels, where at level 1
it is almost as fast as LZ4, and where at higher levels it utilizes
computationally expensive techniques to rival LZMA at compression ratio
but trades off significantly for reduced compresson throughput. The ZSTD
level that should be set for a given column family or table will vary by
use case.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-19 12:04:25 -07:00
23e7aa5ccc
HBASE-26320 Implement a separate thread pool for the LogCleaner ( #3712 )
...
This avoids starvation when the archive directory is large and takes a long time
to iterate through.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2021-10-18 16:21:01 -07:00
ad7d698622
HBASE-26350 Add a DEBUG when we fail the SASL handshake
...
Closes #3743
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-10-14 15:19:30 -04:00
6e7e69a0a7
HBASE-26348 Implement a special procedure to migrate rs group information when upgrading ( #3746 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Reviewed-by: GeorryHuang <215175212@qq.com>
2021-10-14 22:51:37 +08:00
891e90f08f
HBASE-26190 High rate logging of Bucket Allocator Allocation fails ( #3648 )
...
* HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.
Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.
Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-10-14 13:13:17 +05:30
39a20c528e
HBASE-26324 Reuse compressors and decompressors in WAL CompressionContext ( #3728 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-07 09:45:17 -07:00
42fe5e5baa
HBASE-26259 Fallback support to pure Java compression ( #3691 )
...
This change introduces provided compression codecs to HBase as
new Maven modules. Each module provides compression codec support
that formerly required Hadoop native codecs, which in turn relies
on native code integration, which may or may not be available on
a given hardware platform or in an operational environment. We
now provide codecs in the HBase distribution for users whom for
whatever reason cannot or do not wish to deploy the Hadoop native
codecs.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-06 13:17:18 -07:00
f65b769e8c
HBASE-24601: Change default Hfile storage policy from HOT to NONE for HDFS ( #1940 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-02 16:35:14 +08:00
d3c86f4f90
HBASE-26305 Move NavigableSet add operation to writer thread in BucketCache ( #3705 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-10-01 20:57:51 +08:00
121bdea230
HBASE-26295 BucketCache could not free BucketEntry which restored fro… ( #3699 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-29 21:24:12 +08:00
1152a61b5b
HBASE-26220 Use P2P communicate between region servers to sync the list for bootstrap node ( #3697 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-29 21:12:58 +08:00
f000b77532
HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results ( #3688 )
...
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-29 10:03:53 +02:00
113cc2a591
HBASE-26293 Use reservoir sampling when selecting bootstrap nodes ( #3702 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-09-28 23:27:47 +08:00
748a6827c4
HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME ( #3647 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-28 21:48:32 +08:00
63306942b1
HBASE-26251 StochasticLoadBalancer metrics should update even if balancer doesn't run ( #3678 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-09-28 21:20:48 +08:00
d956828aac
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job ( #3684 )
...
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
Signed-off-by: Josh Elser <elserj@apache.org>
2021-09-22 09:26:57 -07:00
ecd35f77ae
Revert "HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job ( #3684 )" ( #3695 )
...
This reverts commit 6556a5ee91
2021-09-22 09:19:05 -07:00
6556a5ee91
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job ( #3684 )
...
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
2021-09-22 09:17:18 -07:00
96fa015043
HBASE-26261 Store configuration loss when use update_config ( #3664 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-22 18:22:30 +08:00
e6508f6776
HBASE-26270 Provide getConfiguration method for Region and Store interface ( #3671 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 11:10:04 +08:00
2599bd8eab
Revert "Provide getConfiguration method for Region and Store interface ( #3671 )"
...
This reverts commit 4f6e0cf601
2021-09-22 11:08:51 +08:00
4f6e0cf601
Provide getConfiguration method for Region and Store interface ( #3671 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 10:23:25 +08:00
a9abdf4936
HBASE-26288 Revisit the usage of MetaTableLocator when HRegionServer.TEST_SKIP_REPORTING_TRANSITION is true ( #3689 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-22 00:00:35 +08:00
dd58fdb4ba
HBASE-26285 Addendum fix typo in table.jsp
2021-09-21 23:58:53 +08:00
4ea23c3baf
HBASE-26285 Remove MetaTableLocator usages in non-migration code ( #3686 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-21 22:22:00 +08:00
4614c7bc57
HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed ( #3680 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-17 22:15:23 +08:00
d26bcaaa91
HBASE-25288 Make MasterRpcServices not extends RSRpcServices and also HMaster not extends HRegionServer ( #3612 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-13 09:56:13 +08:00
8d2b995352
HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy ( #3646 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 18:26:37 +08:00
922d0666a3
[HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" ( #3650 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 12:11:49 +08:00
03b6f2d3f2
HBASE-26163 Better logging in RSGroupInfoManagerImpl ( #3610 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bharath Vissapragada <bharathv@apache.org>
2021-09-07 22:20:09 +08:00
b7c6a0b637
HBASE-26228 updateRSGroupConfig operation should be authorized by AccessController ( #3633 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-09-07 22:17:26 +08:00
dd293c8ba9
HBASE-26230 Start an in process HRegionServer in maintenance mode ( #3659 )
...
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
2021-09-03 17:07:30 +08:00
ec747bcb29
HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. ( #3636 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-02 09:16:54 -07:00
a15e94a47f
HBASE-26147 Add a dry run mode to the balancer, where moves are calculated but not actually executed
...
Closes #3630
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org
2021-09-01 18:01:13 -04:00
345d7256c8
HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky ( #3651 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 18:43:25 +08:00
36884c3dff
HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore ( #3604 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:50:51 +08:00
d19728b80c
HBASE-25642 Fix or stop warning about already cached block ( #3638 )
...
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)
Because it is harmless, log at DEBUG level, not WARN.
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
2021-08-31 09:25:31 -07:00
889049eab6
HBASE-26235 We could start RegionServerTracker before becoming active master ( #3645 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-08-30 12:14:10 +08:00
c4daabd9c5
HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans ( #3639 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-29 21:13:17 +08:00
00981643d2
HBASE-26216 Move HRegionServer.abort(String) to Abortable as a default method ( #3642 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-28 22:23:23 +08:00
07c0eeebb3
HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG ( #3579 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-08-27 10:13:36 -07:00
7cc876de52
Revert "HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG ( #3579 )"
...
This reverts commit c770b1de0d
2021-08-27 10:13:34 -07:00
c770b1de0d
HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG ( #3579 )
2021-08-27 10:11:16 -07:00
11b32dbfd3
HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ ( #3632 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-27 16:42:27 +08:00
735bcf85e9
HBASE-26219 Negative time is logged while waiting on regionservers ( #3622 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:24:32 +02:00
137c7dcd3d
HBASE-26214 Introduce a ConnectionRegistryEndpoint interface ( #3613 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-25 19:20:10 +08:00
91db10a8bc
HBASE-26180 Introduce a initial refresh interval for RpcConnectionRegistry ( #3601 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-08-25 18:42:04 +08:00
1fb78a3302
HBASE-26213 Refactor AnnotationReadingPriorityFunction ( #3614 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-08-25 18:36:29 +08:00
4b0a64033a
HBASE-26215 The backup master status page should use ActiveMasterManager instead of MasterAddressTracker ( #3621 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:41:42 +08:00
2ce2f9336f
HBASE-26173 Return only a sub set of region servers as bootstrap nodes ( #3599 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-24 23:04:34 +08:00
6bb5701783
HBASE-26184 TestTableSnapshotScanner.testMergeRegion error message is… ( #3572 )
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-20 10:45:16 +01:00
d4593ce8c5
HBASE-26181 Region server and master could use itself as ConnectionRegistry ( #3603 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-20 15:35:28 +08:00
c8d9d4df80
HBASE-26172 Deprecated MasterRegistry ( #3566 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-19 16:16:35 +08:00
f2e2140b57
Amend HBASE-26187 UTs, adding a check for Split procedure completion before proceeding with test logic. ( #3598 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-18 15:39:00 +01:00
33e15a261d
HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler ( #3489 )
...
Signed-off-by: stack <stack@apache.org>
2021-08-18 14:52:01 +08:00
10c837f0e4
HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler ( #3489 )
...
Signed-off-by: stack <stack@apache.org>
2021-08-18 13:28:46 +08:00
721cb96f8c
HBASE-26187 Write straight into the store directory when Splitting an… ( #3574 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-17 09:46:00 +01:00
cacf4a86a6
HBASE-26193 Do not store meta region location as permanent state on zookeeper ( #3583 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2021-08-17 15:31:50 +08:00
356cfe9351
HBASE-24652 master-status UI make date type fields sortable
2021-08-16 16:03:50 -07:00
19f5ad5e30
HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts ( #2508 )"
...
This reverts commit 8a995ae81b
2021-08-16 13:50:37 -07:00
44d5624908
HBASE-25680 Non-idempotent test in TestReplicationHFileCleaner ( #2984 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-14 11:00:52 +08:00
11222fc4df
HBASE-26026 HBase Write may be stuck forever when using CompactingMemStore ( #3421 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 23:11:19 +08:00
238c9b40bf
HBASE-26155 JVM crash when scan ( #3553 )
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 17:09:18 +08:00
d307a8f2e8
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable ( #3577 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-08-12 13:46:22 +05:30
5e8a269b1a
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables ( #3573 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2021-08-10 10:57:04 +05:30
7f614ce77e
HBASE-6908: Add pluggable rpc queue implementation ( #3522 )
...
Can pass in a FQCN to load as the call queue implementation.
Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.
`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature
Hard fails if the class fails to load as a `BlockingQueue<CallRunner>`
Signed-off-by: stack <stack@apache.org>
2021-08-09 12:54:18 -07:00
a79a9cc53e
HBASE-26179 TestRequestTooBigException spends too much time to finish ( #3571 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-08-07 23:01:55 +08:00
c9383f2c89
HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes ( #3564 )
...
Signed-off-by: stack <stack@apache.com>
2021-08-05 08:05:26 -07:00
d4aed4d59e
HBASE-26142 NullPointerException when set 'hbase.hregion.memstore.mslab.indexchunksize.percent' to zero ( #3531 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-05 20:48:18 +08:00
83661c5636
HBASE-25469 Add detailed RIT info in JSON format for consumption as metrics ( #3535 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-04 18:04:13 -07:00
63d4970de4
HBASE-26150 Let region server also carry ClientMetaService ( #3550 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-04 23:44:10 +08:00
73a0411bb9
HBASE-26166 Fix a minor bug of table list on master ui ( #3554 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
2021-08-04 20:27:44 +08:00
2e9ab3ce94
HBASE-26154: Adds exception metrics for QuotaExceededException and RpcThrottlingException ( #3545 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2021-08-02 09:50:17 +05:30
b248730126
HBASE-26151 Reimplement MasterAddressTracker to also cache backup master addresses ( #3548 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-31 15:39:08 +08:00
8fbc2d2400
HBASE-26144 The HStore.snapshot method is never called in main code ( #3533 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-31 14:33:46 +08:00
ed4b51a6b7
HBASE-26105 Rectify the expired TODO comment in CombinedBC. ( #3509 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-30 21:34:14 +08:00
5f0950558f
HBASE-26096 Cleanup the deprecated methods in HBTU related classes and format code ( #3503 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-29 10:18:38 +08:00
02d263e7dd
HBASE-26118 The HStore.commitFile and HStore.moveFileIntoPlace almost have the same logic ( #3525 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-26 20:58:16 +08:00
4a3c7d73b0
HBASE-21946 Use ByteBuffer pread instead of byte[] pread in HFileBlock when applicable ( #3434 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-26 02:31:39 -07:00
c74366c498
HBASE-26049 Remove DfsBuilderUtility ( #3444 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-26 02:30:22 -07:00
f0324a7516
HBASE-26119 Polish TestAsyncNonMetaRegionLocator ( #3526 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-07-26 16:57:49 +08:00
8ae394285a
HBASE-26091 Remove FirstKeyValueMatchingQualifiersFilter ( #3497 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-25 21:12:20 +08:00
0294c73f1f
HBASE-26093 Replication is stuck due to zero length wal file in oldWALs directory ( #3504 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-23 09:32:55 -07:00
3c70bc1f31
HBASE-26107 MOB compaction with missing files catches incorrect exception ( #3511 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-07-22 10:16:03 +02:00
9e27de6aed
HBASE-24734 RegionInfo#containsRange should support check meta table ( #3496 )
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2021-07-22 16:07:52 +08:00
21c4578f22
HBASE-24984 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used with multi operation ( #3495 )
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-07-21 12:18:54 +05:30
16721239e7
HBASE-26100 Set version as 3.0.0-alpha-2-SNAPSHOT in master ( #3508 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-20 23:04:08 +08:00
0f313176be
HBASE-25986 set default value of normalization enabled from hbase site ( #3372 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-07-19 15:25:36 +05:30
d30cc27097
HBASE-26081 Copy HBTU to hbase-testing-util, rename the HBTU related classes in hbase-server and mark them as IA.LimitedPrivate ( #3478 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-19 09:29:08 +08:00
83d1bf1667
HBASE-26090 Remove the deprecated methods in Scan which should be removed in 3.0.0 ( #3493 )
...
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-07-16 22:27:22 +08:00
3666357ba0
HBASE-26083 L1 miss metric is incorrect when using CombinedBlockCache ( #3491 )
...
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
2021-07-16 10:25:56 +08:00
meiyi
Duo Zhang
Ruanhui
Andrew Purtell
Xiaolin Ha
Bryan Beaudreault
Nick Dimiduk
chenglei
Rushabh Shah
Istvan Toth
Mike Drob
Niels Basjes
Richard Marscher
Yutong Xiao
BukrosSzabolcs
Tak Lon (Stephen) Wu
Huaxiang Sun
huaxiangsun
sunyuting1
xianjingfeng
Wellington Ramos Chevreuil
林尚泉
Samir Khan
BukrosSzabolcs
GeorryHuang
zhengzhuobinzzb
Norbert Kalmar
Josh Elser
LiangJun He
RamanChodzka
Tomu Tsuruhara
liangxs
ss77892
Xiaolin Ha
clarax
XinSun
Anoop Sam John
Sourabh Dhanotia
binlijin
Viraj Jasani
z-york
KulwantSingh011
imbajin
richardantal
bitterfox
GeorryHuang
meiyi
hapihu
caroliney14
Pankaj
keyserbrian1
lpalasthy
eomiks
stack
lzx404243
Wei-Chiu Chuang
Peter Somogyi
gkanade
Aman Poonia