Commit Graph

8888 Commits

Author SHA1 Message Date
Tak Lon (Stephen) Wu 6556a5ee91
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684)
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching 
INDEX/LEAF_INDEX block when a client, e.g. 
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
2021-09-22 09:17:18 -07:00
meiyi 96fa015043
HBASE-26261 Store configuration loss when use update_config (#3664)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-22 18:22:30 +08:00
meiyi e6508f6776 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 11:10:04 +08:00
meiyi 2599bd8eab Revert "Provide getConfiguration method for Region and Store interface (#3671)"
This reverts commit 4f6e0cf601.
2021-09-22 11:08:51 +08:00
meiyi 4f6e0cf601
Provide getConfiguration method for Region and Store interface (#3671)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 10:23:25 +08:00
Duo Zhang a9abdf4936
HBASE-26288 Revisit the usage of MetaTableLocator when HRegionServer.TEST_SKIP_REPORTING_TRANSITION is true (#3689)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-22 00:00:35 +08:00
Duo Zhang dd58fdb4ba HBASE-26285 Addendum fix typo in table.jsp 2021-09-21 23:58:53 +08:00
Duo Zhang 4ea23c3baf
HBASE-26285 Remove MetaTableLocator usages in non-migration code (#3686)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-21 22:22:00 +08:00
chenglei 4614c7bc57
HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-17 22:15:23 +08:00
Duo Zhang d26bcaaa91
HBASE-25288 Make MasterRpcServices not extends RSRpcServices and also HMaster not extends HRegionServer (#3612)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-13 09:56:13 +08:00
Xiaolin Ha 8d2b995352
HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 18:26:37 +08:00
hapihu 922d0666a3
[HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 12:11:49 +08:00
caroliney14 03b6f2d3f2
HBASE-26163 Better logging in RSGroupInfoManagerImpl (#3610)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bharath Vissapragada <bharathv@apache.org>
2021-09-07 22:20:09 +08:00
Pankaj b7c6a0b637
HBASE-26228 updateRSGroupConfig operation should be authorized by AccessController (#3633)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-09-07 22:17:26 +08:00
Duo Zhang dd293c8ba9
HBASE-26230 Start an in process HRegionServer in maintenance mode (#3659)
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
2021-09-03 17:07:30 +08:00
Rushabh Shah ec747bcb29
HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-02 09:16:54 -07:00
Bryan Beaudreault a15e94a47f HBASE-26147 Add a dry run mode to the balancer, where moves are calculated but not actually executed
Closes #3630

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org
2021-09-01 18:01:13 -04:00
XinSun 345d7256c8
HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 18:43:25 +08:00
chenglei 36884c3dff
HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore (#3604)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:50:51 +08:00
Andrew Purtell d19728b80c
HBASE-25642 Fix or stop warning about already cached block (#3638)
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)

Because it is harmless, log at DEBUG level, not WARN.

Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
2021-08-31 09:25:31 -07:00
Duo Zhang 889049eab6
HBASE-26235 We could start RegionServerTracker before becoming active master (#3645)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-08-30 12:14:10 +08:00
keyserbrian1 c4daabd9c5
HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans (#3639)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-29 21:13:17 +08:00
GeorryHuang 00981643d2
HBASE-26216 Move HRegionServer.abort(String) to Abortable as a default method (#3642)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-28 22:23:23 +08:00
Andrew Purtell 07c0eeebb3 HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-08-27 10:13:36 -07:00
Andrew Purtell 7cc876de52 Revert "HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579)"
This reverts commit c770b1de0d.

GH workflow error caused commit with incorrect message.
2021-08-27 10:13:34 -07:00
Andrew Purtell c770b1de0d
HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579) 2021-08-27 10:11:16 -07:00
Pankaj 11b32dbfd3
HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ (#3632)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-27 16:42:27 +08:00
lpalasthy 735bcf85e9
HBASE-26219 Negative time is logged while waiting on regionservers (#3622)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:24:32 +02:00
Duo Zhang 137c7dcd3d
HBASE-26214 Introduce a ConnectionRegistryEndpoint interface (#3613)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-25 19:20:10 +08:00
Duo Zhang 91db10a8bc
HBASE-26180 Introduce a initial refresh interval for RpcConnectionRegistry (#3601)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-08-25 18:42:04 +08:00
Duo Zhang 1fb78a3302
HBASE-26213 Refactor AnnotationReadingPriorityFunction (#3614)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-08-25 18:36:29 +08:00
GeorryHuang 4b0a64033a
HBASE-26215 The backup master status page should use ActiveMasterManager instead of MasterAddressTracker (#3621)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:41:42 +08:00
Duo Zhang 2ce2f9336f
HBASE-26173 Return only a sub set of region servers as bootstrap nodes (#3599)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-24 23:04:34 +08:00
Wellington Ramos Chevreuil 6bb5701783
HBASE-26184 TestTableSnapshotScanner.testMergeRegion error message is… (#3572)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-20 10:45:16 +01:00
Duo Zhang d4593ce8c5
HBASE-26181 Region server and master could use itself as ConnectionRegistry (#3603)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-20 15:35:28 +08:00
Duo Zhang c8d9d4df80
HBASE-26172 Deprecated MasterRegistry (#3566)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-19 16:16:35 +08:00
Wellington Ramos Chevreuil f2e2140b57
Amend HBASE-26187 UTs, adding a check for Split procedure completion before proceeding with test logic. (#3598)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-18 15:39:00 +01:00
Xiaolin Ha 33e15a261d HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler (#3489)
Signed-off-by: stack <stack@apache.org>
2021-08-18 14:52:01 +08:00
Xiaolin Ha 10c837f0e4
HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler (#3489)
Signed-off-by: stack <stack@apache.org>
2021-08-18 13:28:46 +08:00
Wellington Ramos Chevreuil 721cb96f8c
HBASE-26187 Write straight into the store directory when Splitting an… (#3574)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-17 09:46:00 +01:00
Duo Zhang cacf4a86a6
HBASE-26193 Do not store meta region location as permanent state on zookeeper (#3583)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2021-08-17 15:31:50 +08:00
eomiks 356cfe9351 HBASE-24652 master-status UI make date type fields sortable 2021-08-16 16:03:50 -07:00
stack 19f5ad5e30 HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)"
This reverts commit 8a995ae81b.
2021-08-16 13:50:37 -07:00
lzx404243 44d5624908
HBASE-25680 Non-idempotent test in TestReplicationHFileCleaner (#2984)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-14 11:00:52 +08:00
chenglei 11222fc4df
HBASE-26026 HBase Write may be stuck forever when using CompactingMemStore (#3421)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 23:11:19 +08:00
Xiaolin Ha 238c9b40bf
HBASE-26155 JVM crash when scan (#3553)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 17:09:18 +08:00
Rushabh Shah d307a8f2e8
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable (#3577)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-08-12 13:46:22 +05:30
Viraj Jasani 5e8a269b1a
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables (#3573)
Signed-off-by: Michael Stack <stack@apache.org>
2021-08-10 10:57:04 +05:30
Richard Marscher 7f614ce77e
HBASE-6908: Add pluggable rpc queue implementation (#3522)
Can pass in a FQCN to load as the call queue implementation.

Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.

`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature

Hard fails if the class fails to load as a `BlockingQueue<CallRunner>`

Signed-off-by: stack <stack@apache.org>
2021-08-09 12:54:18 -07:00
Duo Zhang a79a9cc53e
HBASE-26179 TestRequestTooBigException spends too much time to finish (#3571)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-08-07 23:01:55 +08:00