Tak Lon (Stephen) Wu
6556a5ee91
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job ( #3684 )
...
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
2021-09-22 09:17:18 -07:00
meiyi
96fa015043
HBASE-26261 Store configuration loss when use update_config ( #3664 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-22 18:22:30 +08:00
meiyi
e6508f6776
HBASE-26270 Provide getConfiguration method for Region and Store interface ( #3671 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 11:10:04 +08:00
meiyi
2599bd8eab
Revert "Provide getConfiguration method for Region and Store interface ( #3671 )"
...
This reverts commit 4f6e0cf601
.
2021-09-22 11:08:51 +08:00
meiyi
4f6e0cf601
Provide getConfiguration method for Region and Store interface ( #3671 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 10:23:25 +08:00
Duo Zhang
a9abdf4936
HBASE-26288 Revisit the usage of MetaTableLocator when HRegionServer.TEST_SKIP_REPORTING_TRANSITION is true ( #3689 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-22 00:00:35 +08:00
Duo Zhang
dd58fdb4ba
HBASE-26285 Addendum fix typo in table.jsp
2021-09-21 23:58:53 +08:00
Duo Zhang
4ea23c3baf
HBASE-26285 Remove MetaTableLocator usages in non-migration code ( #3686 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-21 22:22:00 +08:00
chenglei
4614c7bc57
HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed ( #3680 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-17 22:15:23 +08:00
Andrew Purtell
c60adfd13a
HBASE-26282 Update downloads.xml for release 2.4.6
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-13 17:08:40 -07:00
Josh Elser
86bc640c17
HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job
...
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-09-13 19:09:35 -04:00
Duo Zhang
d26bcaaa91
HBASE-25288 Make MasterRpcServices not extends RSRpcServices and also HMaster not extends HRegionServer ( #3612 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-13 09:56:13 +08:00
Mallikarjun
04c38883af
HBASE-25891 Remove dependence on storing WAL filenames for backup ( #3359 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-13 09:47:51 +08:00
Duo Zhang
fc5a8fd3bf
Revert "HBASE-25891 Remove dependence on storing WAL filenames for backup ( #3359 )"
...
This reverts commit df57b1ca6b
.
2021-09-13 09:47:25 +08:00
Mallikarjun
df57b1ca6b
HBASE-25891 Remove dependence on storing WAL filenames for backup ( #3359 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-13 09:46:43 +08:00
Wellington Ramos Chevreuil
ee632bdcae
HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells ( #3673 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-09-10 16:26:10 +01:00
Bryan Beaudreault
ed87e98d67
HBASE-26277: Fix InterfaceAudience for BalanceRequest$Builder and BalanceResponse$Builder
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-09-10 10:28:13 -04:00
Bryan Beaudreault
8679e08dab
HBASE-26240 Set InterfaceAudience to Private for BalanceRequest$Builder ( #3663 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-09-09 10:25:20 -07:00
Xiaolin Ha
8d2b995352
HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy ( #3646 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 18:26:37 +08:00
hapihu
922d0666a3
[HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" ( #3650 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 12:11:49 +08:00
huaxiangsun
b8ba3f788b
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat ( #3661 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-08 09:46:34 -07:00
chenglei
fae6261d96
HBASE-26197 Fix some obvious bugs in MultiByteBuff.put ( #3586 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-07 22:25:04 +08:00
caroliney14
03b6f2d3f2
HBASE-26163 Better logging in RSGroupInfoManagerImpl ( #3610 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bharath Vissapragada <bharathv@apache.org>
2021-09-07 22:20:09 +08:00
Pankaj
b7c6a0b637
HBASE-26228 updateRSGroupConfig operation should be authorized by AccessController ( #3633 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-09-07 22:17:26 +08:00
clarax
afbdd4115b
HBASE-26237 Improve computation complexity for primaryRegionCountSkewCostFunction ( #3657 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-09-03 18:36:55 -07:00
Duo Zhang
dd293c8ba9
HBASE-26230 Start an in process HRegionServer in maintenance mode ( #3659 )
...
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
2021-09-03 17:07:30 +08:00
Rushabh Shah
ec747bcb29
HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. ( #3636 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-02 09:16:54 -07:00
Duo Zhang
f0226921ed
HBASE-26157 Expose some IA.LimitedPrivate interface in TestingHBaseCluster ( #3643 )
...
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-09-02 16:39:09 +08:00
Bryan Beaudreault
a15e94a47f
HBASE-26147 Add a dry run mode to the balancer, where moves are calculated but not actually executed
...
Closes #3630
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org
2021-09-01 18:01:13 -04:00
bitterfox
f62caa5c88
HBASE-26205 Use specified cluster conf for UserProvider in TableMRUtil#initCredentialsForCluster ( #3592 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
2021-09-01 20:30:41 +08:00
XinSun
345d7256c8
HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky ( #3651 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 18:43:25 +08:00
chenglei
36884c3dff
HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore ( #3604 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:50:51 +08:00
chenglei
3c64f8621f
HBASE-26244 Avoid trim the error stack trace when running UT with maven ( #3654 )
...
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:17:05 +08:00
Andrew Purtell
ed56a40e46
HBASE-25588 Excessive logging of "hbase.zookeeper.useMulti is deprecated. Default to true always." ( #3640 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Duo Zhang <zhangduo@apache.org>
2021-08-31 09:39:21 -07:00
Andrew Purtell
d19728b80c
HBASE-25642 Fix or stop warning about already cached block ( #3638 )
...
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)
Because it is harmless, log at DEBUG level, not WARN.
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
2021-08-31 09:25:31 -07:00
Rushabh Shah
a0864ed3bc
HBASE-26103 Deprecate BufferedMutatorParams#pool method ( #3635 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
2021-08-30 10:21:32 -07:00
Duo Zhang
889049eab6
HBASE-26235 We could start RegionServerTracker before becoming active master ( #3645 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-08-30 12:14:10 +08:00
keyserbrian1
c4daabd9c5
HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans ( #3639 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-29 21:13:17 +08:00
GeorryHuang
00981643d2
HBASE-26216 Move HRegionServer.abort(String) to Abortable as a default method ( #3642 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-28 22:23:23 +08:00
Andrew Purtell
07c0eeebb3
HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG ( #3579 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-08-27 10:13:36 -07:00
Andrew Purtell
7cc876de52
Revert "HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG ( #3579 )"
...
This reverts commit c770b1de0d
.
GH workflow error caused commit with incorrect message.
2021-08-27 10:13:34 -07:00
Andrew Purtell
c770b1de0d
HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG ( #3579 )
2021-08-27 10:11:16 -07:00
Pankaj
11b32dbfd3
HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ ( #3632 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-27 16:42:27 +08:00
lpalasthy
735bcf85e9
HBASE-26219 Negative time is logged while waiting on regionservers ( #3622 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:24:32 +02:00
Duo Zhang
137c7dcd3d
HBASE-26214 Introduce a ConnectionRegistryEndpoint interface ( #3613 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-25 19:20:10 +08:00
Duo Zhang
91db10a8bc
HBASE-26180 Introduce a initial refresh interval for RpcConnectionRegistry ( #3601 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-08-25 18:42:04 +08:00
Duo Zhang
1fb78a3302
HBASE-26213 Refactor AnnotationReadingPriorityFunction ( #3614 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-08-25 18:36:29 +08:00
GeorryHuang
4b0a64033a
HBASE-26215 The backup master status page should use ActiveMasterManager instead of MasterAddressTracker ( #3621 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:41:42 +08:00
Duo Zhang
2ce2f9336f
HBASE-26173 Return only a sub set of region servers as bootstrap nodes ( #3599 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-24 23:04:34 +08:00
bitterfox
d781113a08
HBASE-26204 Obtain credential for VerifyReplication with peerQuorumAddress ( #3591 )
...
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-08-24 12:17:02 +01:00