Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,008 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

19008 Commits

Author SHA1 Message Date
clarax 2b26dfbaf4
HBASE-26178 Improve data structure and algorithm for BalanceClusterState to improve computation speed for large cluster (#3682) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-25 20:02:28 +08:00
Tak Lon (Stephen) Wu d956828aac HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684) 
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
 2021-09-22 09:26:57 -07:00
Tak Lon (Stephen) Wu ecd35f77ae
Revert "HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684)" (#3695) 
This reverts commit 6556a5ee91.
 2021-09-22 09:19:05 -07:00
Tak Lon (Stephen) Wu 6556a5ee91
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684) 
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching 
INDEX/LEAF_INDEX block when a client, e.g. 
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
 2021-09-22 09:17:18 -07:00
meiyi 96fa015043
HBASE-26261 Store configuration loss when use update_config (#3664) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-22 18:22:30 +08:00
meiyi e6508f6776 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-22 11:10:04 +08:00
meiyi 2599bd8eab Revert "Provide getConfiguration method for Region and Store interface (#3671)" 
This reverts commit 4f6e0cf601.
 2021-09-22 11:08:51 +08:00
meiyi 4f6e0cf601
Provide getConfiguration method for Region and Store interface (#3671) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-22 10:23:25 +08:00
Duo Zhang a9abdf4936
HBASE-26288 Revisit the usage of MetaTableLocator when HRegionServer.TEST_SKIP_REPORTING_TRANSITION is true (#3689) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-09-22 00:00:35 +08:00
Duo Zhang dd58fdb4ba HBASE-26285 Addendum fix typo in table.jsp 2021-09-21 23:58:53 +08:00
Duo Zhang 4ea23c3baf
HBASE-26285 Remove MetaTableLocator usages in non-migration code (#3686) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-09-21 22:22:00 +08:00
chenglei 4614c7bc57
HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-17 22:15:23 +08:00
Andrew Purtell c60adfd13a HBASE-26282 Update downloads.xml for release 2.4.6 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-13 17:08:40 -07:00
Josh Elser 86bc640c17 HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job 
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2021-09-13 19:09:35 -04:00
Duo Zhang d26bcaaa91
HBASE-25288 Make MasterRpcServices not extends RSRpcServices and also HMaster not extends HRegionServer (#3612) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-09-13 09:56:13 +08:00
Mallikarjun 04c38883af HBASE-25891 Remove dependence on storing WAL filenames for backup (#3359) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-13 09:47:51 +08:00
Duo Zhang fc5a8fd3bf Revert "HBASE-25891 Remove dependence on storing WAL filenames for backup (#3359)" 
This reverts commit df57b1ca6b.
 2021-09-13 09:47:25 +08:00
Mallikarjun df57b1ca6b
HBASE-25891 Remove dependence on storing WAL filenames for backup (#3359) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-13 09:46:43 +08:00
Wellington Ramos Chevreuil ee632bdcae
HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells (#3673) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-09-10 16:26:10 +01:00
Bryan Beaudreault ed87e98d67 HBASE-26277: Fix InterfaceAudience for BalanceRequest$Builder and BalanceResponse$Builder 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-09-10 10:28:13 -04:00
Bryan Beaudreault 8679e08dab
HBASE-26240 Set InterfaceAudience to Private for BalanceRequest$Builder (#3663) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-09-09 10:25:20 -07:00
Xiaolin Ha 8d2b995352
HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 18:26:37 +08:00
hapihu 922d0666a3
[HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 12:11:49 +08:00
huaxiangsun b8ba3f788b
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat (#3661) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-08 09:46:34 -07:00
chenglei fae6261d96
HBASE-26197 Fix some obvious bugs in MultiByteBuff.put (#3586) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-07 22:25:04 +08:00
caroliney14 03b6f2d3f2
HBASE-26163 Better logging in RSGroupInfoManagerImpl (#3610) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bharath Vissapragada <bharathv@apache.org>
 2021-09-07 22:20:09 +08:00
Pankaj b7c6a0b637
HBASE-26228 updateRSGroupConfig operation should be authorized by AccessController (#3633) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
 2021-09-07 22:17:26 +08:00
clarax afbdd4115b
HBASE-26237 Improve computation complexity for primaryRegionCountSkewCostFunction (#3657) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-09-03 18:36:55 -07:00
Duo Zhang dd293c8ba9
HBASE-26230 Start an in process HRegionServer in maintenance mode (#3659) 
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
 2021-09-03 17:07:30 +08:00
Rushabh Shah ec747bcb29
HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-02 09:16:54 -07:00
Duo Zhang f0226921ed
HBASE-26157 Expose some IA.LimitedPrivate interface in TestingHBaseCluster (#3643) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
 2021-09-02 16:39:09 +08:00
Bryan Beaudreault a15e94a47f HBASE-26147 Add a dry run mode to the balancer, where moves are calculated but not actually executed 
Closes #3630

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org
 2021-09-01 18:01:13 -04:00
bitterfox f62caa5c88
HBASE-26205 Use specified cluster conf for UserProvider in TableMRUtil#initCredentialsForCluster (#3592) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
 2021-09-01 20:30:41 +08:00
XinSun 345d7256c8
HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-01 18:43:25 +08:00
chenglei 36884c3dff
HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore (#3604) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-01 15:50:51 +08:00
chenglei 3c64f8621f
HBASE-26244 Avoid trim the error stack trace when running UT with maven (#3654) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-01 15:17:05 +08:00
Andrew Purtell ed56a40e46
HBASE-25588 Excessive logging of "hbase.zookeeper.useMulti is deprecated. Default to true always." (#3640) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Duo Zhang <zhangduo@apache.org>
 2021-08-31 09:39:21 -07:00
Andrew Purtell d19728b80c
HBASE-25642 Fix or stop warning about already cached block (#3638) 
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)

Because it is harmless, log at DEBUG level, not WARN.

Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
 2021-08-31 09:25:31 -07:00
Rushabh Shah a0864ed3bc
HBASE-26103 Deprecate BufferedMutatorParams#pool method (#3635) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-08-30 10:21:32 -07:00
Duo Zhang 889049eab6
HBASE-26235 We could start RegionServerTracker before becoming active master (#3645) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-08-30 12:14:10 +08:00
keyserbrian1 c4daabd9c5
HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans (#3639) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-29 21:13:17 +08:00
GeorryHuang 00981643d2
HBASE-26216 Move HRegionServer.abort(String) to Abortable as a default method (#3642) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-28 22:23:23 +08:00
Andrew Purtell 07c0eeebb3 HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-08-27 10:13:36 -07:00
Andrew Purtell 7cc876de52 Revert "HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579)" 
This reverts commit c770b1de0d.

GH workflow error caused commit with incorrect message.
 2021-08-27 10:13:34 -07:00
Andrew Purtell c770b1de0d
HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579) 2021-08-27 10:11:16 -07:00
Pankaj 11b32dbfd3
HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ (#3632) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-27 16:42:27 +08:00
lpalasthy 735bcf85e9
HBASE-26219 Negative time is logged while waiting on regionservers (#3622) 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-25 16:24:32 +02:00
Duo Zhang 137c7dcd3d
HBASE-26214 Introduce a ConnectionRegistryEndpoint interface (#3613) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-08-25 19:20:10 +08:00
Duo Zhang 91db10a8bc
HBASE-26180 Introduce a initial refresh interval for RpcConnectionRegistry (#3601) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2021-08-25 18:42:04 +08:00
Duo Zhang 1fb78a3302
HBASE-26213 Refactor AnnotationReadingPriorityFunction (#3614) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2021-08-25 18:36:29 +08:00