Sean Busbey
82ccd33186
HBASE-26186 jenkins script for caching artifacts should verify cached file before relying on it. ( #3590 )
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-09 13:19:43 +08:00
xicm
7832518d8a
HBASE-26312 Shell scan fails with timestamp ( #3734 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-09 10:28:25 +08:00
Duo Zhang
c410baebe3
HBASE-26339 SshPublisher will skip uploading artifacts if the build is failure ( #3736 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2021-10-09 09:43:43 +08:00
Andrew Purtell
a384c239b9
HBASE-26335 Minor improvements to IntegrationTestLoadCommonCrawl ( #3731 )
...
HBASE-26335 Minor improvements to IntegrationTestLoadCommonCrawl
- Use BufferedMutator instead of Table.
- Improve row key generator.
- Improve retries and log levels.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-08 10:00:51 -07:00
Andrew Purtell
39a20c528e
HBASE-26324 Reuse compressors and decompressors in WAL CompressionContext ( #3728 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-07 09:45:17 -07:00
Duo Zhang
7ae71e880d
HBASE-26318 Publish test logs for flaky jobs to nightlies ( #3717 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 21:58:48 +08:00
Duo Zhang
aad893530b
HBASE-26317 Publish the test logs for pre commit jenkins job to nightlies ( #3715 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 21:58:28 +08:00
Duo Zhang
11b94d3384
HBASE-26313 Publish the test logs for our nightly jobs to nightlies.apache.org ( #3713 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 21:57:21 +08:00
Andrew Purtell
42fe5e5baa
HBASE-26259 Fallback support to pure Java compression ( #3691 )
...
This change introduces provided compression codecs to HBase as
new Maven modules. Each module provides compression codec support
that formerly required Hadoop native codecs, which in turn relies
on native code integration, which may or may not be available on
a given hardware platform or in an operational environment. We
now provide codecs in the HBase distribution for users whom for
whatever reason cannot or do not wish to deploy the Hadoop native
codecs.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-06 13:17:18 -07:00
Peter Somogyi
b94188ff94
HBASE-26329 Upgrade commons-io to 2.11.0 ( #3722 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-06 10:19:17 +02:00
imbajin
f65b769e8c
HBASE-24601: Change default Hfile storage policy from HOT to NONE for HDFS ( #1940 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-02 16:35:14 +08:00
Yutong Xiao
d3c86f4f90
HBASE-26305 Move NavigableSet add operation to writer thread in BucketCache ( #3705 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-10-01 20:57:51 +08:00
chenglei
121bdea230
HBASE-26295 BucketCache could not free BucketEntry which restored fro… ( #3699 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-29 21:24:12 +08:00
Duo Zhang
1152a61b5b
HBASE-26220 Use P2P communicate between region servers to sync the list for bootstrap node ( #3697 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-29 21:12:58 +08:00
richardantal
f000b77532
HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results ( #3688 )
...
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-29 10:03:53 +02:00
Duo Zhang
113cc2a591
HBASE-26293 Use reservoir sampling when selecting bootstrap nodes ( #3702 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-09-28 23:27:47 +08:00
bitterfox
748a6827c4
HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME ( #3647 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-28 21:48:32 +08:00
GeorryHuang
63306942b1
HBASE-26251 StochasticLoadBalancer metrics should update even if balancer doesn't run ( #3678 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-09-28 21:20:48 +08:00
clarax
cbebf85b3c
HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison ( #3698 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-26 15:10:44 +08:00
clarax
2b26dfbaf4
HBASE-26178 Improve data structure and algorithm for BalanceClusterState to improve computation speed for large cluster ( #3682 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-25 20:02:28 +08:00
Tak Lon (Stephen) Wu
d956828aac
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job ( #3684 )
...
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
Signed-off-by: Josh Elser <elserj@apache.org>
2021-09-22 09:26:57 -07:00
Tak Lon (Stephen) Wu
ecd35f77ae
Revert "HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job ( #3684 )" ( #3695 )
...
This reverts commit 6556a5ee91
.
2021-09-22 09:19:05 -07:00
Tak Lon (Stephen) Wu
6556a5ee91
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job ( #3684 )
...
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
2021-09-22 09:17:18 -07:00
meiyi
96fa015043
HBASE-26261 Store configuration loss when use update_config ( #3664 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-22 18:22:30 +08:00
meiyi
e6508f6776
HBASE-26270 Provide getConfiguration method for Region and Store interface ( #3671 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 11:10:04 +08:00
meiyi
2599bd8eab
Revert "Provide getConfiguration method for Region and Store interface ( #3671 )"
...
This reverts commit 4f6e0cf601
.
2021-09-22 11:08:51 +08:00
meiyi
4f6e0cf601
Provide getConfiguration method for Region and Store interface ( #3671 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 10:23:25 +08:00
Duo Zhang
a9abdf4936
HBASE-26288 Revisit the usage of MetaTableLocator when HRegionServer.TEST_SKIP_REPORTING_TRANSITION is true ( #3689 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-22 00:00:35 +08:00
Duo Zhang
dd58fdb4ba
HBASE-26285 Addendum fix typo in table.jsp
2021-09-21 23:58:53 +08:00
Duo Zhang
4ea23c3baf
HBASE-26285 Remove MetaTableLocator usages in non-migration code ( #3686 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-21 22:22:00 +08:00
chenglei
4614c7bc57
HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed ( #3680 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-17 22:15:23 +08:00
Andrew Purtell
c60adfd13a
HBASE-26282 Update downloads.xml for release 2.4.6
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-13 17:08:40 -07:00
Josh Elser
86bc640c17
HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job
...
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-09-13 19:09:35 -04:00
Duo Zhang
d26bcaaa91
HBASE-25288 Make MasterRpcServices not extends RSRpcServices and also HMaster not extends HRegionServer ( #3612 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-09-13 09:56:13 +08:00
Mallikarjun
04c38883af
HBASE-25891 Remove dependence on storing WAL filenames for backup ( #3359 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-13 09:47:51 +08:00
Duo Zhang
fc5a8fd3bf
Revert "HBASE-25891 Remove dependence on storing WAL filenames for backup ( #3359 )"
...
This reverts commit df57b1ca6b
.
2021-09-13 09:47:25 +08:00
Mallikarjun
df57b1ca6b
HBASE-25891 Remove dependence on storing WAL filenames for backup ( #3359 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-13 09:46:43 +08:00
Wellington Ramos Chevreuil
ee632bdcae
HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells ( #3673 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-09-10 16:26:10 +01:00
Bryan Beaudreault
ed87e98d67
HBASE-26277: Fix InterfaceAudience for BalanceRequest$Builder and BalanceResponse$Builder
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-09-10 10:28:13 -04:00
Bryan Beaudreault
8679e08dab
HBASE-26240 Set InterfaceAudience to Private for BalanceRequest$Builder ( #3663 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-09-09 10:25:20 -07:00
Xiaolin Ha
8d2b995352
HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy ( #3646 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 18:26:37 +08:00
hapihu
922d0666a3
[HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" ( #3650 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 12:11:49 +08:00
huaxiangsun
b8ba3f788b
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat ( #3661 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-08 09:46:34 -07:00
chenglei
fae6261d96
HBASE-26197 Fix some obvious bugs in MultiByteBuff.put ( #3586 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-07 22:25:04 +08:00
caroliney14
03b6f2d3f2
HBASE-26163 Better logging in RSGroupInfoManagerImpl ( #3610 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bharath Vissapragada <bharathv@apache.org>
2021-09-07 22:20:09 +08:00
Pankaj
b7c6a0b637
HBASE-26228 updateRSGroupConfig operation should be authorized by AccessController ( #3633 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-09-07 22:17:26 +08:00
clarax
afbdd4115b
HBASE-26237 Improve computation complexity for primaryRegionCountSkewCostFunction ( #3657 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-09-03 18:36:55 -07:00
Duo Zhang
dd293c8ba9
HBASE-26230 Start an in process HRegionServer in maintenance mode ( #3659 )
...
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
2021-09-03 17:07:30 +08:00
Rushabh Shah
ec747bcb29
HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. ( #3636 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-02 09:16:54 -07:00
Duo Zhang
f0226921ed
HBASE-26157 Expose some IA.LimitedPrivate interface in TestingHBaseCluster ( #3643 )
...
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
2021-09-02 16:39:09 +08:00