Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,981 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18981 Commits

Author SHA1 Message Date
KulwantSingh011 891e90f08f
HBASE-26190 High rate logging of Bucket Allocator Allocation fails (#3648) 
* HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.
Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.

Signed-off-by: Anoop <anoopsamjohn@apache.org>
 2021-10-14 13:13:17 +05:30
Nick Dimiduk 4d27c4726d HBASE-26359 Loosen Dockerfile pinned package versions for `create-release/mac-sshd-gpg-agent/Dockerfile` 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-10-13 12:15:35 -07:00
Viraj Jasani ede4d2715d
HBASE-26345 Design doc for HBase NamedQueue framework 2021-10-12 20:43:17 +05:30
Horváth Dóra ce44e16939
HBASE-26284 Add HBase Thrift API to get all table names along with wh… (#3693) 
Signed-off-by: Norbert Kalmar <nkalmar@cloudera.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-10-11 13:04:03 +01:00
Sean Busbey 82ccd33186
HBASE-26186 jenkins script for caching artifacts should verify cached file before relying on it. (#3590) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-09 13:19:43 +08:00
xicm 7832518d8a
HBASE-26312 Shell scan fails with timestamp (#3734) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-09 10:28:25 +08:00
Duo Zhang c410baebe3
HBASE-26339 SshPublisher will skip uploading artifacts if the build is failure (#3736) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-10-09 09:43:43 +08:00
Andrew Purtell a384c239b9
HBASE-26335 Minor improvements to IntegrationTestLoadCommonCrawl (#3731) 
HBASE-26335 Minor improvements to IntegrationTestLoadCommonCrawl

- Use BufferedMutator instead of Table.
- Improve row key generator.
- Improve retries and log levels.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-08 10:00:51 -07:00
Andrew Purtell 39a20c528e
HBASE-26324 Reuse compressors and decompressors in WAL CompressionContext (#3728) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-07 09:45:17 -07:00
Duo Zhang 7ae71e880d
HBASE-26318 Publish test logs for flaky jobs to nightlies (#3717) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-10-07 21:58:48 +08:00
Duo Zhang aad893530b
HBASE-26317 Publish the test logs for pre commit jenkins job to nightlies (#3715) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-10-07 21:58:28 +08:00
Duo Zhang 11b94d3384
HBASE-26313 Publish the test logs for our nightly jobs to nightlies.apache.org (#3713) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-10-07 21:57:21 +08:00
Andrew Purtell 42fe5e5baa
HBASE-26259 Fallback support to pure Java compression (#3691) 
This change introduces provided compression codecs to HBase as
new Maven modules. Each module provides compression codec support
that formerly required Hadoop native codecs, which in turn relies
on native code integration, which may or may not be available on
a given hardware platform or in an operational environment. We
now provide codecs in the HBase distribution for users whom for
whatever reason cannot or do not wish to deploy the Hadoop native
codecs.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-06 13:17:18 -07:00
Peter Somogyi b94188ff94
HBASE-26329 Upgrade commons-io to 2.11.0 (#3722) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-06 10:19:17 +02:00
imbajin f65b769e8c
HBASE-24601: Change default Hfile storage policy from HOT to NONE for HDFS (#1940) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-02 16:35:14 +08:00
Yutong Xiao d3c86f4f90
HBASE-26305 Move NavigableSet add operation to writer thread in BucketCache (#3705) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
 2021-10-01 20:57:51 +08:00
chenglei 121bdea230
HBASE-26295 BucketCache could not free BucketEntry which restored fro… (#3699) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-29 21:24:12 +08:00
Duo Zhang 1152a61b5b
HBASE-26220 Use P2P communicate between region servers to sync the list for bootstrap node (#3697) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-09-29 21:12:58 +08:00
richardantal f000b77532
HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results (#3688) 
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-09-29 10:03:53 +02:00
Duo Zhang 113cc2a591
HBASE-26293 Use reservoir sampling when selecting bootstrap nodes (#3702) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-09-28 23:27:47 +08:00
bitterfox 748a6827c4
HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-28 21:48:32 +08:00
GeorryHuang 63306942b1
HBASE-26251 StochasticLoadBalancer metrics should update even if balancer doesn't run (#3678) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-09-28 21:20:48 +08:00
clarax cbebf85b3c
HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison (#3698) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-26 15:10:44 +08:00
clarax 2b26dfbaf4
HBASE-26178 Improve data structure and algorithm for BalanceClusterState to improve computation speed for large cluster (#3682) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-25 20:02:28 +08:00
Tak Lon (Stephen) Wu d956828aac HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684) 
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
 2021-09-22 09:26:57 -07:00
Tak Lon (Stephen) Wu ecd35f77ae
Revert "HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684)" (#3695) 
This reverts commit 6556a5ee91.
 2021-09-22 09:19:05 -07:00
Tak Lon (Stephen) Wu 6556a5ee91
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684) 
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching 
INDEX/LEAF_INDEX block when a client, e.g. 
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.
 2021-09-22 09:17:18 -07:00
meiyi 96fa015043
HBASE-26261 Store configuration loss when use update_config (#3664) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-22 18:22:30 +08:00
meiyi e6508f6776 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-22 11:10:04 +08:00
meiyi 2599bd8eab Revert "Provide getConfiguration method for Region and Store interface (#3671)" 
This reverts commit 4f6e0cf601.
 2021-09-22 11:08:51 +08:00
meiyi 4f6e0cf601
Provide getConfiguration method for Region and Store interface (#3671) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-22 10:23:25 +08:00
Duo Zhang a9abdf4936
HBASE-26288 Revisit the usage of MetaTableLocator when HRegionServer.TEST_SKIP_REPORTING_TRANSITION is true (#3689) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-09-22 00:00:35 +08:00
Duo Zhang dd58fdb4ba HBASE-26285 Addendum fix typo in table.jsp 2021-09-21 23:58:53 +08:00
Duo Zhang 4ea23c3baf
HBASE-26285 Remove MetaTableLocator usages in non-migration code (#3686) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-09-21 22:22:00 +08:00
chenglei 4614c7bc57
HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-17 22:15:23 +08:00
Andrew Purtell c60adfd13a HBASE-26282 Update downloads.xml for release 2.4.6 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-13 17:08:40 -07:00
Josh Elser 86bc640c17 HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job 
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2021-09-13 19:09:35 -04:00
Duo Zhang d26bcaaa91
HBASE-25288 Make MasterRpcServices not extends RSRpcServices and also HMaster not extends HRegionServer (#3612) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-09-13 09:56:13 +08:00
Mallikarjun 04c38883af HBASE-25891 Remove dependence on storing WAL filenames for backup (#3359) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-13 09:47:51 +08:00
Duo Zhang fc5a8fd3bf Revert "HBASE-25891 Remove dependence on storing WAL filenames for backup (#3359)" 
This reverts commit df57b1ca6b.
 2021-09-13 09:47:25 +08:00
Mallikarjun df57b1ca6b
HBASE-25891 Remove dependence on storing WAL filenames for backup (#3359) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-13 09:46:43 +08:00
Wellington Ramos Chevreuil ee632bdcae
HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells (#3673) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-09-10 16:26:10 +01:00
Bryan Beaudreault ed87e98d67 HBASE-26277: Fix InterfaceAudience for BalanceRequest$Builder and BalanceResponse$Builder 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-09-10 10:28:13 -04:00
Bryan Beaudreault 8679e08dab
HBASE-26240 Set InterfaceAudience to Private for BalanceRequest$Builder (#3663) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-09-09 10:25:20 -07:00
Xiaolin Ha 8d2b995352
HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 18:26:37 +08:00
hapihu 922d0666a3
[HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 12:11:49 +08:00
huaxiangsun b8ba3f788b
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat (#3661) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-08 09:46:34 -07:00
chenglei fae6261d96
HBASE-26197 Fix some obvious bugs in MultiByteBuff.put (#3586) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-07 22:25:04 +08:00
caroliney14 03b6f2d3f2
HBASE-26163 Better logging in RSGroupInfoManagerImpl (#3610) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bharath Vissapragada <bharathv@apache.org>
 2021-09-07 22:20:09 +08:00
Pankaj b7c6a0b637
HBASE-26228 updateRSGroupConfig operation should be authorized by AccessController (#3633) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
 2021-09-07 22:17:26 +08:00