Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,558 Commits 95 Branches 866 Tags
Commit Graph

8924 Commits

Author SHA1 Message Date
Rajeshbabu Chintaguntla
33872f7791 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:41:20 +05:30
Rajeshbabu Chintaguntla
d18d368445 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:54:56 +05:30
Rajeshbabu Chintaguntla
a3e0182cef HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-05 03:32:49 +05:30
Bryan Beaudreault
4c9185b37d HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-04 08:30:15 -04:00
Wellington Ramos Chevreuil
3aad87664d HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781) 
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2022-09-20 10:58:58 +01:00
Duo Zhang
ca86eea482
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4790) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-19 07:56:47 +08:00
Duo Zhang
df5c1ca854 HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04cf2ffa71c23b80c5680d8cbb69234b)
 2022-09-15 15:35:44 +08:00
binlijin
18c23f75f5 HBASE-27314 Make index block be customized and configured (#4763) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-13 10:10:10 +08:00
Duo Zhang
c1cad7f653 HBASE-27360 The trace related assertions are flaky for async client tests (#4767) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f3f88ff6c17633d98facf9dccb57e63b87200e4a)
 2022-09-09 23:03:16 +08:00
chenglei
fa11c8024e HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf105743de28c62a6442eba2ef04d17d46af)
 2022-09-08 16:44:02 +08:00
Bryan Beaudreault
6f6857b83f HBASE-27224 HFile tool statistic sampling produces misleading results (#4638) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
 2022-09-06 15:37:52 -04:00
Xiaolin Ha
890d6dedfe HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-05 21:16:23 +08:00
Michael Stack
71cf98f63f
HBASE-27340 Artifacts with resolved profiles (#4740) 
Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
    make it so the flatten plugin can figure 'hadoop.version'
    definitively.

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

    * hbase-asyncfs/pom.xml
    * hbase-endpoint/pom.xml
    * hbase-examples/pom.xml
    * hbase-http/pom.xml
    * hbase-rest/pom.xml
    * hbase-server/pom.xml
     Move the minikdc under profiles so it picks up appropriate hadoop version
     when the flatten plugin runs.

    * hbase-hadoop2-compat/pom.xml
     Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
     under them so we pick up appropriate hadoop version when flatten
     plugin runs.

    * hbase-mapreduce/pom.xml
     Move hadoop dependencies under profiles so right version is
     available when the flatten plugin runs.

    * hbase-shaded/hbase-shaded-testing-util/pom.xml
     Add profiles for hadoop-2.0 and hadoop-3.0 and move the
     hadoop dependencies under them.

    pom.xml
     Add the flatten plugin with the flatten profiles enabled.
     Add a few excludes on hadoop profiles picked up from sub-modules.
     E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-02 16:43:29 -07:00
Istvan Toth
81ba1231dc
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. (#4749) 
Signed-off-by: Sakthi <sakthi@apache.org>
 2022-08-31 15:50:10 +02:00
Xiaolin Ha
b0edb77b72
HBASE-27152 Under compaction mark may leak (#4725) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-08-30 01:20:28 +08:00
LiangJun He
a40d645312 HBASE-27336 The region visualizer shows 'undefined' region server (#4736) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fa02350a27d527a6e83a5b50ca80577847dfbb5f)
 2022-08-28 22:53:00 +08:00
Ujjawal
13841f52f0 HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533) 
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2022-08-26 08:58:21 -04:00
Nick Dimiduk
f1f79b9efe Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 15:44:51 +00:00
Nick Dimiduk
2ecd8bd6d6 Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 15:44:34 +00:00
Nick Dimiduk
29475d6edb Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 14:04:18 +00:00
Nick Dimiduk
6cdbc46c02 Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 14:03:59 +00:00
Tak Lon (Stephen) Wu
a97a5c7cc4
HBASE-26882 "HBASE-26810 Add dynamic configuration support for system coprocessors" to branch-2 2022-08-23 14:06:38 +02:00
Ruanhui
51576ae45a HBASE-27305 add an option to skip file splitting when bulkload hfiles (#4709) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00a719e76f16b7380f6695fc986f003e0e5f47fe)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/BulkLoadHFilesTool.java
 2022-08-22 22:45:55 +08:00
LiangJun He
78f587f559 HBASE-27104 Add a tool command list_unknownservers (#4714) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1bd0b581cb68341d6087f9fda0e4f3efe289a3a0)
 2022-08-22 21:26:19 +08:00
tianhang
3984891114 HBASE-27129 Add a config that allows us to configure region-level storage policies (#4547) 
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f238a92b6dfc63dd6a14ea49a7073d6f5ee01a73)
 2022-08-22 10:07:41 +08:00
Andrew Purtell
f2345af6d8 HBASE-27206 Clean up error-prone findings in hbase-common (#4645) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fbe3b90e0c4eef1dc13fb2a5ed9381106ca671dd)

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValueUtil.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/ServerName.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/io/crypto/TestKeyStoreKeyProvider.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/types/TestOrderedFloat32.java
 2022-08-21 21:36:25 +08:00
Fantasy-Jay
46ffdabd13 HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710) 
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a552970e592ed39735186b4364f85ed1)
 2022-08-20 21:09:53 +08:00
BukrosSzabolcs
9f3c52265d HBASE-26969:Eliminate MOB renames when SFT is enabled 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>

closes #4712
 2022-08-19 12:24:27 +02:00
Peter Somogyi
e239f70f2d HBASE-25970 MOB data loss - incorrect concatenation of MOB_FILE_REFS (#3355) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2022-08-19 12:17:30 +02:00
Sean Busbey
a9f4ec3759 HBASE-24163 MOB compactor implementations should use format specifiers when calling String.format 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-08-17 13:58:31 +02:00
huaxiangsun
e595f154d1
HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#4617) (#4704) 
* HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#1446)

* Reorganize MOB compaction tests for more reuse.
* Add tests for mob compaction after snapshot clone operations
* note the original table used to write a given mob hfile and use that to find it later.

Signed-off-by: Esteban Gutierrez <esteban@apache.org>

* spotless:apply to fix HBaseTestingUtility

* Fix error-prone errors

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Co-authored-by: Sean Busbey <busbey@apache.org>

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Co-authored-by: Andrew Purtell <apurtell@apache.org>
Co-authored-by: Sean Busbey <busbey@apache.org>
 2022-08-15 13:16:00 -07:00
liangxs
3980e6d087 HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… (#4376) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: stack <stack@apache.org>
 2022-08-15 11:12:34 -07:00
huaxiangsun
7f6f184f06
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695) (#4702) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-15 09:16:51 -07:00
SiCheng-Zheng
5a606837fc HBASE-27248 WALPrettyPrinter add print timestamp (#4659) 
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6b2e9d14a71d3ccbedabf971fe961802d263a995)
 2022-08-10 21:31:06 +08:00
Bryan Beaudreault
c0717c7383 HBASE-27241 Add metrics for evaluating cost and effectiveness of bloom filters (#4669) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-09 15:28:43 -04:00
Duo Zhang
187c084cf2 HBASE-27283 Use readTO instead of hard coded RpcClient.DEFAULT_SOCKET_TIMEOUT_READ when creating ReadTimeoutHandler in NettyRpcConnection (#4685) 
Signed-off-by: Xin Sun <ddupgs@gmail.com
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 5919b30b6d9e905130033461efc37fae60bab947)
 2022-08-09 16:23:08 +08:00
chaijunjie0101
97d87b011f HBASE-27282 CME in AuthManager causes region server crash (#4684) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d6641626a97529982720de2b73593e294869c4ca)
 2022-08-09 09:57:40 +08:00
Duo Zhang
0a36504848 HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big (#4679) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 486d19e99ff4370bc60e0db235508198c84a00e3)
 2022-08-06 20:31:38 +08:00
LiangJun He
a7f8dde815 HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect (#4678) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2dc26082be978796046d9124212e8c9d2d8a1f5d)
 2022-08-04 23:17:30 +08:00
Nick Dimiduk
472e81098e HBASE-27153 Improvements to read-path tracing 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-08-02 14:10:05 +02:00
Bryan Beaudreault
7aa46f03f4 HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-07-29 15:33:44 -04:00
Andrew Purtell
ce1455c365 HBASE-27087 TestQuotaThrottle times out 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-26 14:11:32 -07:00
Bryan Beaudreault
25136c39f9 HBASE-27229 BucketCache statistics should not count evictions by hfile (#4639) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-26 17:10:41 -04:00
Duo Zhang
88f957b323 HBASE-27222 Purge FutureReturnValueIgnored warnings from error prone (#4634) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 8b091c4061220cc4307ef2ed35291f6fe14bbdb0)
 2022-07-26 23:45:29 +08:00
Bryan Beaudreault
4e4ebe99c5 HBASE-27225 Add BucketAllocator bucket size statistic logging (#4637) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-07-25 21:02:23 -04:00
Duo Zhang
a6a75ef43d HBASE-27075 TestUpdateRSGroupConfiguration.testCustomOnlineConfigChangeInRSGroup is flaky (#4636) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 31fc97edeede08cfc9c8dd9fe22c3775ede2eebb)

Conflicts:
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsBase.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
 2022-07-21 14:52:59 +08:00
Duo Zhang
cf4da36954 Revert "HBASE-27152 Under compaction mark may leak (#4568)" 
This reverts commit 3ebb4360b9bc17c8eed362671c1cba49c3a05697.
 2022-07-21 09:04:37 +08:00
Xiaolin Ha
3ebb4360b9 HBASE-27152 Under compaction mark may leak (#4568) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit da27a67a1e3abfa0117b0cf1a59d01b7a2f8ab05)
 2022-07-20 08:52:10 +08:00
Nihal Jain
25c375e186 HBASE-20499 Replication/Priority executors can use specific max queue length as default value instead of general maxQueueLength 
Signed-off-by: tedyu <yuzhihong@gmail.com>
(cherry picked from commit 6d080762ef795adf02dd0ab236c4b3eb73e19a91)
 2022-07-19 13:57:47 +08:00
Duo Zhang
9c3528d730 HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-19 10:03:26 +08:00