Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,469 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

8882 Commits

Author SHA1 Message Date
d-c-manning b9ec644e51 HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 14:19:42 -07:00
Andrew Purtell 511e0105ae HBASE-27432 TestUsersOperationsWithSecureHadoop fails after HBASE-27411 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 13:15:20 -07:00
Andrew Purtell a8605912ec Preparing development version 2.5.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-13 09:11:37 -07:00
Andrew Purtell edf0b62273 Preparing hbase release 2.5.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-13 09:11:34 -07:00
binlijin 66873ca5a6
HBASE-25166 MobFileCompactionChore is closing the master's shared cluster connection (#2514) (#4826) 
Co-authored-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-10-13 22:07:46 +08:00
Andrew Purtell b7fbb668d5 HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-10-10 22:57:29 +00:00
Duo Zhang 050f3e1ef5 HBASE-27401 Addendum fix more javadoc issues 
(cherry picked from commit 4b45256910)
 2022-10-07 00:55:26 +08:00
Duo Zhang fb988373c1 HBASE-27401 Clean up current broken 'n's in our javadoc (#4812) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
 2022-10-06 23:01:14 +08:00
Rajeshbabu Chintaguntla 33872f7791 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:41:20 +05:30
Rajeshbabu Chintaguntla d18d368445 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:54:56 +05:30
Rajeshbabu Chintaguntla a3e0182cef HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-05 03:32:49 +05:30
Bryan Beaudreault 4c9185b37d HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-04 08:30:15 -04:00
Wellington Ramos Chevreuil 3aad87664d HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781) 
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2022-09-20 10:58:58 +01:00
Duo Zhang ca86eea482
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4790) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-19 07:56:47 +08:00
Duo Zhang df5c1ca854 HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04)
 2022-09-15 15:35:44 +08:00
binlijin 18c23f75f5 HBASE-27314 Make index block be customized and configured (#4763) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-13 10:10:10 +08:00
Duo Zhang c1cad7f653 HBASE-27360 The trace related assertions are flaky for async client tests (#4767) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f3f88ff6c1)
 2022-09-09 23:03:16 +08:00
chenglei fa11c8024e HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf1057)
 2022-09-08 16:44:02 +08:00
Bryan Beaudreault 6f6857b83f HBASE-27224 HFile tool statistic sampling produces misleading results (#4638) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
 2022-09-06 15:37:52 -04:00
Xiaolin Ha 890d6dedfe HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-05 21:16:23 +08:00
Michael Stack 71cf98f63f
HBASE-27340 Artifacts with resolved profiles (#4740) 
Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
    make it so the flatten plugin can figure 'hadoop.version'
    definitively.

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

    * hbase-asyncfs/pom.xml
    * hbase-endpoint/pom.xml
    * hbase-examples/pom.xml
    * hbase-http/pom.xml
    * hbase-rest/pom.xml
    * hbase-server/pom.xml
     Move the minikdc under profiles so it picks up appropriate hadoop version
     when the flatten plugin runs.

    * hbase-hadoop2-compat/pom.xml
     Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
     under them so we pick up appropriate hadoop version when flatten
     plugin runs.

    * hbase-mapreduce/pom.xml
     Move hadoop dependencies under profiles so right version is
     available when the flatten plugin runs.

    * hbase-shaded/hbase-shaded-testing-util/pom.xml
     Add profiles for hadoop-2.0 and hadoop-3.0 and move the
     hadoop dependencies under them.

    pom.xml
     Add the flatten plugin with the flatten profiles enabled.
     Add a few excludes on hadoop profiles picked up from sub-modules.
     E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-02 16:43:29 -07:00
Istvan Toth 81ba1231dc
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. (#4749) 
Signed-off-by: Sakthi <sakthi@apache.org>
 2022-08-31 15:50:10 +02:00
Xiaolin Ha b0edb77b72
HBASE-27152 Under compaction mark may leak (#4725) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-08-30 01:20:28 +08:00
LiangJun He a40d645312 HBASE-27336 The region visualizer shows 'undefined' region server (#4736) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fa02350a27)
 2022-08-28 22:53:00 +08:00
Ujjawal 13841f52f0 HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533) 
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2022-08-26 08:58:21 -04:00
Nick Dimiduk f1f79b9efe Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 15:44:51 +00:00
Nick Dimiduk 2ecd8bd6d6 Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 15:44:34 +00:00
Nick Dimiduk 29475d6edb Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 14:04:18 +00:00
Nick Dimiduk 6cdbc46c02 Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 14:03:59 +00:00
Tak Lon (Stephen) Wu a97a5c7cc4
HBASE-26882 "HBASE-26810 Add dynamic configuration support for system coprocessors" to branch-2 2022-08-23 14:06:38 +02:00
Ruanhui 51576ae45a HBASE-27305 add an option to skip file splitting when bulkload hfiles (#4709) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00a719e76f)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/BulkLoadHFilesTool.java
 2022-08-22 22:45:55 +08:00
LiangJun He 78f587f559 HBASE-27104 Add a tool command list_unknownservers (#4714) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1bd0b581cb)
 2022-08-22 21:26:19 +08:00
tianhang 3984891114 HBASE-27129 Add a config that allows us to configure region-level storage policies (#4547) 
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f238a92b6d)
 2022-08-22 10:07:41 +08:00
Andrew Purtell f2345af6d8 HBASE-27206 Clean up error-prone findings in hbase-common (#4645) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fbe3b90e0c)

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValueUtil.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/ServerName.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/io/crypto/TestKeyStoreKeyProvider.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/types/TestOrderedFloat32.java
 2022-08-21 21:36:25 +08:00
Fantasy-Jay 46ffdabd13 HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710) 
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a5)
 2022-08-20 21:09:53 +08:00
BukrosSzabolcs 9f3c52265d HBASE-26969:Eliminate MOB renames when SFT is enabled 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>

closes #4712
 2022-08-19 12:24:27 +02:00
Peter Somogyi e239f70f2d HBASE-25970 MOB data loss - incorrect concatenation of MOB_FILE_REFS (#3355) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2022-08-19 12:17:30 +02:00
Sean Busbey a9f4ec3759 HBASE-24163 MOB compactor implementations should use format specifiers when calling String.format 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-08-17 13:58:31 +02:00
huaxiangsun e595f154d1
HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#4617) (#4704) 
* HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#1446)

* Reorganize MOB compaction tests for more reuse.
* Add tests for mob compaction after snapshot clone operations
* note the original table used to write a given mob hfile and use that to find it later.

Signed-off-by: Esteban Gutierrez <esteban@apache.org>

* spotless:apply to fix HBaseTestingUtility

* Fix error-prone errors

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Co-authored-by: Sean Busbey <busbey@apache.org>

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Co-authored-by: Andrew Purtell <apurtell@apache.org>
Co-authored-by: Sean Busbey <busbey@apache.org>
 2022-08-15 13:16:00 -07:00
liangxs 3980e6d087 HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… (#4376) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: stack <stack@apache.org>
 2022-08-15 11:12:34 -07:00
huaxiangsun 7f6f184f06
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695) (#4702) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-15 09:16:51 -07:00
SiCheng-Zheng 5a606837fc HBASE-27248 WALPrettyPrinter add print timestamp (#4659) 
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6b2e9d14a7)
 2022-08-10 21:31:06 +08:00
Bryan Beaudreault c0717c7383 HBASE-27241 Add metrics for evaluating cost and effectiveness of bloom filters (#4669) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-09 15:28:43 -04:00
Duo Zhang 187c084cf2 HBASE-27283 Use readTO instead of hard coded RpcClient.DEFAULT_SOCKET_TIMEOUT_READ when creating ReadTimeoutHandler in NettyRpcConnection (#4685) 
Signed-off-by: Xin Sun <ddupgs@gmail.com
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 5919b30b6d)
 2022-08-09 16:23:08 +08:00
chaijunjie0101 97d87b011f HBASE-27282 CME in AuthManager causes region server crash (#4684) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d6641626a9)
 2022-08-09 09:57:40 +08:00
Duo Zhang 0a36504848 HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big (#4679) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 486d19e99f)
 2022-08-06 20:31:38 +08:00
LiangJun He a7f8dde815 HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect (#4678) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2dc26082be)
 2022-08-04 23:17:30 +08:00
Nick Dimiduk 472e81098e HBASE-27153 Improvements to read-path tracing 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-08-02 14:10:05 +02:00
Bryan Beaudreault 7aa46f03f4 HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-07-29 15:33:44 -04:00
Andrew Purtell ce1455c365 HBASE-27087 TestQuotaThrottle times out 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-26 14:11:32 -07:00