Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,504 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

8901 Commits

Author SHA1 Message Date
Ruanhui cf5527be97 HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
(cherry picked from commit bb9f43c6f9)
 2022-11-27 23:44:47 +08:00
Peter Somogyi b68dcf46e9 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ddb5bb43c)
 2022-11-25 15:51:35 +01:00
Ruanhui c9ed26dd98 HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee59)
 2022-11-23 20:48:03 +08:00
Charles Connell 2c7776e979 HBASE-27496 Optionally limit the amount of plans executed in the Normalizer (#4888) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-11-22 13:19:54 -05:00
Bryan Beaudreault 060ca84374 HBASE-27408 Improve BucketAllocatorException log to always include HFile name (#4886) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-11-21 08:23:37 -05:00
Tak Lon (Stephen) Wu 22ec7fbeba HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse (#4887) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-11-20 15:05:36 -08:00
chenglei 4bf0523a0f HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d)
 2022-11-17 23:21:50 +08:00
YiweiLi4 61b74d88a9 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a8)
 2022-11-17 21:39:04 +08:00
mrzhao 71f746acce HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2)
 2022-11-16 16:43:38 +08:00
Bri Augenreich 2d038edf4c HBASE-26809: Report client backoff time for server overloaded (#4786) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-11-15 15:41:40 -05:00
Xin Sun 3880884e8e HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-15 11:18:51 +08:00
Duo Zhang dfb9fdc88d HBASE-27443 Use java11 in the general check of our jenkins job (#4845) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47)
 2022-11-08 00:01:30 +08:00
Ruanhui 78ddd3dae4 HBASE-27414 Adjust hfilelink alternative paths order (#4847) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699f)
 2022-11-05 23:03:27 +08:00
Duo Zhang 41c2e9950d HBASE-27437 TestHeapSize is flaky (#4841) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da92)
 2022-10-28 23:13:24 +08:00
tianliuliu 784d1a96cd HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e)
 2022-10-24 18:56:41 +08:00
Duo Zhang f3a64e468e HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line (#4836) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 2fc879e863)
 2022-10-24 12:16:04 +08:00
chenglei d4145db6ab
HBASE-27433 DefaultMobStoreCompactor should delete MobStoreFile cleanly when compaction is failed (#4840) 2022-10-21 17:53:19 +08:00
Andrew Purtell 27d69ff53f Preparing development version 2.5.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 15:37:08 -07:00
Andrew Purtell 894ac15342 Preparing hbase release 2.5.1RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 15:37:04 -07:00
d-c-manning b9ec644e51 HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 14:19:42 -07:00
Andrew Purtell 511e0105ae HBASE-27432 TestUsersOperationsWithSecureHadoop fails after HBASE-27411 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 13:15:20 -07:00
Andrew Purtell a8605912ec Preparing development version 2.5.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-13 09:11:37 -07:00
Andrew Purtell edf0b62273 Preparing hbase release 2.5.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-13 09:11:34 -07:00
binlijin 66873ca5a6
HBASE-25166 MobFileCompactionChore is closing the master's shared cluster connection (#2514) (#4826) 
Co-authored-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-10-13 22:07:46 +08:00
Andrew Purtell b7fbb668d5 HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-10-10 22:57:29 +00:00
Duo Zhang 050f3e1ef5 HBASE-27401 Addendum fix more javadoc issues 
(cherry picked from commit 4b45256910)
 2022-10-07 00:55:26 +08:00
Duo Zhang fb988373c1 HBASE-27401 Clean up current broken 'n's in our javadoc (#4812) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
 2022-10-06 23:01:14 +08:00
Rajeshbabu Chintaguntla 33872f7791 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:41:20 +05:30
Rajeshbabu Chintaguntla d18d368445 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:54:56 +05:30
Rajeshbabu Chintaguntla a3e0182cef HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-05 03:32:49 +05:30
Bryan Beaudreault 4c9185b37d HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-04 08:30:15 -04:00
Wellington Ramos Chevreuil 3aad87664d HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781) 
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2022-09-20 10:58:58 +01:00
Duo Zhang ca86eea482
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4790) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-19 07:56:47 +08:00
Duo Zhang df5c1ca854 HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04)
 2022-09-15 15:35:44 +08:00
binlijin 18c23f75f5 HBASE-27314 Make index block be customized and configured (#4763) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-13 10:10:10 +08:00
Duo Zhang c1cad7f653 HBASE-27360 The trace related assertions are flaky for async client tests (#4767) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f3f88ff6c1)
 2022-09-09 23:03:16 +08:00
chenglei fa11c8024e HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf1057)
 2022-09-08 16:44:02 +08:00
Bryan Beaudreault 6f6857b83f HBASE-27224 HFile tool statistic sampling produces misleading results (#4638) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
 2022-09-06 15:37:52 -04:00
Xiaolin Ha 890d6dedfe HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-05 21:16:23 +08:00
Michael Stack 71cf98f63f
HBASE-27340 Artifacts with resolved profiles (#4740) 
Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
    make it so the flatten plugin can figure 'hadoop.version'
    definitively.

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

    * hbase-asyncfs/pom.xml
    * hbase-endpoint/pom.xml
    * hbase-examples/pom.xml
    * hbase-http/pom.xml
    * hbase-rest/pom.xml
    * hbase-server/pom.xml
     Move the minikdc under profiles so it picks up appropriate hadoop version
     when the flatten plugin runs.

    * hbase-hadoop2-compat/pom.xml
     Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
     under them so we pick up appropriate hadoop version when flatten
     plugin runs.

    * hbase-mapreduce/pom.xml
     Move hadoop dependencies under profiles so right version is
     available when the flatten plugin runs.

    * hbase-shaded/hbase-shaded-testing-util/pom.xml
     Add profiles for hadoop-2.0 and hadoop-3.0 and move the
     hadoop dependencies under them.

    pom.xml
     Add the flatten plugin with the flatten profiles enabled.
     Add a few excludes on hadoop profiles picked up from sub-modules.
     E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-02 16:43:29 -07:00
Istvan Toth 81ba1231dc
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. (#4749) 
Signed-off-by: Sakthi <sakthi@apache.org>
 2022-08-31 15:50:10 +02:00
Xiaolin Ha b0edb77b72
HBASE-27152 Under compaction mark may leak (#4725) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-08-30 01:20:28 +08:00
LiangJun He a40d645312 HBASE-27336 The region visualizer shows 'undefined' region server (#4736) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fa02350a27)
 2022-08-28 22:53:00 +08:00
Ujjawal 13841f52f0 HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533) 
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2022-08-26 08:58:21 -04:00
Nick Dimiduk f1f79b9efe Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 15:44:51 +00:00
Nick Dimiduk 2ecd8bd6d6 Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 15:44:34 +00:00
Nick Dimiduk 29475d6edb Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 14:04:18 +00:00
Nick Dimiduk 6cdbc46c02 Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-23 14:03:59 +00:00
Tak Lon (Stephen) Wu a97a5c7cc4
HBASE-26882 "HBASE-26810 Add dynamic configuration support for system coprocessors" to branch-2 2022-08-23 14:06:38 +02:00
Ruanhui 51576ae45a HBASE-27305 add an option to skip file splitting when bulkload hfiles (#4709) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00a719e76f)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/BulkLoadHFilesTool.java
 2022-08-22 22:45:55 +08:00