Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,690 Commits 95 Branches 866 Tags
Commit Graph

9027 Commits

Author SHA1 Message Date
Tak Lon (Stephen) Wu
66aedcae02 HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse (#4887) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-11-20 14:52:12 -08:00
chenglei
daa39a46ab HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d6ca51c310c41a194628f90e3815c17)
 2022-11-17 23:21:38 +08:00
YiweiLi4
309ed58f07 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a84676c4fac7eb697a21255abddf143a)
 2022-11-17 21:37:00 +08:00
mrzhao
43b1c9722b HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2c14bec591597a74f043b36f35bd6a3)
 2022-11-16 16:43:29 +08:00
Bri Augenreich
53e872e5f1
HBASE-26809: Report client backoff time for server overloaded (#4786) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-11-15 15:41:08 -05:00
Xin Sun
7bba9ae24e HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-15 11:59:10 +08:00
SiCheng-Zheng
71826de852
HBASE-27309 Add major compact table or region operation on master web table page (#4870) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-12 21:15:20 +08:00
Rushabh Shah
ecf3debd42
HBASE-26913 Replication Observability Framework (#4862) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-11-08 13:05:42 -08:00
Duo Zhang
ea4ccf0044 HBASE-27443 Use java11 in the general check of our jenkins job (#4845) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47b5340ff02e0dec144424ab91407e07)
 2022-11-08 00:00:56 +08:00
Ruanhui
b8dacbec60 HBASE-27414 Adjust hfilelink alternative paths order (#4847) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699fd2f03e88dcd37cb9dc7d20bacfa3f2)
 2022-11-05 23:03:16 +08:00
LiangJun He
1530d855ea
HBASE-27448 Add an admin method to get replication enabled state (#4858) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-01 11:22:05 +08:00
Duo Zhang
7b0d705a1a HBASE-27437 TestHeapSize is flaky (#4841) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da9298b7f2f396826487d4133e78810895)
 2022-10-28 23:12:54 +08:00
tianliuliu
beabc198d0 HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e9be5723ff5bfb0e97cadca4092455a)
 2022-10-24 18:56:27 +08:00
Duo Zhang
738ed028ad HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line (#4836) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 2fc879e863ccdcfd32e29b2dbc70d687eaad45ef)
 2022-10-24 12:05:01 +08:00
Kota-SH
25dad1fb68 HBASE-27363: Fix the config key name for PREFETCH_PERSISTENCE_PATH_KEY and spotbugs (#4774) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c881eb1ff040fce399e4f73e3f602d0da0ce8fae)
 2022-10-21 15:11:42 +08:00
chenglei
edb5b60845
HBASE-27433 DefaultMobStoreCompactor should delete MobStoreFile cleanly when compaction is failed (#4839) 2022-10-21 11:12:22 +08:00
Luca Kovács
a31b1486b7 HBASE-27406 Make /prometheus endpoint accessible from HBase UI (#4833) 
Signed-off-by: Andor Molnar <andor@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
(cherry picked from commit dffc8e0fbefda603e3c0557bc2ceac600152675e)
 2022-10-20 12:51:30 +02:00
d-c-manning
fc4191afa1 HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 14:19:37 -07:00
binlijin
861938fe26
HBASE-25166 MobFileCompactionChore is closing the master's shared cluster connection (#2514) (#4825) 
Co-authored-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-10-13 22:06:35 +08:00
Andrew Purtell
517e6172eb HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-10-10 22:57:13 +00:00
Duo Zhang
397ab6900d HBASE-27401 Addendum fix more javadoc issues 
(cherry picked from commit 4b45256910bb8ec06c7761ee4279732e493feba2)
 2022-10-07 00:55:13 +08:00
Duo Zhang
5cab4be075 HBASE-27401 Clean up current broken 'n's in our javadoc (#4812) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f08cdde6ac0fde1342ffd050e8e02441)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
 2022-10-06 22:13:14 +08:00
Rajeshbabu Chintaguntla
d8749658db HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:40:10 +05:30
Rajeshbabu Chintaguntla
5395f92178 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:51:33 +05:30
Rajeshbabu Chintaguntla
0566f0cca5 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time-addendum 2022-10-05 04:29:31 +05:30
Rajeshbabu Chintaguntla
108479e95e HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-04 23:35:56 +05:30
Bryan Beaudreault
af28101ccc HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-04 08:29:20 -04:00
LiangJun He
f69b47275e
HBASE-27304 Support using IP to expose master/rs servers for some special scenarios (#4798) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-25 22:50:06 +08:00
Bryan Beaudreault
2a92819f0b HBASE-27280 Add mutual authentication support to TLS (#4796) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
 2022-09-23 09:11:30 -04:00
Wellington Ramos Chevreuil
34f644095f HBASE-27386 Use encoded size for calculating compression ratio in block size predicator (#4795) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
 2022-09-23 10:59:12 +01:00
Wellington Ramos Chevreuil
f8c0c35fce HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781) 
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2022-09-20 10:50:00 +01:00
SiCheng-Zheng
205582d962 HBASE-27310 Add disabled table is displayed red on master web tables list (#4755) 
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8bc6a5954aa715b6ce0f24cd441fc11816919926)
 2022-09-20 17:19:09 +08:00
Duo Zhang
9fb3aee22b
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4789) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-18 18:31:05 +08:00
Duo Zhang
11b327fddc HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04cf2ffa71c23b80c5680d8cbb69234b)
 2022-09-15 15:35:33 +08:00
Abhradeep Kundu
a303a9fd71 HBASE-27317 Rectifying the option for columnfamily as mandatory (#4773) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-09-14 13:43:49 +02:00
Duo Zhang
7ae66a1d2e HBASE-27360 The trace related assertions are flaky for async client tests (#4767) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f3f88ff6c17633d98facf9dccb57e63b87200e4a)
 2022-09-09 23:03:05 +08:00
Kota-SH
a1fc483ba8
HBASE-27313: Persist list of Hfiles names for which prefetch is done (#4771) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-08 20:52:50 +01:00
chenglei
88d1bd0942 HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf105743de28c62a6442eba2ef04d17d46af)
 2022-09-08 16:43:52 +08:00
binlijin
bfd8501e23
HBASE-27314 Make index block be customized and configured (#4763) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-08 09:27:53 +08:00
Bryan Beaudreault
b103685a1b HBASE-27224 HFile tool statistic sampling produces misleading results (#4638) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
 2022-09-06 15:23:18 -04:00
Xiaolin Ha
18d03058aa HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-05 21:14:08 +08:00
Michael Stack
0f29423cc5 HBASE-27340 Artifacts with resolved profiles (#4740) 
Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
    make it so the flatten plugin can figure 'hadoop.version'
    definitively.

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

    * hbase-asyncfs/pom.xml
    * hbase-endpoint/pom.xml
    * hbase-examples/pom.xml
    * hbase-http/pom.xml
    * hbase-rest/pom.xml
    * hbase-server/pom.xml
     Move the minikdc under profiles so it picks up appropriate hadoop version
     when the flatten plugin runs.

    * hbase-hadoop2-compat/pom.xml
     Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
     under them so we pick up appropriate hadoop version when flatten
     plugin runs.

    * hbase-mapreduce/pom.xml
     Move hadoop dependencies under profiles so right version is
     available when the flatten plugin runs.

    * hbase-shaded/hbase-shaded-testing-util/pom.xml
     Add profiles for hadoop-2.0 and hadoop-3.0 and move the
     hadoop dependencies under them.

    pom.xml
     Add the flatten plugin with the flatten profiles enabled.
     Add a few excludes on hadoop profiles picked up from sub-modules.
     E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-02 16:44:27 -07:00
Andor Molnár
9838c070aa
HBASE-27342 Use Hadoop Credentials API to retrieve passwords of TLS key/trust stores (#4751) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
 2022-09-01 10:06:15 +02:00
Istvan Toth
a7dab37b7f
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. (#4748) 
Signed-off-by: Sakthi <sakthi@apache.org>
 2022-08-31 15:47:52 +02:00
Xiaolin Ha
bd032460b8
HBASE-27152 Under compaction mark may leak (#4725) (#4744) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-08-30 01:19:09 +08:00
LiangJun He
2e53a517a2 HBASE-27336 The region visualizer shows 'undefined' region server (#4736) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fa02350a27d527a6e83a5b50ca80577847dfbb5f)
 2022-08-28 22:52:49 +08:00
Duo Zhang
935b0d2277 HBASE-27321 The ReplicationLogCleaner is not thread safe but can be called from different threads at the same time (#4730) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 37651ee1b0c019b2637142aabb8e17eb6d1d3c84)
 2022-08-28 00:30:34 +08:00
Ujjawal
c71e984a1f HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533) 
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 2022-08-26 08:57:12 -04:00
Ruanhui
d92d533924 HBASE-27325 the bulkload max call queue size can be update to a wrong value (#4728) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 92cf962fee37f83dc7fafbb5571a699bf23ab275)
 2022-08-25 11:00:28 +08:00
Ruanhui
f66d67bbdf HBASE-27305 add an option to skip file splitting when bulkload hfiles (#4709) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00a719e76f16b7380f6695fc986f003e0e5f47fe)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/BulkLoadHFilesTool.java
 2022-08-22 22:45:30 +08:00