Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,540 Commits 95 Branches 866 Tags
Commit Graph

8934 Commits

Author SHA1 Message Date
Ruanhui
983eb0c0be HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
(cherry picked from commit bb9f43c6f9079b196e7a9d5a5eb35e721b092052)
 2022-11-27 23:42:53 +08:00
Wellington Ramos Chevreuil
8a76451a9b HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction (#4882) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-11-25 22:00:01 +00:00
Peter Somogyi
59f92a8f60 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ddb5bb43cfe4f543710a84884a5df20d02ff0a8)
 2022-11-25 15:32:54 +01:00
Ruanhui
c56197248e HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee592959ee5ddd646a6769bb81a781d610)
 2022-11-23 20:47:52 +08:00
LiangJun He
8c2f4b2aaa
HBASE-27444 Add tool commands list_enabled_tables and list_disabled_tables (#4880) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-23 10:29:37 +08:00
Charles Connell
5976684168 HBASE-27496 Optionally limit the amount of plans executed in the Normalizer (#4888) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-11-22 13:08:43 -05:00
Bryan Beaudreault
ad8d38b61f HBASE-27408 Improve BucketAllocatorException log to always include HFile name (#4886) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-11-21 08:22:42 -05:00
Tak Lon (Stephen) Wu
66aedcae02 HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse (#4887) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-11-20 14:52:12 -08:00
chenglei
daa39a46ab HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d6ca51c310c41a194628f90e3815c17)
 2022-11-17 23:21:38 +08:00
YiweiLi4
309ed58f07 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a84676c4fac7eb697a21255abddf143a)
 2022-11-17 21:37:00 +08:00
mrzhao
43b1c9722b HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2c14bec591597a74f043b36f35bd6a3)
 2022-11-16 16:43:29 +08:00
Bri Augenreich
53e872e5f1
HBASE-26809: Report client backoff time for server overloaded (#4786) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-11-15 15:41:08 -05:00
Xin Sun
7bba9ae24e HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-15 11:59:10 +08:00
SiCheng-Zheng
71826de852
HBASE-27309 Add major compact table or region operation on master web table page (#4870) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-12 21:15:20 +08:00
Rushabh Shah
ecf3debd42
HBASE-26913 Replication Observability Framework (#4862) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-11-08 13:05:42 -08:00
Duo Zhang
ea4ccf0044 HBASE-27443 Use java11 in the general check of our jenkins job (#4845) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47b5340ff02e0dec144424ab91407e07)
 2022-11-08 00:00:56 +08:00
Ruanhui
b8dacbec60 HBASE-27414 Adjust hfilelink alternative paths order (#4847) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699fd2f03e88dcd37cb9dc7d20bacfa3f2)
 2022-11-05 23:03:16 +08:00
LiangJun He
1530d855ea
HBASE-27448 Add an admin method to get replication enabled state (#4858) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-11-01 11:22:05 +08:00
Duo Zhang
7b0d705a1a HBASE-27437 TestHeapSize is flaky (#4841) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da9298b7f2f396826487d4133e78810895)
 2022-10-28 23:12:54 +08:00
tianliuliu
beabc198d0 HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e9be5723ff5bfb0e97cadca4092455a)
 2022-10-24 18:56:27 +08:00
Duo Zhang
738ed028ad HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line (#4836) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 2fc879e863ccdcfd32e29b2dbc70d687eaad45ef)
 2022-10-24 12:05:01 +08:00
Kota-SH
25dad1fb68 HBASE-27363: Fix the config key name for PREFETCH_PERSISTENCE_PATH_KEY and spotbugs (#4774) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c881eb1ff040fce399e4f73e3f602d0da0ce8fae)
 2022-10-21 15:11:42 +08:00
chenglei
edb5b60845
HBASE-27433 DefaultMobStoreCompactor should delete MobStoreFile cleanly when compaction is failed (#4839) 2022-10-21 11:12:22 +08:00
Luca Kovács
a31b1486b7 HBASE-27406 Make /prometheus endpoint accessible from HBase UI (#4833) 
Signed-off-by: Andor Molnar <andor@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
(cherry picked from commit dffc8e0fbefda603e3c0557bc2ceac600152675e)
 2022-10-20 12:51:30 +02:00
d-c-manning
fc4191afa1 HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 14:19:37 -07:00
binlijin
861938fe26
HBASE-25166 MobFileCompactionChore is closing the master's shared cluster connection (#2514) (#4825) 
Co-authored-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-10-13 22:06:35 +08:00
Andrew Purtell
517e6172eb HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-10-10 22:57:13 +00:00
Duo Zhang
397ab6900d HBASE-27401 Addendum fix more javadoc issues 
(cherry picked from commit 4b45256910bb8ec06c7761ee4279732e493feba2)
 2022-10-07 00:55:13 +08:00
Duo Zhang
5cab4be075 HBASE-27401 Clean up current broken 'n's in our javadoc (#4812) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f08cdde6ac0fde1342ffd050e8e02441)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
 2022-10-06 22:13:14 +08:00
Rajeshbabu Chintaguntla
d8749658db HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:40:10 +05:30
Rajeshbabu Chintaguntla
5395f92178 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:51:33 +05:30
Rajeshbabu Chintaguntla
0566f0cca5 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time-addendum 2022-10-05 04:29:31 +05:30
Rajeshbabu Chintaguntla
108479e95e HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-04 23:35:56 +05:30
Bryan Beaudreault
af28101ccc HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-04 08:29:20 -04:00
LiangJun He
f69b47275e
HBASE-27304 Support using IP to expose master/rs servers for some special scenarios (#4798) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-25 22:50:06 +08:00
Bryan Beaudreault
2a92819f0b HBASE-27280 Add mutual authentication support to TLS (#4796) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
 2022-09-23 09:11:30 -04:00
Wellington Ramos Chevreuil
34f644095f HBASE-27386 Use encoded size for calculating compression ratio in block size predicator (#4795) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
 2022-09-23 10:59:12 +01:00
Wellington Ramos Chevreuil
f8c0c35fce HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781) 
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2022-09-20 10:50:00 +01:00
SiCheng-Zheng
205582d962 HBASE-27310 Add disabled table is displayed red on master web tables list (#4755) 
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8bc6a5954aa715b6ce0f24cd441fc11816919926)
 2022-09-20 17:19:09 +08:00
Duo Zhang
9fb3aee22b
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4789) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-18 18:31:05 +08:00
Duo Zhang
11b327fddc HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04cf2ffa71c23b80c5680d8cbb69234b)
 2022-09-15 15:35:33 +08:00
Abhradeep Kundu
a303a9fd71 HBASE-27317 Rectifying the option for columnfamily as mandatory (#4773) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-09-14 13:43:49 +02:00
Duo Zhang
7ae66a1d2e HBASE-27360 The trace related assertions are flaky for async client tests (#4767) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f3f88ff6c17633d98facf9dccb57e63b87200e4a)
 2022-09-09 23:03:05 +08:00
Kota-SH
a1fc483ba8
HBASE-27313: Persist list of Hfiles names for which prefetch is done (#4771) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-09-08 20:52:50 +01:00
chenglei
88d1bd0942 HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768) 
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf105743de28c62a6442eba2ef04d17d46af)
 2022-09-08 16:43:52 +08:00
binlijin
bfd8501e23
HBASE-27314 Make index block be customized and configured (#4763) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-08 09:27:53 +08:00
Bryan Beaudreault
b103685a1b HBASE-27224 HFile tool statistic sampling produces misleading results (#4638) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
 2022-09-06 15:23:18 -04:00
Xiaolin Ha
18d03058aa HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-05 21:14:08 +08:00
Michael Stack
0f29423cc5 HBASE-27340 Artifacts with resolved profiles (#4740) 
Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
    make it so the flatten plugin can figure 'hadoop.version'
    definitively.

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

    * hbase-asyncfs/pom.xml
    * hbase-endpoint/pom.xml
    * hbase-examples/pom.xml
    * hbase-http/pom.xml
    * hbase-rest/pom.xml
    * hbase-server/pom.xml
     Move the minikdc under profiles so it picks up appropriate hadoop version
     when the flatten plugin runs.

    * hbase-hadoop2-compat/pom.xml
     Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
     under them so we pick up appropriate hadoop version when flatten
     plugin runs.

    * hbase-mapreduce/pom.xml
     Move hadoop dependencies under profiles so right version is
     available when the flatten plugin runs.

    * hbase-shaded/hbase-shaded-testing-util/pom.xml
     Add profiles for hadoop-2.0 and hadoop-3.0 and move the
     hadoop dependencies under them.

    pom.xml
     Add the flatten plugin with the flatten profiles enabled.
     Add a few excludes on hadoop profiles picked up from sub-modules.
     E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-09-02 16:44:27 -07:00
Andor Molnár
9838c070aa
HBASE-27342 Use Hadoop Credentials API to retrieve passwords of TLS key/trust stores (#4751) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
 2022-09-01 10:06:15 +02:00