Commit Graph

9321 Commits

Author SHA1 Message Date
chenglei 578fa6ad08
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush f… (#4912)
* HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-10 10:18:22 +08:00
Victor 320eca20fb
HBASE-27466: Making metrics instance containing one or more connections. (#4874)
Signed-off-by: David Manning <67607031+d-c-manning@users.noreply.github.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-12-01 18:02:00 -08:00
Ruanhui bb9f43c6f9
HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
2022-11-27 23:07:40 +08:00
Wellington Ramos Chevreuil a5ff289d7a
HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction (#4882)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-11-25 21:58:23 +00:00
Peter Somogyi 1ddb5bb43c
HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-11-25 15:31:56 +01:00
Ruanhui 2f4758ee59
HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-23 20:09:41 +08:00
Charles Connell 47996d6c21
HBASE-27496 Optionally limit the amount of plans executed in the Normalizer (#4888)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-22 13:08:01 -05:00
Bryan Beaudreault 9462933179
HBASE-27408 Improve BucketAllocatorException log to always include HFile name (#4886)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-11-21 08:21:29 -05:00
Tak Lon (Stephen) Wu f68b61a027
HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse (#4887)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-11-20 14:44:39 -08:00
chenglei 7b0ac6451d
HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-17 23:13:12 +08:00
YiweiLi4 a2075f51a8
HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-17 21:10:53 +08:00
mrzhao d7c4447dd2
HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-16 14:51:55 +08:00
Xin Sun e5463e8f4e
HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 11:10:37 +08:00
Andor Molnár 047f4e22e0
HBASE-27347 Port FileWatcher from ZK to autodetect keystore/truststore changes in TLS connections (#4869)
Signed-off-by: wchevreuil@apache.org
2022-11-11 11:22:14 +00:00
Duo Zhang 5c6ff7dc47
HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2022-11-07 23:14:26 +08:00
LiangJun He 186679f5a6
HBASE-27444 Add tool commands list_enabled_tables and list_disabled_tables (#4849)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-06 00:25:37 +08:00
Ruanhui 1bebf8699f
HBASE-27414 Adjust hfilelink alternative paths order (#4847)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
2022-11-05 22:45:10 +08:00
Rushabh Shah 655f19c645
HBASE-26913 Replication Observability Framework (#4556)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-11-03 11:27:08 -07:00
Ruanhui cfbf80d1c4
HBASE-27458 Use ReadWriteLock for region scanner readpoint map (#4859)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-03 16:15:48 +08:00
LiangJun He dc4fa05a2b
HBASE-27448 Add an admin method to get replication enabled state (#4855)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-31 00:02:46 +08:00
tianliuliu d187f6908e
HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-24 18:42:58 +08:00
Duo Zhang 2fc879e863
HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line (#4836)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-10-24 11:50:48 +08:00
Duo Zhang dad9a7da92
HBASE-27437 TestHeapSize is flaky (#4841)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-10-24 10:27:33 +08:00
Kota-SH c881eb1ff0
HBASE-27363: Fix the config key name for PREFETCH_PERSISTENCE_PATH_KEY and spotbugs (#4774)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-21 15:05:06 +08:00
Luca Kovács dffc8e0fbe
HBASE-27406 Make /prometheus endpoint accessible from HBase UI (#4833)
Signed-off-by: Andor Molnar <andor@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-10-20 12:50:12 +02:00
chenglei de1c2fc7ed
HBASE-27433 DefaultMobStoreCompactor should delete MobStoreFile cleanly when compaction is failed (#4834)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-20 18:09:58 +08:00
d-c-manning 5cacece790
HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:18:37 -07:00
Andrew Purtell 8d2efc8aaa
HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-10-10 15:55:57 -07:00
Duo Zhang 4b45256910 HBASE-27401 Addendum fix more javadoc issues 2022-10-07 00:54:05 +08:00
Rajeshbabu Chintaguntla 54a82302b4 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:39:22 +05:30
Duo Zhang 63cdd026f0
HBASE-27401 Clean up current broken 'n's in our javadoc (#4812)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-06 18:17:34 +08:00
Rajeshbabu Chintaguntla 5ffb29688d HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 11:14:23 +05:30
SiCheng-Zheng eb6b2745c5
HBASE-27309 Add major compact table or region operation on master web table page (#4793)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-04 23:10:25 +08:00
Bryan Beaudreault fa54381cb2
HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-04 08:27:01 -04:00
Rajeshbabu Chintaguntla 14b3899a2e
HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time (#4805)
Co-authored-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
2022-10-03 11:16:22 +05:30
Bryan Beaudreault 5baeacb7d6
HBASE-27280 Add mutual authentication support to TLS (#4796)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
2022-09-23 08:36:20 -04:00
Wellington Ramos Chevreuil da87a8e70c
HBASE-27386 Use encoded size for calculating compression ratio in block size predicator (#4795)
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-09-23 10:33:27 +01:00
LiangJun He cc4268a7d2
HBASE-27304 Support using IP to expose master/rs servers for some special scenarios (#4713)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-22 10:17:08 +08:00
chenglei de127bde84
HBASE-27303 (addendum)Unnecessary replication to secondary region replicas should avoid when WAL.sync throws Exception (#4792) 2022-09-21 11:29:10 +08:00
SiCheng-Zheng 8bc6a5954a
HBASE-27310 Add disabled table is displayed red on master web tables list (#4755)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-20 17:10:06 +08:00
Wellington Ramos Chevreuil 3f4734edae
HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781)
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-09-20 09:15:17 +01:00
Duo Zhang 6f0761a668
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-16 22:57:54 +08:00
Duo Zhang 460bb47c04
HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-09-15 15:27:06 +08:00
Abhradeep Kundu efc757577a
HBASE-27317 Rectifying the option for columnfamily as mandatory (#4773)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-09-14 13:41:02 +02:00
Duo Zhang f3f88ff6c1
HBASE-27360 The trace related assertions are flaky for async client tests (#4767)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-09-09 22:41:55 +08:00
Kota-SH 2bfa540be5
HBASE-27313: Persist list of Hfiles names for which prefetch is done (#4726)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-08 11:36:39 +01:00
chenglei a26cbf1057
HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-08 16:39:12 +08:00
Bryan Beaudreault ee58f177f0
HBASE-27224 HFile tool statistic sampling produces misleading results (#4638)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
2022-09-06 15:04:32 -04:00
Michael Stack 1b5403cf7d
HBASE-27340 Artifacts with resolved profiles (#4740) (#4761)
(Forward port from branch-2; simplified by the fact that there
is no hadoop-2.0 profile on master branch)

    Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the profile in the sub-module make it so the flatten
    plugin can figure 'hadoop.version' definitively.
    (In master there is only the hadoop-3.0 profile).

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-06 23:06:13 +08:00
Xiaolin Ha 72c1a84750
HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:13:34 +08:00