11b327fddc
HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize ( #4779 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04
2022-09-15 15:35:33 +08:00
7e140e55fb
HBASE-27371 Bump spotbugs version ( #4783 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 00aba9ca74
2022-09-14 23:32:12 +08:00
a303a9fd71
HBASE-27317 Rectifying the option for columnfamily as mandatory ( #4773 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-09-14 13:43:49 +02:00
74126ea647
HBASE-27352 - Quoted string argument with spaces passed from command line are propagated wrongly to the underlying java class ( #4754 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-09-13 14:43:20 +02:00
7ae66a1d2e
HBASE-27360 The trace related assertions are flaky for async client tests ( #4767 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f3f88ff6c1
2022-09-09 23:03:05 +08:00
a1fc483ba8
HBASE-27313: Persist list of Hfiles names for which prefetch is done ( #4771 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-08 20:52:50 +01:00
e298782ae7
HBASE-27361 Add .flattened-pom.xml to .gitignore ( #4769 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 0dfc45bfa3
2022-09-08 17:00:31 +08:00
88d1bd0942
HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check ( #4768 )
...
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf1057
2022-09-08 16:43:52 +08:00
bfd8501e23
HBASE-27314 Make index block be customized and configured ( #4763 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-08 09:27:53 +08:00
175f5af06b
HBASE-27353 - opentelemetry-context jar missing at runtime causes MR jobs to fail ( #4759 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-09-07 10:51:33 -07:00
c3a30232a8
HBASE-27346 Autodetect key/truststore file type from file extension ( #4757 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-09-06 16:50:54 -04:00
b103685a1b
HBASE-27224 HFile tool statistic sampling produces misleading results ( #4638 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Clay Baenziger <cwb@clayb.net>
2022-09-06 15:23:18 -04:00
18d03058aa
HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools ( #4731 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:14:08 +08:00
0f29423cc5
HBASE-27340 Artifacts with resolved profiles ( #4740 )
...
Make it so our published poms carry the minimum needed to run
an hbase; the published pom has no profiles -- the profiles
specified at build time are resolved, their dependencies inlined,
and then they are stripped -- and no build-time, or plugins
dependencies or properties, etc. Resultant poms have explicit
hadoop lib versions baked in -- no more being able to choose
hbase with hadoop2 or haddop3 at downstream build time by setting
a '-Dhadoop.profile=X.0'.
Pattern is to add profiles when none in sub-modules when
the flatten plugin complains it can't resolve an hadoop
dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
make it so the flatten plugin can figure 'hadoop.version'
definitively.
Another spin on the above happens when profiles already exist
in submodule but the flatten plugin is complaining it can't
figure figure version on an hadoop dependency NOT under
profiles. Below, we move the delinquent hadoop dependency under
existing profiles (minikdc was the usual dependency outside
profiles in sub-modules that flatten complained about).
Sometimes, moving an hadoop dependency under a profile, there
would be excludes on the local dependency. If the parent pom
excludes section was missing the local excludes, we added them
up to the parent module so all excluding is done up there in
the parent profile dependencyManagement section.
* hbase-asyncfs/pom.xml
* hbase-endpoint/pom.xml
* hbase-examples/pom.xml
* hbase-http/pom.xml
* hbase-rest/pom.xml
* hbase-server/pom.xml
Move the minikdc under profiles so it picks up appropriate hadoop version
when the flatten plugin runs.
* hbase-hadoop2-compat/pom.xml
Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
under them so we pick up appropriate hadoop version when flatten
plugin runs.
* hbase-mapreduce/pom.xml
Move hadoop dependencies under profiles so right version is
available when the flatten plugin runs.
* hbase-shaded/hbase-shaded-testing-util/pom.xml
Add profiles for hadoop-2.0 and hadoop-3.0 and move the
hadoop dependencies under them.
pom.xml
Add the flatten plugin with the flatten profiles enabled.
Add a few excludes on hadoop profiles picked up from sub-modules.
E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-02 16:44:27 -07:00
9838c070aa
HBASE-27342 Use Hadoop Credentials API to retrieve passwords of TLS key/trust stores ( #4751 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-09-01 10:06:15 +02:00
a7dab37b7f
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. ( #4748 )
...
Signed-off-by: Sakthi <sakthi@apache.org>
2022-08-31 15:47:52 +02:00
6a7a91a256
HBASE-27335 HBase shell hang for a minute when quiting ( #4737 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-31 11:01:10 +08:00
bd032460b8
HBASE-27152 Under compaction mark may leak ( #4725 ) ( #4744 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-30 01:19:09 +08:00
0640efac7e
HBASE-27338 brotli compression lib tests fail on arm64 ( #4735 )
...
Up the brotli lib from 1.7.1 to 1.8.0
Signed-off-by: Bryan Beaudreault <bbeaudreault>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-29 09:13:34 -07:00
2e53a517a2
HBASE-27336 The region visualizer shows 'undefined' region server ( #4736 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fa02350a27
2022-08-28 22:52:49 +08:00
935b0d2277
HBASE-27321 The ReplicationLogCleaner is not thread safe but can be called from different threads at the same time ( #4730 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 37651ee1b0
2022-08-28 00:30:34 +08:00
c71e984a1f
HBASE-25922 - Disabled sanity checks ignored on snapshot restore ( #4533 )
...
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2022-08-26 08:57:12 -04:00
d92d533924
HBASE-27325 the bulkload max call queue size can be update to a wrong value ( #4728 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 92cf962fee
2022-08-25 11:00:28 +08:00
713ed46d03
HBASE-27246 RSGroupMappingScript#getRSGroup has thread safety problem ( #4657 )
...
Co-authored-by: Sean Xiao Yutong <sean.xiaoyt@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b44bfc52cc
2022-08-24 15:38:26 +08:00
f27a12a2ae
HBASE-27320 hide some sensitive configuration information in the UI ( #4723 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b4e5875dd9
2022-08-24 14:27:50 +08:00
c04edf7835
HBASE-20904 Prometheus /metrics http endpoint for monitoring ( #4691 )
...
Co-authored-by: Luca Kovacs <kovacs.luca.agota@gmail.com>
Co-authored-by: Madhusoodan P <akshayapataki123@gmail.com>
Co-authored-by: Luca Kovacs <lkovacs@cloudera.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f9ea7ee0d6
2022-08-24 11:31:16 +08:00
f66d67bbdf
HBASE-27305 add an option to skip file splitting when bulkload hfiles ( #4709 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00a719e76f
2022-08-22 22:45:30 +08:00
1bd0b581cb
HBASE-27104 Add a tool command list_unknownservers ( #4714 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-22 21:15:47 +08:00
fc93fbac9a
HBASE-27129 Add a config that allows us to configure region-level storage policies ( #4547 )
...
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f238a92b6d
2022-08-22 10:07:27 +08:00
f509e43eaa
HBASE-27089 Add “commons.crypto.stream.buffer.size” configuration ( #4491 )
...
Co-authored-by: wenwj0 <wenweijian2@huawei.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ff927dbd8
2022-08-21 22:32:39 +08:00
f705e3e7d8
HBASE-27206 Clean up error-prone findings in hbase-common ( #4645 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fbe3b90e0c
2022-08-21 21:36:01 +08:00
ca6baa8050
HBASE-27234 Clean up error-prone warnings in hbase-examples
...
Close #4647
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 35fb37cf86
2022-08-21 00:27:18 +08:00
e5f551ebf7
HBASE-27252 Clean up error-prone findings in hbase-it
...
Close #4662
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 1004876bad
2022-08-20 23:39:06 +08:00
8a10dbf6c4
HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime ( #4710 )
...
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a5
2022-08-20 21:09:43 +08:00
d073404706
HBASE-26969:Eliminate MOB renames when SFT is enabled
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
closes #4712
2022-08-19 11:33:48 +02:00
1176b484d1
HBASE-25970 MOB data loss - incorrect concatenation of MOB_FILE_REFS ( #3355 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-08-19 11:20:53 +02:00
1986a6ec31
HBASE-24163 MOB compactor implementations should use format specifiers when calling String.format
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-08-17 13:46:18 +02:00
e4c141cb48
HBASE-27294 Add new hadoop releases in our hadoop checks ( #4692 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 4a57cbd2cb
2022-08-16 21:43:27 +08:00
c2dff398d3
HBASE-27279 Make SslHandler work with SaslWrapHandler/SaslUnwrapHandler ( #4705 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
(cherry picked from commit 2b9d36869f
2022-08-16 21:37:47 +08:00
3acf920e1f
HBASE-27264 Add options to consider compressed size when delimiting blocks during hfile writes ( #4675 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-08-15 22:36:44 +01:00
aaad3a7077
HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… ( #4376 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: stack <stack@apache.org>
2022-08-15 11:12:05 -07:00
b25ded026b
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose ( #4695 ) ( #4701 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-15 09:16:29 -07:00
60394e95a7
HBASE-27299 Bump minimum hadoop 2 version to 2.10.2 ( #4699 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-15 18:54:46 +08:00
b83165cf60
HBASE-27221 Bump spotless version to 2.24.1 ( #4693 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 9215066e2b
2022-08-15 15:23:11 +08:00
1b5d20dcf6
HBASE-27301 Add Delete addFamilyVersion timestamp verify ( #4700 )
...
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b531e71455
2022-08-15 15:23:04 +08:00
f36b34984f
HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone ( #4617 )
...
* HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#1446 )
* Reorganize MOB compaction tests for more reuse.
* Add tests for mob compaction after snapshot clone operations
* note the original table used to write a given mob hfile and use that to find it later.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
* spotless:apply to fix HBaseTestingUtility
* Fix error-prone errors
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Co-authored-by: Sean Busbey <busbey@apache.org>
2022-08-12 14:29:26 -07:00
ed6554de45
HBASE-27298 Bump hadoop version to 3.2.4 ( #4696 )
...
Bumps hadoop-common from 3.2.3 to 3.2.4.
---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 97fb5cc6d2
2022-08-12 14:36:28 +08:00
b820188c68
HBASE-27278 Improve TestTlsIPC to reuse existing IPC test code ( #4682 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit 3309108ca7
2022-08-12 13:21:11 +08:00
3f5076dac5
HBASE-27281 Add default implementation for Connection$getClusterId ( #4683 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-11 17:21:14 +02:00
4079647c39
HBASE-27293 Remove jenkins and personality scripts support for 1.x ( #4690 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit bffae99f40
2022-08-11 16:59:49 +08:00
Duo Zhang
Abhradeep Kundu
Ujjawal
Kota-SH
Michael Stack
chenglei
binlijin
Andor Molnár
Bryan Beaudreault
Xiaolin Ha
Istvan Toth
LiangJun He
Ruanhui
Yutong Xiao
Luca Kovács
tianhang
wenwj0
Andrew Purtell
Fantasy-Jay
BukrosSzabolcs
Peter Somogyi
Sean Busbey
Wellington Ramos Chevreuil
liangxs
huaxiangsun
SiCheng-Zheng
dependabot[bot]