Commit Graph

19531 Commits

Author SHA1 Message Date
Michael Stack 0dfc45bfa3
HBASE-27361 Add .flattened-pom.xml to .gitignore (#4769)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-08 16:58:11 +08:00
chenglei a26cbf1057
HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-08 16:39:12 +08:00
Ujjawal fa3bd7feb9
HBASE-27353 - opentelemetry-context jar missing at runtime causes MR jobs to fail (#4759)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-09-07 10:49:53 -07:00
Andor Molnár d2cc840edf
HBASE-27346 Autodetect key/truststore file type from file extension (#4757)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-09-06 15:43:41 -04:00
Bryan Beaudreault ee58f177f0
HBASE-27224 HFile tool statistic sampling produces misleading results (#4638)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
2022-09-06 15:04:32 -04:00
Michael Stack 1b5403cf7d
HBASE-27340 Artifacts with resolved profiles (#4740) (#4761)
(Forward port from branch-2; simplified by the fact that there
is no hadoop-2.0 profile on master branch)

    Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the profile in the sub-module make it so the flatten
    plugin can figure 'hadoop.version' definitively.
    (In master there is only the hadoop-3.0 profile).

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-06 23:06:13 +08:00
Xiaolin Ha 72c1a84750
HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:13:34 +08:00
Duo Zhang 3d39482339 HBASE-27314 Addendum fix spotless errors 2022-09-04 18:07:14 +08:00
binlijin d21be92fd0
HBASE-27314 Make index block be customized and configured (#4718)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-03 15:52:43 +08:00
Nick Dimiduk 1fc703fe03
HBASE-25563 Add "2.4 Documentation" to the website (#4758)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: zhengsicheng <zhengsicheng@jd.com>
2022-09-02 12:02:55 +02:00
Nick Dimiduk 9d1af59c99
HBASE-27351 Add 2.5 Documentation to the website
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
2022-09-01 15:09:15 +02:00
Bri Augenreich 308cd729d2
HBASE-26809: Report client backoff time for server overloaded (#4729)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-01 09:23:40 +08:00
Nick Dimiduk 10d85f3161
HBASE-27350 Add 2.5.0 to the downloads page
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-31 16:38:36 +02:00
Andor Molnár b60d2eb0b6
HBASE-27342 Use Hadoop Credentials API to retrieve passwords of TLS key/trust stores (#4747)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-08-31 12:53:18 +02:00
huaxiangsun 61f02fc011
HBASE-27345 Add 2.4.14 to the downloads page (#4746)
Signed-off-by: stack <stack@apache.org>
2022-08-29 15:16:16 -07:00
Michael Stack f6b4eb791a
HBASE-27338 brotli compression lib tests fail on arm64 (#4735)
Up the brotli lib from 1.7.1 to 1.8.0

Signed-off-by: Bryan Beaudreault <bbeaudreault>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-29 09:11:52 -07:00
Xiaolin Ha 32a945aa9f
HBASE-27152 Under compaction mark may leak (#4725)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-29 11:49:02 +08:00
LiangJun He fa02350a27
HBASE-27336 The region visualizer shows 'undefined' region server (#4736)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-28 22:34:33 +08:00
Duo Zhang 37651ee1b0
HBASE-27321 The ReplicationLogCleaner is not thread safe but can be called from different threads at the same time (#4730)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-27 23:41:28 +08:00
Ujjawal 06728e554c
HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533)
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-26 08:25:59 -04:00
Ruanhui 92cf962fee
HBASE-27325 the bulkload max call queue size can be update to a wrong value (#4728)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-25 10:59:52 +08:00
Yutong Xiao b44bfc52cc
HBASE-27246 RSGroupMappingScript#getRSGroup has thread safety problem (#4657)
Co-authored-by: Sean Xiao Yutong <sean.xiaoyt@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 15:23:21 +08:00
Ruanhui b4e5875dd9
HBASE-27320 hide some sensitive configuration information in the UI (#4723)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 14:06:18 +08:00
Luca Kovács f9ea7ee0d6
HBASE-20904 Prometheus /metrics http endpoint for monitoring (#4691)
Co-authored-by: Luca Kovacs <kovacs.luca.agota@gmail.com>
Co-authored-by: Madhusoodan P <akshayapataki123@gmail.com>
Co-authored-by: Luca Kovacs <lkovacs@cloudera.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 10:54:27 +08:00
chenglei a0481d100f
HBASE-27303 Unnecessary replication to secondary region replicas should avoid when WAL.sync throws Exception (#4707)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 10:25:42 +08:00
Duo Zhang 950ad8dd3e
HBASE-27311 The implementation of syncReplicationPeerLock is incomplete (#4715)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-23 15:02:17 +08:00
Ruanhui 00a719e76f
HBASE-27305 add an option to skip file splitting when bulkload hfiles (#4709)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-22 21:14:30 +08:00
tianhang f238a92b6d
HBASE-27129 Add a config that allows us to configure region-level storage policies (#4547)
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-22 10:06:14 +08:00
wenwj0 7ff927dbd8
HBASE-27089 Add “commons.crypto.stream.buffer.size” configuration (#4491)
Co-authored-by: wenwj0 <wenweijian2@huawei.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-21 22:21:32 +08:00
Andrew Purtell fbe3b90e0c
HBASE-27206 Clean up error-prone findings in hbase-common (#4645)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-21 21:04:46 +08:00
Andrew Purtell 35fb37cf86 HBASE-27234 Clean up error-prone warnings in hbase-examples
Close #4647

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-08-21 00:13:57 +08:00
Andrew Purtell 1004876bad HBASE-27252 Clean up error-prone findings in hbase-it
Close #4662

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-08-20 23:31:28 +08:00
LiangJun He 61cd63c7b6
HBASE-27104 Add a tool command list_unknownservers (#4523)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-20 21:48:58 +08:00
Fantasy-Jay 32c135d8a5
HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710)
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-20 20:50:40 +08:00
LiangJun He 74fd5b2e68
HBASE-27295 Correct the comment of list_deadservers method in admin.rb (#4694)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-08-17 16:35:31 -07:00
Duo Zhang 116458ab04 HBASE-27279 Addendum fix TestSaslTlsIPCRejectPlainText 2022-08-16 21:43:03 +08:00
Duo Zhang 4a57cbd2cb
HBASE-27294 Add new hadoop releases in our hadoop checks (#4692)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-16 21:06:23 +08:00
Duo Zhang 2b9d36869f
HBASE-27279 Make SslHandler work with SaslWrapHandler/SaslUnwrapHandler (#4705)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
2022-08-16 21:05:42 +08:00
Wellington Ramos Chevreuil eaa47c5cd4
HBASE-27264 Add options to consider compressed size when delimiting blocks during hfile writes (#4675)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-08-15 22:35:35 +01:00
liangxs 8ec02c025e
HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… (#4376)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: stack <stack@apache.org>
2022-08-15 11:09:36 -07:00
Duo Zhang 9215066e2b
HBASE-27221 Bump spotless version to 2.24.1 (#4693)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-15 15:19:57 +08:00
SiCheng-Zheng b531e71455
HBASE-27301 Add Delete addFamilyVersion timestamp verify (#4700)
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-15 15:19:17 +08:00
huaxiangsun 73759be396
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-12 12:17:14 -07:00
dependabot[bot] 97fb5cc6d2
HBASE-27298 Bump hadoop version to 3.2.4 (#4696)
Bumps hadoop-common from 3.2.3 to 3.2.4.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-12 14:31:48 +08:00
Duo Zhang 3309108ca7
HBASE-27278 Improve TestTlsIPC to reuse existing IPC test code (#4682)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-12 12:17:29 +08:00
Peter Somogyi 39b496e191
HBASE-27281 Add default implementation for Connection$getClusterId (#4683)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-11 17:16:23 +02:00
Duo Zhang bffae99f40
HBASE-27293 Remove jenkins and personality scripts support for 1.x (#4690)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-08-11 16:31:30 +08:00
Andrew Purtell 2c3abae18a
HBASE-27201 Clean up error-prone findings in hbase-backup (#4643)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-08-11 15:02:17 +08:00
Andrew Purtell 5eaeff5fcd
HBASE-27240 Clean up error-prone findings in hbase-http (#4653)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-11 14:30:25 +08:00
Masatake Iwasaki 00612106b5
HBASE-27292. Fix build failure against Hadoop 3.3.4 due to added dependency on okhttp. (#4687)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-10 21:38:25 +08:00