Commit Graph

953 Commits

Author SHA1 Message Date
Sean Busbey bb8b80e7a9 HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)
- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit d1149f7e20)
2022-06-05 00:32:43 -05:00
Duo Zhang 40c2743a0c HBASE-27023 Fix license issues after running spotless:apply (#4458)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99)
2022-06-02 20:20:43 +08:00
Andrew Purtell 779e9859dc
HBASE-27065 [branch-2] Build against Hadoop 3.3.3 (#4471)
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:03:41 -07:00
Duo Zhang 778ae2d655
HBASE-26933 Remove all ref guide stuff on branch other than master (#4426)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-05-22 15:12:52 +08:00
Andrew Purtell a836fc86e8 HBASE-27050 Support unit test pattern matching again (#4447)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:09:01 -07:00
Duo Zhang f8e742d495 HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424)
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a)
2022-05-18 21:07:03 +08:00
Duo Zhang 3bafbf1cd2 HBASE-26892 Add spotless:check in our pre commit general check (#4393)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 386869a428)
2022-05-03 21:19:26 +08:00
Duo Zhang 731da45b91 HBASE-26899 tweak pom and formatter
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 0edecbf9e0)
2022-05-01 22:20:12 +08:00
Duo Zhang 30908482c5
HBASE-26932 Skip generating ref guide when running 'mvn site' on branch other than master (#4360)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-04-29 08:05:24 +08:00
Andrew Purtell 0f9f6f2cde HBASE-26959 Brotli compression support (#4353)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-22 16:48:04 -07:00
Duo Zhang edbe44b0d1 HBASE-25058 Export necessary modules when running under JDK11 (#4337)
Singed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 82e47cde27)
2022-04-21 23:50:08 +08:00
Duo Zhang d7e6baf758 HBASE-26947 Implement a special TestAppender to limit the size of test output (#4340)
Singed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 13d932cba3)
2022-04-21 23:06:53 +08:00
Nick Dimiduk a81b369157 HBASE-26906 Remove duplicate dependency declaration
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-19 16:05:24 +02:00
Duo Zhang 28acbc1c9c HBASE-26929 Upgrade surefire plugin to 3.0.0-M6 (#4319)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit c791c8181a)
2022-04-07 11:33:31 +08:00
dependabot[bot] 9ea77ef996 HBASE-26912 Bump checkstyle from 8.28 to 8.29 (#4293)
Bumps [checkstyle](https://github.com/checkstyle/checkstyle) from 8.28 to 8.29.

updated-dependencies:
- dependency-name: com.puppycrawl.tools:checkstyle

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-31 14:26:55 -07:00
Nick Dimiduk 489af42792
HBASE-26545 Implement tracing of scan
* on `AsyncTable`, both `scan` and `scanAll` methods should result in `SCAN` table operations.
* the span of the `SCAN` table operation should have children representing all the RPC calls
  involved in servicing the scan.
* when a user provides custom implementation of `AdvancedScanResultConsumer`, any spans emitted
  from the callback methods should also be tied to the span that represents the `SCAN` table
  operation. This is easily done because these callbacks are executed on the RPC thread.
* when a user provides a custom implementation of `ScanResultConsumer`, any spans emitted from the
  callback methods should be also be tied to the span that represents the `SCAN` table
  operation. This accomplished by carefully passing the span instance around after it is created.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-31 17:29:51 +02:00
Andrew Purtell 455b7c701f HBASE-26903 Bump httpclient from 4.5.3 to 4.5.13 (#4296)
Bump httpclient from 4.5.3 to 4.5.13 to avoid a CVE of medium severity in this
dependency.

Newer httpclient versions enable a URI normalization algorithm by default that
rewrites URIs in a way that breaks some forms of valid REST gateway interactions,
so disable it when building the httpclient instance in Client.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-30 14:31:24 -07:00
dependabot[bot] cd09f3a3aa HBASE-26902 Bump bcprov-jdk15on from 1.60 to 1.67 (#4292)
Bumps [bcprov-jdk15on](https://github.com/bcgit/bc-java) from 1.60 to 1.67.

updated-dependencies:
- dependency-name: org.bouncycastle:bcprov-jdk15on 

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-29 09:03:24 -07:00
Duo Zhang 89e7050542 HBASE-26617 Addendum add removeUnusedImports 2022-03-28 22:57:15 +08:00
Duo Zhang e0ae456262 HBASE-26617 Use spotless to reduce the pain on fixing checkstyle issues (#4214)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-03-28 21:14:01 +08:00
Duo Zhang ba14796289 Revert "HBASE-26813 Remove javax.ws.rs-api dependency (#4191)"
MiniYARNCluster needs it

This reverts commit abde344767.
2022-03-19 19:45:29 +08:00
Nick Dimiduk abde344767 HBASE-26813 Remove javax.ws.rs-api dependency (#4191)
This is no longer needed since we've transitioned to the shaded Jersey shipped in
hbase-thirdparty. Also drop supplemental models entry.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-16 17:24:20 +01:00
Nick Dimiduk 3c968a1bb8 HBASE-25896 Implement a Region Visualization on Master WebUI (#4228)
This is a demonstration of visualization of regions on the cluster. The visualization is a stacked
bar chart showing total storefile size per table per region server, with the x-axis being server
names, the y-axis being storfile size, and the bars stacked per table. The visualization is
generated entirely on the fly from within the browser, implemented using Vega Lite. So far, Vega
appears to handle rendering this visualization for a cluster of over 700 region servers with
approximately 300,000 regions.

Per [0], include an update to the top-level LICENSE.txt. Also update LICENSE files in all binary
distributions (i.e., jars), by way of LICENSE.vm. Vega uses a BSD 3-clause variant without
advertising clause, and as such is a "Category A" license, per [1].

No changes are made to the NOTICE files, as per the existing example of bundling the minified
JQuery, which is also a Category A license.

[0]: https://infra.apache.org/licensing-howto.html
[1]: https://www.apache.org/legal/resolved.html#category-a

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 21:10:23 +01:00
Duo Zhang 9e1de13d03 HBASE-25465 Use javac --release option for supporting cross version compilation (#4164)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-12 18:30:29 +08:00
Duo Zhang 340cc6c6f1
HBASE-26802 Backport the log4j2 changes to branch-2 (#4166)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-11 11:17:43 -08:00
Andrew Purtell bed30b153b Amend HBASE-26691 Replacing log4j with reload4j for branch-2.x
- Update reload4j version to 1.2.19
- Update shading and assembly configurations

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 12:29:19 -08:00
Duo Zhang 4644efb9f3
HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 12:06:34 -08:00
Mike Drob 8a9e083994 HBASE-26622 Update error-prone to 2.10
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-03 11:51:51 +01:00
Nick Dimiduk b3292b88a8 HBASE-26663 Upgrade Maven Enforcer Plugin
The upgrade is to get the fix in MENFORCER-336, making beanshell evaluation safe for use with `mvn
-T`. Also upgrade extra-enforcer-rules to 1.5.1, as per experience with HBASE-26664.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-02-28 10:24:26 +01:00
Nick Dimiduk d242c8fafa HBASE-26521 Name RPC spans as `$package.$service/$method` (#4024)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-10 12:57:45 +01:00
Duo Zhang d747da6985 HBASE-26709 Ban the usage of junit 3 TestCase (#4065)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-02-10 01:06:06 +08:00
fcb-xiaobo 10eea31ca9 HBASE-26631 Upgrade junit to 4.13.2 (#3997)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-05 00:01:02 +08:00
Duo Zhang e53712ae99
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:10:08 +08:00
Andrew Purtell 29e37439f7 HBASE-26601 maven-gpg-plugin failing with "Inappropriate ioctl for device"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:38:40 -08:00
Andrew Purtell b1bc5f3a5c Renumber to 2.6.0-SNAPSHOT after branching branch-2.5
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-08 16:54:32 -08:00
Andrew Purtell 4a00ce1cd5
HBASE-26535 [site, branch-2] DependencyManagement report is broken (#3915)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 11:59:31 +08:00
markjens ad0ed956c2
HBASE-26470 Use openlabtesting protoc on linux arm64 in HBASE 2.x (#3860)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-22 23:13:27 +08:00
Andrew Purtell 18b9fa8a3c HBASE-26259 Fallback support to pure Java compression (#3691)
This change introduces provided compression codecs to HBase as
new Maven modules. Each module provides compression codec support
that formerly required Hadoop native codecs, which in turn relies
on native code integration, which may or may not be available on
a given hardware platform or in an operational environment. We
now provide codecs in the HBase distribution for users whom for
whatever reason cannot or do not wish to deploy the Hadoop native
codecs.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileEncryption.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileSeek.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestCompressedWAL.java
2021-10-06 13:48:33 -07:00
Peter Somogyi 025b42bb28 HBASE-26329 Upgrade commons-io to 2.11.0 (#3722)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-06 10:22:02 +02:00
Tak Lon (Stephen) Wu a746e19c3b HBASE-26138 Backport HBASE-25733 "Upgrade opentelemetry to 1.0.1" to branch-2 (#3628)
15/17 commits of HBASE-22120, original commit b714889989

Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-01 15:29:09 -07:00
Tak Lon (Stephen) Wu 8f160109cd HBASE-26135 Backport HBASE-25616 "Upgrade opentelemetry to 1.0.0" to branch-2 (#3620)
12/17 commits of HBASE-22120, original commits 8399293e21

Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-01 15:29:09 -07:00
Tak Lon (Stephen) Wu d0a53e3f29 HBASE-26133 Backport HBASE-25591 "Upgrade opentelemetry to 0.17.1" to branch-2 (#3608)
10/17 commits of HBASE-22120, original commit f6ff519dd0

Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-01 15:29:09 -07:00
Tak Lon (Stephen) Wu 58b5c007b9 HBASE-26127 Backport HBASE-23898 "Add trace support for simple apis i… (#3556)
4/17 commits of HBASE-22120, original commit 805b2ae2ad

Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:29:09 -07:00
Tak Lon (Stephen) Wu af460132c0 HBASE-26126 Backport HBASE-25424 "Find a way to config OpenTelemetry tracing without directly depending on opentelemetry-sdk" to branch-2 (#3552)
3/17 commits of HBASE-22120, original commit#57960fa8fa7228d65b1a4adc8e9b5b1a8158824d

Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-01 15:29:09 -07:00
Tak Lon (Stephen) Wu 4dfc59c19e HBASE-26125 Backport HBASE-25401 "Add trace support for async call in rpc client" to branch-2 (#3543)
2/17 commits of HBASE-22120

Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-01 15:29:09 -07:00
Tak Lon (Stephen) Wu 665305cc3b HBASE-26124 Backport HBASE-25373 "Remove HTrace completely in code base and try to make use of OpenTelemetry" to branch-2 (#3529)
1/17 commits of HBASE-22120

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-01 15:29:09 -07:00
chenglei 51233c3c9b HBASE-26244 Avoid trim the error stack trace when running UT with maven (#3654)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:21:23 +08:00
Tak Lon (Stephen) Wu c11a3e1b39 Revert "HBASE-26124 Backport HBASE-25373 "Remove HTrace completely in code base and try to make use of OpenTelemetry" to branch-2 (#3529)"
This reverts commit f049301606.
2021-08-04 15:55:13 -07:00
Tak Lon (Stephen) Wu fffdcba5bb Revert "HBASE-26125 Backport HBASE-25401 "Add trace support for async call in rpc client" to branch-2 (#3543)"
This reverts commit ca096437d7.
2021-08-04 15:55:13 -07:00
Tak Lon (Stephen) Wu ca096437d7
HBASE-26125 Backport HBASE-25401 "Add trace support for async call in rpc client" to branch-2 (#3543)
2/17 commits of HBASE-22120

Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-08-02 11:33:19 -07:00