Commit Graph

858 Commits

Author SHA1 Message Date
Nick Dimiduk 227bcaeb88 HBASE-24007 Get `-PrunLargeTests` passing on JDK11 (#1351)
Minor tweaks required to get passing runs of `-PrunLargeTests`.
* Minimum Hadoop version is 3.2.0 due to
  [HADOOP-12760](https://issues.apache.org/jira/browse/HADOOP-12760).
* JDK11 looks like it consumes more memory than JDK8, so failures due
  to OOME see more common here. Bumping heap allocated to surefire
  forks allows better pass rate.

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-30 09:48:58 -07:00
Nick Dimiduk 7d89a9870b HBASE-23980 Use enforcer plugin to print JVM info in maven output
Does what it says on the tin. Bound to `initialize` phase so that it
runs early in lifecycle. Uses `<inherited>false</inherited>` so that
the plugin will run only for the base pom's reactor stage and not for
any children.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-24 09:19:04 -07:00
Nick Dimiduk ffb2359146
HBASE-24013 Bump branch-2 version to 2.4.0-SNAPSHOT (#1309)
Increment version in poms with

```
$ mvn org.codehaus.mojo:versions-maven-plugin:2.7:set -DnewVersion=2.4.0-SNAPSHOT -DgenerateBackupPoms=false
```

Verified no dangling references with

```
$ find . -iname '*pom.xml' -exec grep -n '2.3.0-SNAPSHOT' {} +
```

Verified build with

```
$ JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home mvn clean package -DskipTests
$ JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home mvn clean package -DskipTests -Dhadoop.profile=3.0
```

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-19 08:01:43 -07:00
Nick Dimiduk 33cb9fc932 HBASE-23829 Get `-PrunSmallTests` passing on JDK11
Signed-off-by: stack <stack@apache.org>
2020-03-17 09:01:02 -07:00
Duo Zhang 3366d64046 HBASE-23986 Bump hadoop-two.version to 2.10.0 on master and branch-2 (#1289)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-03-17 08:06:50 +08:00
Wei-Chiu Chuang ba6d8c8f27
HBASE-23861. Reconcile Hadoop version. (#1179) (#1242)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 6d9802fc2e)
2020-03-13 15:16:35 +05:30
Duo Zhang 7eeb6a0815 HBASE-23077 move entirely to spotbugs (#1265)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-12 11:42:23 +08:00
stack 4f92f0f807 HBASE-23956 Use less resources running tests (#1266)
Addendum to cleanup pom warning.
2020-03-11 14:36:34 -07:00
Michael Stack 2655f9647e
HBASE-23956 Use less resources running tests (#1266)
Add being able to configure netty thread counts. Enable socket reuse
(should not have any impact).

hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/BlockingRpcConnection.java
 Rename the threads we create in here so they are NOT named same was
 threads created by Hadoop RPC.

hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/DefaultNettyEventLoopConfig.java
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcClient.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AsyncFSWAL.java
 Allow configuring eventloopgroup thread count (so can override for
 tests)

hbase-examples/src/main/java/org/apache/hadoop/hbase/client/example/HttpProxyExample.java
 Enable socket resuse.

hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcServer.java
 Enable socket resuse and config for how many threads to use.

hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/main/java/org/apache/hadoop/hbase/util/ModifyRegionUtils.java
 Thread name edit; drop the redundant 'Thread' suffix.

hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HFileReplicator.java
 Make closeable and shutdown executor when called.

hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSink.java
 Call close on HFileReplicator

hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationBase.java
 HDFS creates lots of threads. Use less of it so less threads overall.

hbase-server/src/test/resources/hbase-site.xml
hbase-server/src/test/resources/hdfs-site.xml
 Constrain resources when running in test context.

hbase-server/src/test/resources/log4j.properties
 Enable debug on netty to see netty configs in our log

pom.xml
 Add system properties when we launch JVMs to constrain thread counts in
 tests

 Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-03-11 10:25:11 -07:00
stack c5e0a1397b Revert "Put into all site.xmls and check system property is set"
Pushed by mistake

This reverts commit c8c2a87505.
2020-03-04 09:57:33 -08:00
stack c8c2a87505 Put into all site.xmls and check system property is set 2020-03-04 08:55:45 -08:00
Michael Stack 4c8ac72194
HBASE-23779 Up the default fork count; make count relative to CPU count (#1108)
Set the fork count for first and second parts to be 0.5C. Add a bit of
doc too on this as well as some qualification on our test categories.
Also adds -T0.5C to MAVEN_ARGS in the hbase personality.
2020-02-04 20:47:02 -08:00
Mark Robert Miller e385fd97e0 HBASE-23783: Address tests writing and reading SSL/Security files in a common location. (#1116)
This is causing me issues with parallel test runs.

Also allow setting the surefire reports and temp directories via command line.

Signed-off-by: stack <stack@apache.org>
2020-02-04 14:40:52 -08:00
Josh Elser 7b4b90aef5 HBASE-23774 Add the user-zh mailing list 2020-01-31 19:34:21 -05:00
stack 36cdcad43f HBASE-23751 Move core to hbase-thirdparty 3.2.0 2020-01-27 22:08:57 -08:00
Nick Dimiduk ff3d2aea81
HBASE-23707 Add IntelliJ check style plugin configuration (#1064) (#1092)
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-01-27 10:45:27 -08:00
stack cbb2c7e00d Reapply "HBASE-23069 periodic dependency bump for Sep 2019 (#1082)""
Was reverted to see if this was breaking build but it isn't. Putting
back.
2020-01-26 20:45:03 -08:00
stack 3d9e536e2a Revert "HBASE-23069 periodic dependency bump for Sep 2019 (#1082)"
This reverts commit 792feec05d.

 Revert to see if this causing strange test failure on nightlies.
2020-01-24 18:47:39 -08:00
stack 83a2f6b546 Revert " HBASE-23069 periodic dependency bump for Sep 2019 (#1082); ADDENDUM"
This reverts commit 0dc71f9fdf.

 Revert to see if this causing strange test failure on nightlies.
2020-01-24 18:47:34 -08:00
stack 502cb33601 Revert " HBASE-23069 periodic dependency bump for Sep 2019 (#1082); ADDENDUM"
This reverts commit 2a11b7e94b.

 Revert to see if this causing strange test failure on nightlies.
2020-01-24 18:47:30 -08:00
stack a91346a727 Revert " HBASE-23069 periodic dependency bump for Sep 2019 (#1082); ADDENDUM"
This reverts commit 9f04fa69b0.

Revert to see if this causing strange test failure on nightlies.
2020-01-24 18:47:02 -08:00
stack 9f04fa69b0 HBASE-23069 periodic dependency bump for Sep 2019 (#1082); ADDENDUM
AND.... undo thirdparty testing version update.
2020-01-23 14:24:32 -08:00
stack 2a11b7e94b HBASE-23069 periodic dependency bump for Sep 2019 (#1082); ADDENDUM
Remove staging repo added by mistake.
2020-01-23 14:16:23 -08:00
stack 0dc71f9fdf HBASE-23069 periodic dependency bump for Sep 2019 (#1082); ADDENDUM
For asciidoctor, s/1.5.8/1.5.8.1/.
2020-01-23 11:58:47 -08:00
Michael Stack 792feec05d
HBASE-23069 periodic dependency bump for Sep 2019 (#1082)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-01-23 09:25:51 -08:00
Guanghao Zhang 8f292a8d58 HBASE-23156 start-hbase.sh failed with ClassNotFoundException when build with hadoop3 (#1067)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-01-20 13:24:27 +08:00
Nick Dimiduk 2bc67dfda0
HBASE-23700 Upgrade checkstyle and plugin versions (#1056) (#1063)
Bump checkstyle version to 8.28, maven-checkstyle-plugin to 3.1.0.

As per HBASE-23242 and the updated checkstyle docs[1], the LineLength
check should be placed under an instance of Checker.

[1] https://checkstyle.sourceforge.io/config_sizes.html#LineLength

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-17 17:09:16 -08:00
Nick Dimiduk 74bfe023e5
HBASE-23653 Expose content of meta table in web ui (#1021)
Adds a display of the content of 'hbase:meta' to the Master's
table.jsp, when that table is selected. Supports basic pagination,
filtering, &c.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-01-16 08:47:00 -08:00
Peter Somogyi c9fa98a4d6 HBASE-23675 Move to Apache parent POM version 22 2020-01-11 11:19:24 +01:00
Nick Dimiduk fdc9dd63c5
HBASE-23664 Upgrade JUnit to 4.13 (#1009)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-10 07:21:17 -08:00
ravowlga123 7a4623f4fa HBASE-23320 Upgrade surefire plugin to 3.0.0-M4
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-12-23 14:55:45 +01:00
Sean Busbey 0770b0768f HBASE-23337 Release scripts should rely on maven for deploy. (#887)
- switch to nexus-staging-maven-plugin for asf-release
- cleaned up some tabs in the root pom

(differs from master because there are no release scripts here.)

Signed-off-by: stack <stack@apache.org>
(cherry picked from commit 97e0107000)
2019-12-03 15:19:46 -08:00
Wei-Chiu Chuang d9180ab6d7 HBASE-23227 Upgrade jackson-databind to 2.9.10.1
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-10-29 21:08:02 -05:00
Michael Stack d8ad2a0bb5 HBASE-23129 Move core to use hbase-thirdparty-3.1.1 (#695)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-10-11 14:32:19 +02:00
SteNicholas f99a9a8b64 HBASE-23075 Upgrade jackson version (#660)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-09-26 10:24:05 +08:00
Balazs Meszaros c5a5bf7f48 HBASE-23032 Upgrade to Curator 4.2.0
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-09-23 12:00:33 +02:00
ravowlga123 37d49aaaf6 HBASE-22927 Upgrade Mockito version for jdk11 (#593)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-09-18 21:51:10 +08:00
Peter Somogyi 8c436ba9fd HBASE-23043 Use 'advanced' Netty leak detection (#636)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-09-18 20:38:36 +08:00
Duo Zhang 1568e05507 HBASE-22963 Netty ByteBuf leak in rpc client implementation (#577)
Signed-off-by: Michael Stack <stack@apache.org>
2019-09-08 22:10:18 +08:00
Toshihiro Suzuki 345455a3db HBASE-11062 hbtop (#476)
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-09-07 14:17:59 +09:00
Peter Somogyi 2bd4aa2d0b
HBASE-21996 Set locale for javadoc
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-23 22:34:09 +02:00
Viraj Jasani e28a7c29c5 HBASE-22863 Cleanup transitive Jackson1 vulnerable dependencies(forward-port HBASE-22728) (#505)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-21 22:16:52 +08:00
syedmurtazahassan c5b29265a3
HBASE-22725 Remove all remaining Javadoc warnings
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-11 22:02:53 +02:00
Balazs Meszaros 14634411da HBASE-15666 shaded dependencies for hbase-testing-util
Added new artifact hbase-shaded-testing-util. It wraps a whole hbase-server
with its testing dependencies. Users should use only the following dependency
in pom:

<dependency>
  <groupId>org.apache.hbase</groupId>
  <artifactId>hbase-shaded-testing-util</artifactId>
  <version>${hbase.version}</version>
  <scope>test</scope>
</dependency>

Added hbase-shaded-testing-util-tester maven module which ensures
that hbase-shaded-testing-util works with a shaded client.

Signed-off-by: Josh Elser <elserj@apache.org>
2019-08-07 07:43:44 -07:00
nyl3532016 df0b0144f3 HBASE-22778 Upgrade jasckson databind to 2.9.9.2 (#454)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-05 20:36:33 +08:00
Duo Zhang 99ac6e497c HBASE-22722 Upgrade jackson databind dependencies to 2.9.9.1 (#402)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-24 10:03:35 +08:00
Viraj Jasani 1d656e8411 HBASE-22597 Upgrading commons-long to 3.9
Closes #317

Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 5a9d877565)
2019-06-20 09:35:14 -05:00
Sakthi c248e12bc4 HBASE-22588 Upgrade jaxws-ri dependency to 2.3.2
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 92ee197647)
2019-06-19 15:55:14 -05:00
Sakthi 38f051b750 HBASE-22264 Separate out jars related to JDK 11 into a folder in /lib
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 0fead7ff1c)
2019-06-14 09:22:48 -05:00
Josh Elser e38aa2624f HBASE-22560 Upgrade jackson (2.9.9) and jetty (9.3.27) minor versions
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-06-11 14:11:13 -04:00