Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,909 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

489 Commits

Author SHA1 Message Date
Peter Somogyi b2e9321d97 HBASE-24251 PreCommit build is failing because of can not build docker image; addendum (#1579) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-04-24 13:59:51 +02:00
Duo Zhang 4f0d05b462 HBASE-24253 HBASE-Find-Flaky-Tests job is failing because of can not build docker image (#1578) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-24 19:47:12 +08:00
Duo Zhang a0295662da HBASE-24251 PreCommit build is failing because of can not build docker image (#1575) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-24 16:23:34 +08:00
Duo Zhang 15a46388f1 HBASE-24218 Add hadoop 3.2.x in hadoop check (#1559) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-22 10:52:53 +08:00
Duo Zhang 6e95575669
HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches (#1548) 
Signed-off-by: stack <stack@apache.org>
 2020-04-22 10:26:10 +08:00
Peter Somogyi 4646f7b52b HBASE-24203 Bump git version in Dockerfile; addendum (#1543) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-04-17 23:32:37 +02:00
Peter Somogyi 55f65dc030 HBASE-24203 Bump git version in Dockerfile (#1538) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-17 13:07:40 +02:00
Michael Stack 62a488b946 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1504) 2020-04-14 17:36:06 -07:00
Michael Stack 9eb49172d0
HBASE-24150 Allow module tests run in parallel (#1464) 
Pass --threads=2 to mvn when yetus runs so some parallelism
when dependencies allow.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-09 14:41:41 -07:00
Michael Stack ed54c35cf0
HBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 (#1451) 
Down jdk8 forked jvm heap from 2800 to 2200 and the jdk11 heap from
3200 to 2200. Down the mvn size from 4G to 3.6G

Change how many puts done by TestMultiRespectsLimits because made
the test run the forked heap over 2.5G in size.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-04-08 10:51:03 -07:00
stack 953c326498 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 
Addendum number 3; set the yetus proclimit.
 2020-04-07 10:22:24 -07:00
stack ba87ffed09 Revert "HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread." 
Revert because applied with wrong JIRA number.

This reverts commit 9c60c5fddb.
 2020-04-07 10:17:48 -07:00
Minwoo Kang af659564f3 HBASE-24130 rat plugin complains about having an unlicensed file (#1445) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-04-07 09:18:27 -07:00
stack 9c60c5fddb HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread. 
Up the nproc in hbase-personality. Add test that prints out env.
 2020-04-07 07:37:48 -07:00
stack 01715fbbf6 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 
Addendum number 2; docker doesn't like the ulimit arg as is.
 2020-04-06 18:24:09 -07:00
Nick Dimiduk 099333079b HBASE-24081 Provide documentation for running Yetus with HBase 
Signed-off-by: stack <stack@apache.org>
 2020-04-06 16:40:24 -07:00
stack 25773c681b HBASE-24126 Up the container nproc uplimit from 10000 to 12500 
ADDENDUM: Add to hbase-personality
 2020-04-06 16:29:46 -07:00
stack ed24998b85 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 2020-04-06 13:44:53 -07:00
stack 4d31af23e8 HBASE-24122 Change machine ulimit-l to ulimit-a so dumps full ulimit rather than just 'max locked memory' 2020-04-06 08:58:16 -07:00
Michael Stack 3030b59e29
HBASE-24113 Upgrade the maven we use from 3.5.4 to 3.6.3 in nightlies (#1430) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-05 12:53:44 -07:00
Nick Dimiduk 1df979df18 HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-03 16:59:54 -07:00
stack 97a47ed0ee HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread 
Set the forkcount down from 0.5C to 0.25C.
 2020-04-01 16:05:59 -07:00
Nick Dimiduk 8d058a9920 HBASE-24071 [JDK11] Remove `unit` filter from nightly and precommit jobs 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-04-01 12:31:18 -07:00
Nick Dimiduk b7e20c0df1 HBASE-24092 Fix links to build reports generated by nightly job 
Signed-off-by: stack <stack@apache.org>
 2020-04-01 12:19:28 -07:00
stack c5a3ab7504 HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check 2020-03-31 09:51:31 -07:00
Nick Dimiduk 593f44c928 HBASE-24078 SpotBugs check automatically skip inapplicable modules 
Without patch, the spotbugs results include warnings for inapplicable
modules:

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 11s   | Maven dependency ordering
|  +1  |    mvninstall  |   2m 47s   | the source passed
|   0  |      spotbugs  |   0m 11s   | branch/hbase-annotations no spotbugs
|      |                |            | output file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 14s   | branch/hbase-assembly no spotbugs output
|      |                |            | file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 07s   |
|      |                |            | branch/hbase-archetypes/hbase-archetype-bu
|      |                |            | ilder no spotbugs output file
|      |                |            | (spotbugsXml.xml)
+---------------------------------------------------------------------------

With patch,

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 13s   | Maven dependency ordering
|  +1  |    mvninstall  |   3m 09s   | the source passed
|  +1  |      spotbugs  |  17m 09s   | the source passed
+---------------------------------------------------------------------------

Signed-off-by: stack <stack@apache.org>
 2020-03-31 09:33:01 -07:00
Nihal Jain 6f675e269c HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-03-31 09:33:01 -07:00
Nick Dimiduk c98ec0c22c HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM 
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
 2020-03-26 08:48:03 -07:00
Nick Dimiduk a8606c36c7 HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh 
Signed-off-by: stack <stack@apache.org>
 2020-03-25 13:48:15 -07:00
Nick Dimiduk aba0737acb HBASE-24002 shadedjars check does not propagate --hadoop-profile 
This implementation is almost surely incorrect. Personality
initialization parses the `--hadoop-profile` argument and sets
`HADOOP_PROFILE`. That value is then used to build an `extras` value
that is passed  along to module initialization. I'm guessing that the
`extras` value need to be honored down in the shadedjars module. I'm
not clear on how to make that work (need to study the interfaces at
play here), so taking the more ham-handed approach of referring to
`HADOOP_PROFILE`. I'm not sure if this will even work, or if it will
only work because the `foo_yetus.sh` scripts happen to use a variable
of the same name.

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
 2020-03-24 09:35:31 -07:00
Duo Zhang 83388609d0
HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches (#1304) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-03-20 14:18:07 +08:00
stack c8d6ee31b8 HBASE-24017 Turn down flakey rerun rate on all but hot branches 
On master branch run twice a day instead of every 4 hours.
 2020-03-18 15:54:10 -07:00
stack df77c029ae HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY 2020-03-18 14:42:48 -07:00
Nick Dimiduk b942527b60 HBASE-24004 Include hadoop version in Nightly report name 2020-03-17 14:52:13 -07:00
Nick Dimiduk dab736428e HBASE-23978 Dockerfiles reusing stale apt sources info 
Signed-off-by: stack <stack@apache.org>
 2020-03-12 17:28:41 -07:00
Duo Zhang 7eeb6a0815 HBASE-23077 move entirely to spotbugs (#1265) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-03-12 11:42:23 +08:00
Nick Dimiduk ebfc1a206c HBASE-23945 Dockerfiles showing hadolint check failures 
Signed-off-by: stack <stack@apache.org>
 2020-03-10 12:33:18 -07:00
Dima Spivak dacceba0c7 HBASE-18418 Remove apache_hbase_topology from dev-support 2020-03-09 09:53:37 -07:00
Nick Dimiduk 84efaed120 HBASE-23946 [JDK11] Yetus should vote -0 for known JDK11 issues (#1246) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-03-09 09:13:06 -07:00
Nick Dimiduk 3e5d3a0ab3 Revert "HBASE-23945 Dockerfiles showing hadolint check failures" 
This reverts commit 4205677eb7.
 2020-03-07 10:42:22 -08:00
Nick Dimiduk 5872758c6b Revert "HBASE-18418 Remove apache_hbase_topology from dev-support" 
This reverts commit d641726da5.
 2020-03-07 10:42:22 -08:00
Dima Spivak d641726da5 HBASE-18418 Remove apache_hbase_topology from dev-support 2020-03-06 09:56:43 -08:00
Nick Dimiduk 4205677eb7 HBASE-23945 Dockerfiles showing hadolint check failures 
Signed-off-by: stack <stack@apache.org>
 2020-03-06 09:56:43 -08:00
Nick Dimiduk 797a13436c HBASE-23876 Add JDK11 compilation and unit test support to nightly job 
Builds on the Dockerfile changes provided by HBASE-23767.

closes #1195

Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-03-05 13:59:01 -08:00
Nick Dimiduk e0f9d0f562 HBASE-23767 Add JDK11 compilation and unit test support to Github precommit 
Rebuild our Dockerfile with support for multiple JDK versions. Use
multiple stages in the Jenkinsfile instead of yetus's multijdk because
of YETUS-953. Run those multiple stages in parallel to speed up
results.

Note that multiple stages means multiple Yetus invocations means
multiple comments on the PreCommit. This should become more obvious to
users once we can make use of GitHub Checks API, HBASE-23902.

closes #1183

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
  dev-support/Jenkinsfile_GitHub
  dev-support/hbase-personality.sh
 2020-03-05 13:59:01 -08:00
stack 4717eecd5b HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails. 
Addendum again again... hanging quote.
 2020-03-04 13:51:21 -08:00
stack 60641144ab HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails. 
Addendum again. This previous change seems to have altered display of
  flakies. Trying more basic change.
 2020-03-04 11:16:19 -08:00
stack 74af4b30bf HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails. 
Addendum: fix failed variable interpolation
 2020-03-04 10:11:48 -08:00
stack ee4f54f09b HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails. 
Change the forkcount from 1.0C to 0.25C
 2020-03-04 10:00:48 -08:00
Nick Dimiduk 9bee77bb51 HBASE-23874 Move Jira-attached file precommit definition from script in Jenkins config to dev-support (#1191) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-02-26 16:58:17 -08:00