eb16b4a782
HBASE-24631 Loosen Dockerfile pinned package versions of the "debian-revision" ( #1965 )
...
After a bit of research into [0] and [1], and a bit of
experimentation, it seems we can use a partial wild-card expression
for these version strings. Let's try this for now. If it works out, we
should expand this usage to all the version package numbers, pinning
them to their epic:upstream-version components.
[0]: http://manpages.ubuntu.com/manpages/xenial/en/man5/deb-version.5.html
[1]: http://manpages.ubuntu.com/manpages/xenial/man8/apt-get.8.html
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-25 22:26:06 +08:00
5c390f0800
HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME
...
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-03 16:36:54 -07:00
fd7beffcf9
Revert "Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2"
...
This reverts commit f66c80b6a6
2020-06-03 16:36:54 -07:00
f66c80b6a6
Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2
...
HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME
2020-06-03 16:20:49 -07:00
99a40ddacf
HBASE-24280 Skip explicit hadoop3 profile activation on master
...
On 2.x branches, we need to explicitly activate profiles for H3. On
master, all H2 support is dropped which means no special profiles are
required for H3 (though, there is still a profile there to encapsulate
H3 logic).
We need to make sure that the yetus invocation can correctly pass down
any profile information into the personality, so we activate the exact
profiles we want.
Closes #1609
Co-authored-by: Istvan Toth <stoty@cloudera.com>
Signed-off-by: stack <stack@apache.org>
2020-05-29 12:27:58 -04:00
22efe67758
HBASE-24451 Remove the HasThread because the related bug had been fixed since jdk7 ( #1797 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-29 17:46:03 +05:30
b2e9321d97
HBASE-24251 PreCommit build is failing because of can not build docker image; addendum ( #1579 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-24 13:59:51 +02:00
4f0d05b462
HBASE-24253 HBASE-Find-Flaky-Tests job is failing because of can not build docker image ( #1578 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 19:47:12 +08:00
a0295662da
HBASE-24251 PreCommit build is failing because of can not build docker image ( #1575 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 16:23:34 +08:00
15a46388f1
HBASE-24218 Add hadoop 3.2.x in hadoop check ( #1559 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 10:52:53 +08:00
6e95575669
HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches ( #1548 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-22 10:26:10 +08:00
4646f7b52b
HBASE-24203 Bump git version in Dockerfile; addendum ( #1543 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-17 23:32:37 +02:00
55f65dc030
HBASE-24203 Bump git version in Dockerfile ( #1538 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-17 13:07:40 +02:00
62a488b946
HBASE-24126 Up the container nproc uplimit from 10000 to 12500 ( #1504 )
2020-04-14 17:36:06 -07:00
9eb49172d0
HBASE-24150 Allow module tests run in parallel ( #1464 )
...
Pass --threads=2 to mvn when yetus runs so some parallelism
when dependencies allow.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-09 14:41:41 -07:00
ed54c35cf0
HBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 ( #1451 )
...
Down jdk8 forked jvm heap from 2800 to 2200 and the jdk11 heap from
3200 to 2200. Down the mvn size from 4G to 3.6G
Change how many puts done by TestMultiRespectsLimits because made
the test run the forked heap over 2.5G in size.
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-04-08 10:51:03 -07:00
953c326498
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
...
Addendum number 3; set the yetus proclimit.
2020-04-07 10:22:24 -07:00
ba87ffed09
Revert "HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread."
...
Revert because applied with wrong JIRA number.
This reverts commit 9c60c5fddb
2020-04-07 10:17:48 -07:00
af659564f3
HBASE-24130 rat plugin complains about having an unlicensed file ( #1445 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-07 09:18:27 -07:00
9c60c5fddb
HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread.
...
Up the nproc in hbase-personality. Add test that prints out env.
2020-04-07 07:37:48 -07:00
01715fbbf6
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
...
Addendum number 2; docker doesn't like the ulimit arg as is.
2020-04-06 18:24:09 -07:00
099333079b
HBASE-24081 Provide documentation for running Yetus with HBase
...
Signed-off-by: stack <stack@apache.org>
2020-04-06 16:40:24 -07:00
25773c681b
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
...
ADDENDUM: Add to hbase-personality
2020-04-06 16:29:46 -07:00
ed24998b85
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
2020-04-06 13:44:53 -07:00
4d31af23e8
HBASE-24122 Change machine ulimit-l to ulimit-a so dumps full ulimit rather than just 'max locked memory'
2020-04-06 08:58:16 -07:00
3030b59e29
HBASE-24113 Upgrade the maven we use from 3.5.4 to 3.6.3 in nightlies ( #1430 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-05 12:53:44 -07:00
1df979df18
HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-03 16:59:54 -07:00
97a47ed0ee
HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread
...
Set the forkcount down from 0.5C to 0.25C.
2020-04-01 16:05:59 -07:00
8d058a9920
HBASE-24071 [JDK11] Remove `unit` filter from nightly and precommit jobs
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-01 12:31:18 -07:00
b7e20c0df1
HBASE-24092 Fix links to build reports generated by nightly job
...
Signed-off-by: stack <stack@apache.org>
2020-04-01 12:19:28 -07:00
c5a3ab7504
HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check
2020-03-31 09:51:31 -07:00
593f44c928
HBASE-24078 SpotBugs check automatically skip inapplicable modules
...
Without patch, the spotbugs results include warnings for inapplicable
modules:
+---------------------------------------------------------------------------
| | | | Compile Tests
+---------------------------------------------------------------------------
| 0 | mvndep | 0m 11s | Maven dependency ordering
| +1 | mvninstall | 2m 47s | the source passed
| 0 | spotbugs | 0m 11s | branch/hbase-annotations no spotbugs
| | | | output file (spotbugsXml.xml)
| 0 | spotbugs | 0m 14s | branch/hbase-assembly no spotbugs output
| | | | file (spotbugsXml.xml)
| 0 | spotbugs | 0m 07s |
| | | | branch/hbase-archetypes/hbase-archetype-bu
| | | | ilder no spotbugs output file
| | | | (spotbugsXml.xml)
+---------------------------------------------------------------------------
With patch,
+---------------------------------------------------------------------------
| | | | Compile Tests
+---------------------------------------------------------------------------
| 0 | mvndep | 0m 13s | Maven dependency ordering
| +1 | mvninstall | 3m 09s | the source passed
| +1 | spotbugs | 17m 09s | the source passed
+---------------------------------------------------------------------------
Signed-off-by: stack <stack@apache.org>
2020-03-31 09:33:01 -07:00
6f675e269c
HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-31 09:33:01 -07:00
c98ec0c22c
HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM
...
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
2020-03-26 08:48:03 -07:00
a8606c36c7
HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh
...
Signed-off-by: stack <stack@apache.org>
2020-03-25 13:48:15 -07:00
aba0737acb
HBASE-24002 shadedjars check does not propagate --hadoop-profile
...
This implementation is almost surely incorrect. Personality
initialization parses the `--hadoop-profile` argument and sets
`HADOOP_PROFILE`. That value is then used to build an `extras` value
that is passed along to module initialization. I'm guessing that the
`extras` value need to be honored down in the shadedjars module. I'm
not clear on how to make that work (need to study the interfaces at
play here), so taking the more ham-handed approach of referring to
`HADOOP_PROFILE`. I'm not sure if this will even work, or if it will
only work because the `foo_yetus.sh` scripts happen to use a variable
of the same name.
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2020-03-24 09:35:31 -07:00
83388609d0
HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches ( #1304 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-20 14:18:07 +08:00
c8d6ee31b8
HBASE-24017 Turn down flakey rerun rate on all but hot branches
...
On master branch run twice a day instead of every 4 hours.
2020-03-18 15:54:10 -07:00
df77c029ae
HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY
2020-03-18 14:42:48 -07:00
b942527b60
HBASE-24004 Include hadoop version in Nightly report name
2020-03-17 14:52:13 -07:00
dab736428e
HBASE-23978 Dockerfiles reusing stale apt sources info
...
Signed-off-by: stack <stack@apache.org>
2020-03-12 17:28:41 -07:00
7eeb6a0815
HBASE-23077 move entirely to spotbugs ( #1265 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-12 11:42:23 +08:00
ebfc1a206c
HBASE-23945 Dockerfiles showing hadolint check failures
...
Signed-off-by: stack <stack@apache.org>
2020-03-10 12:33:18 -07:00
dacceba0c7
HBASE-18418 Remove apache_hbase_topology from dev-support
2020-03-09 09:53:37 -07:00
84efaed120
HBASE-23946 [JDK11] Yetus should vote -0 for known JDK11 issues ( #1246 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-09 09:13:06 -07:00
3e5d3a0ab3
Revert "HBASE-23945 Dockerfiles showing hadolint check failures"
...
This reverts commit 4205677eb7
2020-03-07 10:42:22 -08:00
5872758c6b
Revert "HBASE-18418 Remove apache_hbase_topology from dev-support"
...
This reverts commit d641726da5
2020-03-07 10:42:22 -08:00
d641726da5
HBASE-18418 Remove apache_hbase_topology from dev-support
2020-03-06 09:56:43 -08:00
4205677eb7
HBASE-23945 Dockerfiles showing hadolint check failures
...
Signed-off-by: stack <stack@apache.org>
2020-03-06 09:56:43 -08:00
797a13436c
HBASE-23876 Add JDK11 compilation and unit test support to nightly job
...
Builds on the Dockerfile changes provided by HBASE-23767.
closes #1195
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-05 13:59:01 -08:00
Nick Dimiduk
Josh Elser
bsglz
Peter Somogyi
Duo Zhang
Michael Stack
stack
Minwoo Kang
Nihal Jain
Dima Spivak
Nick Dimiduk