0f3a66554f
HBASE-25021 Nightly job should skip hadoop-2 integration test for master ( #2409 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-17 09:01:11 +08:00
a8efc3ab81
HBASE-24809 Fix broken Apache Yetus documentation links
...
Closes #2335
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-31 21:01:56 +05:30
85370f1443
HBASE-24953 Temporarily up the timeout for branch-2 from 9 hours to 12 for build
...
Addendum upping build time from 12 to 24 hours.
2020-08-26 21:23:49 -07:00
5c12b1e310
HBASE-24953 Temporarily up the timeout for branch-2 from 9 hours to 12 for build
2020-08-25 13:10:46 -07:00
4bf833418f
HBASE-24876 Fix the flaky job url in hbase-personality.sh ( #2253 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-13 16:52:29 +08:00
7f5f5776b7
HBASE-24841 Change the jenkins job urls in our jenkinsfile ( #2227 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-11 09:07:30 +08:00
aab8ce9e01
HBASE-24838 The pre commit job fails to archive surefire reports ( #2224 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-08-10 11:13:56 +08:00
2a12fd283e
HBASE-24289 Heterogeneous Storage for Date Tiered Compaction ( #1730 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-30 15:19:30 +08:00
eb16b4a782
HBASE-24631 Loosen Dockerfile pinned package versions of the "debian-revision" ( #1965 )
...
After a bit of research into [0] and [1], and a bit of
experimentation, it seems we can use a partial wild-card expression
for these version strings. Let's try this for now. If it works out, we
should expand this usage to all the version package numbers, pinning
them to their epic:upstream-version components.
[0]: http://manpages.ubuntu.com/manpages/xenial/en/man5/deb-version.5.html
[1]: http://manpages.ubuntu.com/manpages/xenial/man8/apt-get.8.html
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-25 22:26:06 +08:00
5c390f0800
HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME
...
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-03 16:36:54 -07:00
fd7beffcf9
Revert "Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2"
...
This reverts commit f66c80b6a6
2020-06-03 16:36:54 -07:00
f66c80b6a6
Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2
...
HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME
2020-06-03 16:20:49 -07:00
99a40ddacf
HBASE-24280 Skip explicit hadoop3 profile activation on master
...
On 2.x branches, we need to explicitly activate profiles for H3. On
master, all H2 support is dropped which means no special profiles are
required for H3 (though, there is still a profile there to encapsulate
H3 logic).
We need to make sure that the yetus invocation can correctly pass down
any profile information into the personality, so we activate the exact
profiles we want.
Closes #1609
Co-authored-by: Istvan Toth <stoty@cloudera.com>
Signed-off-by: stack <stack@apache.org>
2020-05-29 12:27:58 -04:00
22efe67758
HBASE-24451 Remove the HasThread because the related bug had been fixed since jdk7 ( #1797 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-29 17:46:03 +05:30
b2e9321d97
HBASE-24251 PreCommit build is failing because of can not build docker image; addendum ( #1579 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-24 13:59:51 +02:00
4f0d05b462
HBASE-24253 HBASE-Find-Flaky-Tests job is failing because of can not build docker image ( #1578 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 19:47:12 +08:00
a0295662da
HBASE-24251 PreCommit build is failing because of can not build docker image ( #1575 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 16:23:34 +08:00
15a46388f1
HBASE-24218 Add hadoop 3.2.x in hadoop check ( #1559 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 10:52:53 +08:00
6e95575669
HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches ( #1548 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-22 10:26:10 +08:00
4646f7b52b
HBASE-24203 Bump git version in Dockerfile; addendum ( #1543 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-17 23:32:37 +02:00
55f65dc030
HBASE-24203 Bump git version in Dockerfile ( #1538 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-17 13:07:40 +02:00
62a488b946
HBASE-24126 Up the container nproc uplimit from 10000 to 12500 ( #1504 )
2020-04-14 17:36:06 -07:00
9eb49172d0
HBASE-24150 Allow module tests run in parallel ( #1464 )
...
Pass --threads=2 to mvn when yetus runs so some parallelism
when dependencies allow.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-09 14:41:41 -07:00
ed54c35cf0
HBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 ( #1451 )
...
Down jdk8 forked jvm heap from 2800 to 2200 and the jdk11 heap from
3200 to 2200. Down the mvn size from 4G to 3.6G
Change how many puts done by TestMultiRespectsLimits because made
the test run the forked heap over 2.5G in size.
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-04-08 10:51:03 -07:00
953c326498
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
...
Addendum number 3; set the yetus proclimit.
2020-04-07 10:22:24 -07:00
ba87ffed09
Revert "HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread."
...
Revert because applied with wrong JIRA number.
This reverts commit 9c60c5fddb
2020-04-07 10:17:48 -07:00
af659564f3
HBASE-24130 rat plugin complains about having an unlicensed file ( #1445 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-07 09:18:27 -07:00
9c60c5fddb
HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread.
...
Up the nproc in hbase-personality. Add test that prints out env.
2020-04-07 07:37:48 -07:00
01715fbbf6
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
...
Addendum number 2; docker doesn't like the ulimit arg as is.
2020-04-06 18:24:09 -07:00
099333079b
HBASE-24081 Provide documentation for running Yetus with HBase
...
Signed-off-by: stack <stack@apache.org>
2020-04-06 16:40:24 -07:00
25773c681b
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
...
ADDENDUM: Add to hbase-personality
2020-04-06 16:29:46 -07:00
ed24998b85
HBASE-24126 Up the container nproc uplimit from 10000 to 12500
2020-04-06 13:44:53 -07:00
4d31af23e8
HBASE-24122 Change machine ulimit-l to ulimit-a so dumps full ulimit rather than just 'max locked memory'
2020-04-06 08:58:16 -07:00
3030b59e29
HBASE-24113 Upgrade the maven we use from 3.5.4 to 3.6.3 in nightlies ( #1430 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-05 12:53:44 -07:00
1df979df18
HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-03 16:59:54 -07:00
97a47ed0ee
HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread
...
Set the forkcount down from 0.5C to 0.25C.
2020-04-01 16:05:59 -07:00
8d058a9920
HBASE-24071 [JDK11] Remove `unit` filter from nightly and precommit jobs
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-01 12:31:18 -07:00
b7e20c0df1
HBASE-24092 Fix links to build reports generated by nightly job
...
Signed-off-by: stack <stack@apache.org>
2020-04-01 12:19:28 -07:00
c5a3ab7504
HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check
2020-03-31 09:51:31 -07:00
593f44c928
HBASE-24078 SpotBugs check automatically skip inapplicable modules
...
Without patch, the spotbugs results include warnings for inapplicable
modules:
+---------------------------------------------------------------------------
| | | | Compile Tests
+---------------------------------------------------------------------------
| 0 | mvndep | 0m 11s | Maven dependency ordering
| +1 | mvninstall | 2m 47s | the source passed
| 0 | spotbugs | 0m 11s | branch/hbase-annotations no spotbugs
| | | | output file (spotbugsXml.xml)
| 0 | spotbugs | 0m 14s | branch/hbase-assembly no spotbugs output
| | | | file (spotbugsXml.xml)
| 0 | spotbugs | 0m 07s |
| | | | branch/hbase-archetypes/hbase-archetype-bu
| | | | ilder no spotbugs output file
| | | | (spotbugsXml.xml)
+---------------------------------------------------------------------------
With patch,
+---------------------------------------------------------------------------
| | | | Compile Tests
+---------------------------------------------------------------------------
| 0 | mvndep | 0m 13s | Maven dependency ordering
| +1 | mvninstall | 3m 09s | the source passed
| +1 | spotbugs | 17m 09s | the source passed
+---------------------------------------------------------------------------
Signed-off-by: stack <stack@apache.org>
2020-03-31 09:33:01 -07:00
6f675e269c
HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-31 09:33:01 -07:00
c98ec0c22c
HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM
...
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
2020-03-26 08:48:03 -07:00
a8606c36c7
HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh
...
Signed-off-by: stack <stack@apache.org>
2020-03-25 13:48:15 -07:00
aba0737acb
HBASE-24002 shadedjars check does not propagate --hadoop-profile
...
This implementation is almost surely incorrect. Personality
initialization parses the `--hadoop-profile` argument and sets
`HADOOP_PROFILE`. That value is then used to build an `extras` value
that is passed along to module initialization. I'm guessing that the
`extras` value need to be honored down in the shadedjars module. I'm
not clear on how to make that work (need to study the interfaces at
play here), so taking the more ham-handed approach of referring to
`HADOOP_PROFILE`. I'm not sure if this will even work, or if it will
only work because the `foo_yetus.sh` scripts happen to use a variable
of the same name.
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2020-03-24 09:35:31 -07:00
83388609d0
HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches ( #1304 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-20 14:18:07 +08:00
c8d6ee31b8
HBASE-24017 Turn down flakey rerun rate on all but hot branches
...
On master branch run twice a day instead of every 4 hours.
2020-03-18 15:54:10 -07:00
df77c029ae
HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY
2020-03-18 14:42:48 -07:00
b942527b60
HBASE-24004 Include hadoop version in Nightly report name
2020-03-17 14:52:13 -07:00
dab736428e
HBASE-23978 Dockerfiles reusing stale apt sources info
...
Signed-off-by: stack <stack@apache.org>
2020-03-12 17:28:41 -07:00
7eeb6a0815
HBASE-23077 move entirely to spotbugs ( #1265 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-12 11:42:23 +08:00
Duo Zhang
Abhey
stack
Guanghao Zhang
pengmq1
Nick Dimiduk
Josh Elser
bsglz
Peter Somogyi
Michael Stack
Minwoo Kang
Nihal Jain