Commit Graph

549 Commits

Author SHA1 Message Date
Guanghao Zhang 4bf833418f HBASE-24876 Fix the flaky job url in hbase-personality.sh (#2253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-13 16:52:29 +08:00
Duo Zhang 7f5f5776b7 HBASE-24841 Change the jenkins job urls in our jenkinsfile (#2227)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-11 09:07:30 +08:00
Duo Zhang aab8ce9e01 HBASE-24838 The pre commit job fails to archive surefire reports (#2224)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-08-10 11:13:56 +08:00
pengmq1 2a12fd283e HBASE-24289 Heterogeneous Storage for Date Tiered Compaction (#1730)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-30 15:19:30 +08:00
Nick Dimiduk eb16b4a782 HBASE-24631 Loosen Dockerfile pinned package versions of the "debian-revision" (#1965)
After a bit of research into [0] and [1], and a bit of
experimentation, it seems we can use a partial wild-card expression
for these version strings. Let's try this for now. If it works out, we
should expand this usage to all the version package numbers, pinning
them to their epic:upstream-version components.

[0]: http://manpages.ubuntu.com/manpages/xenial/en/man5/deb-version.5.html
[1]: http://manpages.ubuntu.com/manpages/xenial/man8/apt-get.8.html

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-25 22:26:06 +08:00
Nick Dimiduk 5c390f0800 HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-03 16:36:54 -07:00
Nick Dimiduk fd7beffcf9 Revert "Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2"
This reverts commit f66c80b6a6.
2020-06-03 16:36:54 -07:00
Nick Dimiduk f66c80b6a6
Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2
HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME
2020-06-03 16:20:49 -07:00
Josh Elser 99a40ddacf HBASE-24280 Skip explicit hadoop3 profile activation on master
On 2.x branches, we need to explicitly activate profiles for H3. On
master, all H2 support is dropped which means no special profiles are
required for H3 (though, there is still a profile there to encapsulate
H3 logic).

We need to make sure that the yetus invocation can correctly pass down
any profile information into the personality, so we activate the exact
profiles we want.

Closes #1609

Co-authored-by: Istvan Toth <stoty@cloudera.com>
Signed-off-by: stack <stack@apache.org>
2020-05-29 12:27:58 -04:00
bsglz 22efe67758
HBASE-24451 Remove the HasThread because the related bug had been fixed since jdk7 (#1797)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-29 17:46:03 +05:30
Peter Somogyi b2e9321d97 HBASE-24251 PreCommit build is failing because of can not build docker image; addendum (#1579)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-24 13:59:51 +02:00
Duo Zhang 4f0d05b462 HBASE-24253 HBASE-Find-Flaky-Tests job is failing because of can not build docker image (#1578)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 19:47:12 +08:00
Duo Zhang a0295662da HBASE-24251 PreCommit build is failing because of can not build docker image (#1575)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 16:23:34 +08:00
Duo Zhang 15a46388f1 HBASE-24218 Add hadoop 3.2.x in hadoop check (#1559)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 10:52:53 +08:00
Duo Zhang 6e95575669
HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches (#1548)
Signed-off-by: stack <stack@apache.org>
2020-04-22 10:26:10 +08:00
Peter Somogyi 4646f7b52b HBASE-24203 Bump git version in Dockerfile; addendum (#1543)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-17 23:32:37 +02:00
Peter Somogyi 55f65dc030 HBASE-24203 Bump git version in Dockerfile (#1538)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-17 13:07:40 +02:00
Michael Stack 62a488b946 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1504) 2020-04-14 17:36:06 -07:00
Michael Stack 9eb49172d0
HBASE-24150 Allow module tests run in parallel (#1464)
Pass --threads=2 to mvn when yetus runs so some parallelism
when dependencies allow.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-09 14:41:41 -07:00
Michael Stack ed54c35cf0
HBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 (#1451)
Down jdk8 forked jvm heap from 2800 to 2200 and the jdk11 heap from
3200 to 2200. Down the mvn size from 4G to 3.6G

Change how many puts done by TestMultiRespectsLimits because made
the test run the forked heap over 2.5G in size.

Signed-off-by: Sean Busbey <busbey@apache.org>
2020-04-08 10:51:03 -07:00
stack 953c326498 HBASE-24126 Up the container nproc uplimit from 10000 to 12500
Addendum number 3; set the yetus proclimit.
2020-04-07 10:22:24 -07:00
stack ba87ffed09 Revert "HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread."
Revert because applied with wrong JIRA number.

This reverts commit 9c60c5fddb.
2020-04-07 10:17:48 -07:00
Minwoo Kang af659564f3 HBASE-24130 rat plugin complains about having an unlicensed file (#1445)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-07 09:18:27 -07:00
stack 9c60c5fddb HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread.
Up the nproc in hbase-personality. Add test that prints out env.
2020-04-07 07:37:48 -07:00
stack 01715fbbf6 HBASE-24126 Up the container nproc uplimit from 10000 to 12500
Addendum number 2; docker doesn't like the ulimit arg as is.
2020-04-06 18:24:09 -07:00
Nick Dimiduk 099333079b HBASE-24081 Provide documentation for running Yetus with HBase
Signed-off-by: stack <stack@apache.org>
2020-04-06 16:40:24 -07:00
stack 25773c681b HBASE-24126 Up the container nproc uplimit from 10000 to 12500
ADDENDUM: Add to hbase-personality
2020-04-06 16:29:46 -07:00
stack ed24998b85 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 2020-04-06 13:44:53 -07:00
stack 4d31af23e8 HBASE-24122 Change machine ulimit-l to ulimit-a so dumps full ulimit rather than just 'max locked memory' 2020-04-06 08:58:16 -07:00
Michael Stack 3030b59e29
HBASE-24113 Upgrade the maven we use from 3.5.4 to 3.6.3 in nightlies (#1430)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-05 12:53:44 -07:00
Nick Dimiduk 1df979df18 HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-03 16:59:54 -07:00
stack 97a47ed0ee HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread
Set the forkcount down from 0.5C to 0.25C.
2020-04-01 16:05:59 -07:00
Nick Dimiduk 8d058a9920 HBASE-24071 [JDK11] Remove `unit` filter from nightly and precommit jobs
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-01 12:31:18 -07:00
Nick Dimiduk b7e20c0df1 HBASE-24092 Fix links to build reports generated by nightly job
Signed-off-by: stack <stack@apache.org>
2020-04-01 12:19:28 -07:00
stack c5a3ab7504 HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check 2020-03-31 09:51:31 -07:00
Nick Dimiduk 593f44c928 HBASE-24078 SpotBugs check automatically skip inapplicable modules
Without patch, the spotbugs results include warnings for inapplicable
modules:

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 11s   | Maven dependency ordering
|  +1  |    mvninstall  |   2m 47s   | the source passed
|   0  |      spotbugs  |   0m 11s   | branch/hbase-annotations no spotbugs
|      |                |            | output file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 14s   | branch/hbase-assembly no spotbugs output
|      |                |            | file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 07s   |
|      |                |            | branch/hbase-archetypes/hbase-archetype-bu
|      |                |            | ilder no spotbugs output file
|      |                |            | (spotbugsXml.xml)
+---------------------------------------------------------------------------

With patch,

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 13s   | Maven dependency ordering
|  +1  |    mvninstall  |   3m 09s   | the source passed
|  +1  |      spotbugs  |  17m 09s   | the source passed
+---------------------------------------------------------------------------

Signed-off-by: stack <stack@apache.org>
2020-03-31 09:33:01 -07:00
Nihal Jain 6f675e269c HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-31 09:33:01 -07:00
Nick Dimiduk c98ec0c22c HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
2020-03-26 08:48:03 -07:00
Nick Dimiduk a8606c36c7 HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh
Signed-off-by: stack <stack@apache.org>
2020-03-25 13:48:15 -07:00
Nick Dimiduk aba0737acb HBASE-24002 shadedjars check does not propagate --hadoop-profile
This implementation is almost surely incorrect. Personality
initialization parses the `--hadoop-profile` argument and sets
`HADOOP_PROFILE`. That value is then used to build an `extras` value
that is passed  along to module initialization. I'm guessing that the
`extras` value need to be honored down in the shadedjars module. I'm
not clear on how to make that work (need to study the interfaces at
play here), so taking the more ham-handed approach of referring to
`HADOOP_PROFILE`. I'm not sure if this will even work, or if it will
only work because the `foo_yetus.sh` scripts happen to use a variable
of the same name.

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2020-03-24 09:35:31 -07:00
Duo Zhang 83388609d0
HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches (#1304)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-20 14:18:07 +08:00
stack c8d6ee31b8 HBASE-24017 Turn down flakey rerun rate on all but hot branches
On master branch run twice a day instead of every 4 hours.
2020-03-18 15:54:10 -07:00
stack df77c029ae HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY 2020-03-18 14:42:48 -07:00
Nick Dimiduk b942527b60 HBASE-24004 Include hadoop version in Nightly report name 2020-03-17 14:52:13 -07:00
Nick Dimiduk dab736428e HBASE-23978 Dockerfiles reusing stale apt sources info
Signed-off-by: stack <stack@apache.org>
2020-03-12 17:28:41 -07:00
Duo Zhang 7eeb6a0815 HBASE-23077 move entirely to spotbugs (#1265)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-12 11:42:23 +08:00
Nick Dimiduk ebfc1a206c HBASE-23945 Dockerfiles showing hadolint check failures
Signed-off-by: stack <stack@apache.org>
2020-03-10 12:33:18 -07:00
Dima Spivak dacceba0c7 HBASE-18418 Remove apache_hbase_topology from dev-support 2020-03-09 09:53:37 -07:00
Nick Dimiduk 84efaed120 HBASE-23946 [JDK11] Yetus should vote -0 for known JDK11 issues (#1246)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-09 09:13:06 -07:00
Nick Dimiduk 3e5d3a0ab3 Revert "HBASE-23945 Dockerfiles showing hadolint check failures"
This reverts commit 4205677eb7.
2020-03-07 10:42:22 -08:00
Nick Dimiduk 5872758c6b Revert "HBASE-18418 Remove apache_hbase_topology from dev-support"
This reverts commit d641726da5.
2020-03-07 10:42:22 -08:00
Dima Spivak d641726da5 HBASE-18418 Remove apache_hbase_topology from dev-support 2020-03-06 09:56:43 -08:00
Nick Dimiduk 4205677eb7 HBASE-23945 Dockerfiles showing hadolint check failures
Signed-off-by: stack <stack@apache.org>
2020-03-06 09:56:43 -08:00
Nick Dimiduk 797a13436c HBASE-23876 Add JDK11 compilation and unit test support to nightly job
Builds on the Dockerfile changes provided by HBASE-23767.

closes #1195

Signed-off-by: Sean Busbey <busbey@apache.org>
2020-03-05 13:59:01 -08:00
Nick Dimiduk e0f9d0f562 HBASE-23767 Add JDK11 compilation and unit test support to Github precommit
Rebuild our Dockerfile with support for multiple JDK versions. Use
multiple stages in the Jenkinsfile instead of yetus's multijdk because
of YETUS-953. Run those multiple stages in parallel to speed up
results.

Note that multiple stages means multiple Yetus invocations means
multiple comments on the PreCommit. This should become more obvious to
users once we can make use of GitHub Checks API, HBASE-23902.

closes #1183

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
  dev-support/Jenkinsfile_GitHub
  dev-support/hbase-personality.sh
2020-03-05 13:59:01 -08:00
stack 4717eecd5b HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails.
Addendum again again... hanging quote.
2020-03-04 13:51:21 -08:00
stack 60641144ab HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails.
Addendum again. This previous change seems to have altered display of
  flakies. Trying more basic change.
2020-03-04 11:16:19 -08:00
stack 74af4b30bf HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails.
Addendum: fix failed variable interpolation
2020-03-04 10:11:48 -08:00
stack ee4f54f09b HBASE-23926 [Flakey Tests] Down the flakies re-run ferocity; it makes for too many fails.
Change the forkcount from 1.0C to 0.25C
2020-03-04 10:00:48 -08:00
Nick Dimiduk 9bee77bb51 HBASE-23874 Move Jira-attached file precommit definition from script in Jenkins config to dev-support (#1191)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-02-26 16:58:17 -08:00
stack 910a2a66a9 HBASE-23865 Up flakey history from 5 to 10 2020-02-18 16:31:26 -08:00
stack 450503989f HBASE-23779 Up the default fork count to make builds complete faster; make count relative to CPU count
ADDENDUM: Purge changes made to hbase-personality as they disstabilize
jenkins build. All else remains, the changing of forkcount for tests.
2020-02-07 16:00:50 -08:00
Nick Dimiduk 5cda68899a HBASE-23793 Increase maven heap allocation to 4G in Yetus personality (#1122)
I saw this over on
https://builds.apache.org/view/H-L/view/HBase/job/HBase%20Nightly/job/branch-2/2447/console. Looks
like we need to bump the memory allocation for maven. I wonder if this
is the underlying cause of HBASE-22470.

```
6:38:47  ============================================================================
16:38:47  ============================================================================
16:38:47                                Finished build.
16:38:47  ============================================================================
16:38:47  ============================================================================
16:38:47
16:38:47
Post stage
[Pipeline] stash
16:38:48  Warning: overwriting stash 'hadoop2-result'
16:38:48  Stashed 1 file(s)
[Pipeline] junit
16:38:48  Recording test results
16:38:54  Remote call on H2 failed
Error when executing always post condition:
java.io.IOException: Remote call on H2 failed
	at hudson.remoting.Channel.call(Channel.java:963)
	at hudson.FilePath.act(FilePath.java:1072)
	at hudson.FilePath.act(FilePath.java:1061)
	at hudson.tasks.junit.JUnitParser.parseResult(JUnitParser.java:114)
	at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:137)
	at hudson.tasks.junit.JUnitResultArchiver.parseAndAttach(JUnitResultArchiver.java:167)
	at hudson.tasks.junit.pipeline.JUnitResultsStepExecution.run(JUnitResultsStepExecution.java:52)
	at hudson.tasks.junit.pipeline.JUnitResultsStepExecution.run(JUnitResultsStepExecution.java:25)
	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
	at com.sun.org.apache.xerces.internal.util.XMLStringBuffer.append(XMLStringBuffer.java:208)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.scanData(XMLEntityScanner.java:1515)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanCDATASection(XMLDocumentFragmentScannerImpl.java:1654)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:3014)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:842)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:771)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)
	at org.dom4j.io.SAXReader.read(SAXReader.java:465)
	at org.dom4j.io.SAXReader.read(SAXReader.java:343)
	at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:178)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:348)
	at hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:281)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:206)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:178)
	at hudson.tasks.junit.TestResult.<init>(TestResult.java:143)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:146)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:118)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3052)
	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:369)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	... 4 more

[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
16:38:54  Failed in branch yetus jdk8 hadoop2 checks
```

Signed-off-by: stack <stack@apache.org>
2020-02-05 14:20:34 -08:00
Michael Stack 4c8ac72194
HBASE-23779 Up the default fork count; make count relative to CPU count (#1108)
Set the fork count for first and second parts to be 0.5C. Add a bit of
doc too on this as well as some qualification on our test categories.
Also adds -T0.5C to MAVEN_ARGS in the hbase personality.
2020-02-04 20:47:02 -08:00
Josh Elser bef1eb33f4 HBASE-23347 Allow custom authentication methods for RPCs
Decouple the HBase internals such that someone can implement
their own SASL-based authentication mechanism and plug it into
HBase RegionServers/Masters.

Comes with a design doc in dev-support/design-docs and an example in
hbase-examples known as "Shade" which uses a flat-password file
for authenticating users.

Closes #884

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-01-16 11:04:08 -05:00
Sean Busbey 82037ee3f2 HBASE-23228 Allow for jdk8 specific modules on branch-1 in precommit/nightly testing (#804)
Signed-off-by: Josh Elser <elserj@apache.org>
2019-11-08 10:08:56 -06:00
Duo Zhang cddf8b0ae4 HBASE-23236 Upgrade to yetus 0.11.1
Signed-off-by: stack <stack@apache.org>
2019-11-08 13:48:07 +08:00
Peter Somogyi 46952d9b17 HBASE-23053 Disable concurrent nightly builds (#654)
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-10-10 20:12:34 +02:00
Peter Somogyi 14d58e2e64 HBASE-23114 Use archiveArtifacts in Jenkinsfiles (#681)
Signed-off-by: Michael Stack <stack@apache.org>
2019-10-10 18:58:06 +02:00
Sean Busbey 5cedb09b65 HBASE-22955 Properly set jdk7 as JAVA_HOME for branches-1 precommit and nightly. (#621)
master/branches-2 specific changes: work around yetus overwriting JAVA_HOME
in the container with the host JAVA_HOME.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 41990ba20a)
(cherry picked from commit bcad0d9f98)
2019-09-16 22:57:16 -05:00
Sean Busbey 4b471d3904 HBASE-23023 upgrade shellcheck used in dockerfile (#624)
Signed-off-by: stack <stack@apache.org>
(cherry picked from commit 1cb4f687c1)
2019-09-16 21:33:40 -05:00
Peter Somogyi af86b7bd06 HBASE-22981 Remove unused flags for Yetus (#591)
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-09-06 14:58:21 +02:00
Duo Zhang 48f0b1805e HBASE-22724 Add a emoji on the vote table for pre commit result on github (#568)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Stack <stack@apache.org>
2019-09-04 09:04:59 +08:00
Rushabh a386c6cdda HBASE-22852 Stop gpg agent daemons in hbase nightlies. (#525)
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 0438fdc0f6)
2019-08-26 16:46:05 -05:00
Gav 15b0bab120 HBASE-22913 Use Hadoop label for nightly builds (#532)
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:54:25 +08:00
Sean Busbey 6e7dd9c7fd HBASE-22911 reduce concurrent PR builds.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:30:49 +08:00
Artem Ervits 5ac6f6adf2 HBASE-22464 Improvements to hbase-vote script
* wget should use timestamps to avoid re-downloading RC artifacts we already have.
* allow changing to maven profiles other than runAllTests for test step

Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 74fb2040ea)
2019-08-23 12:47:27 -05:00
Duo Zhang 77f0510c40 HBASE-22891 Use HBaseQA in HBase-PreCommit-GitHub-PR job (#518)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-08-22 23:07:35 +08:00
Duo Zhang 9aec8d8b12 HBASE-22856 HBASE-Find-Flaky-Tests fails with pip error 2019-08-15 10:38:41 +08:00
Peter Somogyi 328d1073a5 HBASE-22801 Maven build issue on Github PRs 2019-08-06 18:57:48 +02:00
Duo Zhang c54085a8d9 HBASE-22719 Add debug support for github PR pre commit job 2019-07-22 13:49:31 +08:00
Josh Elser 6978d4a1cf HBASE-22563 Reduce old builds by half
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-10 19:17:18 -04:00
Sean Busbey 72caf79bb3 HBASE-22518 yetus personality is treating branch-1.4 like earlier branches for hadoopcheck
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b4d5a9a8e1)
2019-06-03 09:26:46 -05:00
Guanghao Zhang d1035c8d9b HBASE-22522 The integration test in master branch's nightly job has error "ERROR: Only found 1050 rows." 2019-06-02 22:08:43 +08:00
Guanghao Zhang 7172128a13 HBASE-22490 (addendum) Nightly client integration test fails with hadoop-3 2019-05-31 21:43:32 +08:00
Guanghao 1ce4fcc6ee HBASE-22490 Nightly client integration test fails with hadoop-3.0.3 2019-05-31 21:43:16 +08:00
Duo Zhang 59973d2024 HBASE-22500 Modify pom and jenkins jobs for hadoop versions
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-30 22:31:47 +08:00
zhangduo 6876199bac HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test 2019-05-29 11:38:49 +08:00
Peter Somogyi 0c69831b00 HBASE-22474 Add --mvn-custom-repo parameter to yetus calls 2019-05-26 18:12:12 +02:00
Guanghao Zhang c00cc4d9d6 HBASE-22462 (addendum) Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-24 12:07:15 +08:00
Guanghao Zhang b469d06bd4 HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-24 12:07:09 +08:00
zhangduo 6a28e76f7e HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:56:02 +08:00
Duo Zhang 5537de38b3 HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-05-17 09:51:59 +08:00
Andrew Purtell 8099608439
HBASE-22430 hbase-vote should tee build and test output to console 2019-05-16 16:46:47 -07:00
Tak Lon (Stephen) Wu 48f8bf252e
HBASE-22429 hbase-vote download step requires URL to end with '/' (#243) 2019-05-16 16:46:46 -07:00
Duo Zhang 6bd6a953a7 HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:32 +08:00
Sean Busbey b1752fadc3 HBASE-22406 skip generating rdoc when building gems in our docker image for running yetus
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit 60dc5143f2)
2019-05-13 11:24:09 -05:00
Sean Busbey f41cf781e5 HBASE-22020 update nightly to yetus 0.9.0
Signed-off-by: stack <stack@apache.org>
(cherry picked from commit b5a6fd14fa)
2019-04-24 07:33:16 -05:00
zhangduo 4562bf608c HBASE-22174 Remove error prone from our precommit javac check 2019-04-06 19:12:51 +08:00
Andrew Purtell 06f914e71f
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-05 14:37:46 -07:00