9da5d3a481
HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
...
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-16 23:17:24 -05:00
621a43e709
HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors
...
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 346dd32185
2018-08-14 13:14:22 -05:00
492c0fcd2e
HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed
2018-07-12 10:17:38 +08:00
0a4ae9fa94
HBASE-20334 add a test that verifies basic client and MR integration
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-06-18 14:03:51 -07:00
b04c976fe6
HBASE-20478 Update checkstyle to v8.2
...
Cannot go to latest (8.9) yet due to
https://github.com/checkstyle/checkstyle/issues/5279
* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-06-18 14:02:40 -07:00
a4cb98b1cd
HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-14 20:26:42 -05:00
0a6aec4981
HBASE-19377 Update Java API CC version
...
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
2018-06-12 15:13:35 -05:00
42ca976803
HBASE-20689 Docker fails to install rubocop for precommit
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2018-06-06 23:51:47 +02:00
9431ee3f49
HBASE-20501 update minimum supported Hadoop version to 2.7.1.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
src/main/asciidoc/_chapters/configuration.adoc
2018-05-30 21:28:06 -05:00
8a3b44a7e4
HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:13:35 -05:00
29f492b344
HBASE-20591 nightly job needs to enable maven build system.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:43:21 -05:00
8c7293c514
HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 11:58:39 -05:00
53eb0f60c5
HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
...
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:31:36 -05:00
1d133c005c
HBASE-20389 Move website building flags into a profile.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
hbase-spark/pom.xml
pom.xml
2018-04-13 22:50:55 -05:00
dcd20e9cef
HBASE-20335 ensure each stage of the nightly job gathers machine information.
...
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 22:45:19 -05:00
bd2dddae60
HBASE-20379 shadedjars yetus plugin should add a footer link
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:48:05 -05:00
d5d5c78849
HBASE-20112 register nightly junit over hadoop3 results with jenkins.
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:48:05 -05:00
a50d9f4351
HBASE-20356 Make skipping protoc possible
2018-04-12 14:54:03 -05:00
cc801f5f2d
HBASE-20385 Purge md5-making from our little make_rc.sh script
2018-04-11 09:18:43 -07:00
9bf087d28b
HBASE-20335 nightly job bash cleanup.
...
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:30:49 -05:00
1ef2450ca9
HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:30:46 -05:00
469b57bba0
HBASE-15466 test personality should recognize docs-only patch.
...
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:37:49 -05:00
1e0d909532
HBASE-17730 Add license header to design doc.
2018-04-04 13:11:53 -07:00
40fbecd97c
HBASE-17730 Migration to 2.0 for coprocessors. Upload AsciiDoc for coprocessor design improvements made in HBASE-17732.
2018-04-03 15:50:09 -07:00
dba480856b
HBASE-20308 Dockerfile for test must include git.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-28 18:39:06 -05:00
d42886f4fe
HBASE-20153 Add error prone to precommit
2018-03-12 16:06:08 -05:00
b87165cbf7
HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 17:23:13 -06:00
32c5118f6f
HBASE-20164 add hadoopcheck link to table footer
2018-03-09 15:41:12 -06:00
c99e6f7439
HBASE-18467 addendum parallel steps must account for SCM and marshalling results
...
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
d4c4af09a1
HBASE-20075 remove logic for branch-1.1 nightly testing
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
27642614b4
HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
44f1129234
HBASE-18467 report nightly results to devs via jira
...
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
f5c8713bdd
HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 08:39:19 -06:00
b59c39d942
HBASE-20070 addendum for missing echo. Website generation is failing.
2018-03-04 09:04:06 +05:30
bc735474a9
HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and
...
master
2018-03-03 07:33:25 -08:00
9927c2e14a
HBASE-20070 refactor website generation
...
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
Conflicts:
hbase-backup/pom.xml
hbase-spark-it/pom.xml
2018-03-02 09:51:43 -06:00
2f3632a2a4
HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
...
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:54:31 -06:00
7d5744d2f8
HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 09:57:28 -05:00
b2fe241089
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; AMENDMENT hardcode proclimit and docker memlimit in nightly script...
2018-02-01 20:54:38 -08:00
1dc640c296
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; REAPPLY TO TEST
2018-02-01 20:27:05 -08:00
12a6af0de5
Revert "HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies"
...
This reverts commit 2e6bc12441
2018-02-01 18:04:59 -08:00
ce6c3d96ea
HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- remove docker mem sizing for the moment...
2018-02-01 16:39:05 -08:00
fe6c06ad6c
HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- up proclimit from 6k to 10k and set Docker memory limit of 20G (default is 4G)
2018-02-01 14:08:24 -08:00
afdfa54cd3
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies
2018-01-30 22:26:58 -08:00
2835d51f9a
Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir"
...
Reverting because doesn't work.
This reverts commit 44019c21fb
2018-01-30 12:04:37 -08:00
44019c21fb
HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir
2018-01-30 11:54:47 -08:00
8a1fca09cb
HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
...
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:35:47 -08:00
03a418ed39
HBASE-19891 Up nightly test run timeout from 6 hours to 8
2018-01-29 22:15:37 -08:00
130da9d18b
HBASE-19860 Run branch-2 nightly job more frequently to help with flaky tests debugging
2018-01-24 20:00:30 -08:00
e60d302b90
HBASE-19789 Not exclude flaky tests from nightly builds.
2018-01-16 10:09:50 -08:00
f91589d305
HBASE-19789 Exclude flaky tests from nightly branch-2 runs
2018-01-12 16:24:45 -08:00
026f535a77
HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1
...
M dev-support/make_rc.sh
Disable checkstyle building site. Its an issue being fixed over in HBASE-19780
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
The clusterid was being set into the process only after the
regionserver registers with the Master. That can be too late for some
test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
as it goes to run which could be before Master had called its run
method which is regionserver run method which then calls back to the
master to register itself... and only then do we set the clusterid.
HBASE-19694 changed start order which made it so this test failed.
Setting the clusterid right after we set it in zk makes the test pass.
Another change was that backup masters were not going down on stop.
Backup masters were sleeping for the default zk period which is 90
seconds. They were not being woken up to check for stop. On stop
master now tells active master manager.
M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
Prevent creation of acl table. Messes up our being able to go down
promptly.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
Disabled for now because it wants to run with regions on the Master...
currently broke!
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
Add a bit of debugging.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
Disabled. Fails 40% of the time.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
Disabled. Fails 33% of the time.
Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
2018-01-12 14:09:23 -08:00
581f168f6e
HBASE-19659 Enable -x in make_rc.sh so logs where it is in execution
2017-12-28 14:31:28 -08:00
b263eb5648
HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
...
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:44:33 -08:00
a28156be94
HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE.
2017-12-21 10:55:12 -08:00
90ac3c93c9
HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master.
2017-12-20 17:59:27 -08:00
61ce86399a
HBASE-18563 Fix RAT License complaint about website jenkins scripts
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-19 23:42:24 +08:00
ed98ee1c19
HBASE-18548 Move sources of website gen and check jobs into source control
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-19 23:40:46 +08:00
6616a3fd2d
HBASE-19526 Update hadoop version to 3.0 GA
2017-12-17 22:52:54 -08:00
9144452773
HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck". Updates hadoop version to 3.0.0-beta1.
2017-12-13 00:36:34 -08:00
fd9c4322c5
HBASE-19382 Update report-flakies.py script to handle yetus builds.
2017-11-29 23:02:36 -08:00
d5df4c0426
HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-13 23:05:25 -06:00
72ba5c294e
HBASE-19246 Trivial fix in findHangingTests.py to make it not stop on finding 'bad string'.
2017-11-13 11:46:46 -08:00
d757e651c9
HBASE-19227 Nightly job should archive JVM dumpstream files.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 23:21:23 -06:00
4970b0ad06
HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 16:17:26 -06:00
1e4267f84d
HBASE-19228 nightly job should gather machine stats.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:08:01 -06:00
b75812f445
HBASE-19189 Ad-hoc test job for running a subset of tests lots of times
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:07:52 -06:00
6a61065237
HBASE-19184 Update nightly source artifact check to use git archive for making the tarball.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 08:32:35 -06:00
516d370b4b
HBASE-18817 pull the hbase-spark module out of branch-2.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-08 22:55:23 -06:00
e3bd475317
HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1)
2017-11-07 12:37:53 -08:00
3a8e3704cd
HBASE-19716 Remove hbase-native-client from branch-2
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-11-03 23:18:24 -07:00
b9b0f15cdb
HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:33:11 -05:00
9dc9d0394d
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script; AMENDMENT adding generation of hashes
2017-11-03 10:06:20 -07:00
9026d92f59
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
...
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-03 09:58:18 -07:00
20cc11e167
HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:32:35 -05:00
5a941d8f80
HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:57:33 -05:00
e1152afdd4
HBASE-19098 compatibility checker should handle remotes named something other than 'origin'.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-10-26 16:10:56 -05:00
aed0d6ce24
HBASE-19030 nightly runs should attempt to log test results after archiving.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:33:53 -05:00
9f2f2db91c
HBASE-19054 switch precommit image to one from maven
...
Amending Author: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 14:51:39 -05:00
fe82a302be
HBASE-19070 temporarily make the mvnsite nightly test non-voting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:20:51 -05:00
bd98620c4f
HBASE-19066 Correct the directory of openjdk-8 for jenkins
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:21:25 -05:00
34df2e665e
HBASE-16338 Remove Jackson1 deps
...
* Change imports from org.codehaus to com.fasterxml
* Exclude transitive jackson1 from hadoop and others
* Minor test cleanup to add assert messages, fix some parameter order
* Add anti-pattern check for using jackson 1 imports
* Add explicit non-null serialization directive to ScannerModel
2017-10-23 15:24:51 -05:00
d8afa3e067
HBASE-19058. The wget isn't installed in building docker image
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-20 20:38:06 -05:00
a37ff39b7a
HBASE-19039 refactor shadedjars test to only run on java changes.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:43:08 -05:00
01ab747a5f
HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:43:02 -05:00
64f024a76c
HBASE-19042 Oracle Java 8u144 downloader broken in precommit check
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-19 15:54:49 -05:00
723eb7c6ba
HBASE-19038 precommit mvn install should run from root on patch
2017-10-18 10:39:52 -05:00
16ccd55c43
HBASE-19032 Set mimetype for patches uploaded by submit-patch.py
...
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
2017-10-17 15:43:51 -07:00
822cc1ed73
HBASE-18505 Yetus only run root when all modules changed
2017-10-13 12:12:38 -05:00
e4647da0db
HBASE-18934 pick hadoop versions for precommit test after patch branch is determined.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-09 11:38:16 -05:00
8c6ed571bd
HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality
2017-10-01 15:21:54 -04:00
ac933f7af2
HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732; MINOR AMENDMENT adding README to design-doc dir
2017-09-28 13:25:07 -07:00
a6a303816c
HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732
...
- Change Service Coprocessor#getService() to List<Service> Coprocessor#getServices()
- Checkin the finalized design doc into repo
- Added example to javadoc of Coprocessor base interface on how to implement one in the new design
2017-09-28 10:33:30 -07:00
ea610cfcf7
HBASE-18833 Ensure precommit personality is up to date on all active branches
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-09-20 05:51:42 -05:00
5ed2f899e1
HBASE-18834 fix shellcheck warning on hbase personality
...
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
2017-09-18 08:55:30 -05:00
d576e5a32d
HBASE-17823 Migrate to Apache Yetus Audience Annotations
...
Includes partial backport of hbase-build-configuration module
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2017-09-12 23:15:50 -05:00
bd219c0fb8
HBASE-18674 upgrading to commons-lang3
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-09-05 09:46:49 -07:00
37c40afaff
HBASE-18607: fix submit-patch.py to support utf8
...
one liner to support utf8 content
Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-08-25 00:04:37 -07:00
e9ea19fba6
HBASE-18653 Undo hbase2 check against < hadoop2.6.x; i.e. implement agreed drop of hadoop 2.4 and 2.5 support in hbase2
2017-08-22 09:45:43 -07:00
7029c23b00
HBASE-18527 Update nightly job to account for changes in jenkins plugins.
...
- Stop presuming job will be configured with checkout into a 'component' dir
- Disable autocheckout
- Specify checkout within 'component' dir
- leave the workspace around on pipeline failure so we can browse it.
2017-08-07 11:25:08 -05:00
69fddb58bd
HBASE-14220 nightly check that we can build a source tarball.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-06 12:08:51 -05:00
db18a00b76
HBASE-18426 nightly job should use independent stages to check supported jdks
...
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-06 12:08:48 -05:00
3c8b364379
HBASE-18147 POC jenkinsfile for nightly checks.
...
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile
Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2017-08-06 12:08:34 -05:00
2b1b01fce3
HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop
...
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems
Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-08-04 12:06:45 -05:00
f2e5727e1b
HBASE-18341 (addendum) Replace '.' in test names with '_' when using them as html ids since
...
dot have special significance in CSS selectors.
Without it, we weren't able to select elements and add svg (trends columns) to them.
Change-Id: Ia63ff0851f0a2fad0789a24edf2f0ad00060d578
2017-07-10 12:05:28 -07:00
c05a408093
HBASE-18341 Generalize regex matchers in findHangingTests.py script to match new consoleText of trunk build.
...
Change-Id: I0a4215827d3d561eef3f583da666c617f690d934
2017-07-08 00:52:16 -07:00
7a535f5843
HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
...
Use https for fetching d3 since builds.apache.org is also https. Otherwise d3 script is not loaded (unless browser is explicitly told to do so) and the fancy status markers are not drawn.
Change-Id: I97f7402141717da77499d09e44b05ecdd35c5a6f
2017-05-19 00:29:37 -07:00
7a0a66072d
HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
...
Change-Id: I43851c52723de3d89ea4ca5fa49c86a178afba26
2017-05-18 19:10:19 -07:00
c51c36fd1f
HBASE-18076 Flaky dashboard improvement: Add status markers to show trends of failure/success.
2017-05-18 19:03:11 -07:00
841bb00655
HBASE-18044 Fix bug in report-flakies.py where if counter is set outside for loop, it cannot be overwritten inside loop.
...
http://stackoverflow.com/questions/7537439/how-to-increment-a-variable-on-a-for-loop-in-jinja-template
Change-Id: Ic404d6360fb646e6490d1487374520f9550b76b4
2017-05-15 14:15:57 -07:00
757bf379c1
HBASE-17985 Inline apt-get update calls in Yetus Dockerfile
2017-05-02 17:33:18 -04:00
fe3c32ebd5
HBASE-17809 cleanup unused class
2017-03-23 14:15:28 +08:00
41be3bc2cc
HBASE-17593 Update hadoop 3 version to 3.0.0-alpha2.
...
Change-Id: Ic5411229aaab3d645dc6751ecfbbda1b2d93a4b9
2017-02-06 12:18:21 -08:00
8f8daafee0
HBASE-17228 precommit grep -c ERROR may grab non errors I tested this by doing `cat /tmp/some_file_with_ERROR_combos|grep -c '\[ERROR\]'
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-02 08:51:21 -08:00
8d52d23c77
HBASE-17074 PreCommit job always fails because of OOM
2016-11-15 08:29:24 +08:00
c3b98b87fb
HBASE-16955 Fixup precommit protoc check to do new distributed protos and pb 3.1.0 build
2016-11-08 12:49:12 -08:00
339017f0f6
HBASE_16963 Fixup our hbase-personality post YETUS-322 flip verify_
...
result codes
This patch is about updating our hbase-personality for yetus.
Basic yetus methods flipped what was true and false but we did
not adjust our usage in accordance on an update. See
YETUS-322 flip verify_ result codes. I need this in place so I
can prove that there is nothing I have to do for this the parent
issue HBASE-16955 after I commit HBASE-16952, the revamp of how
we do proto generation. After HBASE-16952 the protoc check will do the
right thing in all cases (pb2.5 vs pb3.1 and we run the protoc
in any module that has protos in it)
2016-10-28 15:34:50 -07:00
187ff190ed
HBASE-16887 Allow setting different hadoopcheck versions in precommit for different branches
2016-10-24 09:58:21 +08:00
1b005f30e4
HBASE-16733 add hadoop 3.0.0-alpha1 to precommit checks
2016-10-18 01:30:03 -07:00
de7316b11e
HBASE-16720 Sort build ids in flaky dashboard.
...
Change-Id: Ie44c7d699486a3468c92351c0e2146151e722764
2016-09-27 15:40:43 -07:00
2765b9d9d9
HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes)
2016-09-24 16:07:25 -07:00
7bda5151ee
HBASE-16591 Add a docker file only contains java 8 for running pre commit on master
2016-09-11 13:02:36 +08:00
1da0a48f6b
HBASE-16535 Use regex to exclude generated classes for findbugs
2016-08-31 14:42:32 +08:00
0d6c4d92ed
HBASE-16434
...
- Add date and count of flaky tests
- Sort tests by decreasing order of flakyness
- Internal links to each job's results
- Correct calculation of total bad runs for a test
- Fixes pylint errors
Change-Id: I12ebc32ccec14c5ff389464b4de8ae93653c876c
2016-08-19 09:55:29 -07:00
7999bb9bd3
HBASE-16384 Update report-flakies.py script to allow specifying a list of build ids to be excluded.
...
Also fixes some pylint errors.
Change-Id: I4620756c277c36a1ddb6d6cbd4d3e380da8442d7
2016-08-17 13:45:22 -07:00
ccf5d27d7a
HBASE-12721 Create Docker container cluster infrastructure to enable better testing
...
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-17 12:03:47 -07:00
938ee73e7c
HBASE-15882 Upgrade to yetus precommit 0.3.0
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-06 01:23:20 -05:00
9454daf25b
HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh
...
* Also some trivial cleanup of spacing to undo poor formatting decisions
of the past.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-19 07:27:32 -05:00
1fbded61c1
HBASE-16124 Make check_compatibility.sh less verbose when building HBase
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 10:21:16 -05:00
294c2dae9e
HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7
...
* This commit also fixes some stray tabs that got into the script at
some point.
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-29 11:26:52 -05:00
ef90ecc00c
HBASE-16073 update compatibility_checker for jacc dropping comma sep args
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-21 15:47:41 -05:00
f283ff01aa
HBASE-16038 Ignore JVM crashes or machine shutdown failures in report-flakies.
...
Change-Id: If49acd704e827b289c75f449a6180038b297d647
2016-06-15 16:01:49 -07:00
9593a9f396
HBASE-15938 submit-patch.py: Don't crash if there are tests with same name. Refactor: Split out flaky dashboard html template to separate file. (Apekshit)
...
Change-Id: Ie5875bdefbf886984a57dfc85661be2ac9592a7b
Signed-off-by: stack <stack@apache.org>
2016-06-02 08:55:42 -07:00
eb64cd9dd1
HBASE-15917 Addendum. Fix bug in report-flakies.py where hanging tests are not being added to flaky list. (Apekshit)
...
ADDENDUM #2 !
Change-Id: I9c55932d0f9e65b72ec8d3ae714144536b2bfe0a
Signed-off-by: stack <stack@apache.org>
2016-05-31 10:16:40 -07:00
75c2360543
HBASE-15918 Cleanup excludes/includes file after use in hbase-personality.sh to avoid asf license error. (Apekshit)
...
Change-Id: I3a47113ef9f598f90357b7cb580cbdc56f3c46f4
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:30:19 -07:00
f0a1e22441
HBASE-15917 Addendum. Add jija2 to python requirements. It's used by report-flakies.py to build the dashboard. (Apekshit)
...
ADDENDUM!!!
Change-Id: I8d30986e204463d1ea26b4a70e2f26915c99bdfc
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:16:33 -07:00
0923346b61
HBASE-15917 Flaky tests dashboard. (Apekshit)
...
Change-Id: If0e4299b173d3d76e0bdb12a3de080e5b51d8748
Signed-off-by: stack <stack@apache.org>
2016-05-30 20:54:01 -07:00
74442fde0f
HBASE-15909 Use Yetus' patch naming rules in submit-patch.py. (Apekshit)
...
Change-Id: I4d71c94da550efe8b24ea73edcde73d9bba84b8a
Signed-off-by: stack <stack@apache.org>
2016-05-28 21:55:17 -07:00
36bd7d03fc
HBASE-15896 ADDENDUM Add timeout tests to flaky list from report-flakies.py.
...
Adding the diff between the original patch approved and the one committed as addendum.
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-27 16:39:13 -07:00
d50cf9972d
HBASE-15895 Remove unmaintained jenkins build analysis tool.
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Dima Spivak <dspivak@cloudera.com>
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Apekshit <apeksharma@gmail.com>
2016-05-27 16:38:39 -07:00
aa016c78a7
HBASE-15896 Add timeout tests to flaky list from report-flakies.py - Adds timed-out tests to flaky list. Dumpes two new files for reference, 'timeout' and 'failed' for corresponding list of bad tests. - Set --max-builds for different urls separately. This is needed so that we can turn the knobs for post-commit job and flaky-tests job separately. (Apekshit)
...
Change-Id: I88e1f9a8924eed1b5010106e73edede3aff34b0b
Signed-off-by: stack <stack@apache.org>
2016-05-27 07:34:10 -07:00
3ffaa116fe
HBASE-15892 Script to create patch, upload it to jira, and update review board. (Apekshit)
...
Change-Id: I920760980b0a715f1e9945b930d923fd543b450b
Signed-off-by: stack <stack@apache.org>
2016-05-26 08:44:26 -07:00
c12eaa5cc4
HBASE-15725 make_patch.sh should add the branch name when -b is passed. -- addendum
2016-05-17 09:05:53 -07:00
0e281e1929
HBASE-15725 make_patch.sh should add the branch name when -b is passed.
2016-05-13 14:02:00 -07:00
2eced6f039
HBASE-15807 - Update report-flakies.py to look for "FAILED" status in test report. - Remove duplicate testcase names in the result
...
Tested:
Ran it manually.
(Apekshit)
Change-Id: I2a7751eefe729b2a69c0f78596f72b6a0eb39b66
Signed-off-by: stack <stack@apache.org>
2016-05-09 11:51:16 -07:00
58888e0911
HBASE-15738 Ensure artifacts in project dist area include required md5 file
2016-05-08 18:06:31 -07:00
fa9fdfee2d
HBASE-15729 Remove old JDiff wrapper scripts in dev-support
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-04 13:28:17 -05:00
e1bf3a66fc
HBASE-15708 Docker for dev-support scripts. (Apekshit)
...
Change-Id: Ifb49125e940a8bacdff54247df8f2a75c6069c54
Signed-off-by: stack <stack@apache.org>
2016-04-27 15:21:28 -07:00
e5d01577e4
HBASE-15689 Changes in hbase-personality.sh to include/exclude tests run by maven. (Apekshit)
...
Change-Id: I517e7a9ba3321cb19d1eeb1d46d62628213b8bbb
2016-04-25 16:27:54 -07:00
57e1dbc8a6
HBASE-15651 Script to report flaky tests. (Apekshit)
...
Change-Id: I5cd5c23985b8c3f928d7ab44e57606b0a5478f15
Signed-off-by: stack <stack@apache.org>
2016-04-21 16:16:06 -07:00
b3e71d4644
HBASE-15434 [findbugs] Exclude scala generated source and protobuf generated code in hbase-spark module
2016-03-10 11:42:25 -08:00
9955118995
HBASE-15195 Don't run findbugs on hbase-it; it has nothing in src/main/java
2016-01-31 11:07:21 -04:00
55bb5ff7fb
HBASE-15119 Include git SHA in check_compatibility reports
2016-01-19 21:29:58 -08:00
164aeb5399
HBASE-13525 replace test-patch with customizations needed to use yetus
...
Signed-off-by: stack <stack@apache.org>
2016-01-08 07:39:40 -06:00
a999c2a010
Re-add zombie test and add return of result of test running
2015-12-28 13:23:23 -08:00
3fca9a9f3f
Try this change to see how it effects overall rating...
2015-12-28 13:23:23 -08:00
53e5d27a80
HBASE-15021 hadoopqa doing false positives
2015-12-21 22:16:38 -08:00
80afb839ec
HBASE-14917 Log in console if individual tests in test-patch.sh fail or pass (Appy)
2015-12-04 19:16:01 -08:00
4f36632d7b
HBASE-14930 check_compatibility.sh needs smarter exit codes
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-12-04 18:55:52 -08:00
7117a2e35d
HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- yet more formatting
2015-12-03 14:11:01 -08:00
5e430837d3
HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- fix indent
2015-12-03 14:01:22 -08:00
a154ecda00
HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- export JIRA_COMMENT so subshell zombie detector picks up current content
2015-12-03 10:05:05 -08:00
69658ea4a9
HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- extra 'tick'
2015-12-02 20:47:59 -08:00
cf8d3bd641
HBASE-14772 Improve zombie detector; be more discerning; part2
2015-12-02 17:44:49 -08:00
cbbad6e5fb
Add small note so we know for sure the zombie script is running
2015-12-01 17:05:34 -08:00
efb5917f22
HBASE-14859 Better checkstyle reporting. Reports file names, error names and old/new error counts. Fix some checks. (Apekshit)
...
Signed-off-by: stack <stack@apache.org>
2015-11-25 12:18:40 -08:00
4cc341b9c2
HBASE-14871 Allow specifying the base branch for make_patch
2015-11-24 11:59:49 -08:00
44367f55e8
HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM fix zombie-detectors' handling of no processes -- was treating no processes as one possible zombie
2015-11-09 13:43:43 -10:00
0af651bde5
HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM -- remove zombie detection from test-patch.sh and rely on script instead
2015-11-09 07:12:27 -10:00
4c2e0d95dc
HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM Add
...
logging date when reporting all is well.
2015-11-08 21:00:28 -10:00
1cbcf1175e
HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM some cleanup in zombie script and run it in test-patch too .. just trying it
2015-11-08 11:09:31 -10:00
305ecaf224
HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM set execute perms on the script
2015-11-07 15:00:08 -10:00
bea2f7feac
HBASE-14772 Improve zombie detector; be more discerning
2015-11-06 16:39:15 -10:00
c585072bc3
HBASE-14762 Update docs about publishing website to show gitsubpub method instead of svnsubpub
...
Also some reformatting to remove trailing whitespace and rewrap long lines.
2015-11-05 09:17:37 +10:00
0eae729ffa
HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; FIX complaint about grep device
2015-11-03 06:24:34 -08:00
870c74e270
HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; ADD EXTRA COMMENTARY
2015-11-02 22:12:40 -08:00
a82d55e3cf
HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies
2015-11-02 22:01:10 -08:00
950050e9d6
Revert "HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan)"
...
Revert because I overcommitted, included files from another patch.
This reverts commit 47659200ac
2015-11-02 08:06:34 -08:00
47659200ac
HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan)
2015-11-01 22:22:59 -08:00
51693b9cde
HBASE-14642 Update website-publishing script
2015-10-20 16:31:20 +10:00
ba3d474f8a
Add comment to test-patch.sh that the zombie killing code is copy/pasted up into jenkins as after-task
2015-10-14 09:58:04 -07:00
94bfe909af
HBASE-14589 Builds are being killed...
2015-10-14 00:29:52 -07:00
08df55defc
Add date on the test-patch.sh so I can see what version of this patch is running
2015-10-13 20:45:50 -07:00
6323cd9544
HBASE-14593 Add more info on zombies to test-patch.sh; ADD EVEN MORE
2015-10-13 07:53:57 -07:00
ac82a86320
HBASE-14593 Add more info on zombies to test-patch.sh
2015-10-12 15:57:28 -07:00
4beefd8ce4
HBASE-14349 pre-commit zombie finder is overly broad; ADDENDUM
2015-10-08 13:04:25 -07:00
e1fd3526b1
HBASE-14349 pre-commit zombie finder is overly broad
2015-10-07 13:41:27 -07:00
26dec4c60d
HBASE-14543 Have findHangingTests.py dump more info
2015-10-02 12:16:28 -07:00
2ea70c7e6c
HBASE-14482 Add hadoop 2.6.1 to the test-patch build list
2015-09-29 10:11:16 +02:00
27a993d837
HBASE-14429 Checkstyle report is broken
2015-09-15 22:29:14 -07:00
a5261b6f44
HBASE-14337 Improve test-patch to better deal with dependency licenses
...
* if we know we're going to fail the build via velocity template failure, output the cause in the generated LICENSE file.
* tweak test-patch workspace handling to allow for checkout of repo next to patch process
2015-09-02 10:37:02 -05:00
4f410e6bd5
HBASE-14318 make_rc.sh should purge/re-resolve dependencies from local repository
2015-09-01 10:28:08 -07:00
fbd6ecb762
HBASE-13339 Update default Hadoop version to latest for master
2015-08-27 15:10:27 -07:00
aca8c3b74b
HBASE-14310 test-patch.sh should handle spurious non-zero exit code from maven
2015-08-26 09:37:41 -07:00
f343a1d438
HBASE-13914 Minor improvements to dev-support/publish_hbase_website.sh
2015-08-17 11:27:19 -07:00
4ce6f486d0
HBASE-14087 Ensure correct ASF headers for docs/code
...
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint
2015-07-29 14:25:43 -05:00
30f7d127c3
HBASE-13992 Integrate SparkOnHBase into HBase
...
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-07-28 11:45:23 -05:00
d07ff5ec5a
HBASE-13387 Add ByteBufferedCell an extension to Cell.
2015-07-09 15:35:24 +05:30
2df3236a4e
HBASE-13948 Expand hadoop2 versions built on the pre-commit
2015-06-24 14:05:46 -07:00
578adca6ee
Revert "HBASE-13948 Expand hadoop2 versions built on the pre-commit"
...
This reverts commit 9db3ea3406
2015-06-24 08:24:38 -07:00
Sean Busbey
Yu Li
Mike Drob
Peter Somogyi
Nihal Jain
Michael Stack
Apekshit Sharma
Alex Leblang
Josh Elser
Esteban Gutierrez
Misty Stanley-Jones
Andrew Purtell
Chia-Ping Tsai
zhangduo
Umesh Agashe
Tamas Penzes
Jonathan M Hsieh
Jerry He
Dima Spivak
Jurriaan Mous
Apekshit
Elliott Clark
Nick Dimiduk
tedyu
Apekshit(Appy) Sharma
Misty Stanley-Jones
Sean Busbey
Ted Malaska
anoopsjohn