Michael Stack
4edfa06564
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
...
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-03 09:52:28 -07:00
Sean Busbey
0ff9dabe6c
HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:31:19 -05:00
Sean Busbey
91273e7b0e
HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:55:32 -05:00
Sean Busbey
60aa1c228a
HBASE-19098 compatibility checker should handle remotes named something other than 'origin'.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-10-26 16:09:17 -05:00
Sean Busbey
5255ae6dfa
HBASE-19030 nightly runs should attempt to log test results after archiving.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:32:13 -05:00
Misty Stanley-Jones
eee3b0180e
HBASE-19054 switch precommit image to one from maven
...
Amending Author: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 14:51:16 -05:00
Sean Busbey
cda2949b81
HBASE-19070 temporarily make the mvnsite nightly test non-voting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:06:58 -05:00
Chia-Ping Tsai
a31e8e34ea
HBASE-19066 Correct the directory of openjdk-8 for jenkins
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:18:47 -05:00
Chia-Ping Tsai
cb5c4776de
HBASE-19058. The wget isn't installed in building docker image
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-20 20:35:33 -05:00
Sean Busbey
b10ad9e97f
HBASE-19039 refactor shadedjars test to only run on java changes.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:20 -05:00
Sean Busbey
dd4dbae764
HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:14 -05:00
Mike Drob
5facaded90
HBASE-16338 Remove Jackson1 deps
...
* Change imports from org.codehaus to com.fasterxml
* Exclude transitive jackson1 from hadoop and others
* Minor test cleanup to add assert messages, fix some parameter order
* Add anti-pattern check for using jackson 1 imports
* Add explicit non-null serialization directive to ScannerModel
2017-10-20 09:20:12 -05:00
zhangduo
af479c580c
HBASE-19042 Oracle Java 8u144 downloader broken in precommit check
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-19 15:53:52 -05:00
zhangduo
4a7b430397
Revert "HBASE-19042 Oracle Java 8u144 downloader broken in precommit check"
...
This reverts commit 9e688117ba
.
2017-10-19 16:03:28 +08:00
zhangduo
9e688117ba
HBASE-19042 Oracle Java 8u144 downloader broken in precommit check
2017-10-19 15:32:48 +08:00
Dima Spivak
3acb081787
HBASE-18418 Remove apache_hbase_topology from dev-support
2017-10-18 14:08:26 -07:00
Mike Drob
c16eb7881f
HBASE-19038 precommit mvn install should run from root on patch
2017-10-18 10:41:17 -05:00
Apekshit Sharma
5368fd5bf0
HBASE-19032 Set mimetype for patches uploaded by submit-patch.py
...
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
2017-10-17 15:43:07 -07:00
Mike Drob
f6a8a76b50
HBASE-18505 Yetus only run root when all modules changed
2017-10-13 12:12:07 -05:00
Sean Busbey
087edf0172
HBASE-18934 pick hadoop versions for precommit test after patch branch is determined.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-09 11:31:55 -05:00
Josh Elser
869b90c612
HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality
2017-10-01 15:46:24 -04:00
Michael Stack
b5b4108fce
HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732; MINOR AMENDMENT adding README to design-doc dir
2017-09-28 13:24:40 -07:00
Apekshit Sharma
74d0adce61
HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732
...
- Change Service Coprocessor#getService() to List<Service> Coprocessor#getServices()
- Checkin the finalized design doc into repo
- Added example to javadoc of Coprocessor base interface on how to implement one in the new design
2017-09-28 10:25:47 -07:00
Sean Busbey
efb95a1794
HBASE-18834 fix shellcheck warning on hbase personality
...
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
2017-09-18 08:54:37 -05:00
Sean Busbey
4b124913f0
HBASE-17823 Migrate to Apache Yetus Audience Annotations
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2017-09-12 20:53:30 -05:00
Sean Busbey
79d9f7a734
HBASE-18760 Make hbase-shaded-check-invariants part of precommit
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-09-10 23:11:01 -05:00
Umesh Agashe
5d60123f3e
HBASE-18674 upgrading to commons-lang3
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-09-05 09:46:10 -07:00
Michael Stack
47a5614edd
Revert "HBASE-18674 upgrading to commons-lang3"
...
Premature push
This reverts commit 5dacc85122
.
2017-08-28 16:41:34 -07:00
Umesh Agashe
5dacc85122
HBASE-18674 upgrading to commons-lang3
2017-08-28 15:57:12 -07:00
Tamas Penzes
158f3da167
HBASE-18607: fix submit-patch.py to support utf8
...
one liner to support utf8 content
Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-08-25 00:04:19 -07:00
Esteban Gutierrez
c37432fefb
HBASE-18563 Fix RAT License complaint about website jenkins scripts
2017-08-10 20:08:03 -05:00
Misty Stanley-Jones
6114824b53
HBASE-18548 Move sources of website gen and check jobs into source control
2017-08-10 14:48:14 -07:00
Sean Busbey
7e7461e42a
HBASE-18527 Update nightly job to account for changes in jenkins plugins.
...
- Stop presuming job will be configured with checkout into a 'component' dir
- Disable autocheckout
- Specify checkout within 'component' dir
- leave the workspace around on pipeline failure so we can browse it.
2017-08-07 11:24:00 -05:00
Sean Busbey
2a717459bd
HBASE-14220 nightly check that we can build a source tarball.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-06 12:01:47 -05:00
Sean Busbey
04424ad65f
HBASE-18426 nightly job should use independent stages to check supported jdks
...
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-06 11:59:45 -05:00
Jan Hentschel
7da47509d2
HBASE-15042 Moved site materials to standard Maven place
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-05 15:22:46 +08:00
Alex Leblang
2bde7a1077
HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop
...
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems
Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-08-04 12:05:10 -05:00
Sean Busbey
bdc94b1d6b
HBASE-18147 POC jenkinsfile for nightly checks.
...
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile
Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2017-07-20 17:07:33 -05:00
Apekshit Sharma
ea0062fa54
HBASE-18376 Add debug logs to hbase-personality.sh to make it possible to debug this issue.
...
Change-Id: I172b95ed6a387ddb507abc6645a0c3aa704321fc
2017-07-14 12:33:42 -07:00
Mike Drob
500592dfd0
HBASE-18339 Update to hadoop3-alpha4
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-07-13 10:03:03 -05:00
Apekshit Sharma
7d08c78103
HBASE-18341 (addendum) Replace '.' in test names with '_' when using them as html ids since
...
dot have special significance in CSS selectors.
Without it, we weren't able to select elements and add svg (trends columns) to them.
Change-Id: Ia63ff0851f0a2fad0789a24edf2f0ad00060d578
2017-07-10 12:04:05 -07:00
Apekshit Sharma
590f02aad0
HBASE-18341 Generalize regex matchers in findHangingTests.py script to match new consoleText of trunk build.
...
Change-Id: I0a4215827d3d561eef3f583da666c617f690d934
2017-07-08 00:50:20 -07:00
Sean Busbey
30d06dfe3a
HBASE-18327 redo test-patch personality 'hadoopcheck' to better account for feature branches
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-07-07 23:07:50 -04:00
zhangduo
58b377751a
HBASE-18179 Add new hadoop releases to the pre commit hadoop check
2017-06-14 14:20:01 +08:00
zhangduo
f5768b4306
HBASE-18200 Set hadoop check versions for branch-2 and branch-2.x in pre commit
2017-06-13 16:31:34 +08:00
Apekshit Sharma
7a535f5843
HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
...
Use https for fetching d3 since builds.apache.org is also https. Otherwise d3 script is not loaded (unless browser is explicitly told to do so) and the fancy status markers are not drawn.
Change-Id: I97f7402141717da77499d09e44b05ecdd35c5a6f
2017-05-19 00:29:37 -07:00
Apekshit Sharma
7a0a66072d
HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
...
Change-Id: I43851c52723de3d89ea4ca5fa49c86a178afba26
2017-05-18 19:10:19 -07:00
Apekshit Sharma
c51c36fd1f
HBASE-18076 Flaky dashboard improvement: Add status markers to show trends of failure/success.
2017-05-18 19:03:11 -07:00
Apekshit Sharma
841bb00655
HBASE-18044 Fix bug in report-flakies.py where if counter is set outside for loop, it cannot be overwritten inside loop.
...
http://stackoverflow.com/questions/7537439/how-to-increment-a-variable-on-a-for-loop-in-jinja-template
Change-Id: Ic404d6360fb646e6490d1487374520f9550b76b4
2017-05-15 14:15:57 -07:00
Josh Elser
757bf379c1
HBASE-17985 Inline apt-get update calls in Yetus Dockerfile
2017-05-02 17:33:18 -04:00
CHIA-PING TSAI
fe3c32ebd5
HBASE-17809 cleanup unused class
2017-03-23 14:15:28 +08:00
Apekshit Sharma
41be3bc2cc
HBASE-17593 Update hadoop 3 version to 3.0.0-alpha2.
...
Change-Id: Ic5411229aaab3d645dc6751ecfbbda1b2d93a4b9
2017-02-06 12:18:21 -08:00
Michael Stack
8f8daafee0
HBASE-17228 precommit grep -c ERROR may grab non errors I tested this by doing `cat /tmp/some_file_with_ERROR_combos|grep -c '\[ERROR\]'
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-02 08:51:21 -08:00
zhangduo
8d52d23c77
HBASE-17074 PreCommit job always fails because of OOM
2016-11-15 08:29:24 +08:00
Michael Stack
c3b98b87fb
HBASE-16955 Fixup precommit protoc check to do new distributed protos and pb 3.1.0 build
2016-11-08 12:49:12 -08:00
Michael Stack
339017f0f6
HBASE_16963 Fixup our hbase-personality post YETUS-322 flip verify_
...
result codes
This patch is about updating our hbase-personality for yetus.
Basic yetus methods flipped what was true and false but we did
not adjust our usage in accordance on an update. See
YETUS-322 flip verify_ result codes. I need this in place so I
can prove that there is nothing I have to do for this the parent
issue HBASE-16955 after I commit HBASE-16952, the revamp of how
we do proto generation. After HBASE-16952 the protoc check will do the
right thing in all cases (pb2.5 vs pb3.1 and we run the protoc
in any module that has protos in it)
2016-10-28 15:34:50 -07:00
zhangduo
187ff190ed
HBASE-16887 Allow setting different hadoopcheck versions in precommit for different branches
2016-10-24 09:58:21 +08:00
Jonathan M Hsieh
1b005f30e4
HBASE-16733 add hadoop 3.0.0-alpha1 to precommit checks
2016-10-18 01:30:03 -07:00
Apekshit Sharma
de7316b11e
HBASE-16720 Sort build ids in flaky dashboard.
...
Change-Id: Ie44c7d699486a3468c92351c0e2146151e722764
2016-09-27 15:40:43 -07:00
Jerry He
2765b9d9d9
HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes)
2016-09-24 16:07:25 -07:00
zhangduo
7bda5151ee
HBASE-16591 Add a docker file only contains java 8 for running pre commit on master
2016-09-11 13:02:36 +08:00
zhangduo
1da0a48f6b
HBASE-16535 Use regex to exclude generated classes for findbugs
2016-08-31 14:42:32 +08:00
Apekshit Sharma
0d6c4d92ed
HBASE-16434
...
- Add date and count of flaky tests
- Sort tests by decreasing order of flakyness
- Internal links to each job's results
- Correct calculation of total bad runs for a test
- Fixes pylint errors
Change-Id: I12ebc32ccec14c5ff389464b4de8ae93653c876c
2016-08-19 09:55:29 -07:00
Apekshit Sharma
7999bb9bd3
HBASE-16384 Update report-flakies.py script to allow specifying a list of build ids to be excluded.
...
Also fixes some pylint errors.
Change-Id: I4620756c277c36a1ddb6d6cbd4d3e380da8442d7
2016-08-17 13:45:22 -07:00
Dima Spivak
ccf5d27d7a
HBASE-12721 Create Docker container cluster infrastructure to enable better testing
...
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-17 12:03:47 -07:00
Jurriaan Mous
938ee73e7c
HBASE-15882 Upgrade to yetus precommit 0.3.0
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-06 01:23:20 -05:00
Dima Spivak
9454daf25b
HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh
...
* Also some trivial cleanup of spacing to undo poor formatting decisions
of the past.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-19 07:27:32 -05:00
Dima Spivak
1fbded61c1
HBASE-16124 Make check_compatibility.sh less verbose when building HBase
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 10:21:16 -05:00
Dima Spivak
294c2dae9e
HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7
...
* This commit also fixes some stray tabs that got into the script at
some point.
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-29 11:26:52 -05:00
Dima Spivak
ef90ecc00c
HBASE-16073 update compatibility_checker for jacc dropping comma sep args
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-21 15:47:41 -05:00
Apekshit Sharma
f283ff01aa
HBASE-16038 Ignore JVM crashes or machine shutdown failures in report-flakies.
...
Change-Id: If49acd704e827b289c75f449a6180038b297d647
2016-06-15 16:01:49 -07:00
Apekshit
9593a9f396
HBASE-15938 submit-patch.py: Don't crash if there are tests with same name. Refactor: Split out flaky dashboard html template to separate file. (Apekshit)
...
Change-Id: Ie5875bdefbf886984a57dfc85661be2ac9592a7b
Signed-off-by: stack <stack@apache.org>
2016-06-02 08:55:42 -07:00
Apekshit
eb64cd9dd1
HBASE-15917 Addendum. Fix bug in report-flakies.py where hanging tests are not being added to flaky list. (Apekshit)
...
ADDENDUM #2 !
Change-Id: I9c55932d0f9e65b72ec8d3ae714144536b2bfe0a
Signed-off-by: stack <stack@apache.org>
2016-05-31 10:16:40 -07:00
Apekshit
75c2360543
HBASE-15918 Cleanup excludes/includes file after use in hbase-personality.sh to avoid asf license error. (Apekshit)
...
Change-Id: I3a47113ef9f598f90357b7cb580cbdc56f3c46f4
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:30:19 -07:00
Apekshit
f0a1e22441
HBASE-15917 Addendum. Add jija2 to python requirements. It's used by report-flakies.py to build the dashboard. (Apekshit)
...
ADDENDUM!!!
Change-Id: I8d30986e204463d1ea26b4a70e2f26915c99bdfc
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:16:33 -07:00
Apekshit
0923346b61
HBASE-15917 Flaky tests dashboard. (Apekshit)
...
Change-Id: If0e4299b173d3d76e0bdb12a3de080e5b51d8748
Signed-off-by: stack <stack@apache.org>
2016-05-30 20:54:01 -07:00
Apekshit
74442fde0f
HBASE-15909 Use Yetus' patch naming rules in submit-patch.py. (Apekshit)
...
Change-Id: I4d71c94da550efe8b24ea73edcde73d9bba84b8a
Signed-off-by: stack <stack@apache.org>
2016-05-28 21:55:17 -07:00
Apekshit
36bd7d03fc
HBASE-15896 ADDENDUM Add timeout tests to flaky list from report-flakies.py.
...
Adding the diff between the original patch approved and the one committed as addendum.
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-27 16:39:13 -07:00
Sean Busbey
d50cf9972d
HBASE-15895 Remove unmaintained jenkins build analysis tool.
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Dima Spivak <dspivak@cloudera.com>
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Apekshit <apeksharma@gmail.com>
2016-05-27 16:38:39 -07:00
Apekshit
aa016c78a7
HBASE-15896 Add timeout tests to flaky list from report-flakies.py - Adds timed-out tests to flaky list. Dumpes two new files for reference, 'timeout' and 'failed' for corresponding list of bad tests. - Set --max-builds for different urls separately. This is needed so that we can turn the knobs for post-commit job and flaky-tests job separately. (Apekshit)
...
Change-Id: I88e1f9a8924eed1b5010106e73edede3aff34b0b
Signed-off-by: stack <stack@apache.org>
2016-05-27 07:34:10 -07:00
Apekshit
3ffaa116fe
HBASE-15892 Script to create patch, upload it to jira, and update review board. (Apekshit)
...
Change-Id: I920760980b0a715f1e9945b930d923fd543b450b
Signed-off-by: stack <stack@apache.org>
2016-05-26 08:44:26 -07:00
Elliott Clark
c12eaa5cc4
HBASE-15725 make_patch.sh should add the branch name when -b is passed. -- addendum
2016-05-17 09:05:53 -07:00
Elliott Clark
0e281e1929
HBASE-15725 make_patch.sh should add the branch name when -b is passed.
2016-05-13 14:02:00 -07:00
Apekshit
2eced6f039
HBASE-15807 - Update report-flakies.py to look for "FAILED" status in test report. - Remove duplicate testcase names in the result
...
Tested:
Ran it manually.
(Apekshit)
Change-Id: I2a7751eefe729b2a69c0f78596f72b6a0eb39b66
Signed-off-by: stack <stack@apache.org>
2016-05-09 11:51:16 -07:00
Nick Dimiduk
58888e0911
HBASE-15738 Ensure artifacts in project dist area include required md5 file
2016-05-08 18:06:31 -07:00
Dima Spivak
fa9fdfee2d
HBASE-15729 Remove old JDiff wrapper scripts in dev-support
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-04 13:28:17 -05:00
Apekshit
e1bf3a66fc
HBASE-15708 Docker for dev-support scripts. (Apekshit)
...
Change-Id: Ifb49125e940a8bacdff54247df8f2a75c6069c54
Signed-off-by: stack <stack@apache.org>
2016-04-27 15:21:28 -07:00
Apekshit
e5d01577e4
HBASE-15689 Changes in hbase-personality.sh to include/exclude tests run by maven. (Apekshit)
...
Change-Id: I517e7a9ba3321cb19d1eeb1d46d62628213b8bbb
2016-04-25 16:27:54 -07:00
Apekshit
57e1dbc8a6
HBASE-15651 Script to report flaky tests. (Apekshit)
...
Change-Id: I5cd5c23985b8c3f928d7ab44e57606b0a5478f15
Signed-off-by: stack <stack@apache.org>
2016-04-21 16:16:06 -07:00
Jonathan M Hsieh
b3e71d4644
HBASE-15434 [findbugs] Exclude scala generated source and protobuf generated code in hbase-spark module
2016-03-10 11:42:25 -08:00
stack
9955118995
HBASE-15195 Don't run findbugs on hbase-it; it has nothing in src/main/java
2016-01-31 11:07:21 -04:00
Nick Dimiduk
55bb5ff7fb
HBASE-15119 Include git SHA in check_compatibility reports
2016-01-19 21:29:58 -08:00
Sean Busbey
164aeb5399
HBASE-13525 replace test-patch with customizations needed to use yetus
...
Signed-off-by: stack <stack@apache.org>
2016-01-08 07:39:40 -06:00
stack
a999c2a010
Re-add zombie test and add return of result of test running
2015-12-28 13:23:23 -08:00
stack
3fca9a9f3f
Try this change to see how it effects overall rating...
2015-12-28 13:23:23 -08:00
stack
53e5d27a80
HBASE-15021 hadoopqa doing false positives
2015-12-21 22:16:38 -08:00
tedyu
80afb839ec
HBASE-14917 Log in console if individual tests in test-patch.sh fail or pass (Appy)
2015-12-04 19:16:01 -08:00
Dima Spivak
4f36632d7b
HBASE-14930 check_compatibility.sh needs smarter exit codes
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-12-04 18:55:52 -08:00
stack
7117a2e35d
HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- yet more formatting
2015-12-03 14:11:01 -08:00
stack
5e430837d3
HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- fix indent
2015-12-03 14:01:22 -08:00