Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,702 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

338 Commits

Author SHA1 Message Date
Misty Stanley-Jones 6114824b53 HBASE-18548 Move sources of website gen and check jobs into source control 2017-08-10 14:48:14 -07:00
Sean Busbey 7e7461e42a HBASE-18527 Update nightly job to account for changes in jenkins plugins. 
- Stop presuming job will be configured with checkout into a 'component' dir
 - Disable autocheckout
 - Specify checkout within 'component' dir
 - leave the workspace around on pipeline failure so we can browse it.
 2017-08-07 11:24:00 -05:00
Sean Busbey 2a717459bd HBASE-14220 nightly check that we can build a source tarball. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-06 12:01:47 -05:00
Sean Busbey 04424ad65f HBASE-18426 nightly job should use independent stages to check supported jdks 
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-06 11:59:45 -05:00
Jan Hentschel 7da47509d2 HBASE-15042 Moved site materials to standard Maven place 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-05 15:22:46 +08:00
Alex Leblang 2bde7a1077 HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop 
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems

Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey

Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-08-04 12:05:10 -05:00
Sean Busbey bdc94b1d6b HBASE-18147 POC jenkinsfile for nightly checks. 
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile

Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
 2017-07-20 17:07:33 -05:00
Apekshit Sharma ea0062fa54 HBASE-18376 Add debug logs to hbase-personality.sh to make it possible to debug this issue. 
Change-Id: I172b95ed6a387ddb507abc6645a0c3aa704321fc
 2017-07-14 12:33:42 -07:00
Mike Drob 500592dfd0 HBASE-18339 Update to hadoop3-alpha4 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-07-13 10:03:03 -05:00
Apekshit Sharma 7d08c78103 HBASE-18341 (addendum) Replace '.' in test names with '_' when using them as html ids since 
dot have special significance in CSS selectors.
Without it, we weren't able to select elements and add svg (trends columns) to them.

Change-Id: Ia63ff0851f0a2fad0789a24edf2f0ad00060d578
 2017-07-10 12:04:05 -07:00
Apekshit Sharma 590f02aad0 HBASE-18341 Generalize regex matchers in findHangingTests.py script to match new consoleText of trunk build. 
Change-Id: I0a4215827d3d561eef3f583da666c617f690d934
 2017-07-08 00:50:20 -07:00
Sean Busbey 30d06dfe3a HBASE-18327 redo test-patch personality 'hadoopcheck' to better account for feature branches 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-07-07 23:07:50 -04:00
zhangduo 58b377751a HBASE-18179 Add new hadoop releases to the pre commit hadoop check 2017-06-14 14:20:01 +08:00
zhangduo f5768b4306 HBASE-18200 Set hadoop check versions for branch-2 and branch-2.x in pre commit 2017-06-13 16:31:34 +08:00
Apekshit Sharma 7a535f5843 HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success 
Use https for fetching d3 since builds.apache.org is also https. Otherwise d3 script is not loaded (unless browser is explicitly told to do so) and the fancy status markers are not drawn.

Change-Id: I97f7402141717da77499d09e44b05ecdd35c5a6f
 2017-05-19 00:29:37 -07:00
Apekshit Sharma 7a0a66072d HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success 
Change-Id: I43851c52723de3d89ea4ca5fa49c86a178afba26
 2017-05-18 19:10:19 -07:00
Apekshit Sharma c51c36fd1f HBASE-18076 Flaky dashboard improvement: Add status markers to show trends of failure/success. 2017-05-18 19:03:11 -07:00
Apekshit Sharma 841bb00655 HBASE-18044 Fix bug in report-flakies.py where if counter is set outside for loop, it cannot be overwritten inside loop. 
http://stackoverflow.com/questions/7537439/how-to-increment-a-variable-on-a-for-loop-in-jinja-template

Change-Id: Ic404d6360fb646e6490d1487374520f9550b76b4
 2017-05-15 14:15:57 -07:00
Josh Elser 757bf379c1 HBASE-17985 Inline apt-get update calls in Yetus Dockerfile 2017-05-02 17:33:18 -04:00
CHIA-PING TSAI fe3c32ebd5 HBASE-17809 cleanup unused class 2017-03-23 14:15:28 +08:00
Apekshit Sharma 41be3bc2cc HBASE-17593 Update hadoop 3 version to 3.0.0-alpha2. 
Change-Id: Ic5411229aaab3d645dc6751ecfbbda1b2d93a4b9
 2017-02-06 12:18:21 -08:00
Michael Stack 8f8daafee0 HBASE-17228 precommit grep -c ERROR may grab non errors I tested this by doing `cat /tmp/some_file_with_ERROR_combos|grep -c '\[ERROR\]' 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-12-02 08:51:21 -08:00
zhangduo 8d52d23c77 HBASE-17074 PreCommit job always fails because of OOM 2016-11-15 08:29:24 +08:00
Michael Stack c3b98b87fb HBASE-16955 Fixup precommit protoc check to do new distributed protos and pb 3.1.0 build 2016-11-08 12:49:12 -08:00
Michael Stack 339017f0f6 HBASE_16963 Fixup our hbase-personality post YETUS-322 flip verify_ 
result codes

This patch is about updating our hbase-personality for yetus.
Basic yetus methods flipped what was true and false but we did
not adjust our usage in accordance on an update. See
YETUS-322 flip verify_ result codes. I need this in place so I
can prove that there is nothing I have to do for this the parent
issue  HBASE-16955 after I commit HBASE-16952, the revamp of how
we do proto generation. After HBASE-16952 the protoc check will do the
right thing in all cases (pb2.5 vs pb3.1 and we run the protoc
in any module that has protos in it)
 2016-10-28 15:34:50 -07:00
zhangduo 187ff190ed HBASE-16887 Allow setting different hadoopcheck versions in precommit for different branches 2016-10-24 09:58:21 +08:00
Jonathan M Hsieh 1b005f30e4 HBASE-16733 add hadoop 3.0.0-alpha1 to precommit checks 2016-10-18 01:30:03 -07:00
Apekshit Sharma de7316b11e HBASE-16720 Sort build ids in flaky dashboard. 
Change-Id: Ie44c7d699486a3468c92351c0e2146151e722764
 2016-09-27 15:40:43 -07:00
Jerry He 2765b9d9d9 HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes) 2016-09-24 16:07:25 -07:00
zhangduo 7bda5151ee HBASE-16591 Add a docker file only contains java 8 for running pre commit on master 2016-09-11 13:02:36 +08:00
zhangduo 1da0a48f6b HBASE-16535 Use regex to exclude generated classes for findbugs 2016-08-31 14:42:32 +08:00
Apekshit Sharma 0d6c4d92ed HBASE-16434 
- Add date and count of flaky tests
- Sort tests by decreasing order of flakyness
- Internal links to each job's results
- Correct calculation of total bad runs for a test
- Fixes pylint errors

Change-Id: I12ebc32ccec14c5ff389464b4de8ae93653c876c
 2016-08-19 09:55:29 -07:00
Apekshit Sharma 7999bb9bd3 HBASE-16384 Update report-flakies.py script to allow specifying a list of build ids to be excluded. 
Also fixes some pylint errors.

Change-Id: I4620756c277c36a1ddb6d6cbd4d3e380da8442d7
 2016-08-17 13:45:22 -07:00
Dima Spivak ccf5d27d7a HBASE-12721 Create Docker container cluster infrastructure to enable better testing 
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-08-17 12:03:47 -07:00
Jurriaan Mous 938ee73e7c HBASE-15882 Upgrade to yetus precommit 0.3.0 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-08-06 01:23:20 -05:00
Dima Spivak 9454daf25b HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh 
* Also some trivial cleanup of spacing to undo poor formatting decisions
  of the past.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-07-19 07:27:32 -05:00
Dima Spivak 1fbded61c1 HBASE-16124 Make check_compatibility.sh less verbose when building HBase 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-06-30 10:21:16 -05:00
Dima Spivak 294c2dae9e HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7 
* This commit also fixes some stray tabs that got into the script at
  some point.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-06-29 11:26:52 -05:00
Dima Spivak ef90ecc00c HBASE-16073 update compatibility_checker for jacc dropping comma sep args 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-06-21 15:47:41 -05:00
Apekshit Sharma f283ff01aa HBASE-16038 Ignore JVM crashes or machine shutdown failures in report-flakies. 
Change-Id: If49acd704e827b289c75f449a6180038b297d647
 2016-06-15 16:01:49 -07:00
Apekshit 9593a9f396 HBASE-15938 submit-patch.py: Don't crash if there are tests with same name. Refactor: Split out flaky dashboard html template to separate file. (Apekshit) 
Change-Id: Ie5875bdefbf886984a57dfc85661be2ac9592a7b

Signed-off-by: stack <stack@apache.org>
 2016-06-02 08:55:42 -07:00
Apekshit eb64cd9dd1 HBASE-15917 Addendum. Fix bug in report-flakies.py where hanging tests are not being added to flaky list. (Apekshit) 
ADDENDUM #2!

Change-Id: I9c55932d0f9e65b72ec8d3ae714144536b2bfe0a

Signed-off-by: stack <stack@apache.org>
 2016-05-31 10:16:40 -07:00
Apekshit 75c2360543 HBASE-15918 Cleanup excludes/includes file after use in hbase-personality.sh to avoid asf license error. (Apekshit) 
Change-Id: I3a47113ef9f598f90357b7cb580cbdc56f3c46f4

Signed-off-by: stack <stack@apache.org>
 2016-05-30 21:30:19 -07:00
Apekshit f0a1e22441 HBASE-15917 Addendum. Add jija2 to python requirements. It's used by report-flakies.py to build the dashboard. (Apekshit) 
ADDENDUM!!!

Change-Id: I8d30986e204463d1ea26b4a70e2f26915c99bdfc

Signed-off-by: stack <stack@apache.org>
 2016-05-30 21:16:33 -07:00
Apekshit 0923346b61 HBASE-15917 Flaky tests dashboard. (Apekshit) 
Change-Id: If0e4299b173d3d76e0bdb12a3de080e5b51d8748

Signed-off-by: stack <stack@apache.org>
 2016-05-30 20:54:01 -07:00
Apekshit 74442fde0f HBASE-15909 Use Yetus' patch naming rules in submit-patch.py. (Apekshit) 
Change-Id: I4d71c94da550efe8b24ea73edcde73d9bba84b8a

Signed-off-by: stack <stack@apache.org>
 2016-05-28 21:55:17 -07:00
Apekshit 36bd7d03fc HBASE-15896 ADDENDUM Add timeout tests to flaky list from report-flakies.py. 
Adding the diff between the original patch approved and the one committed as addendum.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-05-27 16:39:13 -07:00
Sean Busbey d50cf9972d HBASE-15895 Remove unmaintained jenkins build analysis tool. 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Dima Spivak <dspivak@cloudera.com>
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Apekshit <apeksharma@gmail.com>
 2016-05-27 16:38:39 -07:00
Apekshit aa016c78a7 HBASE-15896 Add timeout tests to flaky list from report-flakies.py - Adds timed-out tests to flaky list. Dumpes two new files for reference, 'timeout' and 'failed' for corresponding list of bad tests. - Set --max-builds for different urls separately. This is needed so that we can turn the knobs for post-commit job and flaky-tests job separately. (Apekshit) 
Change-Id: I88e1f9a8924eed1b5010106e73edede3aff34b0b

Signed-off-by: stack <stack@apache.org>
 2016-05-27 07:34:10 -07:00
Apekshit 3ffaa116fe HBASE-15892 Script to create patch, upload it to jira, and update review board. (Apekshit) 
Change-Id: I920760980b0a715f1e9945b930d923fd543b450b

Signed-off-by: stack <stack@apache.org>
 2016-05-26 08:44:26 -07:00
Elliott Clark c12eaa5cc4 HBASE-15725 make_patch.sh should add the branch name when -b is passed. -- addendum 2016-05-17 09:05:53 -07:00
Elliott Clark 0e281e1929 HBASE-15725 make_patch.sh should add the branch name when -b is passed. 2016-05-13 14:02:00 -07:00
Apekshit 2eced6f039 HBASE-15807 - Update report-flakies.py to look for "FAILED" status in test report. - Remove duplicate testcase names in the result 
Tested:
Ran it manually.

(Apekshit)

Change-Id: I2a7751eefe729b2a69c0f78596f72b6a0eb39b66

Signed-off-by: stack <stack@apache.org>
 2016-05-09 11:51:16 -07:00
Nick Dimiduk 58888e0911 HBASE-15738 Ensure artifacts in project dist area include required md5 file 2016-05-08 18:06:31 -07:00
Dima Spivak fa9fdfee2d HBASE-15729 Remove old JDiff wrapper scripts in dev-support 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-05-04 13:28:17 -05:00
Apekshit e1bf3a66fc HBASE-15708 Docker for dev-support scripts. (Apekshit) 
Change-Id: Ifb49125e940a8bacdff54247df8f2a75c6069c54

Signed-off-by: stack <stack@apache.org>
 2016-04-27 15:21:28 -07:00
Apekshit e5d01577e4 HBASE-15689 Changes in hbase-personality.sh to include/exclude tests run by maven. (Apekshit) 
Change-Id: I517e7a9ba3321cb19d1eeb1d46d62628213b8bbb
 2016-04-25 16:27:54 -07:00
Apekshit 57e1dbc8a6 HBASE-15651 Script to report flaky tests. (Apekshit) 
Change-Id: I5cd5c23985b8c3f928d7ab44e57606b0a5478f15

Signed-off-by: stack <stack@apache.org>
 2016-04-21 16:16:06 -07:00
Jonathan M Hsieh b3e71d4644 HBASE-15434 [findbugs] Exclude scala generated source and protobuf generated code in hbase-spark module 2016-03-10 11:42:25 -08:00
stack 9955118995 HBASE-15195 Don't run findbugs on hbase-it; it has nothing in src/main/java 2016-01-31 11:07:21 -04:00
Nick Dimiduk 55bb5ff7fb HBASE-15119 Include git SHA in check_compatibility reports 2016-01-19 21:29:58 -08:00
Sean Busbey 164aeb5399 HBASE-13525 replace test-patch with customizations needed to use yetus 
Signed-off-by: stack <stack@apache.org>
 2016-01-08 07:39:40 -06:00
stack a999c2a010 Re-add zombie test and add return of result of test running 2015-12-28 13:23:23 -08:00
stack 3fca9a9f3f Try this change to see how it effects overall rating... 2015-12-28 13:23:23 -08:00
stack 53e5d27a80 HBASE-15021 hadoopqa doing false positives 2015-12-21 22:16:38 -08:00
tedyu 80afb839ec HBASE-14917 Log in console if individual tests in test-patch.sh fail or pass (Appy) 2015-12-04 19:16:01 -08:00
Dima Spivak 4f36632d7b HBASE-14930 check_compatibility.sh needs smarter exit codes 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2015-12-04 18:55:52 -08:00
stack 7117a2e35d HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- yet more formatting 2015-12-03 14:11:01 -08:00
stack 5e430837d3 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- fix indent 2015-12-03 14:01:22 -08:00
stack a154ecda00 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- export JIRA_COMMENT so subshell zombie detector picks up current content 2015-12-03 10:05:05 -08:00
stack 69658ea4a9 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- extra 'tick' 2015-12-02 20:47:59 -08:00
stack cf8d3bd641 HBASE-14772 Improve zombie detector; be more discerning; part2 2015-12-02 17:44:49 -08:00
stack cbbad6e5fb Add small note so we know for sure the zombie script is running 2015-12-01 17:05:34 -08:00
Apekshit(Appy) Sharma efb5917f22 HBASE-14859 Better checkstyle reporting. Reports file names, error names and old/new error counts. Fix some checks. (Apekshit) 
Signed-off-by: stack <stack@apache.org>
 2015-11-25 12:18:40 -08:00
Elliott Clark 4cc341b9c2 HBASE-14871 Allow specifying the base branch for make_patch 2015-11-24 11:59:49 -08:00
stack 44367f55e8 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM fix zombie-detectors' handling of no processes -- was treating no processes as one possible zombie 2015-11-09 13:43:43 -10:00
stack 0af651bde5 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM -- remove zombie detection from test-patch.sh and rely on script instead 2015-11-09 07:12:27 -10:00
stack 4c2e0d95dc HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM Add 
logging date when reporting all is well.
 2015-11-08 21:00:28 -10:00
stack 1cbcf1175e HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM some cleanup in zombie script and run it in test-patch too .. just trying it 2015-11-08 11:09:31 -10:00
stack 305ecaf224 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM set execute perms on the script 2015-11-07 15:00:08 -10:00
stack bea2f7feac HBASE-14772 Improve zombie detector; be more discerning 2015-11-06 16:39:15 -10:00
Misty Stanley-Jones c585072bc3 HBASE-14762 Update docs about publishing website to show gitsubpub method instead of svnsubpub 
Also some reformatting to remove trailing whitespace and rewrap long lines.
 2015-11-05 09:17:37 +10:00
stack 0eae729ffa HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; FIX complaint about grep device 2015-11-03 06:24:34 -08:00
stack 870c74e270 HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; ADD EXTRA COMMENTARY 2015-11-02 22:12:40 -08:00
stack a82d55e3cf HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies 2015-11-02 22:01:10 -08:00
stack 950050e9d6 Revert "HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan)" 
Revert because I overcommitted, included files from another patch.

This reverts commit 47659200ac.
 2015-11-02 08:06:34 -08:00
stack 47659200ac HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan) 2015-11-01 22:22:59 -08:00
Misty Stanley-Jones 51693b9cde HBASE-14642 Update website-publishing script 2015-10-20 16:31:20 +10:00
stack ba3d474f8a Add comment to test-patch.sh that the zombie killing code is copy/pasted up into jenkins as after-task 2015-10-14 09:58:04 -07:00
stack 94bfe909af HBASE-14589 Builds are being killed... 2015-10-14 00:29:52 -07:00
stack 08df55defc Add date on the test-patch.sh so I can see what version of this patch is running 2015-10-13 20:45:50 -07:00
stack 6323cd9544 HBASE-14593 Add more info on zombies to test-patch.sh; ADD EVEN MORE 2015-10-13 07:53:57 -07:00
stack ac82a86320 HBASE-14593 Add more info on zombies to test-patch.sh 2015-10-12 15:57:28 -07:00
stack 4beefd8ce4 HBASE-14349 pre-commit zombie finder is overly broad; ADDENDUM 2015-10-08 13:04:25 -07:00
stack e1fd3526b1 HBASE-14349 pre-commit zombie finder is overly broad 2015-10-07 13:41:27 -07:00
stack 26dec4c60d HBASE-14543 Have findHangingTests.py dump more info 2015-10-02 12:16:28 -07:00
Nick Dimiduk 2ea70c7e6c HBASE-14482 Add hadoop 2.6.1 to the test-patch build list 2015-09-29 10:11:16 +02:00
stack 27a993d837 HBASE-14429 Checkstyle report is broken 2015-09-15 22:29:14 -07:00
Sean Busbey a5261b6f44 HBASE-14337 Improve test-patch to better deal with dependency licenses 
* if we know we're going to fail the build via velocity template failure, output the cause in the generated LICENSE file.
* tweak test-patch workspace handling to allow for checkout of repo next to patch process
 2015-09-02 10:37:02 -05:00
Nick Dimiduk 4f410e6bd5 HBASE-14318 make_rc.sh should purge/re-resolve dependencies from local repository 2015-09-01 10:28:08 -07:00