Commit Graph

322 Commits

Author SHA1 Message Date
Apekshit Sharma c51c36fd1f HBASE-18076 Flaky dashboard improvement: Add status markers to show trends of failure/success. 2017-05-18 19:03:11 -07:00
Apekshit Sharma 841bb00655 HBASE-18044 Fix bug in report-flakies.py where if counter is set outside for loop, it cannot be overwritten inside loop.
http://stackoverflow.com/questions/7537439/how-to-increment-a-variable-on-a-for-loop-in-jinja-template

Change-Id: Ic404d6360fb646e6490d1487374520f9550b76b4
2017-05-15 14:15:57 -07:00
Josh Elser 757bf379c1 HBASE-17985 Inline apt-get update calls in Yetus Dockerfile 2017-05-02 17:33:18 -04:00
CHIA-PING TSAI fe3c32ebd5 HBASE-17809 cleanup unused class 2017-03-23 14:15:28 +08:00
Apekshit Sharma 41be3bc2cc HBASE-17593 Update hadoop 3 version to 3.0.0-alpha2.
Change-Id: Ic5411229aaab3d645dc6751ecfbbda1b2d93a4b9
2017-02-06 12:18:21 -08:00
Michael Stack 8f8daafee0 HBASE-17228 precommit grep -c ERROR may grab non errors I tested this by doing `cat /tmp/some_file_with_ERROR_combos|grep -c '\[ERROR\]'
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-02 08:51:21 -08:00
zhangduo 8d52d23c77 HBASE-17074 PreCommit job always fails because of OOM 2016-11-15 08:29:24 +08:00
Michael Stack c3b98b87fb HBASE-16955 Fixup precommit protoc check to do new distributed protos and pb 3.1.0 build 2016-11-08 12:49:12 -08:00
Michael Stack 339017f0f6 HBASE_16963 Fixup our hbase-personality post YETUS-322 flip verify_
result codes

This patch is about updating our hbase-personality for yetus.
Basic yetus methods flipped what was true and false but we did
not adjust our usage in accordance on an update. See
YETUS-322 flip verify_ result codes. I need this in place so I
can prove that there is nothing I have to do for this the parent
issue  HBASE-16955 after I commit HBASE-16952, the revamp of how
we do proto generation. After HBASE-16952 the protoc check will do the
right thing in all cases (pb2.5 vs pb3.1 and we run the protoc
in any module that has protos in it)
2016-10-28 15:34:50 -07:00
zhangduo 187ff190ed HBASE-16887 Allow setting different hadoopcheck versions in precommit for different branches 2016-10-24 09:58:21 +08:00
Jonathan M Hsieh 1b005f30e4 HBASE-16733 add hadoop 3.0.0-alpha1 to precommit checks 2016-10-18 01:30:03 -07:00
Apekshit Sharma de7316b11e HBASE-16720 Sort build ids in flaky dashboard.
Change-Id: Ie44c7d699486a3468c92351c0e2146151e722764
2016-09-27 15:40:43 -07:00
Jerry He 2765b9d9d9 HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes) 2016-09-24 16:07:25 -07:00
zhangduo 7bda5151ee HBASE-16591 Add a docker file only contains java 8 for running pre commit on master 2016-09-11 13:02:36 +08:00
zhangduo 1da0a48f6b HBASE-16535 Use regex to exclude generated classes for findbugs 2016-08-31 14:42:32 +08:00
Apekshit Sharma 0d6c4d92ed HBASE-16434
- Add date and count of flaky tests
- Sort tests by decreasing order of flakyness
- Internal links to each job's results
- Correct calculation of total bad runs for a test
- Fixes pylint errors

Change-Id: I12ebc32ccec14c5ff389464b4de8ae93653c876c
2016-08-19 09:55:29 -07:00
Apekshit Sharma 7999bb9bd3 HBASE-16384 Update report-flakies.py script to allow specifying a list of build ids to be excluded.
Also fixes some pylint errors.

Change-Id: I4620756c277c36a1ddb6d6cbd4d3e380da8442d7
2016-08-17 13:45:22 -07:00
Dima Spivak ccf5d27d7a HBASE-12721 Create Docker container cluster infrastructure to enable better testing
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-17 12:03:47 -07:00
Jurriaan Mous 938ee73e7c HBASE-15882 Upgrade to yetus precommit 0.3.0
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-06 01:23:20 -05:00
Dima Spivak 9454daf25b HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh
* Also some trivial cleanup of spacing to undo poor formatting decisions
  of the past.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-19 07:27:32 -05:00
Dima Spivak 1fbded61c1 HBASE-16124 Make check_compatibility.sh less verbose when building HBase
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 10:21:16 -05:00
Dima Spivak 294c2dae9e HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7
* This commit also fixes some stray tabs that got into the script at
  some point.

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-29 11:26:52 -05:00
Dima Spivak ef90ecc00c HBASE-16073 update compatibility_checker for jacc dropping comma sep args
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-21 15:47:41 -05:00
Apekshit Sharma f283ff01aa HBASE-16038 Ignore JVM crashes or machine shutdown failures in report-flakies.
Change-Id: If49acd704e827b289c75f449a6180038b297d647
2016-06-15 16:01:49 -07:00
Apekshit 9593a9f396 HBASE-15938 submit-patch.py: Don't crash if there are tests with same name. Refactor: Split out flaky dashboard html template to separate file. (Apekshit)
Change-Id: Ie5875bdefbf886984a57dfc85661be2ac9592a7b

Signed-off-by: stack <stack@apache.org>
2016-06-02 08:55:42 -07:00
Apekshit eb64cd9dd1 HBASE-15917 Addendum. Fix bug in report-flakies.py where hanging tests are not being added to flaky list. (Apekshit)
ADDENDUM #2!

Change-Id: I9c55932d0f9e65b72ec8d3ae714144536b2bfe0a

Signed-off-by: stack <stack@apache.org>
2016-05-31 10:16:40 -07:00
Apekshit 75c2360543 HBASE-15918 Cleanup excludes/includes file after use in hbase-personality.sh to avoid asf license error. (Apekshit)
Change-Id: I3a47113ef9f598f90357b7cb580cbdc56f3c46f4

Signed-off-by: stack <stack@apache.org>
2016-05-30 21:30:19 -07:00
Apekshit f0a1e22441 HBASE-15917 Addendum. Add jija2 to python requirements. It's used by report-flakies.py to build the dashboard. (Apekshit)
ADDENDUM!!!

Change-Id: I8d30986e204463d1ea26b4a70e2f26915c99bdfc

Signed-off-by: stack <stack@apache.org>
2016-05-30 21:16:33 -07:00
Apekshit 0923346b61 HBASE-15917 Flaky tests dashboard. (Apekshit)
Change-Id: If0e4299b173d3d76e0bdb12a3de080e5b51d8748

Signed-off-by: stack <stack@apache.org>
2016-05-30 20:54:01 -07:00
Apekshit 74442fde0f HBASE-15909 Use Yetus' patch naming rules in submit-patch.py. (Apekshit)
Change-Id: I4d71c94da550efe8b24ea73edcde73d9bba84b8a

Signed-off-by: stack <stack@apache.org>
2016-05-28 21:55:17 -07:00
Apekshit 36bd7d03fc HBASE-15896 ADDENDUM Add timeout tests to flaky list from report-flakies.py.
Adding the diff between the original patch approved and the one committed as addendum.

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-27 16:39:13 -07:00
Sean Busbey d50cf9972d HBASE-15895 Remove unmaintained jenkins build analysis tool.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Dima Spivak <dspivak@cloudera.com>
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Apekshit <apeksharma@gmail.com>
2016-05-27 16:38:39 -07:00
Apekshit aa016c78a7 HBASE-15896 Add timeout tests to flaky list from report-flakies.py - Adds timed-out tests to flaky list. Dumpes two new files for reference, 'timeout' and 'failed' for corresponding list of bad tests. - Set --max-builds for different urls separately. This is needed so that we can turn the knobs for post-commit job and flaky-tests job separately. (Apekshit)
Change-Id: I88e1f9a8924eed1b5010106e73edede3aff34b0b

Signed-off-by: stack <stack@apache.org>
2016-05-27 07:34:10 -07:00
Apekshit 3ffaa116fe HBASE-15892 Script to create patch, upload it to jira, and update review board. (Apekshit)
Change-Id: I920760980b0a715f1e9945b930d923fd543b450b

Signed-off-by: stack <stack@apache.org>
2016-05-26 08:44:26 -07:00
Elliott Clark c12eaa5cc4 HBASE-15725 make_patch.sh should add the branch name when -b is passed. -- addendum 2016-05-17 09:05:53 -07:00
Elliott Clark 0e281e1929 HBASE-15725 make_patch.sh should add the branch name when -b is passed. 2016-05-13 14:02:00 -07:00
Apekshit 2eced6f039 HBASE-15807 - Update report-flakies.py to look for "FAILED" status in test report. - Remove duplicate testcase names in the result
Tested:
Ran it manually.

(Apekshit)

Change-Id: I2a7751eefe729b2a69c0f78596f72b6a0eb39b66

Signed-off-by: stack <stack@apache.org>
2016-05-09 11:51:16 -07:00
Nick Dimiduk 58888e0911 HBASE-15738 Ensure artifacts in project dist area include required md5 file 2016-05-08 18:06:31 -07:00
Dima Spivak fa9fdfee2d HBASE-15729 Remove old JDiff wrapper scripts in dev-support
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-04 13:28:17 -05:00
Apekshit e1bf3a66fc HBASE-15708 Docker for dev-support scripts. (Apekshit)
Change-Id: Ifb49125e940a8bacdff54247df8f2a75c6069c54

Signed-off-by: stack <stack@apache.org>
2016-04-27 15:21:28 -07:00
Apekshit e5d01577e4 HBASE-15689 Changes in hbase-personality.sh to include/exclude tests run by maven. (Apekshit)
Change-Id: I517e7a9ba3321cb19d1eeb1d46d62628213b8bbb
2016-04-25 16:27:54 -07:00
Apekshit 57e1dbc8a6 HBASE-15651 Script to report flaky tests. (Apekshit)
Change-Id: I5cd5c23985b8c3f928d7ab44e57606b0a5478f15

Signed-off-by: stack <stack@apache.org>
2016-04-21 16:16:06 -07:00
Jonathan M Hsieh b3e71d4644 HBASE-15434 [findbugs] Exclude scala generated source and protobuf generated code in hbase-spark module 2016-03-10 11:42:25 -08:00
stack 9955118995 HBASE-15195 Don't run findbugs on hbase-it; it has nothing in src/main/java 2016-01-31 11:07:21 -04:00
Nick Dimiduk 55bb5ff7fb HBASE-15119 Include git SHA in check_compatibility reports 2016-01-19 21:29:58 -08:00
Sean Busbey 164aeb5399 HBASE-13525 replace test-patch with customizations needed to use yetus
Signed-off-by: stack <stack@apache.org>
2016-01-08 07:39:40 -06:00
stack a999c2a010 Re-add zombie test and add return of result of test running 2015-12-28 13:23:23 -08:00
stack 3fca9a9f3f Try this change to see how it effects overall rating... 2015-12-28 13:23:23 -08:00
stack 53e5d27a80 HBASE-15021 hadoopqa doing false positives 2015-12-21 22:16:38 -08:00
tedyu 80afb839ec HBASE-14917 Log in console if individual tests in test-patch.sh fail or pass (Appy) 2015-12-04 19:16:01 -08:00
Dima Spivak 4f36632d7b HBASE-14930 check_compatibility.sh needs smarter exit codes
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-12-04 18:55:52 -08:00
stack 7117a2e35d HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- yet more formatting 2015-12-03 14:11:01 -08:00
stack 5e430837d3 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- fix indent 2015-12-03 14:01:22 -08:00
stack a154ecda00 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- export JIRA_COMMENT so subshell zombie detector picks up current content 2015-12-03 10:05:05 -08:00
stack 69658ea4a9 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- extra 'tick' 2015-12-02 20:47:59 -08:00
stack cf8d3bd641 HBASE-14772 Improve zombie detector; be more discerning; part2 2015-12-02 17:44:49 -08:00
stack cbbad6e5fb Add small note so we know for sure the zombie script is running 2015-12-01 17:05:34 -08:00
Apekshit(Appy) Sharma efb5917f22 HBASE-14859 Better checkstyle reporting. Reports file names, error names and old/new error counts. Fix some checks. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-25 12:18:40 -08:00
Elliott Clark 4cc341b9c2 HBASE-14871 Allow specifying the base branch for make_patch 2015-11-24 11:59:49 -08:00
stack 44367f55e8 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM fix zombie-detectors' handling of no processes -- was treating no processes as one possible zombie 2015-11-09 13:43:43 -10:00
stack 0af651bde5 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM -- remove zombie detection from test-patch.sh and rely on script instead 2015-11-09 07:12:27 -10:00
stack 4c2e0d95dc HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM Add
logging date when reporting all is well.
2015-11-08 21:00:28 -10:00
stack 1cbcf1175e HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM some cleanup in zombie script and run it in test-patch too .. just trying it 2015-11-08 11:09:31 -10:00
stack 305ecaf224 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM set execute perms on the script 2015-11-07 15:00:08 -10:00
stack bea2f7feac HBASE-14772 Improve zombie detector; be more discerning 2015-11-06 16:39:15 -10:00
Misty Stanley-Jones c585072bc3 HBASE-14762 Update docs about publishing website to show gitsubpub method instead of svnsubpub
Also some reformatting to remove trailing whitespace and rewrap long lines.
2015-11-05 09:17:37 +10:00
stack 0eae729ffa HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; FIX complaint about grep device 2015-11-03 06:24:34 -08:00
stack 870c74e270 HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; ADD EXTRA COMMENTARY 2015-11-02 22:12:40 -08:00
stack a82d55e3cf HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies 2015-11-02 22:01:10 -08:00
stack 950050e9d6 Revert "HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan)"
Revert because I overcommitted, included files from another patch.

This reverts commit 47659200ac.
2015-11-02 08:06:34 -08:00
stack 47659200ac HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan) 2015-11-01 22:22:59 -08:00
Misty Stanley-Jones 51693b9cde HBASE-14642 Update website-publishing script 2015-10-20 16:31:20 +10:00
stack ba3d474f8a Add comment to test-patch.sh that the zombie killing code is copy/pasted up into jenkins as after-task 2015-10-14 09:58:04 -07:00
stack 94bfe909af HBASE-14589 Builds are being killed... 2015-10-14 00:29:52 -07:00
stack 08df55defc Add date on the test-patch.sh so I can see what version of this patch is running 2015-10-13 20:45:50 -07:00
stack 6323cd9544 HBASE-14593 Add more info on zombies to test-patch.sh; ADD EVEN MORE 2015-10-13 07:53:57 -07:00
stack ac82a86320 HBASE-14593 Add more info on zombies to test-patch.sh 2015-10-12 15:57:28 -07:00
stack 4beefd8ce4 HBASE-14349 pre-commit zombie finder is overly broad; ADDENDUM 2015-10-08 13:04:25 -07:00
stack e1fd3526b1 HBASE-14349 pre-commit zombie finder is overly broad 2015-10-07 13:41:27 -07:00
stack 26dec4c60d HBASE-14543 Have findHangingTests.py dump more info 2015-10-02 12:16:28 -07:00
Nick Dimiduk 2ea70c7e6c HBASE-14482 Add hadoop 2.6.1 to the test-patch build list 2015-09-29 10:11:16 +02:00
stack 27a993d837 HBASE-14429 Checkstyle report is broken 2015-09-15 22:29:14 -07:00
Sean Busbey a5261b6f44 HBASE-14337 Improve test-patch to better deal with dependency licenses
* if we know we're going to fail the build via velocity template failure, output the cause in the generated LICENSE file.
* tweak test-patch workspace handling to allow for checkout of repo next to patch process
2015-09-02 10:37:02 -05:00
Nick Dimiduk 4f410e6bd5 HBASE-14318 make_rc.sh should purge/re-resolve dependencies from local repository 2015-09-01 10:28:08 -07:00
Elliott Clark fbd6ecb762 HBASE-13339 Update default Hadoop version to latest for master 2015-08-27 15:10:27 -07:00
tedyu aca8c3b74b HBASE-14310 test-patch.sh should handle spurious non-zero exit code from maven 2015-08-26 09:37:41 -07:00
Nick Dimiduk f343a1d438 HBASE-13914 Minor improvements to dev-support/publish_hbase_website.sh 2015-08-17 11:27:19 -07:00
Sean Busbey 4ce6f486d0 HBASE-14087 Ensure correct ASF headers for docs/code
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint
2015-07-29 14:25:43 -05:00
Ted Malaska 30f7d127c3 HBASE-13992 Integrate SparkOnHBase into HBase
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-07-28 11:45:23 -05:00
anoopsjohn d07ff5ec5a HBASE-13387 Add ByteBufferedCell an extension to Cell. 2015-07-09 15:35:24 +05:30
Nick Dimiduk 2df3236a4e HBASE-13948 Expand hadoop2 versions built on the pre-commit 2015-06-24 14:05:46 -07:00
Nick Dimiduk 578adca6ee Revert "HBASE-13948 Expand hadoop2 versions built on the pre-commit"
This reverts commit 9db3ea3406.
2015-06-24 08:24:38 -07:00
Nick Dimiduk 8545d5d6f4 Revert "HBASE-13948 Expand hadoop2 versions built on the pre-commit (addendum)"
This reverts commit 645d7ece12.
2015-06-24 08:24:13 -07:00
Nick Dimiduk 645d7ece12 HBASE-13948 Expand hadoop2 versions built on the pre-commit (addendum) 2015-06-23 20:50:33 -07:00
Nick Dimiduk 9db3ea3406 HBASE-13948 Expand hadoop2 versions built on the pre-commit 2015-06-23 09:46:12 -07:00
anoopsjohn 8ae4b374e3 HBASE-13916 Create MultiByteBuffer an aggregation of ByteBuffers. 2015-06-18 22:38:10 +05:30
Nick Dimiduk 41d9e8d9b4 HBASE-13929 make_rc.sh publishes empty shaded artifacts 2015-06-17 19:39:06 -07:00
Gábor Lipták 624a169d9d HBASE-13666 Correct PDF renaming and bump version of maven-antrun-plugin 2015-06-17 18:58:28 -07:00
Sean Busbey a10a82a8ff HBASE-13910 update precommit test to check branch-1.2 patches. 2015-06-15 23:22:37 -05:00
Nick Dimiduk f0a1ca4a6f HBASE-13761 Optimize FuzzyRowFilter (Vladimir Rodionov) 2015-05-28 10:12:21 -07:00