Commit Graph

634 Commits

Author SHA1 Message Date
Sean Busbey c19fbf2be0 HBASE-20501 update minimum supported Hadoop version to 2.7.1.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-30 21:22:42 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
Sean Busbey 1792f541c6 HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:04:50 -05:00
Sean Busbey dace8ff2a4 HBASE-20591 nightly job needs to enable maven build system.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:40:56 -05:00
Mike Drob e6220c8b60 Revert "HBASE-20478 move hbaseanti import checks to checkstyle"
Need to update version of checkstyle used for new features.

This reverts commit 90d103d6d5.
2018-04-26 13:36:13 -05:00
Mike Drob 90d103d6d5 HBASE-20478 move hbaseanti import checks to checkstyle
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 09:28:59 -05:00
Nihal Jain d4768114e8 HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 07:54:25 -05:00
Sean Busbey f4a39043e2 HBASE-20388 nightly tests running on a feature branch should only comment on that feature branch's jira
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-21 13:50:40 -05:00
Nihal Jain 8219ec7493 HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 11:54:01 -05:00
Sean Busbey 0a31ea4858 HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:30:43 -05:00
Sean Busbey 7b7a2222b6 HBASE-20389 Move website building flags into a profile.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 22:43:19 -05:00
Sean Busbey f695ecb2db HBASE-20335 ensure each stage of the nightly job gathers machine information.
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 22:42:37 -05:00
Sean Busbey 2f74afd6f4 HBASE-20379 shadedjars yetus plugin should add a footer link
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:40:35 -05:00
Sean Busbey 8f1ac01ad8 HBASE-20112 register nightly junit over hadoop3 results with jenkins.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:37:50 -05:00
Mike Drob 70d23214fb HBASE-20356 Make skipping protoc possible 2018-04-12 13:31:54 -05:00
Michael Stack 3eda9f1bb3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:18:21 -07:00
Sean Busbey a2c1be9a76 HBASE-20335 nightly job bash cleanup.
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:33:14 -05:00
Sean Busbey 83ee82d6a0 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:33:14 -05:00
Sean Busbey ee87de9bfd HBASE-15466 test personality should recognize docs-only patch.
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:37:28 -05:00
Apekshit Sharma dcc840e8a5 HBASE-17730 Add documentation to upgrade coprocessors for 2.0 2018-04-04 13:08:22 -07:00
Apekshit Sharma 6318e3bf5f HBASE-17730 Migration to 2.0 for coprocessors. Upload AsciiDoc for coprocessor design improvements made in HBASE-17732. 2018-04-03 15:47:48 -07:00
Sean Busbey d8b550fabc HBASE-20308 Dockerfile for test must include git.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-28 18:07:36 -05:00
Mike Drob 9342e0091d HBASE-20153 Add error prone to precommit 2018-03-12 16:06:57 -05:00
Sean Busbey 15da74ccee HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 17:22:00 -06:00
Mike Drob 28279697c2 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:40:28 -06:00
Sean Busbey 8e0674a2eb HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:12:36 -06:00
Sean Busbey ff7f5ecb0f HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-06 12:22:09 -06:00
Sean Busbey 485af49e53 HBASE-20070 addendum for missing echo. Website generation is failing. 2018-03-04 09:03:19 +05:30
Michael Stack 2b1b2c8490 HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and
master
2018-03-03 07:35:23 -08:00
Sean Busbey 2a65066b35 HBASE-20070 refactor website generation
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2018-03-02 09:25:10 -06:00
Sean Busbey c415ddb38c HBASE-20075 remove logic for branch-1.1 nightly testing
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:28:30 -06:00
Sean Busbey 383b7cc592 HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:21:40 -06:00
Sean Busbey ddc9af9027 HBASE-18467 report nightly results to devs via jira
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 13:11:59 -06:00
Alex Leblang 96ebab748f HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:52:15 -06:00
Josh Elser e47d1e443e HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 09:51:10 -05:00
Michael Stack a2bc19aa11 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; AMENDMENT hardcode proclimit and docker memlimit in nightly script... 2018-02-01 20:54:13 -08:00
Michael Stack cb7bfc21da HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; REAPPLY TO TEST 2018-02-01 20:27:28 -08:00
Michael Stack 18eec8c1a5 Revert "HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies"
This reverts commit 2e6bc12441.
2018-02-01 18:04:23 -08:00
Michael Stack 5f5ddf5541 HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- remove docker mem sizing for the moment... 2018-02-01 16:39:27 -08:00
Michael Stack 0db7db3cd1 HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- up proclimit from 6k to 10k and set Docker memory limit of 20G (default is 4G) 2018-02-01 14:08:04 -08:00
Michael Stack 2e6bc12441 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies 2018-01-30 22:25:24 -08:00
Michael Stack 08bcd64c25 Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir"
Doesn't work. Reverting.

This reverts commit 1ca06d9eea.
2018-01-30 12:01:52 -08:00
Michael Stack 1ca06d9eea HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir 2018-01-30 11:53:09 -08:00
Michael Stack 67f91f1282 HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:34:40 -08:00
Michael Stack 9b8d7e0aef HBASE-19891 Up nightly test run timeout from 6 hours to 8 2018-01-29 22:14:47 -08:00
Apekshit Sharma 9917244be2 HBASE-19789 Not exclude flaky tests from nightly builds. 2018-01-16 10:07:48 -08:00
Michael Stack 4ddfecac56 HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1
M dev-support/make_rc.sh
  Disable checkstyle building site. Its an issue being fixed over in HBASE-19780

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  The clusterid was being set into the process only after the
  regionserver registers with the Master. That can be too late for some
  test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
  as it goes to run which could be before Master had called its run
  method  which is regionserver run method which then calls back to the
  master to register itself... and only then do we set the clusterid.
  HBASE-19694 changed start order which made it so this test failed.
  Setting the clusterid right after we set it in zk makes the test pass.

  Another change was that backup masters were not going down on stop.
  Backup masters were sleeping for the default zk period which is 90
  seconds. They were not being woken up to check for stop. On stop
  master now tells active master manager.

M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
  Prevent creation of acl table. Messes up our being able to go down
  promptly.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
  Disabled for now because it wants to run with regions on the Master...
  currently broke!

M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
  Add a bit of debugging.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
  Disabled. Fails 40% of the time.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
  Disabled. Fails 33% of the time.

Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
2018-01-12 14:09:56 -08:00
Niels Basjes 8ae2a2150b HBASE-19674: Improve make_patch.sh
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2018-01-07 14:41:40 +01:00
Michael Stack 9d02e37a8a
HBASE-19659 Enable -x in make_rc.sh so logs where it is in execution 2017-12-28 14:31:54 -08:00
Apekshit Sharma a4272a9f08 HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:44:04 -08:00
Apekshit Sharma 6cefabee26 HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE. 2017-12-21 10:46:43 -08:00
Apekshit Sharma dc5ec061b5 HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master. 2017-12-20 17:58:08 -08:00
Apekshit Sharma 2a5e5e9e2c HBASE-19526 Update hadoop version to 3.0 GA 2017-12-17 19:10:04 -08:00
Apekshit Sharma 1b822b60b5 HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck". Updates hadoop version to 3.0.0-beta1. 2017-12-12 23:22:04 -08:00
Apekshit Sharma 5b7f9c2535 HBASE-19382 Update report-flakies.py script to handle yetus builds. 2017-11-29 22:21:10 -08:00
Sean Busbey 7406c83ef6 HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-13 22:35:10 -06:00
Apekshit Sharma 41f6bf6b89 HBASE-19246 Trivial fix in findHangingTests.py to make it not stop on finding 'bad string'. 2017-11-13 11:44:43 -08:00
Sean Busbey 35a1e43348 HBASE-19227 Nightly job should archive JVM dumpstream files.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 23:18:18 -06:00
Sean Busbey ead8f9364c HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 16:16:15 -06:00
Sean Busbey 36233e72c1 HBASE-19228 nightly job should gather machine stats.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:06:24 -06:00
Sean Busbey b71544fe4d HBASE-19189 Ad-hoc test job for running a subset of tests lots of times
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:02:13 -06:00
Sean Busbey 7bdff754f0 HBASE-19184 Update nightly source artifact check to use git archive for making the tarball.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 08:28:29 -06:00
Andrew Purtell 46408e021d HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1) 2017-11-07 12:37:36 -08:00
Sean Busbey 3e4b86d4d6 HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:32:35 -05:00
Michael Stack 4857cbd762
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script; AMENDMENT adding generation of hashes 2017-11-03 10:06:55 -07:00
Michael Stack 4edfa06564
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-03 09:52:28 -07:00
Sean Busbey 0ff9dabe6c HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:31:19 -05:00
Sean Busbey 91273e7b0e HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:55:32 -05:00
Sean Busbey 60aa1c228a HBASE-19098 compatibility checker should handle remotes named something other than 'origin'.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-10-26 16:09:17 -05:00
Sean Busbey 5255ae6dfa HBASE-19030 nightly runs should attempt to log test results after archiving.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:32:13 -05:00
Misty Stanley-Jones eee3b0180e HBASE-19054 switch precommit image to one from maven
Amending Author: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 14:51:16 -05:00
Sean Busbey cda2949b81 HBASE-19070 temporarily make the mvnsite nightly test non-voting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:06:58 -05:00
Chia-Ping Tsai a31e8e34ea HBASE-19066 Correct the directory of openjdk-8 for jenkins
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:18:47 -05:00
Chia-Ping Tsai cb5c4776de HBASE-19058. The wget isn't installed in building docker image
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-20 20:35:33 -05:00
Sean Busbey b10ad9e97f HBASE-19039 refactor shadedjars test to only run on java changes.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:20 -05:00
Sean Busbey dd4dbae764 HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:14 -05:00
Mike Drob 5facaded90 HBASE-16338 Remove Jackson1 deps
* Change imports from org.codehaus to com.fasterxml
* Exclude transitive jackson1 from hadoop and others
* Minor test cleanup to add assert messages, fix some parameter order
* Add anti-pattern check for using jackson 1 imports
* Add explicit non-null serialization directive to ScannerModel
2017-10-20 09:20:12 -05:00
zhangduo af479c580c HBASE-19042 Oracle Java 8u144 downloader broken in precommit check
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-19 15:53:52 -05:00
zhangduo 4a7b430397 Revert "HBASE-19042 Oracle Java 8u144 downloader broken in precommit check"
This reverts commit 9e688117ba.
2017-10-19 16:03:28 +08:00
zhangduo 9e688117ba HBASE-19042 Oracle Java 8u144 downloader broken in precommit check 2017-10-19 15:32:48 +08:00
Dima Spivak 3acb081787 HBASE-18418 Remove apache_hbase_topology from dev-support 2017-10-18 14:08:26 -07:00
Mike Drob c16eb7881f HBASE-19038 precommit mvn install should run from root on patch 2017-10-18 10:41:17 -05:00
Apekshit Sharma 5368fd5bf0 HBASE-19032 Set mimetype for patches uploaded by submit-patch.py
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
2017-10-17 15:43:07 -07:00
Mike Drob f6a8a76b50 HBASE-18505 Yetus only run root when all modules changed 2017-10-13 12:12:07 -05:00
Sean Busbey 087edf0172 HBASE-18934 pick hadoop versions for precommit test after patch branch is determined.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-09 11:31:55 -05:00
Josh Elser 869b90c612 HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality 2017-10-01 15:46:24 -04:00
Michael Stack b5b4108fce HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732; MINOR AMENDMENT adding README to design-doc dir 2017-09-28 13:24:40 -07:00
Apekshit Sharma 74d0adce61 HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732
- Change Service Coprocessor#getService() to List<Service> Coprocessor#getServices()
- Checkin the finalized design doc into repo
- Added example to javadoc of Coprocessor base interface on how to implement one in the new design
2017-09-28 10:25:47 -07:00
Sean Busbey efb95a1794 HBASE-18834 fix shellcheck warning on hbase personality
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
2017-09-18 08:54:37 -05:00
Sean Busbey 4b124913f0 HBASE-17823 Migrate to Apache Yetus Audience Annotations
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2017-09-12 20:53:30 -05:00
Sean Busbey 79d9f7a734 HBASE-18760 Make hbase-shaded-check-invariants part of precommit
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-09-10 23:11:01 -05:00
Umesh Agashe 5d60123f3e HBASE-18674 upgrading to commons-lang3
Signed-off-by: Michael Stack <stack@apache.org>
2017-09-05 09:46:10 -07:00
Michael Stack 47a5614edd Revert "HBASE-18674 upgrading to commons-lang3"
Premature push

This reverts commit 5dacc85122.
2017-08-28 16:41:34 -07:00
Umesh Agashe 5dacc85122 HBASE-18674 upgrading to commons-lang3 2017-08-28 15:57:12 -07:00
Tamas Penzes 158f3da167 HBASE-18607: fix submit-patch.py to support utf8
one liner to support utf8 content

Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-08-25 00:04:19 -07:00
Esteban Gutierrez c37432fefb HBASE-18563 Fix RAT License complaint about website jenkins scripts 2017-08-10 20:08:03 -05:00
Misty Stanley-Jones 6114824b53 HBASE-18548 Move sources of website gen and check jobs into source control 2017-08-10 14:48:14 -07:00
Sean Busbey 7e7461e42a HBASE-18527 Update nightly job to account for changes in jenkins plugins.
- Stop presuming job will be configured with checkout into a 'component' dir
 - Disable autocheckout
 - Specify checkout within 'component' dir
 - leave the workspace around on pipeline failure so we can browse it.
2017-08-07 11:24:00 -05:00
Sean Busbey 2a717459bd HBASE-14220 nightly check that we can build a source tarball.
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-06 12:01:47 -05:00
Sean Busbey 04424ad65f HBASE-18426 nightly job should use independent stages to check supported jdks
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-06 11:59:45 -05:00
Jan Hentschel 7da47509d2 HBASE-15042 Moved site materials to standard Maven place
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-05 15:22:46 +08:00
Alex Leblang 2bde7a1077 HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems

Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey

Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-08-04 12:05:10 -05:00
Sean Busbey bdc94b1d6b HBASE-18147 POC jenkinsfile for nightly checks.
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile

Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2017-07-20 17:07:33 -05:00
Apekshit Sharma ea0062fa54 HBASE-18376 Add debug logs to hbase-personality.sh to make it possible to debug this issue.
Change-Id: I172b95ed6a387ddb507abc6645a0c3aa704321fc
2017-07-14 12:33:42 -07:00
Mike Drob 500592dfd0 HBASE-18339 Update to hadoop3-alpha4
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-07-13 10:03:03 -05:00
Apekshit Sharma 7d08c78103 HBASE-18341 (addendum) Replace '.' in test names with '_' when using them as html ids since
dot have special significance in CSS selectors.
Without it, we weren't able to select elements and add svg (trends columns) to them.

Change-Id: Ia63ff0851f0a2fad0789a24edf2f0ad00060d578
2017-07-10 12:04:05 -07:00
Apekshit Sharma 590f02aad0 HBASE-18341 Generalize regex matchers in findHangingTests.py script to match new consoleText of trunk build.
Change-Id: I0a4215827d3d561eef3f583da666c617f690d934
2017-07-08 00:50:20 -07:00
Sean Busbey 30d06dfe3a HBASE-18327 redo test-patch personality 'hadoopcheck' to better account for feature branches
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-07-07 23:07:50 -04:00
zhangduo 58b377751a HBASE-18179 Add new hadoop releases to the pre commit hadoop check 2017-06-14 14:20:01 +08:00
zhangduo f5768b4306 HBASE-18200 Set hadoop check versions for branch-2 and branch-2.x in pre commit 2017-06-13 16:31:34 +08:00
Apekshit Sharma 7a535f5843 HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
Use https for fetching d3 since builds.apache.org is also https. Otherwise d3 script is not loaded (unless browser is explicitly told to do so) and the fancy status markers are not drawn.

Change-Id: I97f7402141717da77499d09e44b05ecdd35c5a6f
2017-05-19 00:29:37 -07:00
Apekshit Sharma 7a0a66072d HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
Change-Id: I43851c52723de3d89ea4ca5fa49c86a178afba26
2017-05-18 19:10:19 -07:00
Apekshit Sharma c51c36fd1f HBASE-18076 Flaky dashboard improvement: Add status markers to show trends of failure/success. 2017-05-18 19:03:11 -07:00
Apekshit Sharma 841bb00655 HBASE-18044 Fix bug in report-flakies.py where if counter is set outside for loop, it cannot be overwritten inside loop.
http://stackoverflow.com/questions/7537439/how-to-increment-a-variable-on-a-for-loop-in-jinja-template

Change-Id: Ic404d6360fb646e6490d1487374520f9550b76b4
2017-05-15 14:15:57 -07:00
Josh Elser 757bf379c1 HBASE-17985 Inline apt-get update calls in Yetus Dockerfile 2017-05-02 17:33:18 -04:00
CHIA-PING TSAI fe3c32ebd5 HBASE-17809 cleanup unused class 2017-03-23 14:15:28 +08:00
Apekshit Sharma 41be3bc2cc HBASE-17593 Update hadoop 3 version to 3.0.0-alpha2.
Change-Id: Ic5411229aaab3d645dc6751ecfbbda1b2d93a4b9
2017-02-06 12:18:21 -08:00
Michael Stack 8f8daafee0 HBASE-17228 precommit grep -c ERROR may grab non errors I tested this by doing `cat /tmp/some_file_with_ERROR_combos|grep -c '\[ERROR\]'
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-02 08:51:21 -08:00
zhangduo 8d52d23c77 HBASE-17074 PreCommit job always fails because of OOM 2016-11-15 08:29:24 +08:00
Michael Stack c3b98b87fb HBASE-16955 Fixup precommit protoc check to do new distributed protos and pb 3.1.0 build 2016-11-08 12:49:12 -08:00
Michael Stack 339017f0f6 HBASE_16963 Fixup our hbase-personality post YETUS-322 flip verify_
result codes

This patch is about updating our hbase-personality for yetus.
Basic yetus methods flipped what was true and false but we did
not adjust our usage in accordance on an update. See
YETUS-322 flip verify_ result codes. I need this in place so I
can prove that there is nothing I have to do for this the parent
issue  HBASE-16955 after I commit HBASE-16952, the revamp of how
we do proto generation. After HBASE-16952 the protoc check will do the
right thing in all cases (pb2.5 vs pb3.1 and we run the protoc
in any module that has protos in it)
2016-10-28 15:34:50 -07:00
zhangduo 187ff190ed HBASE-16887 Allow setting different hadoopcheck versions in precommit for different branches 2016-10-24 09:58:21 +08:00
Jonathan M Hsieh 1b005f30e4 HBASE-16733 add hadoop 3.0.0-alpha1 to precommit checks 2016-10-18 01:30:03 -07:00
Apekshit Sharma de7316b11e HBASE-16720 Sort build ids in flaky dashboard.
Change-Id: Ie44c7d699486a3468c92351c0e2146151e722764
2016-09-27 15:40:43 -07:00
Jerry He 2765b9d9d9 HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes) 2016-09-24 16:07:25 -07:00
zhangduo 7bda5151ee HBASE-16591 Add a docker file only contains java 8 for running pre commit on master 2016-09-11 13:02:36 +08:00
zhangduo 1da0a48f6b HBASE-16535 Use regex to exclude generated classes for findbugs 2016-08-31 14:42:32 +08:00
Apekshit Sharma 0d6c4d92ed HBASE-16434
- Add date and count of flaky tests
- Sort tests by decreasing order of flakyness
- Internal links to each job's results
- Correct calculation of total bad runs for a test
- Fixes pylint errors

Change-Id: I12ebc32ccec14c5ff389464b4de8ae93653c876c
2016-08-19 09:55:29 -07:00
Apekshit Sharma 7999bb9bd3 HBASE-16384 Update report-flakies.py script to allow specifying a list of build ids to be excluded.
Also fixes some pylint errors.

Change-Id: I4620756c277c36a1ddb6d6cbd4d3e380da8442d7
2016-08-17 13:45:22 -07:00
Dima Spivak ccf5d27d7a HBASE-12721 Create Docker container cluster infrastructure to enable better testing
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-17 12:03:47 -07:00
Jurriaan Mous 938ee73e7c HBASE-15882 Upgrade to yetus precommit 0.3.0
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-06 01:23:20 -05:00
Dima Spivak 9454daf25b HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh
* Also some trivial cleanup of spacing to undo poor formatting decisions
  of the past.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-19 07:27:32 -05:00
Dima Spivak 1fbded61c1 HBASE-16124 Make check_compatibility.sh less verbose when building HBase
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 10:21:16 -05:00
Dima Spivak 294c2dae9e HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7
* This commit also fixes some stray tabs that got into the script at
  some point.

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-29 11:26:52 -05:00
Dima Spivak ef90ecc00c HBASE-16073 update compatibility_checker for jacc dropping comma sep args
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-21 15:47:41 -05:00
Apekshit Sharma f283ff01aa HBASE-16038 Ignore JVM crashes or machine shutdown failures in report-flakies.
Change-Id: If49acd704e827b289c75f449a6180038b297d647
2016-06-15 16:01:49 -07:00
Apekshit 9593a9f396 HBASE-15938 submit-patch.py: Don't crash if there are tests with same name. Refactor: Split out flaky dashboard html template to separate file. (Apekshit)
Change-Id: Ie5875bdefbf886984a57dfc85661be2ac9592a7b

Signed-off-by: stack <stack@apache.org>
2016-06-02 08:55:42 -07:00
Apekshit eb64cd9dd1 HBASE-15917 Addendum. Fix bug in report-flakies.py where hanging tests are not being added to flaky list. (Apekshit)
ADDENDUM #2!

Change-Id: I9c55932d0f9e65b72ec8d3ae714144536b2bfe0a

Signed-off-by: stack <stack@apache.org>
2016-05-31 10:16:40 -07:00
Apekshit 75c2360543 HBASE-15918 Cleanup excludes/includes file after use in hbase-personality.sh to avoid asf license error. (Apekshit)
Change-Id: I3a47113ef9f598f90357b7cb580cbdc56f3c46f4

Signed-off-by: stack <stack@apache.org>
2016-05-30 21:30:19 -07:00
Apekshit f0a1e22441 HBASE-15917 Addendum. Add jija2 to python requirements. It's used by report-flakies.py to build the dashboard. (Apekshit)
ADDENDUM!!!

Change-Id: I8d30986e204463d1ea26b4a70e2f26915c99bdfc

Signed-off-by: stack <stack@apache.org>
2016-05-30 21:16:33 -07:00
Apekshit 0923346b61 HBASE-15917 Flaky tests dashboard. (Apekshit)
Change-Id: If0e4299b173d3d76e0bdb12a3de080e5b51d8748

Signed-off-by: stack <stack@apache.org>
2016-05-30 20:54:01 -07:00
Apekshit 74442fde0f HBASE-15909 Use Yetus' patch naming rules in submit-patch.py. (Apekshit)
Change-Id: I4d71c94da550efe8b24ea73edcde73d9bba84b8a

Signed-off-by: stack <stack@apache.org>
2016-05-28 21:55:17 -07:00
Apekshit 36bd7d03fc HBASE-15896 ADDENDUM Add timeout tests to flaky list from report-flakies.py.
Adding the diff between the original patch approved and the one committed as addendum.

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-27 16:39:13 -07:00
Sean Busbey d50cf9972d HBASE-15895 Remove unmaintained jenkins build analysis tool.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Dima Spivak <dspivak@cloudera.com>
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Apekshit <apeksharma@gmail.com>
2016-05-27 16:38:39 -07:00
Apekshit aa016c78a7 HBASE-15896 Add timeout tests to flaky list from report-flakies.py - Adds timed-out tests to flaky list. Dumpes two new files for reference, 'timeout' and 'failed' for corresponding list of bad tests. - Set --max-builds for different urls separately. This is needed so that we can turn the knobs for post-commit job and flaky-tests job separately. (Apekshit)
Change-Id: I88e1f9a8924eed1b5010106e73edede3aff34b0b

Signed-off-by: stack <stack@apache.org>
2016-05-27 07:34:10 -07:00
Apekshit 3ffaa116fe HBASE-15892 Script to create patch, upload it to jira, and update review board. (Apekshit)
Change-Id: I920760980b0a715f1e9945b930d923fd543b450b

Signed-off-by: stack <stack@apache.org>
2016-05-26 08:44:26 -07:00
Elliott Clark c12eaa5cc4 HBASE-15725 make_patch.sh should add the branch name when -b is passed. -- addendum 2016-05-17 09:05:53 -07:00
Elliott Clark 0e281e1929 HBASE-15725 make_patch.sh should add the branch name when -b is passed. 2016-05-13 14:02:00 -07:00
Apekshit 2eced6f039 HBASE-15807 - Update report-flakies.py to look for "FAILED" status in test report. - Remove duplicate testcase names in the result
Tested:
Ran it manually.

(Apekshit)

Change-Id: I2a7751eefe729b2a69c0f78596f72b6a0eb39b66

Signed-off-by: stack <stack@apache.org>
2016-05-09 11:51:16 -07:00
Nick Dimiduk 58888e0911 HBASE-15738 Ensure artifacts in project dist area include required md5 file 2016-05-08 18:06:31 -07:00
Dima Spivak fa9fdfee2d HBASE-15729 Remove old JDiff wrapper scripts in dev-support
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-04 13:28:17 -05:00
Apekshit e1bf3a66fc HBASE-15708 Docker for dev-support scripts. (Apekshit)
Change-Id: Ifb49125e940a8bacdff54247df8f2a75c6069c54

Signed-off-by: stack <stack@apache.org>
2016-04-27 15:21:28 -07:00
Apekshit e5d01577e4 HBASE-15689 Changes in hbase-personality.sh to include/exclude tests run by maven. (Apekshit)
Change-Id: I517e7a9ba3321cb19d1eeb1d46d62628213b8bbb
2016-04-25 16:27:54 -07:00
Apekshit 57e1dbc8a6 HBASE-15651 Script to report flaky tests. (Apekshit)
Change-Id: I5cd5c23985b8c3f928d7ab44e57606b0a5478f15

Signed-off-by: stack <stack@apache.org>
2016-04-21 16:16:06 -07:00
Jonathan M Hsieh b3e71d4644 HBASE-15434 [findbugs] Exclude scala generated source and protobuf generated code in hbase-spark module 2016-03-10 11:42:25 -08:00
stack 9955118995 HBASE-15195 Don't run findbugs on hbase-it; it has nothing in src/main/java 2016-01-31 11:07:21 -04:00
Nick Dimiduk 55bb5ff7fb HBASE-15119 Include git SHA in check_compatibility reports 2016-01-19 21:29:58 -08:00
Sean Busbey 164aeb5399 HBASE-13525 replace test-patch with customizations needed to use yetus
Signed-off-by: stack <stack@apache.org>
2016-01-08 07:39:40 -06:00
stack a999c2a010 Re-add zombie test and add return of result of test running 2015-12-28 13:23:23 -08:00
stack 3fca9a9f3f Try this change to see how it effects overall rating... 2015-12-28 13:23:23 -08:00
stack 53e5d27a80 HBASE-15021 hadoopqa doing false positives 2015-12-21 22:16:38 -08:00
tedyu 80afb839ec HBASE-14917 Log in console if individual tests in test-patch.sh fail or pass (Appy) 2015-12-04 19:16:01 -08:00
Dima Spivak 4f36632d7b HBASE-14930 check_compatibility.sh needs smarter exit codes
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-12-04 18:55:52 -08:00
stack 7117a2e35d HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- yet more formatting 2015-12-03 14:11:01 -08:00
stack 5e430837d3 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- fix indent 2015-12-03 14:01:22 -08:00
stack a154ecda00 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- export JIRA_COMMENT so subshell zombie detector picks up current content 2015-12-03 10:05:05 -08:00
stack 69658ea4a9 HBASE-14772 Improve zombie detector; be more discerning; part2; addendum -- extra 'tick' 2015-12-02 20:47:59 -08:00
stack cf8d3bd641 HBASE-14772 Improve zombie detector; be more discerning; part2 2015-12-02 17:44:49 -08:00
stack cbbad6e5fb Add small note so we know for sure the zombie script is running 2015-12-01 17:05:34 -08:00
Apekshit(Appy) Sharma efb5917f22 HBASE-14859 Better checkstyle reporting. Reports file names, error names and old/new error counts. Fix some checks. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-25 12:18:40 -08:00
Elliott Clark 4cc341b9c2 HBASE-14871 Allow specifying the base branch for make_patch 2015-11-24 11:59:49 -08:00
stack 44367f55e8 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM fix zombie-detectors' handling of no processes -- was treating no processes as one possible zombie 2015-11-09 13:43:43 -10:00
stack 0af651bde5 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM -- remove zombie detection from test-patch.sh and rely on script instead 2015-11-09 07:12:27 -10:00
stack 4c2e0d95dc HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM Add
logging date when reporting all is well.
2015-11-08 21:00:28 -10:00
stack 1cbcf1175e HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM some cleanup in zombie script and run it in test-patch too .. just trying it 2015-11-08 11:09:31 -10:00
stack 305ecaf224 HBASE-14772 Improve zombie detector; be more discerning; ADDENDUM set execute perms on the script 2015-11-07 15:00:08 -10:00
stack bea2f7feac HBASE-14772 Improve zombie detector; be more discerning 2015-11-06 16:39:15 -10:00
Misty Stanley-Jones c585072bc3 HBASE-14762 Update docs about publishing website to show gitsubpub method instead of svnsubpub
Also some reformatting to remove trailing whitespace and rewrap long lines.
2015-11-05 09:17:37 +10:00
stack 0eae729ffa HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; FIX complaint about grep device 2015-11-03 06:24:34 -08:00
stack 870c74e270 HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies; ADD EXTRA COMMENTARY 2015-11-02 22:12:40 -08:00
stack a82d55e3cf HBASE-14589 Looking for the surefire-killer; builds being killed...; ADDENDUM; purge killing of zombies 2015-11-02 22:01:10 -08:00
stack 950050e9d6 Revert "HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan)"
Revert because I overcommitted, included files from another patch.

This reverts commit 47659200ac.
2015-11-02 08:06:34 -08:00
stack 47659200ac HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan) 2015-11-01 22:22:59 -08:00
Misty Stanley-Jones 51693b9cde HBASE-14642 Update website-publishing script 2015-10-20 16:31:20 +10:00
stack ba3d474f8a Add comment to test-patch.sh that the zombie killing code is copy/pasted up into jenkins as after-task 2015-10-14 09:58:04 -07:00
stack 94bfe909af HBASE-14589 Builds are being killed... 2015-10-14 00:29:52 -07:00
stack 08df55defc Add date on the test-patch.sh so I can see what version of this patch is running 2015-10-13 20:45:50 -07:00
stack 6323cd9544 HBASE-14593 Add more info on zombies to test-patch.sh; ADD EVEN MORE 2015-10-13 07:53:57 -07:00
stack ac82a86320 HBASE-14593 Add more info on zombies to test-patch.sh 2015-10-12 15:57:28 -07:00
stack 4beefd8ce4 HBASE-14349 pre-commit zombie finder is overly broad; ADDENDUM 2015-10-08 13:04:25 -07:00
stack e1fd3526b1 HBASE-14349 pre-commit zombie finder is overly broad 2015-10-07 13:41:27 -07:00
stack 26dec4c60d HBASE-14543 Have findHangingTests.py dump more info 2015-10-02 12:16:28 -07:00
Nick Dimiduk 2ea70c7e6c HBASE-14482 Add hadoop 2.6.1 to the test-patch build list 2015-09-29 10:11:16 +02:00
stack 27a993d837 HBASE-14429 Checkstyle report is broken 2015-09-15 22:29:14 -07:00
Sean Busbey a5261b6f44 HBASE-14337 Improve test-patch to better deal with dependency licenses
* if we know we're going to fail the build via velocity template failure, output the cause in the generated LICENSE file.
* tweak test-patch workspace handling to allow for checkout of repo next to patch process
2015-09-02 10:37:02 -05:00
Nick Dimiduk 4f410e6bd5 HBASE-14318 make_rc.sh should purge/re-resolve dependencies from local repository 2015-09-01 10:28:08 -07:00
Elliott Clark fbd6ecb762 HBASE-13339 Update default Hadoop version to latest for master 2015-08-27 15:10:27 -07:00
tedyu aca8c3b74b HBASE-14310 test-patch.sh should handle spurious non-zero exit code from maven 2015-08-26 09:37:41 -07:00
Nick Dimiduk f343a1d438 HBASE-13914 Minor improvements to dev-support/publish_hbase_website.sh 2015-08-17 11:27:19 -07:00
Sean Busbey 4ce6f486d0 HBASE-14087 Ensure correct ASF headers for docs/code
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint
2015-07-29 14:25:43 -05:00
Ted Malaska 30f7d127c3 HBASE-13992 Integrate SparkOnHBase into HBase
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-07-28 11:45:23 -05:00
anoopsjohn d07ff5ec5a HBASE-13387 Add ByteBufferedCell an extension to Cell. 2015-07-09 15:35:24 +05:30
Nick Dimiduk 2df3236a4e HBASE-13948 Expand hadoop2 versions built on the pre-commit 2015-06-24 14:05:46 -07:00
Nick Dimiduk 578adca6ee Revert "HBASE-13948 Expand hadoop2 versions built on the pre-commit"
This reverts commit 9db3ea3406.
2015-06-24 08:24:38 -07:00
Nick Dimiduk 8545d5d6f4 Revert "HBASE-13948 Expand hadoop2 versions built on the pre-commit (addendum)"
This reverts commit 645d7ece12.
2015-06-24 08:24:13 -07:00
Nick Dimiduk 645d7ece12 HBASE-13948 Expand hadoop2 versions built on the pre-commit (addendum) 2015-06-23 20:50:33 -07:00
Nick Dimiduk 9db3ea3406 HBASE-13948 Expand hadoop2 versions built on the pre-commit 2015-06-23 09:46:12 -07:00
anoopsjohn 8ae4b374e3 HBASE-13916 Create MultiByteBuffer an aggregation of ByteBuffers. 2015-06-18 22:38:10 +05:30
Nick Dimiduk 41d9e8d9b4 HBASE-13929 make_rc.sh publishes empty shaded artifacts 2015-06-17 19:39:06 -07:00
Gábor Lipták 624a169d9d HBASE-13666 Correct PDF renaming and bump version of maven-antrun-plugin 2015-06-17 18:58:28 -07:00
Sean Busbey a10a82a8ff HBASE-13910 update precommit test to check branch-1.2 patches. 2015-06-15 23:22:37 -05:00
Nick Dimiduk f0a1ca4a6f HBASE-13761 Optimize FuzzyRowFilter (Vladimir Rodionov) 2015-05-28 10:12:21 -07:00
Andrey Stepachev a7e77821d2 HBASE-13648 test-patch.sh should ignore 'protobuf.generated' 2015-05-08 18:10:25 +01:00
Nick Dimiduk 51ce568d6c HBASE-13600 check_compatibility.sh should ignore shaded jars 2015-04-30 11:57:01 -07:00
anoopsjohn d88a4180f7 HBASE-13595 Fix Javadoc warn induced in Bytes.java. 2015-04-30 20:58:25 +05:30
Nick Dimiduk 7fb6055ed7 add branch-1.1 to precommit build list 2015-04-16 17:45:47 -07:00
Andrew Purtell 1632cd98ff HBASE-13341 Add option to disable filtering on interface annotations for the API compatibility report 2015-04-01 21:58:57 -07:00
Andrew Purtell 797573e1b2 HBASE-13340 Include LimitedPrivate interfaces in the API compatibility report 2015-04-01 21:58:56 -07:00
Elliott Clark 0967c6af29 HBASE-13355 QA bot reports checking javac twice 2015-03-28 10:22:55 -07:00
Elliott Clark 5d2c33158c HBASE-13342 Fix incorrect interface annotations 2015-03-27 00:19:15 -07:00
Andrey Stepachev 69f6a2e7b4 HBASE-13334 FindBugs should create precise report for new bugs introduced (addendum) 2015-03-26 08:18:15 +00:00
Andrey Stepachev a85c1d9d30 Revert "HBASE-13326 Disabled table can't be enabled after HBase is restarted (addendum)"
This reverts commit bfeb067e3a.
2015-03-26 08:17:33 +00:00
Andrey Stepachev bfeb067e3a HBASE-13326 Disabled table can't be enabled after HBase is restarted (addendum) 2015-03-26 08:13:42 +00:00
Andrey Stepachev 948a6a63e8 HBASE-13334 FindBugs should create precise report for new bugs introduced 2015-03-26 00:27:14 +00:00
Jonathan M Hsieh e192f5ed39 HBASE-13233 add hbase-11339 branch to the patch testing script 2015-03-17 00:51:06 -07:00
Sean Busbey dc03942ed1 HBASE-13240 Add an exemption to test-patch for build only changes. 2015-03-16 15:45:21 -05:00
Matteo Bertozzi b21fa7c652 HBASE-13228 Create procedure v2 branch and add it to QA branch list 2015-03-13 17:57:13 +00:00
Esteban Gutierrez 5bf98d0827 HBASE-13208 Patch build should match the patch filename and not the whole relative URL in findBranchNameFromPatchName
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-11 14:02:48 -05:00
Sean Busbey 9087febd21 HBASE-13191. Addendum missed one spot we hard-code MAVEN_OPTS for jenkins. 2015-03-11 13:18:43 -05:00
Sean Busbey ed93ddd94f HBASE-13191 allow jenkins params to alter MAVEN_OPTS, and default to setting more permgen. 2015-03-10 12:39:40 -05:00
Misty Stanley-Jones b4367732c8 Added PDFs to the generated content tracked by the publish_hbase_website script, enabled test to abort the automatic svn commit if it changes too many files. 2015-03-06 12:32:52 +10:00
Misty Stanley-Jones 5bd27af8b0 Fixed bug in publication script 2015-03-05 12:06:46 +10:00
Enis Soztutar 524791bcf5 HBASE-12920 hadoopqa should compile with different hadoop versions - ADDENDUM to add a new line 2015-03-03 13:41:42 -08:00
Enis Soztutar a8555f65f0 HBASE-13081 Branch precommit builds are not updating to branch head before patch application 2015-02-20 16:28:47 -08:00
Andrew Purtell f64d63d24e HBASE-13059 Set executable bit for scripts in dev-support (Dima Spivak) 2015-02-17 13:38:35 -08:00
Enis Soztutar e83444e845 HBASE-12920 hadoopqa should compile with different hadoop versions 2015-02-11 16:51:12 -08:00
Enis Soztutar c61c17b6f8 HBASE-12944 Support patches to branches in precommit jenkins build (ADDENDUM to fix branch name parsing) 2015-01-29 18:13:05 -08:00
Enis Soztutar a5613efa7b HBASE-12944 Support patches to branches in precommit jenkins build (ADDENDUM moves sourcing of .properties file to start of the script) 2015-01-29 15:30:05 -08:00
Enis Soztutar 3931910460 HBASE-12944 Support patches to branches in precommit jenkins build (ADDENDUM to fix the script) 2015-01-29 15:08:18 -08:00
Enis Soztutar eaacc5a0ce HBASE-12944 Support patches to branches in precommit jenkins build 2015-01-29 14:42:53 -08:00
Dima Spivak 15a4738470 HBASE-12808 Use Java API Compliance Checker for binary/source compatibility
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-01-28 16:29:50 -06:00
Nick Dimiduk 508085fe5a HBASE-12896 checkstyle report diff tool 2015-01-22 14:12:46 -08:00
Sean Busbey 36c9170c53 HBASE-12515 update patch tester to use git
Signed-off-by: stack <stack@apache.org>
2014-11-18 12:25:21 -08:00
Misty Stanley-Jones 9ea80f8f11 HBASE-12488 Small bug in publish_hbase_website.sh script 2014-11-17 11:59:45 +10:00
Misty Stanley-Jones 04cb138142 HBASE-12347 Improve the logic for checking JIRA status 2014-11-13 15:52:41 +10:00
stack 6d3339f25e HBASE-12438 Add -Dsurefire.rerunFailingTestsCount=2 to patch build runs so flakies get rerun 2014-11-06 12:06:28 -08:00
Misty Stanley-Jones 66b6dd1941 HBASE-12207 A script to help keep your Git repo fresh 2014-10-27 14:33:28 +10:00
stack b389ca211e Add missing license 2014-10-23 21:46:35 -07:00
Elliott Clark c623b04122 HBASE-12283 Clean up some checkstyle errors 2014-10-22 11:58:23 -07:00
Misty Stanley-Jones dfa98ab93b HBASE-12249 Addendum - Convert tabs to spaces 2014-10-22 15:18:41 +10:00
Misty Stanley-Jones d5f9a38aed HBASE-12249 Script to help you adhere to the patch-naming guidelines 2014-10-22 13:23:36 +10:00
Dima Spivak a470a1f3f3 HBASE-12316 test-patch.sh (Hadoop-QA) outputs the wrong release audit warnings URL
Signed-off-by: stack <stack@apache.org>
2014-10-21 17:18:19 -07:00
Elliott Clark 487b58313c HBASE-12261 Add checkstyle to HBase build process 2014-10-17 11:10:07 -07:00
Misty Stanley-Jones ed3be21e7f HBASE-12232 Suppress dots during svn commit in publish_hbase_website.sh 2014-10-13 16:00:11 +10:00
stack 3176dae37d Remove extraneous 'trunk' in javadoc URL 2014-10-12 15:17:09 -07:00
Ted Yu cab0819327 HBASE-12195 Fix dev-support/findHangingTests (Manukranth Kolloju) 2014-10-07 22:03:50 +00:00
Misty Stanley-Jones 7219471081 HBASE-12151 Set mode to 755 on executable scripts in dev-support directory 2014-10-03 13:06:28 +10:00
Misty Stanley-Jones 0e6d203388 Revert "Set mode to 755 on executable scripts in dev-support directory"
This reverts commit e7ac4d7141.
2014-10-03 13:05:50 +10:00
Misty Stanley-Jones e7ac4d7141 Set mode to 755 on executable scripts in dev-support directory 2014-10-03 09:58:20 +10:00
stack 4ee6a73490 Try adding javadoc url to email output 2014-10-01 16:06:27 -07:00
Misty Stanley-Jones 456e9fa7a7 HBASE-12134 publish_hbase_website.sh script can delete the website accidentally 2014-10-01 15:44:21 +10:00
Elliott Clark a5bd931682 HBASE-12059 Create hbase-annotations module 2014-09-23 16:44:14 -07:00
Matteo Bertozzi bd8df9ccd4 HBASE-11598 Add simple rpc throttling 2014-09-18 22:38:30 +01:00
Misty Stanley-Jones fdbb5e9ca3 Addendum to HBASE-11951 -- actually add the script 2014-09-18 15:48:03 +10:00
Dima Spivak 7066de6362 HBASE-11721 jdiff script no longer works as usage instructions indicate
* Add L argument to the curl pull of JDiff to handle following redirects.
* Change how Git repos are cloned to reflect how shallow clones work
  now.
* Change arguments to support BSD sed (i.e. on Mac OS X).
* chmod +x on the script.

Signed-off-by: Jonathan M Hsieh <jmhsieh@apache.org>
2014-09-10 05:27:33 -07:00
Andrew Purtell e13b629843 HBASE-11885 Provide a Dockerfile to easily build and run HBase from source (Dima Spivak) 2014-09-05 17:36:18 -07:00
Enis Soztutar aa71a8b9b9 Commented out smart -p0 handling in dev-support/smart-apply-patch.sh until we fix our jenkins env 2014-07-17 17:35:14 -07:00
Ted Yu 360df59c0d HBASE-11461 Compilation errors are not posted back to JIRA during QA run 2014-07-04 14:43:54 +00:00
stack 8f6e04c446 Add some debug and echo around findbugs generations 2014-07-03 16:17:41 -07:00
stack ea085c6373 HBASE-4495 CatalogTracker has an identity crisis; needs to be cut-back in scope (Mikhail Antonov) 2014-07-02 19:01:04 -07:00
Devaraj Das 9f8d1876a0 HBASE-11344 Hide row keys and such from the web UIs 2014-07-02 13:07:11 -07:00
Ted Yu 8c8d9d5008 HBASE-11375 Validate compile-protobuf profile in test-patch.sh 2014-06-19 23:46:22 +00:00
Enis Soztutar de1f96096a Added jenkinsEnv.sh for jenkins build environment 2014-05-23 18:52:08 -07:00
Zhihong Yu 88f8f755c8 HBASE-11152 Disable tput in test-patch.sh (Gustavo)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1593817 13f79535-47bb-0310-9956-ffa450edef68
2014-05-11 17:05:04 +00:00
Zhihong Yu a7ba07f757 HBASE-11051 checkJavacWarnings in test-patch.sh should bail out early if there is compilation error (Gustavo)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1592063 13f79535-47bb-0310-9956-ffa450edef68
2014-05-02 22:12:26 +00:00
Zhihong Yu b4daf55761 HBASE-10889 test-patch.sh should exclude thrift generated code from long line detection
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1583858 13f79535-47bb-0310-9956-ffa450edef68
2014-04-02 02:20:39 +00:00
Zhihong Yu 318430bb5c HBASE-10824 Enhance detection of protobuf generated code in line length check
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1581361 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 14:49:30 +00:00
Michael Stack ce71b349c1 Undo the -U I added to get htrace to download from maven central; i.e. restore to how it was
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1580051 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 20:59:34 +00:00
Michael Stack 22e6d86f31 Need quotes adding -U to mvn args
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1580034 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 20:32:55 +00:00
Michael Stack 8bd304ae42 Trying to add -U to force refresh to pick up htrace from mvn central... will undo once this passes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1580004 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 18:15:19 +00:00
Michael Stack 93b8f1606e HBASE-10781 Remove hadoop-one-compat module and all references to hadoop1 -- ADDENDUM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1579544 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 05:58:38 +00:00
Michael Stack 37654f77a6 HBASE-10781 Remove hadoop-one-compat module and all references to hadoop1
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1579449 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 23:08:55 +00:00
Zhihong Yu c96ba61641 HBASE-10691 test-patch.sh should continue even if compilation against hadoop 1.0 / 1.1 fails
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1578982 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 17:48:55 +00:00
nkeywal 7e1ac02210 HBASE-10525 Allow the client to use a different thread for writing to ease interrupt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1571210 13f79535-47bb-0310-9956-ffa450edef68
2014-02-24 10:05:39 +00:00
Michael Stack 5938f5ad16 HBASE-10481 API Compatibility JDiff script does not properly handle arguments in reverse order (Aleksandr Shulman)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1567471 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 23:59:20 +00:00
Andrew Kyle Purtell 1431c22a07 HBASE-10318. generate-hadoopX-poms.sh expects the version to have one extra '-' (Raja Aluri)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1557301 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 02:36:03 +00:00
Zhihong Yu bd5ddea4ce HBASE-10224 Account for empty line in search output
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1554271 13f79535-47bb-0310-9956-ffa450edef68
2013-12-30 16:28:49 +00:00
Zhihong Yu 4e3efb105d HBASE-10224 Line length check in test-patch.sh is broken
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1554234 13f79535-47bb-0310-9956-ffa450edef68
2013-12-30 14:32:54 +00:00
Zhihong Yu a35c25093c HBASE-10044 test-patch.sh should accept documents by known file extensions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1552053 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 18:25:51 +00:00
Zhihong Yu 144f1bb5fc HBASE-10044 Revert: Hadoop QA needs to provide access to tested patches
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1550462 13f79535-47bb-0310-9956-ffa450edef68
2013-12-12 18:13:37 +00:00
Zhihong Yu c066f474ec HBASE-10044 test-patch.sh should accept documents by known file extensions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1550440 13f79535-47bb-0310-9956-ffa450edef68
2013-12-12 15:55:28 +00:00
Michael Stack 57b8613688 HBASE_9955 Make hadoop2 the default and deprecate hadoop1; RETRY
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548374 13f79535-47bb-0310-9956-ffa450edef68
2013-12-06 02:42:20 +00:00
Michael Stack fe5b28625a HBASE-9955 Make hadoop2 the default and deprecate hadoop1; REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548351 13f79535-47bb-0310-9956-ffa450edef68
2013-12-06 01:16:51 +00:00
Michael Stack 66bafba4e1 HBASE-9955 Make hadoop2 the default and deprecate hadoop1
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548346 13f79535-47bb-0310-9956-ffa450edef68
2013-12-06 01:07:29 +00:00
Enis Soztutar 770e336ef6 HBASE-10020 Add maven compile-protobuf profile
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1546237 13f79535-47bb-0310-9956-ffa450edef68
2013-11-27 23:57:23 +00:00
Zhihong Yu 5e1cb013d4 HBASE-9991 Addendum reuses output from maven command
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1545878 13f79535-47bb-0310-9956-ffa450edef68
2013-11-26 22:46:15 +00:00
Zhihong Yu bb8c690e0b HBASE-9991 Enhance test-patch.sh with post back of snippet of compilation error if any is detected
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1545779 13f79535-47bb-0310-9956-ffa450edef68
2013-11-26 18:51:25 +00:00
nkeywal 22f54af029 HBASE-10011 Fix some findbugs in the client - addendum: set OK_FINDBUGS_WARNINGS=89
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1545350 13f79535-47bb-0310-9956-ffa450edef68
2013-11-25 17:51:45 +00:00
Zhihong Yu 45a337446e HBASE-9920 Revert: total findbugs warning is higher than 87, leading to false-positive
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1540188 13f79535-47bb-0310-9956-ffa450edef68
2013-11-08 21:13:10 +00:00
Zhihong Yu bf5f9e5240 HBASE-9920 Lower OK_FINDBUGS_WARNINGS in test-patch.properties
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1540059 13f79535-47bb-0310-9956-ffa450edef68
2013-11-08 14:46:09 +00:00