Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,368 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

515 Commits

Author SHA1 Message Date
Guanghao Zhang 7172128a13 HBASE-22490 (addendum) Nightly client integration test fails with hadoop-3 2019-05-31 21:43:32 +08:00
Guanghao 1ce4fcc6ee HBASE-22490 Nightly client integration test fails with hadoop-3.0.3 2019-05-31 21:43:16 +08:00
Duo Zhang 59973d2024 HBASE-22500 Modify pom and jenkins jobs for hadoop versions 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-30 22:31:47 +08:00
zhangduo 6876199bac HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test 2019-05-29 11:38:49 +08:00
Peter Somogyi 0c69831b00 HBASE-22474 Add --mvn-custom-repo parameter to yetus calls 2019-05-26 18:12:12 +02:00
Guanghao Zhang c00cc4d9d6 HBASE-22462 (addendum) Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-24 12:07:15 +08:00
Guanghao Zhang b469d06bd4 HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-24 12:07:09 +08:00
zhangduo 6a28e76f7e HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:56:02 +08:00
Duo Zhang 5537de38b3 HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-05-17 09:51:59 +08:00
Andrew Purtell 8099608439
HBASE-22430 hbase-vote should tee build and test output to console 2019-05-16 16:46:47 -07:00
Tak Lon (Stephen) Wu 48f8bf252e
HBASE-22429 hbase-vote download step requires URL to end with '/' (#243) 2019-05-16 16:46:46 -07:00
Duo Zhang 6bd6a953a7 HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:32 +08:00
Sean Busbey b1752fadc3 HBASE-22406 skip generating rdoc when building gems in our docker image for running yetus 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit 60dc5143f2)
 2019-05-13 11:24:09 -05:00
Sean Busbey f41cf781e5 HBASE-22020 update nightly to yetus 0.9.0 
Signed-off-by: stack <stack@apache.org>
(cherry picked from commit b5a6fd14fa)
 2019-04-24 07:33:16 -05:00
zhangduo 4562bf608c HBASE-22174 Remove error prone from our precommit javac check 2019-04-06 19:12:51 +08:00
Andrew Purtell 06f914e71f
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-05 14:37:46 -07:00
Apache9 59a6a6c174 HBASE-22152 Addendum use hbase account instead of hadoop (#112) 2019-04-05 22:19:36 +08:00
Duo Zhang 02fea3e7a0 HBASE-22152 Create a jenkins file for yetus to processing GitHub PR 2019-04-04 22:15:31 +08:00
Andrew Purtell b1d236d73b
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse (Ankit Singhal) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-03 16:31:28 -07:00
zhangduo a33b3401cf HBASE-22100 False positive for error prone warnings in pre commit job 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-03-28 13:06:53 +08:00
TAK LON WU 4f1dc1d234 HBASE-21963 Add a script for building and verifying release candidate 2019-03-18 20:00:13 +01:00
Peter Somogyi 5f9316e781 HBASE-21711 Remove references to git.apache.org/hbase.git 2019-01-16 10:03:50 +01:00
Tommy Li 49e7e27467 HBASE-21712 : Make submit-patch.py python3 compatible 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-16 09:28:25 +01:00
Peter Somogyi 1200733cd9 HBASE-21685 Change repository urls to Gitbox 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-15 10:28:18 +01:00
Peter Somogyi 0b086087b2 HBASE-21547 Precommit uses master flaky list for other branches 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-02 08:31:06 +01:00
Michael Stack e5fb2f968a HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors 
ADDENDUM: Remove exception for scala files in findbugs now that we don't have any.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
(cherry picked from commit 2792253322)
(cherry picked from commit 54172c9890)
 2018-11-08 08:52:06 -06:00
Sean Busbey b8bd3b1a74 Revert "HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide" 
This reverts commit 565ea7ad00.

bad commit metadata
 2018-11-08 08:51:53 -06:00
Wellington Chevreuil 565ea7ad00 HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
 2018-11-07 08:10:17 -08:00
Michael Stack b7efc8d4e7
HBASE-21424 Change flakies and nightlies so scheduled less often 
ADDENDUM; Make nightly daily.
 2018-11-01 10:09:41 -07:00
Michael Stack 22a0419f7e
HBASE-21424 Change flakies and nightlies so scheduled less often 
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
 2018-11-01 10:04:43 -07:00
Sean Busbey a074269ee0 HBASE-21103 nightly job should make sure cached yetus will run. 
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 42d7ddc678)
 2018-10-11 10:29:53 -05:00
Mike Drob 302b77697a
HBASE-20764 build broken when latest commit is gpg signed 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-08 19:50:39 -05:00
Sean Busbey 715b95ca5b HBASE-21189 flaky job should gather machine stats 
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 5d14c1af65)
 2018-09-12 23:09:08 -05:00
Sean Busbey f9a3d8acc4 HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf' 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-08-21 09:46:03 -05:00
Sean Busbey 98da781ecf HBASE-21074 JDK7 builds need to be done with TLSv1.2. 
* for master and branches-2 we skip the jdk7 stuff

Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-21 09:15:26 -05:00
Sean Busbey 9da5d3a481 HBASE-20387 turn flaky test tracking infra into per-branch pipeline. 
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-08-16 23:17:24 -05:00
Sean Busbey 621a43e709 HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors 
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 346dd32185)
 2018-08-14 13:14:22 -05:00
Yu Li 492c0fcd2e HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed 2018-07-12 10:17:38 +08:00
Sean Busbey 0a4ae9fa94 HBASE-20334 add a test that verifies basic client and MR integration 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-06-18 14:03:51 -07:00
Mike Drob b04c976fe6 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-06-18 14:02:40 -07:00
Sean Busbey a4cb98b1cd HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-14 20:26:42 -05:00
Mike Drob 0a6aec4981 HBASE-19377 Update Java API CC version 
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
 2018-06-12 15:13:35 -05:00
Peter Somogyi 42ca976803 HBASE-20689 Docker fails to install rubocop for precommit 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-06-06 23:51:47 +02:00
Sean Busbey 9431ee3f49 HBASE-20501 update minimum supported Hadoop version to 2.7.1. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

 Conflicts:
	src/main/asciidoc/_chapters/configuration.adoc
 2018-05-30 21:28:06 -05:00
Sean Busbey 8a3b44a7e4 HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-05-24 13:13:35 -05:00
Sean Busbey 29f492b344 HBASE-20591 nightly job needs to enable maven build system. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-05-22 17:43:21 -05:00
Nihal Jain 8c7293c514 HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-20 11:58:39 -05:00
Sean Busbey 53eb0f60c5 HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from. 
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-14 21:31:36 -05:00
Sean Busbey 1d133c005c HBASE-20389 Move website building flags into a profile. 
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-spark/pom.xml
	pom.xml
 2018-04-13 22:50:55 -05:00
Sean Busbey dcd20e9cef HBASE-20335 ensure each stage of the nightly job gathers machine information. 
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 22:45:19 -05:00
Sean Busbey bd2dddae60 HBASE-20379 shadedjars yetus plugin should add a footer link 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 10:48:05 -05:00
Sean Busbey d5d5c78849 HBASE-20112 register nightly junit over hadoop3 results with jenkins. 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 10:48:05 -05:00
Mike Drob a50d9f4351 HBASE-20356 Make skipping protoc possible 2018-04-12 14:54:03 -05:00
Michael Stack cc801f5f2d HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:18:43 -07:00
Sean Busbey 9bf087d28b HBASE-20335 nightly job bash cleanup. 
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-11 01:30:49 -05:00
Sean Busbey 1ef2450ca9 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven. 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
 2018-04-11 01:30:46 -05:00
Sean Busbey 469b57bba0 HBASE-15466 test personality should recognize docs-only patch. 
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-09 10:37:49 -05:00
Apekshit Sharma 1e0d909532 HBASE-17730 Add license header to design doc. 2018-04-04 13:11:53 -07:00
Apekshit Sharma 40fbecd97c HBASE-17730 Migration to 2.0 for coprocessors. Upload AsciiDoc for coprocessor design improvements made in HBASE-17732. 2018-04-03 15:50:09 -07:00
Sean Busbey dba480856b HBASE-20308 Dockerfile for test must include git. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-28 18:39:06 -05:00
Mike Drob d42886f4fe HBASE-20153 Add error prone to precommit 2018-03-12 16:06:08 -05:00
Sean Busbey b87165cbf7 HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-09 17:23:13 -06:00
Mike Drob 32c5118f6f HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:41:12 -06:00
Sean Busbey c99e6f7439 HBASE-18467 addendum parallel steps must account for SCM and marshalling results 
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-08 11:44:31 -06:00
Sean Busbey d4c4af09a1 HBASE-20075 remove logic for branch-1.1 nightly testing 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-08 11:44:31 -06:00
Sean Busbey 27642614b4 HBASE-15151 ensure findbugs check runs in nightly tests on all branches. 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-08 11:44:31 -06:00
Sean Busbey 44f1129234 HBASE-18467 report nightly results to devs via jira 
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-08 11:44:31 -06:00
Sean Busbey f5c8713bdd HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp. 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-07 08:39:19 -06:00
Sean Busbey b59c39d942 HBASE-20070 addendum for missing echo. Website generation is failing. 2018-03-04 09:04:06 +05:30
Michael Stack bc735474a9 HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and 
master
 2018-03-03 07:33:25 -08:00
Sean Busbey 9927c2e14a HBASE-20070 refactor website generation 
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>

 Conflicts:
	hbase-backup/pom.xml
	hbase-spark-it/pom.xml
 2018-03-02 09:51:43 -06:00
Alex Leblang 2f3632a2a4 HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found 
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-02-28 11:54:31 -06:00
Josh Elser 7d5744d2f8 HBASE-20089 Use the ASF recommended naming for SHA512 xsum files 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-02-27 09:57:28 -05:00
Michael Stack b2fe241089 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; AMENDMENT hardcode proclimit and docker memlimit in nightly script... 2018-02-01 20:54:38 -08:00
Michael Stack 1dc640c296 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; REAPPLY TO TEST 2018-02-01 20:27:05 -08:00
Michael Stack 12a6af0de5 Revert "HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies" 
This reverts commit 2e6bc12441.
 2018-02-01 18:04:59 -08:00
Michael Stack ce6c3d96ea HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- remove docker mem sizing for the moment... 2018-02-01 16:39:05 -08:00
Michael Stack fe6c06ad6c HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- up proclimit from 6k to 10k and set Docker memory limit of 20G (default is 4G) 2018-02-01 14:08:24 -08:00
Michael Stack afdfa54cd3 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies 2018-01-30 22:26:58 -08:00
Michael Stack 2835d51f9a Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir" 
Reverting because doesn't work.

This reverts commit 44019c21fb.
 2018-01-30 12:04:37 -08:00
Michael Stack 44019c21fb HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir 2018-01-30 11:54:47 -08:00
Michael Stack 8a1fca09cb HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0 
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
 2018-01-29 22:35:47 -08:00
Michael Stack 03a418ed39 HBASE-19891 Up nightly test run timeout from 6 hours to 8 2018-01-29 22:15:37 -08:00
Apekshit Sharma 130da9d18b HBASE-19860 Run branch-2 nightly job more frequently to help with flaky tests debugging 2018-01-24 20:00:30 -08:00
Apekshit Sharma e60d302b90 HBASE-19789 Not exclude flaky tests from nightly builds. 2018-01-16 10:09:50 -08:00
Apekshit Sharma f91589d305 HBASE-19789 Exclude flaky tests from nightly branch-2 runs 2018-01-12 16:24:45 -08:00
Michael Stack 026f535a77 HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1 
M dev-support/make_rc.sh
  Disable checkstyle building site. Its an issue being fixed over in HBASE-19780

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  The clusterid was being set into the process only after the
  regionserver registers with the Master. That can be too late for some
  test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
  as it goes to run which could be before Master had called its run
  method  which is regionserver run method which then calls back to the
  master to register itself... and only then do we set the clusterid.
  HBASE-19694 changed start order which made it so this test failed.
  Setting the clusterid right after we set it in zk makes the test pass.

  Another change was that backup masters were not going down on stop.
  Backup masters were sleeping for the default zk period which is 90
  seconds. They were not being woken up to check for stop. On stop
  master now tells active master manager.

M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
  Prevent creation of acl table. Messes up our being able to go down
  promptly.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
  Disabled for now because it wants to run with regions on the Master...
  currently broke!

M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
  Add a bit of debugging.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
  Disabled. Fails 40% of the time.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
  Disabled. Fails 33% of the time.

Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
 2018-01-12 14:09:23 -08:00
Michael Stack 581f168f6e
HBASE-19659 Enable -x in make_rc.sh so logs where it is in execution 2017-12-28 14:31:28 -08:00
Apekshit Sharma b263eb5648 HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs. 
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
 2017-12-21 17:44:33 -08:00
Apekshit Sharma a28156be94 HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE. 2017-12-21 10:55:12 -08:00
Apekshit Sharma 90ac3c93c9 HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master. 2017-12-20 17:59:27 -08:00
Esteban Gutierrez 61ce86399a HBASE-18563 Fix RAT License complaint about website jenkins scripts 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-19 23:42:24 +08:00
Misty Stanley-Jones ed98ee1c19 HBASE-18548 Move sources of website gen and check jobs into source control 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-19 23:40:46 +08:00
Apekshit Sharma 6616a3fd2d HBASE-19526 Update hadoop version to 3.0 GA 2017-12-17 22:52:54 -08:00
Apekshit Sharma 9144452773 HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck". Updates hadoop version to 3.0.0-beta1. 2017-12-13 00:36:34 -08:00
Apekshit Sharma fd9c4322c5 HBASE-19382 Update report-flakies.py script to handle yetus builds. 2017-11-29 23:02:36 -08:00
Sean Busbey d5df4c0426 HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-11-13 23:05:25 -06:00
Apekshit Sharma 72ba5c294e HBASE-19246 Trivial fix in findHangingTests.py to make it not stop on finding 'bad string'. 2017-11-13 11:46:46 -08:00
Sean Busbey d757e651c9 HBASE-19227 Nightly job should archive JVM dumpstream files. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-09 23:21:23 -06:00
Sean Busbey 4970b0ad06 HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-11-09 16:17:26 -06:00
Sean Busbey 1e4267f84d HBASE-19228 nightly job should gather machine stats. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-09 15:08:01 -06:00
Sean Busbey b75812f445 HBASE-19189 Ad-hoc test job for running a subset of tests lots of times 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-09 15:07:52 -06:00
Sean Busbey 6a61065237 HBASE-19184 Update nightly source artifact check to use git archive for making the tarball. 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-11-09 08:32:35 -06:00
Sean Busbey 516d370b4b HBASE-18817 pull the hbase-spark module out of branch-2. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-08 22:55:23 -06:00
Andrew Purtell e3bd475317 HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1) 2017-11-07 12:37:53 -08:00
Michael Stack 3a8e3704cd
HBASE-19716 Remove hbase-native-client from branch-2 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-11-03 23:18:24 -07:00
Sean Busbey b9b0f15cdb HBASE-19097 update nightly tests to use Apache Yetus 0.6.0 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-03 15:33:11 -05:00
Michael Stack 9dc9d0394d
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script; AMENDMENT adding generation of hashes 2017-11-03 10:06:20 -07:00
Michael Stack 9026d92f59
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script 
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-11-03 09:58:18 -07:00
Sean Busbey 20cc11e167 HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script. 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-11-02 15:32:35 -05:00
Sean Busbey 5a941d8f80 HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-11-01 09:57:33 -05:00
Sean Busbey e1152afdd4 HBASE-19098 compatibility checker should handle remotes named something other than 'origin'. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-10-26 16:10:56 -05:00
Sean Busbey aed0d6ce24 HBASE-19030 nightly runs should attempt to log test results after archiving. 
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2017-10-25 10:33:53 -05:00
Misty Stanley-Jones 9f2f2db91c HBASE-19054 switch precommit image to one from maven 
Amending Author: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-10-24 14:51:39 -05:00
Sean Busbey fe82a302be HBASE-19070 temporarily make the mvnsite nightly test non-voting. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-24 12:20:51 -05:00
Chia-Ping Tsai bd98620c4f HBASE-19066 Correct the directory of openjdk-8 for jenkins 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-10-24 09:21:25 -05:00
Mike Drob 34df2e665e HBASE-16338 Remove Jackson1 deps 
* Change imports from org.codehaus to com.fasterxml
* Exclude transitive jackson1 from hadoop and others
* Minor test cleanup to add assert messages, fix some parameter order
* Add anti-pattern check for using jackson 1 imports
* Add explicit non-null serialization directive to ScannerModel
 2017-10-23 15:24:51 -05:00
Chia-Ping Tsai d8afa3e067 HBASE-19058. The wget isn't installed in building docker image 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-10-20 20:38:06 -05:00
Sean Busbey a37ff39b7a HBASE-19039 refactor shadedjars test to only run on java changes. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-20 19:43:08 -05:00
Sean Busbey 01ab747a5f HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-20 19:43:02 -05:00
zhangduo 64f024a76c HBASE-19042 Oracle Java 8u144 downloader broken in precommit check 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-19 15:54:49 -05:00
Mike Drob 723eb7c6ba HBASE-19038 precommit mvn install should run from root on patch 2017-10-18 10:39:52 -05:00
Apekshit Sharma 16ccd55c43 HBASE-19032 Set mimetype for patches uploaded by submit-patch.py 
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
 2017-10-17 15:43:51 -07:00
Mike Drob 822cc1ed73 HBASE-18505 Yetus only run root when all modules changed 2017-10-13 12:12:38 -05:00
Sean Busbey e4647da0db HBASE-18934 pick hadoop versions for precommit test after patch branch is determined. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-09 11:38:16 -05:00
Josh Elser 8c6ed571bd HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality 2017-10-01 15:21:54 -04:00
Michael Stack ac933f7af2 HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732; MINOR AMENDMENT adding README to design-doc dir 2017-09-28 13:25:07 -07:00
Apekshit Sharma a6a303816c HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732 
- Change Service Coprocessor#getService() to List<Service> Coprocessor#getServices()
- Checkin the finalized design doc into repo
- Added example to javadoc of Coprocessor base interface on how to implement one in the new design
 2017-09-28 10:33:30 -07:00
Sean Busbey ea610cfcf7 HBASE-18833 Ensure precommit personality is up to date on all active branches 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-09-20 05:51:42 -05:00
Sean Busbey 5ed2f899e1 HBASE-18834 fix shellcheck warning on hbase personality 
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
 2017-09-18 08:55:30 -05:00
Sean Busbey d576e5a32d HBASE-17823 Migrate to Apache Yetus Audience Annotations 
Includes partial backport of hbase-build-configuration module

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
 2017-09-12 23:15:50 -05:00
Umesh Agashe bd219c0fb8 HBASE-18674 upgrading to commons-lang3 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-09-05 09:46:49 -07:00
Tamas Penzes 37c40afaff HBASE-18607: fix submit-patch.py to support utf8 
one liner to support utf8 content

Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-08-25 00:04:37 -07:00
Michael Stack e9ea19fba6 HBASE-18653 Undo hbase2 check against < hadoop2.6.x; i.e. implement agreed drop of hadoop 2.4 and 2.5 support in hbase2 2017-08-22 09:45:43 -07:00
Sean Busbey 7029c23b00 HBASE-18527 Update nightly job to account for changes in jenkins plugins. 
- Stop presuming job will be configured with checkout into a 'component' dir
 - Disable autocheckout
 - Specify checkout within 'component' dir
 - leave the workspace around on pipeline failure so we can browse it.
 2017-08-07 11:25:08 -05:00
Sean Busbey 69fddb58bd HBASE-14220 nightly check that we can build a source tarball. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-06 12:08:51 -05:00
Sean Busbey db18a00b76 HBASE-18426 nightly job should use independent stages to check supported jdks 
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-06 12:08:48 -05:00
Sean Busbey 3c8b364379 HBASE-18147 POC jenkinsfile for nightly checks. 
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile

Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
 2017-08-06 12:08:34 -05:00
Alex Leblang 2b1b01fce3 HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop 
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems

Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey

Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-08-04 12:06:45 -05:00
Apekshit Sharma f2e5727e1b HBASE-18341 (addendum) Replace '.' in test names with '_' when using them as html ids since 
dot have special significance in CSS selectors.
Without it, we weren't able to select elements and add svg (trends columns) to them.

Change-Id: Ia63ff0851f0a2fad0789a24edf2f0ad00060d578
 2017-07-10 12:05:28 -07:00
Apekshit Sharma c05a408093 HBASE-18341 Generalize regex matchers in findHangingTests.py script to match new consoleText of trunk build. 
Change-Id: I0a4215827d3d561eef3f583da666c617f690d934
 2017-07-08 00:52:16 -07:00
Apekshit Sharma 7a535f5843 HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success 
Use https for fetching d3 since builds.apache.org is also https. Otherwise d3 script is not loaded (unless browser is explicitly told to do so) and the fancy status markers are not drawn.

Change-Id: I97f7402141717da77499d09e44b05ecdd35c5a6f
 2017-05-19 00:29:37 -07:00
Apekshit Sharma 7a0a66072d HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success 
Change-Id: I43851c52723de3d89ea4ca5fa49c86a178afba26
 2017-05-18 19:10:19 -07:00
Apekshit Sharma c51c36fd1f HBASE-18076 Flaky dashboard improvement: Add status markers to show trends of failure/success. 2017-05-18 19:03:11 -07:00
Apekshit Sharma 841bb00655 HBASE-18044 Fix bug in report-flakies.py where if counter is set outside for loop, it cannot be overwritten inside loop. 
http://stackoverflow.com/questions/7537439/how-to-increment-a-variable-on-a-for-loop-in-jinja-template

Change-Id: Ic404d6360fb646e6490d1487374520f9550b76b4
 2017-05-15 14:15:57 -07:00
Josh Elser 757bf379c1 HBASE-17985 Inline apt-get update calls in Yetus Dockerfile 2017-05-02 17:33:18 -04:00
CHIA-PING TSAI fe3c32ebd5 HBASE-17809 cleanup unused class 2017-03-23 14:15:28 +08:00
Apekshit Sharma 41be3bc2cc HBASE-17593 Update hadoop 3 version to 3.0.0-alpha2. 
Change-Id: Ic5411229aaab3d645dc6751ecfbbda1b2d93a4b9
 2017-02-06 12:18:21 -08:00
Michael Stack 8f8daafee0 HBASE-17228 precommit grep -c ERROR may grab non errors I tested this by doing `cat /tmp/some_file_with_ERROR_combos|grep -c '\[ERROR\]' 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-12-02 08:51:21 -08:00
zhangduo 8d52d23c77 HBASE-17074 PreCommit job always fails because of OOM 2016-11-15 08:29:24 +08:00