Commit Graph

437 Commits

Author SHA1 Message Date
Sean Busbey 04db900772 HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-14 20:24:29 -05:00
Mike Drob 8648af07d4
HBASE-19377 Update Java API CC version
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
2018-06-12 14:19:13 -05:00
Peter Somogyi b002b0b8b0 HBASE-20689 Docker fails to install rubocop for precommit
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2018-06-06 23:51:07 +02:00
Sean Busbey c19fbf2be0 HBASE-20501 update minimum supported Hadoop version to 2.7.1.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-30 21:22:42 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
Sean Busbey 1792f541c6 HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:04:50 -05:00
Sean Busbey dace8ff2a4 HBASE-20591 nightly job needs to enable maven build system.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:40:56 -05:00
Mike Drob e6220c8b60 Revert "HBASE-20478 move hbaseanti import checks to checkstyle"
Need to update version of checkstyle used for new features.

This reverts commit 90d103d6d5.
2018-04-26 13:36:13 -05:00
Mike Drob 90d103d6d5 HBASE-20478 move hbaseanti import checks to checkstyle
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 09:28:59 -05:00
Nihal Jain d4768114e8 HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 07:54:25 -05:00
Sean Busbey f4a39043e2 HBASE-20388 nightly tests running on a feature branch should only comment on that feature branch's jira
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-21 13:50:40 -05:00
Nihal Jain 8219ec7493 HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 11:54:01 -05:00
Sean Busbey 0a31ea4858 HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:30:43 -05:00
Sean Busbey 7b7a2222b6 HBASE-20389 Move website building flags into a profile.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 22:43:19 -05:00
Sean Busbey f695ecb2db HBASE-20335 ensure each stage of the nightly job gathers machine information.
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 22:42:37 -05:00
Sean Busbey 2f74afd6f4 HBASE-20379 shadedjars yetus plugin should add a footer link
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:40:35 -05:00
Sean Busbey 8f1ac01ad8 HBASE-20112 register nightly junit over hadoop3 results with jenkins.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:37:50 -05:00
Mike Drob 70d23214fb HBASE-20356 Make skipping protoc possible 2018-04-12 13:31:54 -05:00
Michael Stack 3eda9f1bb3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:18:21 -07:00
Sean Busbey a2c1be9a76 HBASE-20335 nightly job bash cleanup.
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:33:14 -05:00
Sean Busbey 83ee82d6a0 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:33:14 -05:00
Sean Busbey ee87de9bfd HBASE-15466 test personality should recognize docs-only patch.
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:37:28 -05:00
Apekshit Sharma dcc840e8a5 HBASE-17730 Add documentation to upgrade coprocessors for 2.0 2018-04-04 13:08:22 -07:00
Apekshit Sharma 6318e3bf5f HBASE-17730 Migration to 2.0 for coprocessors. Upload AsciiDoc for coprocessor design improvements made in HBASE-17732. 2018-04-03 15:47:48 -07:00
Sean Busbey d8b550fabc HBASE-20308 Dockerfile for test must include git.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-28 18:07:36 -05:00
Mike Drob 9342e0091d HBASE-20153 Add error prone to precommit 2018-03-12 16:06:57 -05:00
Sean Busbey 15da74ccee HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 17:22:00 -06:00
Mike Drob 28279697c2 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:40:28 -06:00
Sean Busbey 8e0674a2eb HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:12:36 -06:00
Sean Busbey ff7f5ecb0f HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-06 12:22:09 -06:00
Sean Busbey 485af49e53 HBASE-20070 addendum for missing echo. Website generation is failing. 2018-03-04 09:03:19 +05:30
Michael Stack 2b1b2c8490 HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and
master
2018-03-03 07:35:23 -08:00
Sean Busbey 2a65066b35 HBASE-20070 refactor website generation
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2018-03-02 09:25:10 -06:00
Sean Busbey c415ddb38c HBASE-20075 remove logic for branch-1.1 nightly testing
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:28:30 -06:00
Sean Busbey 383b7cc592 HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:21:40 -06:00
Sean Busbey ddc9af9027 HBASE-18467 report nightly results to devs via jira
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 13:11:59 -06:00
Alex Leblang 96ebab748f HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:52:15 -06:00
Josh Elser e47d1e443e HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 09:51:10 -05:00
Michael Stack a2bc19aa11 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; AMENDMENT hardcode proclimit and docker memlimit in nightly script... 2018-02-01 20:54:13 -08:00
Michael Stack cb7bfc21da HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; REAPPLY TO TEST 2018-02-01 20:27:28 -08:00
Michael Stack 18eec8c1a5 Revert "HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies"
This reverts commit 2e6bc12441.
2018-02-01 18:04:23 -08:00
Michael Stack 5f5ddf5541 HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- remove docker mem sizing for the moment... 2018-02-01 16:39:27 -08:00
Michael Stack 0db7db3cd1 HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- up proclimit from 6k to 10k and set Docker memory limit of 20G (default is 4G) 2018-02-01 14:08:04 -08:00
Michael Stack 2e6bc12441 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies 2018-01-30 22:25:24 -08:00
Michael Stack 08bcd64c25 Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir"
Doesn't work. Reverting.

This reverts commit 1ca06d9eea.
2018-01-30 12:01:52 -08:00
Michael Stack 1ca06d9eea HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir 2018-01-30 11:53:09 -08:00
Michael Stack 67f91f1282 HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:34:40 -08:00
Michael Stack 9b8d7e0aef HBASE-19891 Up nightly test run timeout from 6 hours to 8 2018-01-29 22:14:47 -08:00
Apekshit Sharma 9917244be2 HBASE-19789 Not exclude flaky tests from nightly builds. 2018-01-16 10:07:48 -08:00
Michael Stack 4ddfecac56 HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1
M dev-support/make_rc.sh
  Disable checkstyle building site. Its an issue being fixed over in HBASE-19780

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  The clusterid was being set into the process only after the
  regionserver registers with the Master. That can be too late for some
  test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
  as it goes to run which could be before Master had called its run
  method  which is regionserver run method which then calls back to the
  master to register itself... and only then do we set the clusterid.
  HBASE-19694 changed start order which made it so this test failed.
  Setting the clusterid right after we set it in zk makes the test pass.

  Another change was that backup masters were not going down on stop.
  Backup masters were sleeping for the default zk period which is 90
  seconds. They were not being woken up to check for stop. On stop
  master now tells active master manager.

M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
  Prevent creation of acl table. Messes up our being able to go down
  promptly.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
  Disabled for now because it wants to run with regions on the Master...
  currently broke!

M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
  Add a bit of debugging.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
  Disabled. Fails 40% of the time.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
  Disabled. Fails 33% of the time.

Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
2018-01-12 14:09:56 -08:00
Niels Basjes 8ae2a2150b HBASE-19674: Improve make_patch.sh
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2018-01-07 14:41:40 +01:00
Michael Stack 9d02e37a8a
HBASE-19659 Enable -x in make_rc.sh so logs where it is in execution 2017-12-28 14:31:54 -08:00
Apekshit Sharma a4272a9f08 HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:44:04 -08:00
Apekshit Sharma 6cefabee26 HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE. 2017-12-21 10:46:43 -08:00
Apekshit Sharma dc5ec061b5 HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master. 2017-12-20 17:58:08 -08:00
Apekshit Sharma 2a5e5e9e2c HBASE-19526 Update hadoop version to 3.0 GA 2017-12-17 19:10:04 -08:00
Apekshit Sharma 1b822b60b5 HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck". Updates hadoop version to 3.0.0-beta1. 2017-12-12 23:22:04 -08:00
Apekshit Sharma 5b7f9c2535 HBASE-19382 Update report-flakies.py script to handle yetus builds. 2017-11-29 22:21:10 -08:00
Sean Busbey 7406c83ef6 HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-13 22:35:10 -06:00
Apekshit Sharma 41f6bf6b89 HBASE-19246 Trivial fix in findHangingTests.py to make it not stop on finding 'bad string'. 2017-11-13 11:44:43 -08:00
Sean Busbey 35a1e43348 HBASE-19227 Nightly job should archive JVM dumpstream files.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 23:18:18 -06:00
Sean Busbey ead8f9364c HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 16:16:15 -06:00
Sean Busbey 36233e72c1 HBASE-19228 nightly job should gather machine stats.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:06:24 -06:00
Sean Busbey b71544fe4d HBASE-19189 Ad-hoc test job for running a subset of tests lots of times
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:02:13 -06:00
Sean Busbey 7bdff754f0 HBASE-19184 Update nightly source artifact check to use git archive for making the tarball.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 08:28:29 -06:00
Andrew Purtell 46408e021d HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1) 2017-11-07 12:37:36 -08:00
Sean Busbey 3e4b86d4d6 HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:32:35 -05:00
Michael Stack 4857cbd762
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script; AMENDMENT adding generation of hashes 2017-11-03 10:06:55 -07:00
Michael Stack 4edfa06564
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-03 09:52:28 -07:00
Sean Busbey 0ff9dabe6c HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:31:19 -05:00
Sean Busbey 91273e7b0e HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:55:32 -05:00
Sean Busbey 60aa1c228a HBASE-19098 compatibility checker should handle remotes named something other than 'origin'.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-10-26 16:09:17 -05:00
Sean Busbey 5255ae6dfa HBASE-19030 nightly runs should attempt to log test results after archiving.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:32:13 -05:00
Misty Stanley-Jones eee3b0180e HBASE-19054 switch precommit image to one from maven
Amending Author: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 14:51:16 -05:00
Sean Busbey cda2949b81 HBASE-19070 temporarily make the mvnsite nightly test non-voting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:06:58 -05:00
Chia-Ping Tsai a31e8e34ea HBASE-19066 Correct the directory of openjdk-8 for jenkins
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:18:47 -05:00
Chia-Ping Tsai cb5c4776de HBASE-19058. The wget isn't installed in building docker image
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-20 20:35:33 -05:00
Sean Busbey b10ad9e97f HBASE-19039 refactor shadedjars test to only run on java changes.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:20 -05:00
Sean Busbey dd4dbae764 HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:14 -05:00
Mike Drob 5facaded90 HBASE-16338 Remove Jackson1 deps
* Change imports from org.codehaus to com.fasterxml
* Exclude transitive jackson1 from hadoop and others
* Minor test cleanup to add assert messages, fix some parameter order
* Add anti-pattern check for using jackson 1 imports
* Add explicit non-null serialization directive to ScannerModel
2017-10-20 09:20:12 -05:00
zhangduo af479c580c HBASE-19042 Oracle Java 8u144 downloader broken in precommit check
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-19 15:53:52 -05:00
zhangduo 4a7b430397 Revert "HBASE-19042 Oracle Java 8u144 downloader broken in precommit check"
This reverts commit 9e688117ba.
2017-10-19 16:03:28 +08:00
zhangduo 9e688117ba HBASE-19042 Oracle Java 8u144 downloader broken in precommit check 2017-10-19 15:32:48 +08:00
Dima Spivak 3acb081787 HBASE-18418 Remove apache_hbase_topology from dev-support 2017-10-18 14:08:26 -07:00
Mike Drob c16eb7881f HBASE-19038 precommit mvn install should run from root on patch 2017-10-18 10:41:17 -05:00
Apekshit Sharma 5368fd5bf0 HBASE-19032 Set mimetype for patches uploaded by submit-patch.py
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
2017-10-17 15:43:07 -07:00
Mike Drob f6a8a76b50 HBASE-18505 Yetus only run root when all modules changed 2017-10-13 12:12:07 -05:00
Sean Busbey 087edf0172 HBASE-18934 pick hadoop versions for precommit test after patch branch is determined.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-09 11:31:55 -05:00
Josh Elser 869b90c612 HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality 2017-10-01 15:46:24 -04:00
Michael Stack b5b4108fce HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732; MINOR AMENDMENT adding README to design-doc dir 2017-09-28 13:24:40 -07:00
Apekshit Sharma 74d0adce61 HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732
- Change Service Coprocessor#getService() to List<Service> Coprocessor#getServices()
- Checkin the finalized design doc into repo
- Added example to javadoc of Coprocessor base interface on how to implement one in the new design
2017-09-28 10:25:47 -07:00
Sean Busbey efb95a1794 HBASE-18834 fix shellcheck warning on hbase personality
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
2017-09-18 08:54:37 -05:00
Sean Busbey 4b124913f0 HBASE-17823 Migrate to Apache Yetus Audience Annotations
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2017-09-12 20:53:30 -05:00
Sean Busbey 79d9f7a734 HBASE-18760 Make hbase-shaded-check-invariants part of precommit
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-09-10 23:11:01 -05:00
Umesh Agashe 5d60123f3e HBASE-18674 upgrading to commons-lang3
Signed-off-by: Michael Stack <stack@apache.org>
2017-09-05 09:46:10 -07:00
Michael Stack 47a5614edd Revert "HBASE-18674 upgrading to commons-lang3"
Premature push

This reverts commit 5dacc85122.
2017-08-28 16:41:34 -07:00
Umesh Agashe 5dacc85122 HBASE-18674 upgrading to commons-lang3 2017-08-28 15:57:12 -07:00
Tamas Penzes 158f3da167 HBASE-18607: fix submit-patch.py to support utf8
one liner to support utf8 content

Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-08-25 00:04:19 -07:00
Esteban Gutierrez c37432fefb HBASE-18563 Fix RAT License complaint about website jenkins scripts 2017-08-10 20:08:03 -05:00
Misty Stanley-Jones 6114824b53 HBASE-18548 Move sources of website gen and check jobs into source control 2017-08-10 14:48:14 -07:00