Commit Graph

484 Commits

Author SHA1 Message Date
Jan Høydahl f38c401283
LUCENE-10179 No longer check for release status on mirrors (#384) 2021-10-15 20:25:29 +02:00
Jan Høydahl ae956db41c
LUCENE-9997 Revisit smoketester for 9.0 build (#355)
* LUCENE-9997 Revisit smoketester for 9.0 build

* Remove checkBrokenLinks

* Add back checkBrokenLinks

* Review feedback. Remove traces of solr-specific testNotice() method
Move backCompat test up to other "if isSrc" block

* Review feedback. Bring back the 'checkMaven()' method, as it checks lucene maven artifacts.
But since we dont have pom template files anymore, no need to compare with templates

* Review feedback. Fix script compatibility by comparing against X.Y instead of X.Y.Z

* Review feedback. Remove unnecessary if lucene test
Convert some ant commands to gradle

* Update MANIFEST tests to match the gradle-produced manifest

* LUCENE-10107 Read multi-line commit from Manifest
Backport from branch_8x

* Collapse for project in 'lucene' loops and methods taking 'project' as argument
Disable checkJavadocLinks, as this dependency no longer exists in 'scripts' folder

* Review feedback - fix more ant stuff, convert to gradle equivalent

* Review feedback: Refactor file open

* Comment out javadoc generation - was only used to check broken links?

* Fix charset of gpg console output to always be utf-8
Fix two more places to use with open()

* Accept 'LICENSE' without txt or md suffix in top-level

* Disable vector dictionary abuse exception if started with -Dsmoketester

* Reformat code

* Use -Dsmoketester flag when invoking IndexFiles
2021-10-13 15:24:14 +02:00
Jan Høydahl 674b66dd16
LUCENE-9809 Adapt Release Wizard to only release Lucene (#344)
* Update wording in README and poll-mirrors.py
* First pass at updating wizard
- lucene/solr -> lucene
- removed solr-only tasks and python functions
* Update addVersion to remove Solr parts
- fixes bug with a regex and missing String qualifier for gradle baseVersion
* buildAndPushRelease - remove solr parts
* githubPRs.py report on PRs from new lucene repo and lucene JIRA only
* update smokeTestRelease.py example in README.md (but not smokeTestRelease.py itself)
* remove Solr references in releasedJirasRegex.py
* Update releasedJirasRegex.py
* Add gpg release signing to buildAndPushRelease.py

Co-authored-by: Christine Poerschke <cpoerschke@apache.org>
2021-10-05 23:33:59 +02:00
Christine Poerschke 57524c6a5e
LUCENE-9809: replace 'master' with 'main' in release wizard (#305) 2021-09-20 17:51:41 +01:00
Houston Putman 059d06cec7
Fix gpg key download in release wizard. (#279)
Old URL to check the apache id gpg key is no longer available.
2021-09-02 18:08:57 -04:00
Uwe Schindler 5813292de2 LUCENE-10055: Update Subversion foder for Javadocs 2021-08-22 13:34:09 +02:00
Dawid Weiss 3bedc0871e
LUCENE-9977: rat task corrections (proper up-to-date checks, cleanup and rewrite of the task itself). (#178) 2021-06-11 09:26:34 +02:00
Christine Poerschke 1ec2a715a2 Fix 8.9.0 < 8.10.0 comparison in smokeTestRelease.py script. (#2509) 2021-06-08 15:54:57 +01:00
Ayushman Singh Chauhan c49bfb8e01
DOC: Fix spelling (#111) 2021-04-28 13:19:34 -04:00
Dawid Weiss 3115797463 LUCENE-9871: clean up some old cruft and shuffle files around. Correct inputs/outputs on check broken links so that it's incremental. 2021-03-30 10:55:19 +02:00
Uwe Schindler 5ade66059f
Cleanup readme file, doaps and copy build instructions from lucene subfolder (#6) 2021-03-10 16:10:06 +01:00
Dawid Weiss 409bc37c13
SOLR-14759: a few initial changes so that Lucene can be built independently while Solr code is still in place. (#2448) 2021-03-08 14:59:08 +01:00
Ignacio Vera cfd0ccefe1
LUCENE-9777: Fix out of date versions on releases 8.7.0 and 8.8.0 (#2377) 2021-02-17 08:29:05 +01:00
Jan Høydahl 2f6807cc76
Split the publish_maven step in two TODOs (#2279) 2021-02-05 09:58:48 +01:00
Dawid Weiss 7f8b7ffbca LUCENE-9570: code reformatting [partial]. 2021-01-03 21:46:01 +01:00
Dawid Weiss 2d6ad2fee6 LUCENE-9570: code reformatting [partial]. 2020-12-23 12:41:23 +01:00
Houston Putman 0f15b5e2ee
Adding Apache Reporter step in Release Wizard. (#2130) 2020-12-08 04:04:49 -05:00
David Smiley d50bdbae83
Remove obsolete dev-tools scripts (#2105) 2020-12-02 16:04:40 -05:00
David Smiley 1e0ae2fb74
SOLR-15001 Docker: require init_var_solr.sh (#2083)
The Dockerfile should not initialize /var/solr's contents because this is confusing and redundant with init_var_solr.sh.
No need for init_var_solr.sh to echo what it does; VERBOSE can be used to accomplish that.

Separate CHANGES.md for Docker and contrib modules.
2020-11-27 14:59:54 -05:00
Jan Høydahl 462c6c70d1
Graduate the release wizard from ALPHA (#2041) 2020-10-29 11:24:02 +01:00
Jason Gerlowski 80df6a3d62 LUCENE-9434: Remove wiki-update step from release 2020-10-09 14:13:05 -04:00
Jason Gerlowski 2a9d704002 Update addBackcompatIndexes.py test running to gradle 2020-10-09 11:32:49 -04:00
Jason Gerlowski 178d83d635 Update addVersion.py test running to gradle 2020-10-09 10:25:19 -04:00
Mike Drob 08e38d3452
LUCENE-9488 Create Release Artifacts with Gradle (#1905)
* Build Lucene binary distribution using Gradle
* Generate SHA-512 checksums for all release artifacts
* Update documentation artifacts included in binaries
* Delete some additional Ant relics

Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
Co-authored-by: Uwe Schindler <uschindler@apache.org>
2020-10-08 14:25:51 -05:00
Mike Drob 3134f10a42
LUCENE-9488 Update release process to work with gradle (#1860)
* Restore lucene/version.properties
* Switch release wizard commands from ant to gradle equivalents
* Remove remaining checks for ant
* Remove checks for Java 8
* Update Copyright year
* Minor bug fixes around determining next version for a major release
2020-09-15 10:10:17 -05:00
Robert Muir 784ede4eda
LUCENE-9215: replace checkJavaDocs.py with doclet (#1802)
This has the same logic as the previous python, but no longer relies
upon parsing HTML output, instead using java's doclet processor.

The errors are reported like "normal" javadoc errors with source file
name and line number and happen when running "gradlew javadoc"

Although the "rules" are the same as the previous python, the python had
some bugs where the checker didn't quite do exactly what we wanted, so
some fixes were applied throughout.

Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
Co-authored-by: Uwe Schindler <uschindler@apache.org>
2020-09-02 08:29:17 -04:00
Alexandre Rafalovitch a8ea6e70eb
Ancient patch file deleted (#1800) 2020-08-31 08:41:36 -04:00
Alexandre Rafalovitch a57ba25400
SOLR-14783: Remove DIH from 9.0 (#1794)
* Remove DIH example directory

* Remove contrib code directories

* Remove contrib package related configurations for build tools

* Remove mention of DIH example

* remove dih as build dependencies and no-longer needed version pins

* Remove README references to DIH

* Remove dih mention from the script that probably does need to exist at all

* More build artifact references

* More removed dependencies leftovers (licenses/versions)

* No need to smoke exclude DIH anymore

* Remove Admin UI's DIH integration

* Remove DIH from shortname package list

* Remove unused DIH (related? not?) dataset
Unclear what is happening here, but there is no reference to that directory anywhere else
The other parallel directories ARE referenced in a TestConfigSetsAPI.java

* Hidden Idea files references

* No DIH to ignore anymore

* Remove last Derby DB references

* Remove DIH from documentation
Add the information in Major Changes document with the link to the external repo

* Added/updated a mention to CHANGES

* Fix leftover library mentions

* Fix Spellings
2020-08-29 10:52:04 -04:00
Jan Høydahl 18e5f21178
LUCENE-9485: Check early if Solr port 8983 is available (#1792) 2020-08-28 10:08:40 +02:00
Simon Willnauer 75e15497ec
Run tests last to fail fast on missing license and doc issues (#1788) 2020-08-26 12:55:25 +02:00
Houston Putman 0f06eff4b7 Additions to releaseWizard (#1763)
- Backporting the DOA changes
- Adding link to Solr Upgrade Notes in release notes
- Adding step for obtaining jira permissions.
2020-08-24 09:53:03 -04:00
S N Munendra d2cc022fcf
Fix syntax warning in smokeTestRelease.py (#1746)
while verifying the 8.6.1 release with latest python(3.8.5), observed
one SyntaxWarning.
https://adamj.eu/tech/2020/01/21/why-does-python-3-8-syntaxwarning-for-is-literal/
2020-08-13 21:15:28 +05:30
Cassandra Targett a747051c6a LUCENE-9452: remove jenkins.build.ref.guide.sh as it's no longer needed 2020-08-10 15:48:13 -05:00
Cassandra Targett 10baa50519 Add paths for gems on new CI machines 2020-08-07 13:58:07 -05:00
Cassandra Targett 5dd4cd1ed3 Comment out RVM_PATH and RUBY_VERSION 2020-08-07 13:40:36 -05:00
Cassandra Targett fb9110ad18 This time comment out ALL the RVM commands to fix the build 2020-08-07 13:35:37 -05:00
Cassandra Targett abf637fc88 INFRA-20656: remove more RVM stuff for Ref Guide build on new CI machines 2020-08-07 13:22:15 -05:00
Cassandra Targett a03e323a9f INFRA-20656: comment out RVM install to fix the Ref Guide build on new Jenkins 2020-08-07 13:03:22 -05:00
Marcus 7110118ad4
SOLR-14702: Remove oppressive language (part1) (#1711)
Replace references to "master" and "slave" with "leader" and "follower"
2020-08-05 14:52:48 -07:00
Mike Drob 591d844e80
LUCENE-9412 Do not validate jenkins HTTPS cert 2020-06-19 23:42:02 -05:00
Mike Drob 674c2c28f4
Fix typos in release wizard (#1539) 2020-06-03 15:27:37 -05:00
Ignacio Vera 98ef96ccbb
LUCENE-9288: poll_mirrors.py release script can handle HTTPS mirrors (#1520) 2020-05-15 16:33:23 +02:00
Jan Høydahl 329e7c7bd5
LUCENE-9033 Update ReleaseWizard for new website instructions (#1324) 2020-05-13 23:52:40 +02:00
Mike McCandless e0c06ee6a6 LUCENE-9191: make LineFileDocs random seeking more efficient by recording safe skip points in the concatenated gzip'd chunks 2020-04-21 12:09:17 -04:00
Mike Drob cd9375a6f9 LUCENE-9266 Update smoke test for gradle 2020-03-26 13:46:55 -05:00
Alan Woodward 232d940c98 Really fix python syntax in smoke tester 2020-03-12 14:41:12 +00:00
Alan Woodward f312ca327f Fix python syntax in smoke tester 2020-03-12 12:06:38 +00:00
Alan Woodward daf149817a Correctly pass gpg_key to release script 2020-03-12 10:52:21 +00:00
Alan Woodward 26a32d79cc Changes to release scripts for 8.5 release
* Warning message in releaseWizard about setting GPG_TTY
* Download GPG keys from new location
* Correct git commands in release wizard
2020-03-12 09:10:28 +00:00
Jan Høydahl 751fbecc58
Remove some unused lines from addBackcompatIndexes.py related to svn (#1322) 2020-03-11 00:43:42 +01:00
Jan Høydahl 354f07cd3d
Remove unused scripts in dev-tools folder (#1326) 2020-03-10 19:48:42 +01:00
Adrien Grand 46bda6bea0 SOLR-12930: Include `dev-docs` in the expected list files for the source archive.
Otherwise the smoke tester fails.
2020-03-04 08:59:57 +01:00
Jan Høydahl c777db7c8a Add HTML output format to gitHubPRs.py
Also better JSON output structure
2020-02-15 02:06:16 +01:00
David Smiley 46c0945614 SOLR-14149: CHANGES.txt Remove off-topic stuff
* No Introduction (to Solr) header.  Point at solr-upgrade-notes.adoc instead
* No Getting Started header
* No Versions of Major Components header
* No "Upgrade Notes" for subsequent releases.  See solr-upgrade-notes.adoc
Closes #1202
2020-02-08 22:52:38 -05:00
Robert Muir 69f26d099e
LUCENE-9213: fix documentation-lint (and finally precommit) to work on java 12 and 13
the "missing javadocs" checker needed tweaks to work with the format
changes of java 13.

As a followup we may investigate javadoc (maybe the new doclet api). It
has its own missing checks too now, but they are black vs white (either
fully documented or not checked), whereas this python tool allows us to
"improve", e.g. enforce that all classes have doc, even if all
methods do not yet.
2020-02-07 17:18:26 -05:00
Nicholas Knize 78655239c5 LUCENE-8369: Remove obsolete spatial module 2020-01-16 11:22:05 -06:00
Adrien Grand 43e30f9665 Minor fixes to the release wizard. (#1127) 2019-12-30 17:21:18 +01:00
Jan Høydahl d86b473ab8
Change 72h voting rules for release wizard (#1118) 2019-12-24 23:13:01 +01:00
Chris Hostetter acd56b350d LUCENE-9054: fix stupid nocommit comment 2019-11-22 08:22:39 -07:00
Chris Hostetter 2d1e67c8b4 LUCENE-9054: Fix reproduceJenkinsFailures.py to not overwrite junit XML files when retrying 2019-11-21 15:28:46 -07:00
Cassandra Targett b5bf906caf
SOLR-13782: Remove PDF Ref Guide build (#999)
closes #999
2019-11-19 14:54:30 -07:00
Cassandra Targett b3d59a7a8b SOLR-12786: add back explicit asciidoctor install for Jenkins build 2019-10-16 12:21:48 -05:00
Cassandra Targett 621461fd1a SOLR-12786: Update Ref Guide build tool versions & fix section links for new format requirements 2019-10-16 11:03:17 -05:00
David Smiley 742e6b7eff LUCENE-8883: addVersion.py now adds categories to CHANGES.txt 2019-08-06 13:53:22 +02:00
Jan Høydahl 36af839eb1 LUCENE-8852: Fix wording and git commit msg 2019-07-04 19:04:24 +02:00
Cassandra Targett 82bf95727e Update Ruby version in Ref Guide build script 2019-07-01 10:25:16 -05:00
Alan Woodward df3011a539 LUCENE-8766: Add monitor sub-project to smoke tester 2019-06-20 17:32:23 +01:00
Jan Høydahl 87c131baa7
LUCENE-8852 ReleaseWizard tool (#710) 2019-06-20 14:45:17 +02:00
Jan Høydahl d2793688ca
LUCENE-8861: Script to find open PRs that needs attention (#719) 2019-06-14 13:30:04 +02:00
Jan Høydahl 44287d4206
LUCENE-8837 smokeTestRelease.py option --download-only (#702)
* LUCENE-8837: smokeTestRelease.py option --download-only
Move download() and check_and() functions to scriptutil
Add cwd param to run() function in scriptutil
Move the check_ant function from buildAndPushRelease into scriptutil.py, and let it return the version.
2019-06-11 10:17:10 +02:00
Jan Høydahl df1775ffd3
LUCENE-8802: buildAndPushRelease --logfile arg (#679) 2019-06-06 21:47:50 +02:00
Jan Høydahl 8d6fd7298f LUCENE-8818: Fix smokeTestRelease.py encoding bug 2019-06-06 21:42:24 +02:00
Jan Høydahl 6b70bdb3c0 LUCENE-8827: Speed up poll-mirrors.py 2019-06-05 21:22:29 +02:00
Jan Høydahl f070b7c742
LUCENE-8827: Speed up poll-mirrors.py and add -once argument. Python3 only (#699)
Also skips Python2 support like the other scripts in the folder
2019-06-05 21:14:31 +02:00
Ishan Chattopadhyaya 0d8243a132 SOLR-13335: Fix addVersion.py script that references velocity versions 2019-05-01 14:45:19 +05:30
Ishan Chattopadhyaya 53eafe75f3 SOLR-13335: Fix addVersion.py script that references velocity versions 2019-05-01 14:45:19 +05:30
Uwe Schindler faaee86efb LUCENE-8738: Move to Java 11 as minimum Java version (merged branch: jira/LUCENE-8738)
Co-authored-by: Adrien Grand <jpountz@apache.org>
2019-04-16 14:00:09 +02:00
Tomoko Uchida 6e28cd60a8 LUCENE-2562: Fix smoker for 'luke' module. 2019-04-13 01:24:05 +09:00
Alan Woodward 55c061770e Allow GPG keys with no spaces 2019-02-12 09:02:03 +00:00
Adrien Grand c074b97e79 LUCENE-8579: Don't run bad apples when building a release. 2018-11-30 09:42:20 +01:00
Cassandra Targett 1e3cc4861a SOLR-12746: Simplify the Ref Guide HTML structure and use semantic HTML tags where possible. Adds new template files for Asciidoctor HTML conversion. 2018-11-05 09:07:01 -06:00
Jan Høydahl 03c9c04353 LUCENE-8493: Stop publishing insecure .sha1 files with releases 2018-09-26 15:31:26 +02:00
Jim Ferenczi a02959c87e LUCENE-8500: Fix release smoke test to always use the downloaded KEYS file 2018-09-15 21:28:12 +02:00
Jan Høydahl 5b96f89d2b LUCENE-5143: Fix smoketester, fix RM PGP key check, fix solr DOAP file, add CHANGES entry
Remove unused/stale 'copy-to-stage' and '-dist-keys' targets from ant build
2018-09-11 22:39:19 +02:00
Jan Høydahl 982ee3931b LUCENE-5143: rm or formalize dealing with "general" KEYS files in our dist dir 2018-09-04 13:24:24 +02:00
Alexandre Rafalovitch b7d14c50fb SOLR-11694: Remove outdated UIMA module 2018-07-07 09:58:57 -04:00
Steve Rowe 302df4dbf3 fix 'gem uninstall' to remove ignore dependency conflicts 2018-07-05 15:03:41 -04:00
Steve Rowe 407e1500bb fix 'gem uninstall' to remove all versions of the gem 2018-07-05 15:00:56 -04:00
Steve Rowe 6c0a03c578 First uninstall 'asciidoctor' gem before installing it, to remove unwanted versions 2018-07-05 14:58:10 -04:00
Steve Rowe 039dae76cb Run 'rvm cleanup all' to remove old stuff 2018-07-05 14:53:44 -04:00
Steve Rowe ee5aa87254 Remove duplicate 'git merge' 2018-06-20 10:16:12 -04:00
Steve Rowe bcbcb16b6a Make sure remote branch is available and tracked locally, and merge remote into local branch 2018-06-20 09:38:30 -04:00
Steve Rowe 74bd5d5658 Handle the case of checking out a remote branch that has never been checked out locally before 2018-06-19 22:21:26 -04:00
Steve Rowe d04acc95f0 Actually checkout the tip of the branch instead of just saying we will 2018-06-19 19:33:54 -04:00
Steve Rowe 9cbaf327e8 install asciidoctor gem before jekyll-asciidoc, to prevent installation of a too-new version of asciidoctor 2018-05-17 17:32:41 -04:00
Steve Rowe 99c4adfb6a Pin asciidoctor gem to v1.5.6.2 to avoid behavior changes in v1.5.7 2018-05-17 14:42:12 -04:00
Jan Høydahl 60ae7be407 LUCENE-7935: Keep md5/sha1 checksums for maven artifacts 2018-04-05 02:18:04 +02:00
Steve Rowe 1ce72537b8 LUCENE-8106: add missing import 2018-03-29 13:51:39 -04:00
Jan Høydahl 9e780ba564 LUCENE-7935: Publish .sha512 hash files with the release artifacts 2018-03-28 09:14:03 +02:00
Alan Woodward f2e3b109e6 LUCENE-8224: Allow releases to be built with ant 1.10
Also adds a check to common-build.xml to fail early with ant 1.10.2, which
has a bug that prevents lucene from building.
2018-03-26 14:06:54 +01:00