Commit Graph

505 Commits

Author SHA1 Message Date
Adrien Grand 65296e5f84
Use CDN to download source release. (#529) 2022-01-05 15:54:33 +01:00
Adrien Grand 6149387f7c
Modernize release announcement text. (#525)
It currently reads as Lucene is a full-text search library when it can do much
more than that nowadays.
2022-01-05 15:53:49 +01:00
Dawid Weiss a94fbb79ac LUCENE-10301: make the test-framework a proper module by moving all test
classes to org.apache.lucene.tests.*. Also changes distribution layout
(all modules are now under modules/).
2021-12-21 20:30:45 +01:00
Jan Høydahl 8c48475c4d Add java version mapping for lucene 10 2021-12-16 13:07:03 +01:00
Adrien Grand f605b4a692
LUCENE-10253: Remove the BadApple annotation. (#468) 2021-12-01 18:03:02 +01:00
Dawid Weiss a37b74a630 LUCENE-10234: update smoke-tester with new module names. 2021-12-01 09:59:15 +01:00
Adrien Grand 24fcd80a37
LUCENE-10168: Only test N-2 codecs on nightly runs. (#466)
In order for tests to keep running fast, this annotates all tests of N-2 codecs
with `@Nightly`. To keep good coverage of releases, the smoke tester is now
configured to run nightly tests.
2021-11-24 08:20:04 +01:00
Adrien Grand 0902d803fd Add dash between `rev` and the git hash. 2021-11-20 08:09:42 +01:00
Adrien Grand f9be01d5cc Format javadocs of new versions in a way that Spotless is happy with. 2021-11-02 13:12:39 +01:00
Dawid Weiss 0544819b78
LUCENE-10200: store git revision in the release folder and read it back from buildAndPushRelease (#419) 2021-11-01 09:29:06 +01:00
Dawid Weiss ded915b29b LUCENE-10192: Use modules instead of classpath for binary distribution testing. 2021-10-31 10:41:49 +01:00
Dawid Weiss 01839da593 LUCENE-10192: Adjust checks to the new binary file structure. 2021-10-31 10:41:42 +01:00
Dawid Weiss d23f37d02d LUCENE-10200: The branch does not have to be on origin remote. Replace this logic with a check whether the branch is up to date with the remote. 2021-10-31 10:41:32 +01:00
Dawid Weiss 1613355149 LUCENE-10163: update smoke tester - README inside lucene/ is no longer there in the source release. 2021-10-26 21:58:20 +02:00
Dawid Weiss fb6aaa7b2c
LUCENE-10199: drop binary .zip artifact. (#407) 2021-10-26 21:21:30 +02:00
Jan Høydahl 5b8f0a5eb5
LUCENE-10174 Speed up 'pushLocal' by using uncompressed tar (#401) 2021-10-20 14:41:24 +02:00
Tomoko Uchida 54418cef45
LUCENE-9997: write release revision to system temp dir (#394) 2021-10-20 07:06:30 +09:00
Jan Høydahl c77e9ddf93
LUCENE-9997 Second pass smoketester fixes for 9.0 (#391)
* Java17 fixes

* Add to error message that the unexpected file is in lucene/ folder

* Fix gpg command utf-8 output

* Add --no-daemon to all gradle calls, and skip clean

Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
Co-Authored-by: Tomoko Uchida <tomoko.uchida.1111@gmail.com>
2021-10-19 21:24:06 +02:00
Jan Høydahl f5486d13e6
LUCENE-10174 BuildAndPushRelease additional improvements (#396) 2021-10-19 19:48:44 +02:00
Tomoko Uchida 03e8192674
Specify minimum required python version for dev scripts (#387) 2021-10-17 13:45:49 +09:00
Jan Høydahl cdfa11b158
LUCENE-10174 Update buildAndPushRelease.py for new gradle build (#382)
Co-authored-by: Tomoko Uchida <tomoko.uchida.1111@gmail.com>
2021-10-17 01:17:34 +02:00
Jan Høydahl f38c401283
LUCENE-10179 No longer check for release status on mirrors (#384) 2021-10-15 20:25:29 +02:00
Jan Høydahl ae956db41c
LUCENE-9997 Revisit smoketester for 9.0 build (#355)
* LUCENE-9997 Revisit smoketester for 9.0 build

* Remove checkBrokenLinks

* Add back checkBrokenLinks

* Review feedback. Remove traces of solr-specific testNotice() method
Move backCompat test up to other "if isSrc" block

* Review feedback. Bring back the 'checkMaven()' method, as it checks lucene maven artifacts.
But since we dont have pom template files anymore, no need to compare with templates

* Review feedback. Fix script compatibility by comparing against X.Y instead of X.Y.Z

* Review feedback. Remove unnecessary if lucene test
Convert some ant commands to gradle

* Update MANIFEST tests to match the gradle-produced manifest

* LUCENE-10107 Read multi-line commit from Manifest
Backport from branch_8x

* Collapse for project in 'lucene' loops and methods taking 'project' as argument
Disable checkJavadocLinks, as this dependency no longer exists in 'scripts' folder

* Review feedback - fix more ant stuff, convert to gradle equivalent

* Review feedback: Refactor file open

* Comment out javadoc generation - was only used to check broken links?

* Fix charset of gpg console output to always be utf-8
Fix two more places to use with open()

* Accept 'LICENSE' without txt or md suffix in top-level

* Disable vector dictionary abuse exception if started with -Dsmoketester

* Reformat code

* Use -Dsmoketester flag when invoking IndexFiles
2021-10-13 15:24:14 +02:00
Jan Høydahl 674b66dd16
LUCENE-9809 Adapt Release Wizard to only release Lucene (#344)
* Update wording in README and poll-mirrors.py
* First pass at updating wizard
- lucene/solr -> lucene
- removed solr-only tasks and python functions
* Update addVersion to remove Solr parts
- fixes bug with a regex and missing String qualifier for gradle baseVersion
* buildAndPushRelease - remove solr parts
* githubPRs.py report on PRs from new lucene repo and lucene JIRA only
* update smokeTestRelease.py example in README.md (but not smokeTestRelease.py itself)
* remove Solr references in releasedJirasRegex.py
* Update releasedJirasRegex.py
* Add gpg release signing to buildAndPushRelease.py

Co-authored-by: Christine Poerschke <cpoerschke@apache.org>
2021-10-05 23:33:59 +02:00
Christine Poerschke 57524c6a5e
LUCENE-9809: replace 'master' with 'main' in release wizard (#305) 2021-09-20 17:51:41 +01:00
Houston Putman 059d06cec7
Fix gpg key download in release wizard. (#279)
Old URL to check the apache id gpg key is no longer available.
2021-09-02 18:08:57 -04:00
Uwe Schindler 5813292de2 LUCENE-10055: Update Subversion foder for Javadocs 2021-08-22 13:34:09 +02:00
Dawid Weiss 3bedc0871e
LUCENE-9977: rat task corrections (proper up-to-date checks, cleanup and rewrite of the task itself). (#178) 2021-06-11 09:26:34 +02:00
Christine Poerschke 1ec2a715a2 Fix 8.9.0 < 8.10.0 comparison in smokeTestRelease.py script. (#2509) 2021-06-08 15:54:57 +01:00
Ayushman Singh Chauhan c49bfb8e01
DOC: Fix spelling (#111) 2021-04-28 13:19:34 -04:00
Dawid Weiss 3115797463 LUCENE-9871: clean up some old cruft and shuffle files around. Correct inputs/outputs on check broken links so that it's incremental. 2021-03-30 10:55:19 +02:00
Uwe Schindler 5ade66059f
Cleanup readme file, doaps and copy build instructions from lucene subfolder (#6) 2021-03-10 16:10:06 +01:00
Dawid Weiss 409bc37c13
SOLR-14759: a few initial changes so that Lucene can be built independently while Solr code is still in place. (#2448) 2021-03-08 14:59:08 +01:00
Ignacio Vera cfd0ccefe1
LUCENE-9777: Fix out of date versions on releases 8.7.0 and 8.8.0 (#2377) 2021-02-17 08:29:05 +01:00
Jan Høydahl 2f6807cc76
Split the publish_maven step in two TODOs (#2279) 2021-02-05 09:58:48 +01:00
Dawid Weiss 7f8b7ffbca LUCENE-9570: code reformatting [partial]. 2021-01-03 21:46:01 +01:00
Dawid Weiss 2d6ad2fee6 LUCENE-9570: code reformatting [partial]. 2020-12-23 12:41:23 +01:00
Houston Putman 0f15b5e2ee
Adding Apache Reporter step in Release Wizard. (#2130) 2020-12-08 04:04:49 -05:00
David Smiley d50bdbae83
Remove obsolete dev-tools scripts (#2105) 2020-12-02 16:04:40 -05:00
David Smiley 1e0ae2fb74
SOLR-15001 Docker: require init_var_solr.sh (#2083)
The Dockerfile should not initialize /var/solr's contents because this is confusing and redundant with init_var_solr.sh.
No need for init_var_solr.sh to echo what it does; VERBOSE can be used to accomplish that.

Separate CHANGES.md for Docker and contrib modules.
2020-11-27 14:59:54 -05:00
Jan Høydahl 462c6c70d1
Graduate the release wizard from ALPHA (#2041) 2020-10-29 11:24:02 +01:00
Jason Gerlowski 80df6a3d62 LUCENE-9434: Remove wiki-update step from release 2020-10-09 14:13:05 -04:00
Jason Gerlowski 2a9d704002 Update addBackcompatIndexes.py test running to gradle 2020-10-09 11:32:49 -04:00
Jason Gerlowski 178d83d635 Update addVersion.py test running to gradle 2020-10-09 10:25:19 -04:00
Mike Drob 08e38d3452
LUCENE-9488 Create Release Artifacts with Gradle (#1905)
* Build Lucene binary distribution using Gradle
* Generate SHA-512 checksums for all release artifacts
* Update documentation artifacts included in binaries
* Delete some additional Ant relics

Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
Co-authored-by: Uwe Schindler <uschindler@apache.org>
2020-10-08 14:25:51 -05:00
Mike Drob 3134f10a42
LUCENE-9488 Update release process to work with gradle (#1860)
* Restore lucene/version.properties
* Switch release wizard commands from ant to gradle equivalents
* Remove remaining checks for ant
* Remove checks for Java 8
* Update Copyright year
* Minor bug fixes around determining next version for a major release
2020-09-15 10:10:17 -05:00
Robert Muir 784ede4eda
LUCENE-9215: replace checkJavaDocs.py with doclet (#1802)
This has the same logic as the previous python, but no longer relies
upon parsing HTML output, instead using java's doclet processor.

The errors are reported like "normal" javadoc errors with source file
name and line number and happen when running "gradlew javadoc"

Although the "rules" are the same as the previous python, the python had
some bugs where the checker didn't quite do exactly what we wanted, so
some fixes were applied throughout.

Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
Co-authored-by: Uwe Schindler <uschindler@apache.org>
2020-09-02 08:29:17 -04:00
Alexandre Rafalovitch a8ea6e70eb
Ancient patch file deleted (#1800) 2020-08-31 08:41:36 -04:00
Alexandre Rafalovitch a57ba25400
SOLR-14783: Remove DIH from 9.0 (#1794)
* Remove DIH example directory

* Remove contrib code directories

* Remove contrib package related configurations for build tools

* Remove mention of DIH example

* remove dih as build dependencies and no-longer needed version pins

* Remove README references to DIH

* Remove dih mention from the script that probably does need to exist at all

* More build artifact references

* More removed dependencies leftovers (licenses/versions)

* No need to smoke exclude DIH anymore

* Remove Admin UI's DIH integration

* Remove DIH from shortname package list

* Remove unused DIH (related? not?) dataset
Unclear what is happening here, but there is no reference to that directory anywhere else
The other parallel directories ARE referenced in a TestConfigSetsAPI.java

* Hidden Idea files references

* No DIH to ignore anymore

* Remove last Derby DB references

* Remove DIH from documentation
Add the information in Major Changes document with the link to the external repo

* Added/updated a mention to CHANGES

* Fix leftover library mentions

* Fix Spellings
2020-08-29 10:52:04 -04:00
Jan Høydahl 18e5f21178
LUCENE-9485: Check early if Solr port 8983 is available (#1792) 2020-08-28 10:08:40 +02:00
Simon Willnauer 75e15497ec
Run tests last to fail fast on missing license and doc issues (#1788) 2020-08-26 12:55:25 +02:00
Houston Putman 0f06eff4b7 Additions to releaseWizard (#1763)
- Backporting the DOA changes
- Adding link to Solr Upgrade Notes in release notes
- Adding step for obtaining jira permissions.
2020-08-24 09:53:03 -04:00
S N Munendra d2cc022fcf
Fix syntax warning in smokeTestRelease.py (#1746)
while verifying the 8.6.1 release with latest python(3.8.5), observed
one SyntaxWarning.
https://adamj.eu/tech/2020/01/21/why-does-python-3-8-syntaxwarning-for-is-literal/
2020-08-13 21:15:28 +05:30
Cassandra Targett a747051c6a LUCENE-9452: remove jenkins.build.ref.guide.sh as it's no longer needed 2020-08-10 15:48:13 -05:00
Cassandra Targett 10baa50519 Add paths for gems on new CI machines 2020-08-07 13:58:07 -05:00
Cassandra Targett 5dd4cd1ed3 Comment out RVM_PATH and RUBY_VERSION 2020-08-07 13:40:36 -05:00
Cassandra Targett fb9110ad18 This time comment out ALL the RVM commands to fix the build 2020-08-07 13:35:37 -05:00
Cassandra Targett abf637fc88 INFRA-20656: remove more RVM stuff for Ref Guide build on new CI machines 2020-08-07 13:22:15 -05:00
Cassandra Targett a03e323a9f INFRA-20656: comment out RVM install to fix the Ref Guide build on new Jenkins 2020-08-07 13:03:22 -05:00
Marcus 7110118ad4
SOLR-14702: Remove oppressive language (part1) (#1711)
Replace references to "master" and "slave" with "leader" and "follower"
2020-08-05 14:52:48 -07:00
Mike Drob 591d844e80
LUCENE-9412 Do not validate jenkins HTTPS cert 2020-06-19 23:42:02 -05:00
Mike Drob 674c2c28f4
Fix typos in release wizard (#1539) 2020-06-03 15:27:37 -05:00
Ignacio Vera 98ef96ccbb
LUCENE-9288: poll_mirrors.py release script can handle HTTPS mirrors (#1520) 2020-05-15 16:33:23 +02:00
Jan Høydahl 329e7c7bd5
LUCENE-9033 Update ReleaseWizard for new website instructions (#1324) 2020-05-13 23:52:40 +02:00
Mike McCandless e0c06ee6a6 LUCENE-9191: make LineFileDocs random seeking more efficient by recording safe skip points in the concatenated gzip'd chunks 2020-04-21 12:09:17 -04:00
Mike Drob cd9375a6f9 LUCENE-9266 Update smoke test for gradle 2020-03-26 13:46:55 -05:00
Alan Woodward 232d940c98 Really fix python syntax in smoke tester 2020-03-12 14:41:12 +00:00
Alan Woodward f312ca327f Fix python syntax in smoke tester 2020-03-12 12:06:38 +00:00
Alan Woodward daf149817a Correctly pass gpg_key to release script 2020-03-12 10:52:21 +00:00
Alan Woodward 26a32d79cc Changes to release scripts for 8.5 release
* Warning message in releaseWizard about setting GPG_TTY
* Download GPG keys from new location
* Correct git commands in release wizard
2020-03-12 09:10:28 +00:00
Jan Høydahl 751fbecc58
Remove some unused lines from addBackcompatIndexes.py related to svn (#1322) 2020-03-11 00:43:42 +01:00
Jan Høydahl 354f07cd3d
Remove unused scripts in dev-tools folder (#1326) 2020-03-10 19:48:42 +01:00
Adrien Grand 46bda6bea0 SOLR-12930: Include `dev-docs` in the expected list files for the source archive.
Otherwise the smoke tester fails.
2020-03-04 08:59:57 +01:00
Jan Høydahl c777db7c8a Add HTML output format to gitHubPRs.py
Also better JSON output structure
2020-02-15 02:06:16 +01:00
David Smiley 46c0945614 SOLR-14149: CHANGES.txt Remove off-topic stuff
* No Introduction (to Solr) header.  Point at solr-upgrade-notes.adoc instead
* No Getting Started header
* No Versions of Major Components header
* No "Upgrade Notes" for subsequent releases.  See solr-upgrade-notes.adoc
Closes #1202
2020-02-08 22:52:38 -05:00
Robert Muir 69f26d099e
LUCENE-9213: fix documentation-lint (and finally precommit) to work on java 12 and 13
the "missing javadocs" checker needed tweaks to work with the format
changes of java 13.

As a followup we may investigate javadoc (maybe the new doclet api). It
has its own missing checks too now, but they are black vs white (either
fully documented or not checked), whereas this python tool allows us to
"improve", e.g. enforce that all classes have doc, even if all
methods do not yet.
2020-02-07 17:18:26 -05:00
Nicholas Knize 78655239c5 LUCENE-8369: Remove obsolete spatial module 2020-01-16 11:22:05 -06:00
Adrien Grand 43e30f9665 Minor fixes to the release wizard. (#1127) 2019-12-30 17:21:18 +01:00
Jan Høydahl d86b473ab8
Change 72h voting rules for release wizard (#1118) 2019-12-24 23:13:01 +01:00
Chris Hostetter acd56b350d LUCENE-9054: fix stupid nocommit comment 2019-11-22 08:22:39 -07:00
Chris Hostetter 2d1e67c8b4 LUCENE-9054: Fix reproduceJenkinsFailures.py to not overwrite junit XML files when retrying 2019-11-21 15:28:46 -07:00
Cassandra Targett b5bf906caf
SOLR-13782: Remove PDF Ref Guide build (#999)
closes #999
2019-11-19 14:54:30 -07:00
Cassandra Targett b3d59a7a8b SOLR-12786: add back explicit asciidoctor install for Jenkins build 2019-10-16 12:21:48 -05:00
Cassandra Targett 621461fd1a SOLR-12786: Update Ref Guide build tool versions & fix section links for new format requirements 2019-10-16 11:03:17 -05:00
David Smiley 742e6b7eff LUCENE-8883: addVersion.py now adds categories to CHANGES.txt 2019-08-06 13:53:22 +02:00
Jan Høydahl 36af839eb1 LUCENE-8852: Fix wording and git commit msg 2019-07-04 19:04:24 +02:00
Cassandra Targett 82bf95727e Update Ruby version in Ref Guide build script 2019-07-01 10:25:16 -05:00
Alan Woodward df3011a539 LUCENE-8766: Add monitor sub-project to smoke tester 2019-06-20 17:32:23 +01:00
Jan Høydahl 87c131baa7
LUCENE-8852 ReleaseWizard tool (#710) 2019-06-20 14:45:17 +02:00
Jan Høydahl d2793688ca
LUCENE-8861: Script to find open PRs that needs attention (#719) 2019-06-14 13:30:04 +02:00
Jan Høydahl 44287d4206
LUCENE-8837 smokeTestRelease.py option --download-only (#702)
* LUCENE-8837: smokeTestRelease.py option --download-only
Move download() and check_and() functions to scriptutil
Add cwd param to run() function in scriptutil
Move the check_ant function from buildAndPushRelease into scriptutil.py, and let it return the version.
2019-06-11 10:17:10 +02:00
Jan Høydahl df1775ffd3
LUCENE-8802: buildAndPushRelease --logfile arg (#679) 2019-06-06 21:47:50 +02:00
Jan Høydahl 8d6fd7298f LUCENE-8818: Fix smokeTestRelease.py encoding bug 2019-06-06 21:42:24 +02:00
Jan Høydahl 6b70bdb3c0 LUCENE-8827: Speed up poll-mirrors.py 2019-06-05 21:22:29 +02:00
Jan Høydahl f070b7c742
LUCENE-8827: Speed up poll-mirrors.py and add -once argument. Python3 only (#699)
Also skips Python2 support like the other scripts in the folder
2019-06-05 21:14:31 +02:00
Ishan Chattopadhyaya 0d8243a132 SOLR-13335: Fix addVersion.py script that references velocity versions 2019-05-01 14:45:19 +05:30
Ishan Chattopadhyaya 53eafe75f3 SOLR-13335: Fix addVersion.py script that references velocity versions 2019-05-01 14:45:19 +05:30
Uwe Schindler faaee86efb LUCENE-8738: Move to Java 11 as minimum Java version (merged branch: jira/LUCENE-8738)
Co-authored-by: Adrien Grand <jpountz@apache.org>
2019-04-16 14:00:09 +02:00
Tomoko Uchida 6e28cd60a8 LUCENE-2562: Fix smoker for 'luke' module. 2019-04-13 01:24:05 +09:00
Alan Woodward 55c061770e Allow GPG keys with no spaces 2019-02-12 09:02:03 +00:00