aaffb3ed75
changed to hostmanager-aware taskQueue
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150838 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:03:31 +00:00
b6243a3cbe
better handling of status codes
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150837 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:02:43 +00:00
25926e6866
- Added FIXME.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150832 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 20:21:18 +00:00
9aadfdbc15
- Moved constructor up, made attributes private, added a FIXME and a TODO.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150831 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 19:30:40 +00:00
0279b5b1fc
- Files to ignore.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150830 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 18:18:10 +00:00
3e4a19fed7
- Fixed vague class reference that caused compilation errors with Jikes.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150829 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 18:15:46 +00:00
04e68db1cd
- Made queue attribute private; cosmetics.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150828 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 17:54:29 +00:00
d1e9be8015
- Split target build into targets compile and dist. Made compile target the
...
default one.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150827 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:58:07 +00:00
69397847cd
- Made constructor private, added a few FIXMEs, etc.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150826 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:38:14 +00:00
c3a69fd77d
- Made this singleton thread-safe.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150825 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:26:21 +00:00
e8dfbf2ace
- Added APL.
...
- Moved all attributes up.
- Fixed weird class javadoc.
- Made a few small mods and added FIXMEs.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150824 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:22:05 +00:00
3252c4925a
- Added 2 FIXMEs.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150823 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:13:12 +00:00
475a837eaf
- Added APL, made an attrib private.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150822 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:10:17 +00:00
302f6949ab
- Added javadoc skeletons for a few methods.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150821 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:09:23 +00:00
3e11600e4e
- Made attributes private.
...
- Added FIXME.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150820 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:01:13 +00:00
8ba01b18ad
- Made attributes private, formatter final.
...
- Added FIXME, added some Javadocs.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150819 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 23:55:41 +00:00
21ec179316
- Added a comment about a small bug with the messageQueue's status.
...
- A few minor cosmetic changes.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150818 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 20:58:12 +00:00
bc40fa1994
- Modified to clean dirs/files created by run.sh.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150817 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 19:22:45 +00:00
b248127c1f
- Default build properties for LARM. Initial checkin.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150816 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 19:19:47 +00:00
9438e5ab02
- Moved properties to a properties file.
...
- Commented out checksyntax and run targets, since LARM can be started from
run.sh now.
- Added target clean that just cleans the build files and changed cleanall
target to use it.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150815 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 19:16:28 +00:00
d6cc4d7342
- Modified to make it usable. This way we don't have to use Ant to run LARM.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150814 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 18:51:49 +00:00
2bd4df4bcb
added with -kb option
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150800 13f79535-47bb-0310-9956-ffa450edef68
2002-06-30 18:05:15 +00:00
407fadc3bb
was empty
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150799 13f79535-47bb-0310-9956-ffa450edef68
2002-06-30 15:12:54 +00:00
c7e103618b
.doc doesn't seem to work. let's try rtf
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150798 13f79535-47bb-0310-9956-ffa450edef68
2002-06-30 15:12:04 +00:00
1a0a676354
- Added oro.jar property.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150797 13f79535-47bb-0310-9956-ffa450edef68
2002-06-30 14:58:49 +00:00
05d752d877
- Fixed Usage text.
...
- Added oro.jar property.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150796 13f79535-47bb-0310-9956-ffa450edef68
2002-06-30 14:58:27 +00:00
6af8f0a0c2
- Initial checkin.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150793 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 22:30:17 +00:00
a2ec870f44
- Renamed the assert(boolean) method to affirm(boolean) to avoid warnings
...
about assert being a reserved word (JDK 1.4).
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150792 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 21:57:00 +00:00
e6aeb1c4d8
- This is not needed any more.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150791 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 21:55:49 +00:00
138b3d3b1f
not much changed
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150790 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 11:42:54 +00:00
bea35900d5
see file
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150789 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 11:39:51 +00:00
91b3058b38
added LuceneStorage
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150788 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:49:57 +00:00
be12c931f4
lucene.jar is now necessary for building lucene storage
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150787 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:47:39 +00:00
42c33097b3
changed web doc. to field/value pairs
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150786 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:46:35 +00:00
8790e328db
added experimental version of LuceneStorage
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150785 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:45:10 +00:00
bdd627d35c
added experimental version of a LuceneStorage
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150784 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:44:22 +00:00
8ed5fa47fd
added URLNormalizer
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150783 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 14:16:12 +00:00
8e18fa1cb0
moved HostInfo/HostManager to larm.net package; added URLNormalizer
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150782 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 14:00:13 +00:00
5b90c10cb5
added URLNormalizer. Changed filters to use normalized URLs if possible
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150781 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 13:59:28 +00:00
14fdfb458f
removed bug: doc is saved under new URL if 301/302 error occured
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150780 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 13:58:33 +00:00
6fd283db33
added storage pipeline; some fixes on Tokenizer
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150778 13f79535-47bb-0310-9956-ffa450edef68
2002-06-01 18:55:16 +00:00
7a3b5acf37
added license info; added anchor text extraction
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150775 13f79535-47bb-0310-9956-ffa450edef68
2002-05-22 23:09:22 +00:00
e16a9e73df
added documentation
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150772 13f79535-47bb-0310-9956-ffa450edef68
2002-05-13 21:26:09 +00:00
f4e2c2bbbb
- A REDME for LARM webcrawler contribution.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150752 13f79535-47bb-0310-9956-ffa450edef68
2002-05-04 14:32:24 +00:00
cf2fa142c8
Initial revision
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150751 13f79535-47bb-0310-9956-ffa450edef68
2002-05-04 13:58:45 +00:00
cmarschner
Otis Gospodnetic