Commit Graph

43 Commits

Author SHA1 Message Date
cmarschner 61aa56d778 fixed build issues
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150874 13f79535-47bb-0310-9956-ffa450edef68
2003-04-11 13:43:41 +00:00
cmarschner babe70d08d *** empty log message ***
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150854 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:40:48 +00:00
cmarschner 528544daa3 added copy constructor for URLMessages; added some setter/getter methods
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150853 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:38:50 +00:00
cmarschner a01f445199 added isEmpty and clear methods
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150852 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:37:09 +00:00
cmarschner ebbf92c2f4 added getCurrentKey method
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150851 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:36:40 +00:00
cmarschner 71607a59dd minor fix
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150850 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:32:08 +00:00
cmarschner cfc8c67549 write raw bytes to page files instead of characters
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150849 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:31:16 +00:00
cmarschner dc3fa94442 changed hostManager stuff to hostResolver
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150848 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:24:26 +00:00
cmarschner 922db8cfe6 added host semaphores
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150847 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:22:59 +00:00
cmarschner 2d3e3954ac added logging
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150846 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:21:50 +00:00
cmarschner 9f5185b44c takes normalized URL string for comparisons; added logging
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150845 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:21:00 +00:00
cmarschner a27b6a627a changed isFrame to linkType; improved error checking when one of the args is null
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150844 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:19:56 +00:00
cmarschner 09c4896e3a minor display changes
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150843 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:16:35 +00:00
cmarschner e9ebe848b8 improved logging
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150842 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:15:07 +00:00
cmarschner c221f17ea5 moved HTTPClient config from Task to Thread
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150841 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:11:44 +00:00
cmarschner df5d692480 removed test case from main()
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150840 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:09:22 +00:00
cmarschner e50d457ef7 more than one start URL; hostResolver
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150839 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:05:07 +00:00
cmarschner aaffb3ed75 changed to hostmanager-aware taskQueue
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150838 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:03:31 +00:00
cmarschner b6243a3cbe better handling of status codes
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150837 13f79535-47bb-0310-9956-ffa450edef68
2002-10-22 15:02:43 +00:00
Otis Gospodnetic 25926e6866 - Added FIXME.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150832 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 20:21:18 +00:00
Otis Gospodnetic 9aadfdbc15 - Moved constructor up, made attributes private, added a FIXME and a TODO.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150831 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 19:30:40 +00:00
Otis Gospodnetic 3e4a19fed7 - Fixed vague class reference that caused compilation errors with Jikes.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150829 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 18:15:46 +00:00
Otis Gospodnetic 04e68db1cd - Made queue attribute private; cosmetics.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150828 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 17:54:29 +00:00
Otis Gospodnetic 69397847cd - Made constructor private, added a few FIXMEs, etc.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150826 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:38:14 +00:00
Otis Gospodnetic c3a69fd77d - Made this singleton thread-safe.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150825 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:26:21 +00:00
Otis Gospodnetic e8dfbf2ace - Added APL.
- Moved all attributes up.
- Fixed weird class javadoc.
- Made a few small mods and added FIXMEs.


git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150824 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:22:05 +00:00
Otis Gospodnetic 3252c4925a - Added 2 FIXMEs.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150823 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:13:12 +00:00
Otis Gospodnetic 475a837eaf - Added APL, made an attrib private.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150822 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:10:17 +00:00
Otis Gospodnetic 302f6949ab - Added javadoc skeletons for a few methods.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150821 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:09:23 +00:00
Otis Gospodnetic 3e11600e4e - Made attributes private.
- Added FIXME.


git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150820 13f79535-47bb-0310-9956-ffa450edef68
2002-09-15 00:01:13 +00:00
Otis Gospodnetic 8ba01b18ad - Made attributes private, formatter final.
- Added FIXME, added some Javadocs.


git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150819 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 23:55:41 +00:00
Otis Gospodnetic 21ec179316 - Added a comment about a small bug with the messageQueue's status.
- A few minor cosmetic changes.


git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150818 13f79535-47bb-0310-9956-ffa450edef68
2002-09-14 20:58:12 +00:00
Otis Gospodnetic a2ec870f44 - Renamed the assert(boolean) method to affirm(boolean) to avoid warnings
about assert being a reserved word (JDK 1.4).


git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150792 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 21:57:00 +00:00
cmarschner 42c33097b3 changed web doc. to field/value pairs
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150786 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:46:35 +00:00
cmarschner 8790e328db added experimental version of LuceneStorage
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150785 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:45:10 +00:00
cmarschner bdd627d35c added experimental version of a LuceneStorage
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150784 13f79535-47bb-0310-9956-ffa450edef68
2002-06-18 00:44:22 +00:00
cmarschner 8ed5fa47fd added URLNormalizer
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150783 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 14:16:12 +00:00
cmarschner 8e18fa1cb0 moved HostInfo/HostManager to larm.net package; added URLNormalizer
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150782 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 14:00:13 +00:00
cmarschner 5b90c10cb5 added URLNormalizer. Changed filters to use normalized URLs if possible
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150781 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 13:59:28 +00:00
cmarschner 14fdfb458f removed bug: doc is saved under new URL if 301/302 error occured
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150780 13f79535-47bb-0310-9956-ffa450edef68
2002-06-17 13:58:33 +00:00
cmarschner 6fd283db33 added storage pipeline; some fixes on Tokenizer
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150778 13f79535-47bb-0310-9956-ffa450edef68
2002-06-01 18:55:16 +00:00
cmarschner 7a3b5acf37 added license info; added anchor text extraction
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150775 13f79535-47bb-0310-9956-ffa450edef68
2002-05-22 23:09:22 +00:00
Otis Gospodnetic cf2fa142c8 Initial revision
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@150751 13f79535-47bb-0310-9956-ffa450edef68
2002-05-04 13:58:45 +00:00