Commit Graph

80 Commits

Author SHA1 Message Date
Noble Paul 6fe805f80b SOLR-1153 deltaImportQuery should be honored on child entities as well
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@776958 13f79535-47bb-0310-9956-ffa450edef68
2009-05-21 05:52:48 +00:00
Shalin Shekhar Mangar 6ef6e52271 SOLR-1146 -- ConcurrentModificationException in DataImporter.getStatusMessages
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@771580 13f79535-47bb-0310-9956-ffa450edef68
2009-05-05 06:24:21 +00:00
Shalin Shekhar Mangar 99a48e5604 SOLR-1092 -- Added a new command named 'import' which does not automatically clean the index
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@770980 13f79535-47bb-0310-9956-ffa450edef68
2009-05-02 19:50:25 +00:00
Shalin Shekhar Mangar 9f5b8ad035 SOLR-1127 -- Add support for field name to be templatized
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@769751 13f79535-47bb-0310-9956-ffa450edef68
2009-04-29 11:23:28 +00:00
Shalin Shekhar Mangar d7f7ca176f SOLR-1120 followup -- Introduced a DocWrapper which takes care of maintaining document level session variables
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@769058 13f79535-47bb-0310-9956-ffa450edef68
2009-04-27 16:55:46 +00:00
Shalin Shekhar Mangar e2a020b6c6 SOLR-1060 -- A LineEntityProcessor which can stream lines of text from a given file to be indexed directly or for processing with transformers and child entities.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@766638 13f79535-47bb-0310-9956-ffa450edef68
2009-04-20 10:12:50 +00:00
Shalin Shekhar Mangar a336753fdc SOLR-1120 -- Simplify EntityProcessor API
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@766608 13f79535-47bb-0310-9956-ffa450edef68
2009-04-20 07:36:55 +00:00
Shalin Shekhar Mangar 3c2e9ab3d6 SOLR-1080 followup -- Additional test cases for RegexTransformer
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@765559 13f79535-47bb-0310-9956-ffa450edef68
2009-04-16 10:15:54 +00:00
Shalin Shekhar Mangar 49a83c536e SOLR-969 -- Changed the FULL_DUMP, DELTA_DUMP, FIND_DELTA constants in Context to String. Changed Context.currentProcess() to return a string instead of an integer.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@765499 13f79535-47bb-0310-9956-ffa450edef68
2009-04-16 08:01:10 +00:00
Shalin Shekhar Mangar 12024eba47 SOLR-934 -- A MailEntityProcessor to enable indexing mails from POP/IMAP sources into a solr index
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@764601 13f79535-47bb-0310-9956-ffa450edef68
2009-04-13 20:26:10 +00:00
Shalin Shekhar Mangar 4d5f12e417 SOLR-1087 -- Deprecate 'where' attribute in CachedSqlEntityProcessor in favor of cacheKey and cacheLookup
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@762183 13f79535-47bb-0310-9956-ffa450edef68
2009-04-05 22:58:14 +00:00
Shalin Shekhar Mangar e7c2a9d7dd SOLR-1098 -- DateFormatTransformer can cache the format objects
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@762180 13f79535-47bb-0310-9956-ffa450edef68
2009-04-05 22:50:10 +00:00
Shalin Shekhar Mangar a8db365bbc SOLR-1090 -- DataImportHandler should load the data-config.xml using UTF-8 encoding
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@759337 13f79535-47bb-0310-9956-ffa450edef68
2009-03-27 20:42:49 +00:00
Shalin Shekhar Mangar 96a3f027ce SOLR-1084 -- Better error reporting when entity name is a reserved word and when data-config.xml is missing the root node
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757691 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 09:07:47 +00:00
Shalin Shekhar Mangar 5b885e1642 SOLR-1027 -- Alias the 'dataimporter' namespace to a shorter name 'dih'.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757690 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 08:54:43 +00:00
Shalin Shekhar Mangar dfdc5a80e1 SOLR-1083 -- An Evaluator for escaping query characters
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757682 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 08:09:49 +00:00
Shalin Shekhar Mangar 42756bb924 SOLR-1081 -- Change EventListener to be an interface so that components such as an EntityProcessor or a Transformer can act as an event listener
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757325 13f79535-47bb-0310-9956-ffa450edef68
2009-03-23 06:20:27 +00:00
Shalin Shekhar Mangar ed946926a3 SOLR-1058 -- JdbcDataSource can lookup javax.sql.DataSource using JNDI
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757170 13f79535-47bb-0310-9956-ffa450edef68
2009-03-22 11:31:51 +00:00
Shalin Shekhar Mangar 30efee5f15 SOLR-1080 -- RegexTransformer should not replace if regex is not matched
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757140 13f79535-47bb-0310-9956-ffa450edef68
2009-03-22 07:24:39 +00:00
Shalin Shekhar Mangar 6d5163dd21 SOLR-1077 -- IndexOutOfBoundsException with useSolrAddSchema in XPathEntityProcessor
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756684 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 17:47:14 +00:00
Shalin Shekhar Mangar 9e94327025 SOLR-1055 -- Make DIH JdbcDataSource easily extensible by making the createConnectionFactory method protected and return a Callable<Connection> object
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756407 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 10:36:20 +00:00
Shalin Shekhar Mangar b53c3495e4 SOLR-1076 -- JdbcDataSource should resolve variables in all its configuration parameters
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756340 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 06:27:01 +00:00
Shalin Shekhar Mangar 766c0e6c7d SOLR-1059 -- New methods in Context and special flags introduced for deleting documents, skipping rows and stopping transforms
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755897 13f79535-47bb-0310-9956-ffa450edef68
2009-03-19 10:27:33 +00:00
Shalin Shekhar Mangar f92165443e SOLR-1061 -- Improve RegexTransformer to create multiple columns from regex groups
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755143 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 07:58:10 +00:00
Shalin Shekhar Mangar 7de4dee17c SOLR-1065 -- A ContentStreamDataSource which can accept HTTP POST data in a content stream. This can be used to push data to Solr instead of just pulling it from DB/Files/URLs
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755141 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 07:50:09 +00:00
Shalin Shekhar Mangar 2d4d167ced SOLR-1062 -- A LogTransformer which can log data in a given template format
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755132 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 06:42:33 +00:00
Shalin Shekhar Mangar c02eee38d4 SOLR-1066 -- New methods in Context to expose Script details. ScriptTransformer changed to read scripts through the new API methods
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@752586 13f79535-47bb-0310-9956-ffa450edef68
2009-03-11 19:17:50 +00:00
Shalin Shekhar Mangar 15a9d6b543 SOLR-1053 -- IndexOutOfBoundsException in SolrWriter.getResourceAsString when size of data-config.xml is a multiple of 1024 bytes
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@751696 13f79535-47bb-0310-9956-ffa450edef68
2009-03-09 14:55:40 +00:00
Shalin Shekhar Mangar 2484c0efe7 SOLR-1042 -- Fix memory leak in DIH by making TemplateString non-static member in VariableResolverImpl
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@748969 13f79535-47bb-0310-9956-ffa450edef68
2009-03-01 07:33:25 +00:00
Shalin Shekhar Mangar 59cbcf51a7 SOLR-1040 -- XPathEntityProcessor fails with an xpath like containing forward slash in a attribute selector's value
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@748117 13f79535-47bb-0310-9956-ffa450edef68
2009-02-26 12:41:08 +00:00
Shalin Shekhar Mangar aea2aff871 SOLR-1037 -- DIH should not add null values in a row returned by EntityProcessor to documents.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747707 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 08:31:25 +00:00
Shalin Shekhar Mangar c8e94bec4b SOLR-1033 -- Current entity's namespace is made available to all Transformers. This allows one to use an output field of TemplateTransformer in other transformers, among other things.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747664 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 05:27:31 +00:00
Shalin Shekhar Mangar 3a5fa680eb SOLR-1029 -- Standardize Evaluator parameter parsing and added helper functions for parsing all evaluator parameters in a standard way.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747291 13f79535-47bb-0310-9956-ffa450edef68
2009-02-24 06:58:46 +00:00
Shalin Shekhar Mangar 831a3026de SOLR-783 -- Enhance delta-imports by maintaining separate last_index_time for each entity
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@746189 13f79535-47bb-0310-9956-ffa450edef68
2009-02-20 09:43:36 +00:00
Shalin Shekhar Mangar e96345130e SOLR-1024 -- Calling abort on DataImportHandler import commits data instead of calling rollback
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745831 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 11:59:54 +00:00
Shalin Shekhar Mangar fa19dfca0f SOLR-1004 -- Check for abort more frequently during delta-imports
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745742 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 05:43:06 +00:00
Shalin Shekhar Mangar a2b4aa53fc SOLR-996 -- Expose Context to Evaluators
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745734 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 05:28:48 +00:00
Shalin Shekhar Mangar 801ea7c395 SOLR-1017 -- Fix thread-safety issue with last_index_time for concurrent imports in multiple cores due to unsafe usage of SimpleDateFormat by multiple threads.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@743299 13f79535-47bb-0310-9956-ffa450edef68
2009-02-11 11:01:44 +00:00
Shalin Shekhar Mangar c4a96dc1de SOLR-1009 -- Repeated column names result in duplicate values
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@743280 13f79535-47bb-0310-9956-ffa450edef68
2009-02-11 09:30:05 +00:00
Shalin Shekhar Mangar 8391810098 SOLR-989 -- Expose running statistics from the Context API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@741698 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 20:02:48 +00:00
Shalin Shekhar Mangar a91912c99b SOLR-1001 -- Allow variables in various attributes of RegexTransformer, HTMLStripTransformer and NumberFormatTransformer.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@741435 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 06:51:50 +00:00
Shalin Shekhar Mangar 34b0ed7cff SOLR-1003 -- XPathEntityprocessor must allow slurping all text from a given xml node and its children
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@741268 13f79535-47bb-0310-9956-ffa450edef68
2009-02-05 19:53:10 +00:00
Shalin Shekhar Mangar d707212bbf SOLR-1000 -- FileListEntityProcessor should not apply fileName filter to directory names. Wow, we reached 1000 issues!
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@740423 13f79535-47bb-0310-9956-ffa450edef68
2009-02-03 20:33:20 +00:00
Shalin Shekhar Mangar 33f9318049 SOLR-999 -- XPathRecordReader fails on XMLs with nodes mixed with CDATA content
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@739962 13f79535-47bb-0310-9956-ffa450edef68
2009-02-02 11:30:18 +00:00
Shalin Shekhar Mangar 8220d4383e SOLR-980 -- A PlainTextEntityProcessor which can read from any DataSource<Reader> and output a String
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@738401 13f79535-47bb-0310-9956-ffa450edef68
2009-01-28 08:30:02 +00:00
Shalin Shekhar Mangar 100d85d8a6 SOLR-974 -- DataImportHandler skips commit if no data has been updated
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@738020 13f79535-47bb-0310-9956-ffa450edef68
2009-01-27 07:49:22 +00:00
Shalin Shekhar Mangar 0d6494cb75 SOLR-988 -- Add a new scope for session data stored in Context to store objects across imports
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@738015 13f79535-47bb-0310-9956-ffa450edef68
2009-01-27 07:21:52 +00:00
Shalin Shekhar Mangar e36809b163 SOLR-985 -- Fix thread-safety issue with TemplateString for concurrent imports with multiple cores
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@737771 13f79535-47bb-0310-9956-ffa450edef68
2009-01-26 18:00:06 +00:00
Shalin Shekhar Mangar 4ee827471d SOLR-801 -- Add support for configurable pre-import and post-import delete query per root-entity
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@737555 13f79535-47bb-0310-9956-ffa450edef68
2009-01-25 18:05:41 +00:00
Shalin Shekhar Mangar fa5b4e8f04 SOLR-964 -- XPathEntityProcessor now ignores DTD validations
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@736616 13f79535-47bb-0310-9956-ffa450edef68
2009-01-22 12:12:24 +00:00