Commit Graph

135 Commits

Author SHA1 Message Date
Shalin Shekhar Mangar e2a020b6c6 SOLR-1060 -- A LineEntityProcessor which can stream lines of text from a given file to be indexed directly or for processing with transformers and child entities.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@766638 13f79535-47bb-0310-9956-ffa450edef68
2009-04-20 10:12:50 +00:00
Shalin Shekhar Mangar a336753fdc SOLR-1120 -- Simplify EntityProcessor API
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@766608 13f79535-47bb-0310-9956-ffa450edef68
2009-04-20 07:36:55 +00:00
Shalin Shekhar Mangar 3c2e9ab3d6 SOLR-1080 followup -- Additional test cases for RegexTransformer
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@765559 13f79535-47bb-0310-9956-ffa450edef68
2009-04-16 10:15:54 +00:00
Shalin Shekhar Mangar 49a83c536e SOLR-969 -- Changed the FULL_DUMP, DELTA_DUMP, FIND_DELTA constants in Context to String. Changed Context.currentProcess() to return a string instead of an integer.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@765499 13f79535-47bb-0310-9956-ffa450edef68
2009-04-16 08:01:10 +00:00
Shalin Shekhar Mangar 67fa0ec527 SOLR-1076 followup -- Fix bug with resolving batchSize
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@765481 13f79535-47bb-0310-9956-ffa450edef68
2009-04-16 06:16:42 +00:00
Shalin Shekhar Mangar be6911ec84 SOLR-934 fix -- Copy libs from contrib/extraction/lib for setting up mail example
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@764709 13f79535-47bb-0310-9956-ffa450edef68
2009-04-14 08:28:06 +00:00
Shalin Shekhar Mangar b157e9c6e2 SOLR-934 followup -- Make CustomFilter static, remove extra logging code, check log level before logging
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@764691 13f79535-47bb-0310-9956-ffa450edef68
2009-04-14 07:15:16 +00:00
Shalin Shekhar Mangar 12024eba47 SOLR-934 -- A MailEntityProcessor to enable indexing mails from POP/IMAP sources into a solr index
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@764601 13f79535-47bb-0310-9956-ffa450edef68
2009-04-13 20:26:10 +00:00
Shalin Shekhar Mangar 40a1e6da34 SOLR-1059 -- Fixing bug where skipping a row containing nested entities did not skip the nested entities. Handling special flag variables is in one method now.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@764379 13f79535-47bb-0310-9956-ffa450edef68
2009-04-13 09:00:59 +00:00
Shalin Shekhar Mangar d653d93305 SOLR-1058 followup -- Fix check for driver attribute
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@762184 13f79535-47bb-0310-9956-ffa450edef68
2009-04-05 23:06:52 +00:00
Shalin Shekhar Mangar 4d5f12e417 SOLR-1087 -- Deprecate 'where' attribute in CachedSqlEntityProcessor in favor of cacheKey and cacheLookup
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@762183 13f79535-47bb-0310-9956-ffa450edef68
2009-04-05 22:58:14 +00:00
Shalin Shekhar Mangar e7c2a9d7dd SOLR-1098 -- DateFormatTransformer can cache the format objects
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@762180 13f79535-47bb-0310-9956-ffa450edef68
2009-04-05 22:50:10 +00:00
Shalin Shekhar Mangar 3ee3b599e4 SOLR-891 -- Adding a test case for ClobTransformer
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@762174 13f79535-47bb-0310-9956-ffa450edef68
2009-04-05 22:18:50 +00:00
Shalin Shekhar Mangar 273705738f SOLR-886 -- No need to call commit after calling rollback
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@761605 13f79535-47bb-0310-9956-ffa450edef68
2009-04-03 10:34:28 +00:00
Shalin Shekhar Mangar a8db365bbc SOLR-1090 -- DataImportHandler should load the data-config.xml using UTF-8 encoding
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@759337 13f79535-47bb-0310-9956-ffa450edef68
2009-03-27 20:42:49 +00:00
Shalin Shekhar Mangar 96a3f027ce SOLR-1084 -- Better error reporting when entity name is a reserved word and when data-config.xml is missing the root node
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757691 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 09:07:47 +00:00
Shalin Shekhar Mangar 5b885e1642 SOLR-1027 -- Alias the 'dataimporter' namespace to a shorter name 'dih'.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757690 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 08:54:43 +00:00
Shalin Shekhar Mangar dfdc5a80e1 SOLR-1083 -- An Evaluator for escaping query characters
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757682 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 08:09:49 +00:00
Shalin Shekhar Mangar a3e7952c84 SOLR-1081 followup -- Remove abstract keyword
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757332 13f79535-47bb-0310-9956-ffa450edef68
2009-03-23 07:14:19 +00:00
Shalin Shekhar Mangar 42756bb924 SOLR-1081 -- Change EventListener to be an interface so that components such as an EntityProcessor or a Transformer can act as an event listener
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757325 13f79535-47bb-0310-9956-ffa450edef68
2009-03-23 06:20:27 +00:00
Shalin Shekhar Mangar ed946926a3 SOLR-1058 -- JdbcDataSource can lookup javax.sql.DataSource using JNDI
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757170 13f79535-47bb-0310-9956-ffa450edef68
2009-03-22 11:31:51 +00:00
Shalin Shekhar Mangar 30efee5f15 SOLR-1080 -- RegexTransformer should not replace if regex is not matched
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757140 13f79535-47bb-0310-9956-ffa450edef68
2009-03-22 07:24:39 +00:00
Shalin Shekhar Mangar 6d5163dd21 SOLR-1077 -- IndexOutOfBoundsException with useSolrAddSchema in XPathEntityProcessor
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756684 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 17:47:14 +00:00
Shalin Shekhar Mangar 9e94327025 SOLR-1055 -- Make DIH JdbcDataSource easily extensible by making the createConnectionFactory method protected and return a Callable<Connection> object
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756407 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 10:36:20 +00:00
Shalin Shekhar Mangar b53c3495e4 SOLR-1076 -- JdbcDataSource should resolve variables in all its configuration parameters
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756340 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 06:27:01 +00:00
Shalin Shekhar Mangar 09100e8c0c SOLR-1059 followup -- Adding a test for delete doc functionality using the special flag variables
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756130 13f79535-47bb-0310-9956-ffa450edef68
2009-03-19 18:51:44 +00:00
Shalin Shekhar Mangar 766c0e6c7d SOLR-1059 -- New methods in Context and special flags introduced for deleting documents, skipping rows and stopping transforms
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755897 13f79535-47bb-0310-9956-ffa450edef68
2009-03-19 10:27:33 +00:00
Shalin Shekhar Mangar f92165443e SOLR-1061 -- Improve RegexTransformer to create multiple columns from regex groups
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755143 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 07:58:10 +00:00
Shalin Shekhar Mangar 7de4dee17c SOLR-1065 -- A ContentStreamDataSource which can accept HTTP POST data in a content stream. This can be used to push data to Solr instead of just pulling it from DB/Files/URLs
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755141 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 07:50:09 +00:00
Shalin Shekhar Mangar 2d4d167ced SOLR-1062 -- A LogTransformer which can log data in a given template format
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755132 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 06:42:33 +00:00
Shalin Shekhar Mangar c02eee38d4 SOLR-1066 -- New methods in Context to expose Script details. ScriptTransformer changed to read scripts through the new API methods
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@752586 13f79535-47bb-0310-9956-ffa450edef68
2009-03-11 19:17:50 +00:00
Shalin Shekhar Mangar cdbb5216ec SOLR-1056 -- Fix ending condition for ClobTransformer
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@751993 13f79535-47bb-0310-9956-ffa450edef68
2009-03-10 06:26:23 +00:00
Shalin Shekhar Mangar 15a9d6b543 SOLR-1053 -- IndexOutOfBoundsException in SolrWriter.getResourceAsString when size of data-config.xml is a multiple of 1024 bytes
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@751696 13f79535-47bb-0310-9956-ffa450edef68
2009-03-09 14:55:40 +00:00
Shalin Shekhar Mangar ab7106f35f SOLR-783 followup - Make sure indexStartTime is never null. Set index start time even if commit=false for full imports too.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@751043 13f79535-47bb-0310-9956-ffa450edef68
2009-03-06 19:26:27 +00:00
Shalin Shekhar Mangar 2484c0efe7 SOLR-1042 -- Fix memory leak in DIH by making TemplateString non-static member in VariableResolverImpl
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@748969 13f79535-47bb-0310-9956-ffa450edef68
2009-03-01 07:33:25 +00:00
Shalin Shekhar Mangar 59cbcf51a7 SOLR-1040 -- XPathEntityProcessor fails with an xpath like containing forward slash in a attribute selector's value
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@748117 13f79535-47bb-0310-9956-ffa450edef68
2009-02-26 12:41:08 +00:00
Shalin Shekhar Mangar c1e663e905 SOLR-783 followup -- Set last_index_time to current date even if commit=false to avoid NPE.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747792 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 14:17:36 +00:00
Shalin Shekhar Mangar aea2aff871 SOLR-1037 -- DIH should not add null values in a row returned by EntityProcessor to documents.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747707 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 08:31:25 +00:00
Shalin Shekhar Mangar c8e94bec4b SOLR-1033 -- Current entity's namespace is made available to all Transformers. This allows one to use an output field of TemplateTransformer in other transformers, among other things.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747664 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 05:27:31 +00:00
Shalin Shekhar Mangar 19d7b267a7 SOLR-801 follow-up -- Fix NullPointerException in case of multiple root entities when deleteQuery is not specified
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747343 13f79535-47bb-0310-9956-ffa450edef68
2009-02-24 11:19:51 +00:00
Shalin Shekhar Mangar 3a5fa680eb SOLR-1029 -- Standardize Evaluator parameter parsing and added helper functions for parsing all evaluator parameters in a standard way.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747291 13f79535-47bb-0310-9956-ffa450edef68
2009-02-24 06:58:46 +00:00
Shalin Shekhar Mangar ed887ca631 Removing main method added for testing
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@746300 13f79535-47bb-0310-9956-ffa450edef68
2009-02-20 17:37:00 +00:00
Shalin Shekhar Mangar 831a3026de SOLR-783 -- Enhance delta-imports by maintaining separate last_index_time for each entity
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@746189 13f79535-47bb-0310-9956-ffa450edef68
2009-02-20 09:43:36 +00:00
Shalin Shekhar Mangar e96345130e SOLR-1024 -- Calling abort on DataImportHandler import commits data instead of calling rollback
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745831 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 11:59:54 +00:00
Shalin Shekhar Mangar 7477c06f89 SOLR-996 followup -- missing set context
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745807 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 10:25:09 +00:00
Shalin Shekhar Mangar fa19dfca0f SOLR-1004 -- Check for abort more frequently during delta-imports
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745742 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 05:43:06 +00:00
Shalin Shekhar Mangar a2b4aa53fc SOLR-996 -- Expose Context to Evaluators
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745734 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 05:28:48 +00:00
Shalin Shekhar Mangar 801ea7c395 SOLR-1017 -- Fix thread-safety issue with last_index_time for concurrent imports in multiple cores due to unsafe usage of SimpleDateFormat by multiple threads.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@743299 13f79535-47bb-0310-9956-ffa450edef68
2009-02-11 11:01:44 +00:00
Shalin Shekhar Mangar c4a96dc1de SOLR-1009 -- Repeated column names result in duplicate values
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@743280 13f79535-47bb-0310-9956-ffa450edef68
2009-02-11 09:30:05 +00:00
Shalin Shekhar Mangar 8391810098 SOLR-989 -- Expose running statistics from the Context API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@741698 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 20:02:48 +00:00