Commit Graph

117 Commits

Author SHA1 Message Date
Shalin Shekhar Mangar 96a3f027ce SOLR-1084 -- Better error reporting when entity name is a reserved word and when data-config.xml is missing the root node
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757691 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 09:07:47 +00:00
Shalin Shekhar Mangar 5b885e1642 SOLR-1027 -- Alias the 'dataimporter' namespace to a shorter name 'dih'.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757690 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 08:54:43 +00:00
Shalin Shekhar Mangar dfdc5a80e1 SOLR-1083 -- An Evaluator for escaping query characters
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757682 13f79535-47bb-0310-9956-ffa450edef68
2009-03-24 08:09:49 +00:00
Shalin Shekhar Mangar 42756bb924 SOLR-1081 -- Change EventListener to be an interface so that components such as an EntityProcessor or a Transformer can act as an event listener
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757325 13f79535-47bb-0310-9956-ffa450edef68
2009-03-23 06:20:27 +00:00
Shalin Shekhar Mangar ed946926a3 SOLR-1058 -- JdbcDataSource can lookup javax.sql.DataSource using JNDI
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757170 13f79535-47bb-0310-9956-ffa450edef68
2009-03-22 11:31:51 +00:00
Shalin Shekhar Mangar 30efee5f15 SOLR-1080 -- RegexTransformer should not replace if regex is not matched
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@757140 13f79535-47bb-0310-9956-ffa450edef68
2009-03-22 07:24:39 +00:00
Shalin Shekhar Mangar 6d5163dd21 SOLR-1077 -- IndexOutOfBoundsException with useSolrAddSchema in XPathEntityProcessor
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756684 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 17:47:14 +00:00
Shalin Shekhar Mangar 9e94327025 SOLR-1055 -- Make DIH JdbcDataSource easily extensible by making the createConnectionFactory method protected and return a Callable<Connection> object
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756407 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 10:36:20 +00:00
Shalin Shekhar Mangar b53c3495e4 SOLR-1076 -- JdbcDataSource should resolve variables in all its configuration parameters
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@756340 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 06:27:01 +00:00
Shalin Shekhar Mangar 766c0e6c7d SOLR-1059 -- New methods in Context and special flags introduced for deleting documents, skipping rows and stopping transforms
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755897 13f79535-47bb-0310-9956-ffa450edef68
2009-03-19 10:27:33 +00:00
Shalin Shekhar Mangar f92165443e SOLR-1061 -- Improve RegexTransformer to create multiple columns from regex groups
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755143 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 07:58:10 +00:00
Shalin Shekhar Mangar 7de4dee17c SOLR-1065 -- A ContentStreamDataSource which can accept HTTP POST data in a content stream. This can be used to push data to Solr instead of just pulling it from DB/Files/URLs
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755141 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 07:50:09 +00:00
Shalin Shekhar Mangar 2d4d167ced SOLR-1062 -- A LogTransformer which can log data in a given template format
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@755132 13f79535-47bb-0310-9956-ffa450edef68
2009-03-17 06:42:33 +00:00
Shalin Shekhar Mangar c02eee38d4 SOLR-1066 -- New methods in Context to expose Script details. ScriptTransformer changed to read scripts through the new API methods
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@752586 13f79535-47bb-0310-9956-ffa450edef68
2009-03-11 19:17:50 +00:00
Shalin Shekhar Mangar 15a9d6b543 SOLR-1053 -- IndexOutOfBoundsException in SolrWriter.getResourceAsString when size of data-config.xml is a multiple of 1024 bytes
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@751696 13f79535-47bb-0310-9956-ffa450edef68
2009-03-09 14:55:40 +00:00
Shalin Shekhar Mangar 2484c0efe7 SOLR-1042 -- Fix memory leak in DIH by making TemplateString non-static member in VariableResolverImpl
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@748969 13f79535-47bb-0310-9956-ffa450edef68
2009-03-01 07:33:25 +00:00
Shalin Shekhar Mangar 59cbcf51a7 SOLR-1040 -- XPathEntityProcessor fails with an xpath like containing forward slash in a attribute selector's value
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@748117 13f79535-47bb-0310-9956-ffa450edef68
2009-02-26 12:41:08 +00:00
Shalin Shekhar Mangar aea2aff871 SOLR-1037 -- DIH should not add null values in a row returned by EntityProcessor to documents.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747707 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 08:31:25 +00:00
Shalin Shekhar Mangar c8e94bec4b SOLR-1033 -- Current entity's namespace is made available to all Transformers. This allows one to use an output field of TemplateTransformer in other transformers, among other things.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747664 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 05:27:31 +00:00
Shalin Shekhar Mangar 3a5fa680eb SOLR-1029 -- Standardize Evaluator parameter parsing and added helper functions for parsing all evaluator parameters in a standard way.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@747291 13f79535-47bb-0310-9956-ffa450edef68
2009-02-24 06:58:46 +00:00
Shalin Shekhar Mangar 831a3026de SOLR-783 -- Enhance delta-imports by maintaining separate last_index_time for each entity
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@746189 13f79535-47bb-0310-9956-ffa450edef68
2009-02-20 09:43:36 +00:00
Shalin Shekhar Mangar e96345130e SOLR-1024 -- Calling abort on DataImportHandler import commits data instead of calling rollback
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745831 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 11:59:54 +00:00
Shalin Shekhar Mangar fa19dfca0f SOLR-1004 -- Check for abort more frequently during delta-imports
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745742 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 05:43:06 +00:00
Shalin Shekhar Mangar a2b4aa53fc SOLR-996 -- Expose Context to Evaluators
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@745734 13f79535-47bb-0310-9956-ffa450edef68
2009-02-19 05:28:48 +00:00
Shalin Shekhar Mangar 801ea7c395 SOLR-1017 -- Fix thread-safety issue with last_index_time for concurrent imports in multiple cores due to unsafe usage of SimpleDateFormat by multiple threads.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@743299 13f79535-47bb-0310-9956-ffa450edef68
2009-02-11 11:01:44 +00:00
Shalin Shekhar Mangar c4a96dc1de SOLR-1009 -- Repeated column names result in duplicate values
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@743280 13f79535-47bb-0310-9956-ffa450edef68
2009-02-11 09:30:05 +00:00
Shalin Shekhar Mangar 8391810098 SOLR-989 -- Expose running statistics from the Context API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@741698 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 20:02:48 +00:00
Shalin Shekhar Mangar a91912c99b SOLR-1001 -- Allow variables in various attributes of RegexTransformer, HTMLStripTransformer and NumberFormatTransformer.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@741435 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 06:51:50 +00:00
Shalin Shekhar Mangar 34b0ed7cff SOLR-1003 -- XPathEntityprocessor must allow slurping all text from a given xml node and its children
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@741268 13f79535-47bb-0310-9956-ffa450edef68
2009-02-05 19:53:10 +00:00
Shalin Shekhar Mangar d707212bbf SOLR-1000 -- FileListEntityProcessor should not apply fileName filter to directory names. Wow, we reached 1000 issues!
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@740423 13f79535-47bb-0310-9956-ffa450edef68
2009-02-03 20:33:20 +00:00
Shalin Shekhar Mangar 33f9318049 SOLR-999 -- XPathRecordReader fails on XMLs with nodes mixed with CDATA content
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@739962 13f79535-47bb-0310-9956-ffa450edef68
2009-02-02 11:30:18 +00:00
Shalin Shekhar Mangar 8220d4383e SOLR-980 -- A PlainTextEntityProcessor which can read from any DataSource<Reader> and output a String
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@738401 13f79535-47bb-0310-9956-ffa450edef68
2009-01-28 08:30:02 +00:00
Shalin Shekhar Mangar 100d85d8a6 SOLR-974 -- DataImportHandler skips commit if no data has been updated
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@738020 13f79535-47bb-0310-9956-ffa450edef68
2009-01-27 07:49:22 +00:00
Shalin Shekhar Mangar 0d6494cb75 SOLR-988 -- Add a new scope for session data stored in Context to store objects across imports
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@738015 13f79535-47bb-0310-9956-ffa450edef68
2009-01-27 07:21:52 +00:00
Shalin Shekhar Mangar e36809b163 SOLR-985 -- Fix thread-safety issue with TemplateString for concurrent imports with multiple cores
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@737771 13f79535-47bb-0310-9956-ffa450edef68
2009-01-26 18:00:06 +00:00
Shalin Shekhar Mangar 4ee827471d SOLR-801 -- Add support for configurable pre-import and post-import delete query per root-entity
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@737555 13f79535-47bb-0310-9956-ffa450edef68
2009-01-25 18:05:41 +00:00
Shalin Shekhar Mangar fa5b4e8f04 SOLR-964 -- XPathEntityProcessor now ignores DTD validations
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@736616 13f79535-47bb-0310-9956-ffa450edef68
2009-01-22 12:12:24 +00:00
Shalin Shekhar Mangar 0bae610c14 SOLR-938 -- Add event listener API for import start and end
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@732695 13f79535-47bb-0310-9956-ffa450edef68
2009-01-08 12:52:16 +00:00
Shalin Shekhar Mangar 9f6e8ea8ec SOLR-782 followup -- Removed multiple document nodes in the configuration xml. Removed support for 'default' variables, they are automatically available as request parameters.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@730055 13f79535-47bb-0310-9956-ffa450edef68
2008-12-30 06:42:48 +00:00
Shalin Shekhar Mangar 80dea5625e SOLR-910 -- Add a few utility commands to the DIH admin page such as full import, delta import, status, reload config
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@726512 13f79535-47bb-0310-9956-ffa450edef68
2008-12-14 18:30:38 +00:00
Shalin Shekhar Mangar 133f1f4031 SOLR-812 -- Configurable JDBC settings in JdbcDataSource including optimized defaults for read only mode
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@726241 13f79535-47bb-0310-9956-ffa450edef68
2008-12-13 17:38:00 +00:00
Shalin Shekhar Mangar 843ce957a9 SOLR-891 -- A Transformer to read strings from Clob type
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@725926 13f79535-47bb-0310-9956-ffa450edef68
2008-12-12 07:02:09 +00:00
Shalin Shekhar Mangar c1d1c274ae SOLR-884 -- CachedSqlEntityProcessor should check if the cache key is present in the query results
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@725684 13f79535-47bb-0310-9956-ffa450edef68
2008-12-11 13:43:23 +00:00
Shalin Shekhar Mangar 714d1c7ad7 SOLR-841 -- DataImportHandler should throw exception if a field does not have column attribute
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@725635 13f79535-47bb-0310-9956-ffa450edef68
2008-12-11 09:39:31 +00:00
Shalin Shekhar Mangar cf0a31f1f7 SOLR-846 -- Reduce memory consumption during delta import by removing keys when used
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@725627 13f79535-47bb-0310-9956-ffa450edef68
2008-12-11 09:05:39 +00:00
Shalin Shekhar Mangar 7549d04c32 SOLR-888 -- DateFormatTransformer cannot convert non-string type
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@725618 13f79535-47bb-0310-9956-ffa450edef68
2008-12-11 08:34:08 +00:00
Shalin Shekhar Mangar 2b931ae33e Moving DataImportHandler fix to correct CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@725617 13f79535-47bb-0310-9956-ffa450edef68
2008-12-11 08:31:26 +00:00
Shalin Shekhar Mangar 7fe3fa9468 SOLR-893 -- Unable to delete documents via SQL and deletedPkQuery with deltaimport
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@723824 13f79535-47bb-0310-9956-ffa450edef68
2008-12-05 19:14:11 +00:00
Shalin Shekhar Mangar 90b387a92d SOLR-887 -- A Transformer to strip HTML tags.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@723410 13f79535-47bb-0310-9956-ffa450edef68
2008-12-04 19:50:43 +00:00
Shalin Shekhar Mangar e3ba95b8b8 SOLR-873 -- Fix case-sensitive field names and columns
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@719187 13f79535-47bb-0310-9956-ffa450edef68
2008-11-20 07:19:41 +00:00
Shalin Shekhar Mangar a788efe789 SOLR-864 -- DataImportHandler does not catch and log Errors
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@718187 13f79535-47bb-0310-9956-ffa450edef68
2008-11-17 08:26:29 +00:00
Shalin Shekhar Mangar dff17dc8a7 SOLR-833 -- A DataSource to read data from a field as a reader. This can be used, for example, to read XMLs residing as CLOBs or BLOBs in databases.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@713343 13f79535-47bb-0310-9956-ffa450edef68
2008-11-12 10:29:49 +00:00
Shalin Shekhar Mangar d501b33bc8 SOLR-842 -- Better error handling in DataImportHandler with options to abort, skip and continue imports
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@713335 13f79535-47bb-0310-9956-ffa450edef68
2008-11-12 09:51:12 +00:00
Shalin Shekhar Mangar 49d7932a92 SOLR-838 -- The VariableResolver obtained from a DataSource's context does not have current data
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@712067 13f79535-47bb-0310-9956-ffa450edef68
2008-11-07 05:51:41 +00:00
Shalin Shekhar Mangar 96b0ebc980 SOLR-832 -- Rows parameter is not honored in non-debug mode and can abort a running import in debug mode.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@709352 13f79535-47bb-0310-9956-ffa450edef68
2008-10-31 05:32:03 +00:00
Shalin Shekhar Mangar 19c70e9df5 SOLR-742 -- Add ability to create dynamic fields with custom DataImportHandler transformers
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@708967 13f79535-47bb-0310-9956-ffa450edef68
2008-10-29 18:05:26 +00:00
Shalin Shekhar Mangar 1e5562a910 SOLR-728 -- Add synchronization to avoid race condition of multiple imports working concurrently
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@707295 13f79535-47bb-0310-9956-ffa450edef68
2008-10-23 06:54:56 +00:00
Shalin Shekhar Mangar ca6e3f100f SOLR-823 -- Request parameter variables ${dataimporter.request.xxx} are not resolved
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@707287 13f79535-47bb-0310-9956-ffa450edef68
2008-10-23 06:16:45 +00:00
Shalin Shekhar Mangar 3803c42a6b SOLR-811 -- Allow a "deltaImportQuery" attribute in SqlEntityProcessor which is used for delta imports instead of DataImportHandler manipulating the SQL itself
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@706588 13f79535-47bb-0310-9956-ffa450edef68
2008-10-21 11:57:56 +00:00
Shalin Shekhar Mangar be8a3a53ff SOLR-782 -- Refactored SolrWriter to make it a concrete class and removed wrappers over SolrInputDocument
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@706542 13f79535-47bb-0310-9956-ffa450edef68
2008-10-21 07:05:39 +00:00
Shalin Shekhar Mangar bdb1d606f0 SOLR-800 -- Deep copy collections to avoid ConcurrentModificationException in XPathEntityprocessor while streaming
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@704365 13f79535-47bb-0310-9956-ffa450edef68
2008-10-14 07:51:43 +00:00
Shalin Shekhar Mangar 3f62c69a91 SOLR-768 -- Set last_index_time variable in full-import command.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@697373 13f79535-47bb-0310-9956-ffa450edef68
2008-09-20 14:48:54 +00:00
Shalin Shekhar Mangar c5d5dcfb8e Adding Walter's name since he reported the bug.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@690132 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 07:03:13 +00:00
Shalin Shekhar Mangar aa9ff47086 SOLR-726 -- Jdbc Drivers and DataSources fail to load if placed in multicore sharedLib or core's lib directory.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@690131 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 07:00:48 +00:00
Shalin Shekhar Mangar 9a89d44c88 SOLR-729 -- Context.getDataSource(String) gives current entity's DataSource instance regardless of argument.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@689867 13f79535-47bb-0310-9956-ffa450edef68
2008-08-28 16:04:45 +00:00
Shalin Shekhar Mangar d00a997ad7 SOLR-704 -- NumberFormatTransformer can silently ignore part of the string while parsing. Now it tries to use the complete string for parsing. Failure to do so will result in an exception.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@686196 13f79535-47bb-0310-9956-ffa450edef68
2008-08-15 11:53:34 +00:00
Shalin Shekhar Mangar 0291a24619 SOLR-700 -- Allow configurable locales through a locale attribute in fields for NumberFormatTransformer.
git-svn-id: https://svn.apache.org/repos/asf/lucene/solr/trunk@686176 13f79535-47bb-0310-9956-ffa450edef68
2008-08-15 08:49:35 +00:00