Xavier Léauté
5f36e7a992
Merge pull request #1712 from metamx/searchQueryDimExtraction
...
Add dimension extraction functionality to SearchQuery
2015-09-14 15:26:13 -07:00
Charles Allen
e569f4b6a7
Add dimension extraction functionality to SearchQuery
...
* Add IdentityExtractionFn
2015-09-14 11:36:15 -07:00
Himanshu
5ff92664f8
Merge pull request #1696 from metamx/cpuTimeReporting
...
Add CPU time to metrics for segment scanning.
2015-09-14 10:53:55 -05:00
Fangjin Yang
34ef81572d
Merge pull request #1700 from himanshug/update_agg_test_helper
...
update indexing in the helper to use multiple persists and merge
2015-09-14 06:56:29 -07:00
Fangjin Yang
1548fa8afc
Merge pull request #1721 from himanshug/hdfs_fs_init_fix
...
fix for "java.io.IOException: No FileSystem for scheme: hdfs" error
2015-09-13 08:26:01 +08:00
Xavier Léauté
1715849642
Merge pull request #1718 from metamx/task-duration
...
Adds task duration to indexer console for completed tasks.
2015-09-11 22:35:08 -07:00
Xavier Léauté
43012d3c48
Merge pull request #1725 from metamx/genericIndexedWriteOptimizationObjectsSorted
...
Don't check for sortedness if we already know GenericIndexedWriter isn't sorted
2015-09-11 22:33:53 -07:00
Charles Allen
8d3cdd8572
Don't check for sortedness if we already know GenericIndexedWriter isn't sorted
2015-09-11 16:32:09 -07:00
Fangjin Yang
5f9be8dd0a
Merge pull request #1723 from guobingkun/fix_typo
...
fix typo in segments.md
2015-09-12 05:51:55 +08:00
Bingkun Guo
e222e6b86b
fix typo in segments.md
2015-09-11 16:32:50 -05:00
Himanshu Gupta
b989a7054c
fix for "java.io.IOException: No FileSystem for scheme: hdfs" error
...
aka workaround for https://issues.apache.org/jira/browse/HDFS-8750
2015-09-11 15:35:59 -05:00
Gian Merlino
252bb5a6bc
Merge pull request #1720 from himanshug/faq_update
...
update ingestion faq to mention dataSource inputSpec
2015-09-11 12:40:34 -07:00
Himanshu Gupta
075b6d4385
update ingestion faq to mention dataSource inputSpec as an option of reindexing via hadoop
2015-09-10 14:41:13 -05:00
Nishant
4681ff22ed
add task duration in response for completed tasks
2015-09-10 13:51:50 +05:30
Gian Merlino
e5532367e1
Merge pull request #1717 from himanshug/doc_fix
...
in configuration/index.md s/instantialize/initialize
2015-09-09 21:35:21 -07:00
Himanshu Gupta
39d23ffc45
in configuration/index.md s/instantialize/initialize
2015-09-09 21:18:26 -05:00
Charles Allen
7c5d2fa686
Merge pull request #1699 from himanshug/composing_emitter
...
composing emitter module to use multiple emitters together
2015-09-09 19:05:39 -07:00
Himanshu Gupta
ebdb612933
composing emitter module to use multiple emitters together
2015-09-09 16:45:50 -05:00
Himanshu Gupta
5da58e48e0
use Rule based TemporaryFolder for cleanup of temp directory/files
2015-09-09 11:10:33 -05:00
Himanshu Gupta
44911039c5
update indexing in the helper to use multiple persists and final merge to
...
catch further issues in aggregator implementations
2015-09-09 11:10:33 -05:00
Charles Allen
fcf5cae81d
Add CPU time to metrics for segment scanning.
2015-09-08 13:34:19 -07:00
Fangjin Yang
07266d682a
Merge pull request #1694 from metamx/namespaceExtractionCacheManagerTestImprovements
...
Better timing and locking in NamespaceExtractionCacheManagerExecutorsTest
2015-09-04 15:06:22 -07:00
Charles Allen
0b8a3035c6
Better timing and locking in NamespaceExtractionCacheManagerExecutorsTest
2015-09-04 13:02:14 -07:00
Charles Allen
9b5889b393
Merge pull request #1703 from metamx/fix-npe
...
add null check for task context.
2015-09-04 11:04:12 -07:00
Nishant
47aac991ec
add null check for task context.
...
make variable final
2015-09-04 22:19:01 +05:30
Fangjin Yang
75a582974b
Merge pull request #1639 from gianm/new-plumber
...
New plumber
2015-09-03 18:52:57 -07:00
Himanshu
66a9a332d0
Merge pull request #1604 from metamx/task-jvm-config
...
Allow task to override ForkingTaskRunner tunings and jvm settings
2015-09-03 16:43:49 -05:00
Gian Merlino
062a47fba4
Modify Plumbers in these ways,
...
1) Persist using Committer instead of Runnable. (Although the metadata object
is ignored in this patch)
2) Remove the getSink method.
3) Plumbers are now responsible for time-based and hydrant-full-based periodic
committing. (FireChief, RealtimeIndexTask, and IndexTask used to do this)
2015-09-03 11:13:06 -07:00
Nishant
726326abc3
Add Task Context and ability to override task specific properties
...
override javaOpts
fix compilation
review comments
Add Test for typecast
review comments - remove unused method.
2015-09-03 23:36:32 +05:30
Fangjin Yang
4546652b3b
Merge pull request #1698 from gianm/docs-skipEmptyBuckets
...
Timeseries skipEmptyBucket docs.
2015-09-02 15:30:43 -07:00
Gian Merlino
cbef4a15b0
Timeseries skipEmptyBucket docs.
2015-09-02 14:59:21 -07:00
Nishant
e79572b4bc
Merge pull request #1637 from metamx/peonPlaysNiceOnShutdown
...
Make jetty scheduler threads daemon thread
2015-09-03 00:03:20 +05:30
Nishant
0096e6a0a0
Merge pull request #1658 from metamx/cleanupJDBCExtractionNamespaceTest
...
Hopefully add better timeouts and ordering to JDBCExtractionNamespaceTest
2015-09-02 23:49:49 +05:30
Xavier Léauté
82f9ecf56b
Merge pull request #1620 from metamx/longFriendlyQTL
...
Allow long values in the key or value fields for URIExtractionNamespace
2015-09-02 10:55:35 -07:00
Charles Allen
ce3506b8e1
Merge pull request #1542 from metamx/audit-rule-history
...
add endpoint to fetch rule history for all datasources
2015-09-01 13:57:28 -07:00
cheddar
4f61b42f40
Merge pull request #1578 from b-slim/fix_extraction_filter_2
...
Fix UT and documentation to the extraction filter
2015-09-01 10:46:20 -07:00
Xavier Léauté
d89b0fa76a
Merge pull request #1662 from qix/pathFormat-doc
...
Add documentation for pathFormat in batch ingestion
2015-08-31 11:14:54 -07:00
Josh Yudaken
29c29b42d3
Add default value and link to joda docs
2015-08-31 11:09:54 -07:00
Fangjin Yang
5e3a83871e
Merge pull request #1687 from himanshug/num_reducer_override
...
do not let user override hadoop job settings explicitly provided by druid code
2015-08-31 09:30:26 -07:00
Himanshu Gupta
9ca6106128
user specified hadoop settings are ignored if explicitly set in code
2015-08-31 10:50:18 -05:00
nishant
0835e12f2a
add endpoint to fetch rule history for all datasources.
...
review comments
Review comment
fix compilation
2015-08-31 14:05:52 +05:30
Fangjin Yang
dfe3be0f6d
Merge pull request #1689 from metamx/lz4TranscoderUpdate
...
Update LZ4Transcoder to match Compressed strategy factory type.
2015-08-29 12:31:59 -07:00
Himanshu
04ff6cd355
Merge pull request #1685 from gianm/close-loudly
...
Close output streams and channels loudly when creating segments.
2015-08-28 23:32:22 -05:00
Charles Allen
413c0d1c9e
Update LZ4Transcoder to match Compressed strategy factory type.
2015-08-28 19:19:48 -07:00
Charles Allen
8cf7eff93c
Merge pull request #1686 from gianm/fix-imports
...
Replace funky imports with standard ones.
2015-08-28 18:32:48 -07:00
Gian Merlino
940e1aa3eb
Replace funky imports with standard ones.
...
1) Lots of Guava imports were not coming from the actual Guava
2) junit.framework.Assert should be org.junit.Assert
2015-08-28 18:02:05 -07:00
Gian Merlino
e7b4cf942b
Merge pull request #1682 from jon-wei/master
...
Support parsing of BytesWritable strings in HadoopDruidIndexerMapper
2015-08-28 17:46:26 -07:00
Gian Merlino
7d6fa2ba50
Close output streams and channels loudly when creating segments.
2015-08-28 17:14:03 -07:00
jon-wei
e5c4927b14
Add support for parsing BytesWritable strings to Hadoop Indexer
2015-08-28 14:27:14 -07:00
Himanshu
ceaa49ec4f
Merge pull request #1681 from gianm/ingest-segment-overlapping
...
Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat
2015-08-28 11:12:51 -05:00