5810 Commits

Author SHA1 Message Date
Charles Allen
0b8a3035c6 Better timing and locking in NamespaceExtractionCacheManagerExecutorsTest 2015-09-04 13:02:14 -07:00
Fangjin Yang
75a582974b Merge pull request #1639 from gianm/new-plumber
New plumber
2015-09-03 18:52:57 -07:00
Himanshu
66a9a332d0 Merge pull request #1604 from metamx/task-jvm-config
Allow task to override ForkingTaskRunner tunings and jvm settings
2015-09-03 16:43:49 -05:00
Gian Merlino
062a47fba4 Modify Plumbers in these ways,
1) Persist using Committer instead of Runnable. (Although the metadata object
   is ignored in this patch)

2) Remove the getSink method.

3) Plumbers are now responsible for time-based and hydrant-full-based periodic
   committing. (FireChief, RealtimeIndexTask, and IndexTask used to do this)
2015-09-03 11:13:06 -07:00
Nishant
726326abc3 Add Task Context and ability to override task specific properties
override javaOpts

fix compilation

review comments

Add Test for typecast

review comments - remove unused method.
2015-09-03 23:36:32 +05:30
Fangjin Yang
4546652b3b Merge pull request #1698 from gianm/docs-skipEmptyBuckets
Timeseries skipEmptyBucket docs.
2015-09-02 15:30:43 -07:00
Gian Merlino
cbef4a15b0 Timeseries skipEmptyBucket docs. 2015-09-02 14:59:21 -07:00
Nishant
e79572b4bc Merge pull request #1637 from metamx/peonPlaysNiceOnShutdown
Make jetty scheduler threads daemon thread
2015-09-03 00:03:20 +05:30
Nishant
0096e6a0a0 Merge pull request #1658 from metamx/cleanupJDBCExtractionNamespaceTest
Hopefully add better timeouts and ordering to JDBCExtractionNamespaceTest
2015-09-02 23:49:49 +05:30
Xavier Léauté
82f9ecf56b Merge pull request #1620 from metamx/longFriendlyQTL
Allow long values in the key or value fields for URIExtractionNamespace
2015-09-02 10:55:35 -07:00
Charles Allen
ce3506b8e1 Merge pull request #1542 from metamx/audit-rule-history
add endpoint to fetch rule history for all datasources
2015-09-01 13:57:28 -07:00
cheddar
4f61b42f40 Merge pull request #1578 from b-slim/fix_extraction_filter_2
Fix UT and documentation to the extraction filter
2015-09-01 10:46:20 -07:00
Xavier Léauté
d89b0fa76a Merge pull request #1662 from qix/pathFormat-doc
Add documentation for pathFormat in batch ingestion
2015-08-31 11:14:54 -07:00
Josh Yudaken
29c29b42d3 Add default value and link to joda docs 2015-08-31 11:09:54 -07:00
Fangjin Yang
5e3a83871e Merge pull request #1687 from himanshug/num_reducer_override
do not let user override hadoop job settings explicitly provided by druid code
2015-08-31 09:30:26 -07:00
Himanshu Gupta
9ca6106128 user specified hadoop settings are ignored if explicitly set in code 2015-08-31 10:50:18 -05:00
nishant
0835e12f2a add endpoint to fetch rule history for all datasources.
review comments

Review comment

fix compilation
2015-08-31 14:05:52 +05:30
Fangjin Yang
dfe3be0f6d Merge pull request #1689 from metamx/lz4TranscoderUpdate
Update LZ4Transcoder to match Compressed strategy factory type.
2015-08-29 12:31:59 -07:00
Himanshu
04ff6cd355 Merge pull request #1685 from gianm/close-loudly
Close output streams and channels loudly when creating segments.
2015-08-28 23:32:22 -05:00
Charles Allen
413c0d1c9e Update LZ4Transcoder to match Compressed strategy factory type. 2015-08-28 19:19:48 -07:00
Charles Allen
8cf7eff93c Merge pull request #1686 from gianm/fix-imports
Replace funky imports with standard ones.
2015-08-28 18:32:48 -07:00
Gian Merlino
940e1aa3eb Replace funky imports with standard ones.
1) Lots of Guava imports were not coming from the actual Guava
2) junit.framework.Assert should be org.junit.Assert
2015-08-28 18:02:05 -07:00
Gian Merlino
e7b4cf942b Merge pull request #1682 from jon-wei/master
Support parsing of BytesWritable strings in HadoopDruidIndexerMapper
2015-08-28 17:46:26 -07:00
Gian Merlino
7d6fa2ba50 Close output streams and channels loudly when creating segments. 2015-08-28 17:14:03 -07:00
jon-wei
e5c4927b14 Add support for parsing BytesWritable strings to Hadoop Indexer 2015-08-28 14:27:14 -07:00
Himanshu
ceaa49ec4f Merge pull request #1681 from gianm/ingest-segment-overlapping
Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat
2015-08-28 11:12:51 -05:00
Himanshu
1b0b1d5fbb Merge pull request #1683 from gianm/remove-unused-indexer-interface
Remove unused Indexer interface.
2015-08-28 11:12:28 -05:00
Gian Merlino
e575ef2b20 Remove unused Indexer interface. 2015-08-28 08:40:47 -07:00
Gian Merlino
414a6fb477 Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat.
Fixes #1678. IngestSegmentFirehose (and its users) need to remember which
windows of which segments should actually be read, based on a timeline.
2015-08-28 07:32:41 -07:00
Gian Merlino
19c63a1103 Merge pull request #1609 from himanshug/kafka_firehose2
Experimental kafa simple consumer based firehose
2015-08-27 21:04:02 -07:00
Himanshu Gupta
2e0dd1d792 adding UTs and addressing review comments to
firehoseV2 addition to Realtime[Manager|Plumber],
essential segment metadata persist support,
kafka-simple-consumer-firehose extension patch
2015-08-27 20:50:46 -05:00
lvjq
2237a8cf0f kafka 8 simple consumer firehose 2015-08-27 20:50:46 -05:00
Charles Allen
10af233b37 Merge pull request #1622 from metamx/smile-eventreceiverfirehose
Support for JSON Smile format for EventReceiverFirehoseFactory
2015-08-27 10:42:25 -07:00
Charles Allen
c1388a1685 Merge pull request #1632 from Hailei/fix-subquery-innerquery-demension
Inner Query  should build on sub query
2015-08-27 10:25:38 -07:00
Nishant
6e5900e354 Merge pull request #1676 from metamx/fix-convert-segment-task
fix convert segment task
2015-08-27 18:13:09 +05:30
Charles Allen
ac8e32b58e Hopefully add better timeouts and ordering to JDBCExtractionNamespaceTest 2015-08-26 23:05:51 -07:00
Nishant
b306739e9c fix convert segment task
1) fix serde
2) fix wrong parameter being passed when creating subtask

remove sysout
2015-08-27 11:34:41 +05:30
Gian Merlino
5b67ec6cda Merge pull request #1672 from metamx/derbyRule
Migrate TestDerbyConnector to a JUnit @Rule
2015-08-26 22:56:18 -07:00
Charles Allen
e38cf54bc8 Migrate TestDerbyConnector to a JUnit @Rule 2015-08-26 21:47:40 -07:00
Fangjin Yang
94da7af94e Merge pull request #1675 from metamx/update-druid-api
update druid-api for jackson 2.4.6
2015-08-26 19:29:45 -07:00
Xavier Léauté
25853aee9b update druid-api for jackson 2.4.6 2015-08-26 19:23:37 -07:00
Fangjin Yang
12fd78f4d8 Merge pull request #1673 from guobingkun/patch-1
Fix batch ingestion doc
2015-08-26 19:12:13 -07:00
Hailei Zhang
e9e3aae9ab Merge pull request #1 from metamx/testFor1632
Add test for #1632
2015-08-27 10:02:12 +08:00
Fangjin Yang
b928c63771 Merge pull request #1674 from gianm/jackson-downgrade
Downgrade Jackson to 2.4.6.
2015-08-26 18:35:24 -07:00
Gian Merlino
2a866f49df Downgrade Jackson to 2.4.6. 2015-08-26 18:25:55 -07:00
Xavier Léauté
e9237611c5 Merge pull request #1668 from metamx/cachingClusteredClientCodeCleanup1
Code cleanup for CachingClusteredClientTest
2015-08-26 17:13:55 -07:00
Bingkun
ae1f104c10 Fix batch ingestion doc 2015-08-26 15:16:21 -05:00
Charles Allen
b24a88b328 Allow long values in the key or value fields for URIExtractionNamespace 2015-08-26 09:44:03 -07:00
Charles Allen
4befd6bfef Merge pull request #1670 from druid-io/fix-format
fix formatting
2015-08-26 09:22:37 -07:00
fjy
bdfe67fe17 fix formatting 2015-08-26 09:21:32 -07:00