Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-02-10 03:55:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,882 Commits 116 Branches 507 Tags
Commit Graph

5882 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Charles Allen
8d3cdd8572 Don't check for sortedness if we already know GenericIndexedWriter isn't sorted 2015-09-11 16:32:09 -07:00
Fangjin Yang
5f9be8dd0a Merge pull request #1723 from guobingkun/fix_typo 
fix typo in segments.md
 2015-09-12 05:51:55 +08:00
Bingkun Guo
e222e6b86b fix typo in segments.md 2015-09-11 16:32:50 -05:00
Himanshu Gupta
b989a7054c fix for "java.io.IOException: No FileSystem for scheme: hdfs" error 
aka workaround for https://issues.apache.org/jira/browse/HDFS-8750
 2015-09-11 15:35:59 -05:00
Gian Merlino
252bb5a6bc Merge pull request #1720 from himanshug/faq_update 
update ingestion faq to mention dataSource inputSpec
 2015-09-11 12:40:34 -07:00
Himanshu Gupta
075b6d4385 update ingestion faq to mention dataSource inputSpec as an option of reindexing via hadoop 2015-09-10 14:41:13 -05:00
Charles Allen
d6849805ea Add some basic latching to concurrency testing in IncrementalIndexTest 2015-09-10 10:06:51 -07:00
Nishant
4681ff22ed add task duration in response for completed tasks 2015-09-10 13:51:50 +05:30
Gian Merlino
e5532367e1 Merge pull request #1717 from himanshug/doc_fix 
in configuration/index.md s/instantialize/initialize
 2015-09-09 21:35:21 -07:00
Himanshu Gupta
39d23ffc45 in configuration/index.md s/instantialize/initialize 2015-09-09 21:18:26 -05:00
Charles Allen
7c5d2fa686 Merge pull request #1699 from himanshug/composing_emitter 
composing emitter module to use multiple emitters together
 2015-09-09 19:05:39 -07:00
Himanshu Gupta
ebdb612933 composing emitter module to use multiple emitters together 2015-09-09 16:45:50 -05:00
Himanshu Gupta
67aa3dc153 on HDFS store segments in "dataSource/interval/.." and not in "dataSource/dataSource/interval.." 2015-09-09 11:12:01 -05:00
Himanshu Gupta
fe0233adf2 removing unused imports from HadoopIndexTask 2015-09-09 11:12:01 -05:00
Himanshu Gupta
5da58e48e0 use Rule based TemporaryFolder for cleanup of temp directory/files 2015-09-09 11:10:33 -05:00
Himanshu Gupta
44911039c5 update indexing in the helper to use multiple persists and final merge to 
catch further issues in aggregator implementations
 2015-09-09 11:10:33 -05:00
Charles Allen
5813856819 More memcached metrics 2015-09-08 13:34:58 -07:00
Charles Allen
fcf5cae81d Add CPU time to metrics for segment scanning. 2015-09-08 13:34:19 -07:00
Charles Allen
1977ac9c5d Better logging of URIExtractionNamespace failures due to missing files 2015-09-08 13:33:32 -07:00
Fangjin Yang
07266d682a Merge pull request #1694 from metamx/namespaceExtractionCacheManagerTestImprovements 
Better timing and locking in NamespaceExtractionCacheManagerExecutorsTest
 2015-09-04 15:06:22 -07:00
Charles Allen
0b8a3035c6 Better timing and locking in NamespaceExtractionCacheManagerExecutorsTest 2015-09-04 13:02:14 -07:00
Charles Allen
9b5889b393 Merge pull request #1703 from metamx/fix-npe 
add null check for task context.
 2015-09-04 11:04:12 -07:00
Nishant
47aac991ec add null check for task context. 
make variable final
 2015-09-04 22:19:01 +05:30
Fangjin Yang
75a582974b Merge pull request #1639 from gianm/new-plumber 
New plumber
 2015-09-03 18:52:57 -07:00
Himanshu
66a9a332d0 Merge pull request #1604 from metamx/task-jvm-config 
Allow task to override ForkingTaskRunner tunings and jvm settings
 2015-09-03 16:43:49 -05:00
Gian Merlino
062a47fba4 Modify Plumbers in these ways, 
1) Persist using Committer instead of Runnable. (Although the metadata object
   is ignored in this patch)

2) Remove the getSink method.

3) Plumbers are now responsible for time-based and hydrant-full-based periodic
   committing. (FireChief, RealtimeIndexTask, and IndexTask used to do this)
 2015-09-03 11:13:06 -07:00
Nishant
726326abc3 Add Task Context and ability to override task specific properties 
override javaOpts

fix compilation

review comments

Add Test for typecast

review comments - remove unused method.
 2015-09-03 23:36:32 +05:30
Fangjin Yang
4546652b3b Merge pull request #1698 from gianm/docs-skipEmptyBuckets 
Timeseries skipEmptyBucket docs.
 2015-09-02 15:30:43 -07:00
Gian Merlino
cbef4a15b0 Timeseries skipEmptyBucket docs. 2015-09-02 14:59:21 -07:00
Nishant
e79572b4bc Merge pull request #1637 from metamx/peonPlaysNiceOnShutdown 
Make jetty scheduler threads daemon thread
 2015-09-03 00:03:20 +05:30
Nishant
0096e6a0a0 Merge pull request #1658 from metamx/cleanupJDBCExtractionNamespaceTest 
Hopefully add better timeouts and ordering to JDBCExtractionNamespaceTest
 2015-09-02 23:49:49 +05:30
Xavier Léauté
82f9ecf56b Merge pull request #1620 from metamx/longFriendlyQTL 
Allow long values in the key or value fields for URIExtractionNamespace
 2015-09-02 10:55:35 -07:00
Charles Allen
ce3506b8e1 Merge pull request #1542 from metamx/audit-rule-history 
add endpoint to fetch rule history for all datasources
 2015-09-01 13:57:28 -07:00
cheddar
4f61b42f40 Merge pull request #1578 from b-slim/fix_extraction_filter_2 
Fix UT and documentation to the extraction filter
 2015-09-01 10:46:20 -07:00
Xavier Léauté
d89b0fa76a Merge pull request #1662 from qix/pathFormat-doc 
Add documentation for pathFormat in batch ingestion
 2015-08-31 11:14:54 -07:00
Josh Yudaken
29c29b42d3 Add default value and link to joda docs 2015-08-31 11:09:54 -07:00
Fangjin Yang
5e3a83871e Merge pull request #1687 from himanshug/num_reducer_override 
do not let user override hadoop job settings explicitly provided by druid code
 2015-08-31 09:30:26 -07:00
Himanshu Gupta
9ca6106128 user specified hadoop settings are ignored if explicitly set in code 2015-08-31 10:50:18 -05:00
nishant
0835e12f2a add endpoint to fetch rule history for all datasources. 
review comments

Review comment

fix compilation
 2015-08-31 14:05:52 +05:30
Fangjin Yang
dfe3be0f6d Merge pull request #1689 from metamx/lz4TranscoderUpdate 
Update LZ4Transcoder to match Compressed strategy factory type.
 2015-08-29 12:31:59 -07:00
Himanshu
04ff6cd355 Merge pull request #1685 from gianm/close-loudly 
Close output streams and channels loudly when creating segments.
 2015-08-28 23:32:22 -05:00
Charles Allen
413c0d1c9e Update LZ4Transcoder to match Compressed strategy factory type. 2015-08-28 19:19:48 -07:00
Charles Allen
8cf7eff93c Merge pull request #1686 from gianm/fix-imports 
Replace funky imports with standard ones.
 2015-08-28 18:32:48 -07:00
Gian Merlino
940e1aa3eb Replace funky imports with standard ones. 
1) Lots of Guava imports were not coming from the actual Guava
2) junit.framework.Assert should be org.junit.Assert
 2015-08-28 18:02:05 -07:00
Gian Merlino
e7b4cf942b Merge pull request #1682 from jon-wei/master 
Support parsing of BytesWritable strings in HadoopDruidIndexerMapper
 2015-08-28 17:46:26 -07:00
Gian Merlino
7d6fa2ba50 Close output streams and channels loudly when creating segments. 2015-08-28 17:14:03 -07:00
jon-wei
e5c4927b14 Add support for parsing BytesWritable strings to Hadoop Indexer 2015-08-28 14:27:14 -07:00
Himanshu
ceaa49ec4f Merge pull request #1681 from gianm/ingest-segment-overlapping 
Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat
 2015-08-28 11:12:51 -05:00
Himanshu
1b0b1d5fbb Merge pull request #1683 from gianm/remove-unused-indexer-interface 
Remove unused Indexer interface.
 2015-08-28 11:12:28 -05:00
Gian Merlino
e575ef2b20 Remove unused Indexer interface. 2015-08-28 08:40:47 -07:00