Commit Graph

5880 Commits

Author SHA1 Message Date
Xavier Léauté 21ba859f33 Merge pull request #1366 from metamx/futurizeSQLMetadataSegmentManager
Properly shutdown SQLMetadataSegmentManager and SQLMetadataRuleManager
2015-05-15 17:33:25 -07:00
Fangjin Yang 1d33f46ece Merge pull request #1373 from metamx/segmentMetadataQueryDocClarification
Modify SegmentMetadataQuery.md to refer to flat data instead of `TSV`
2015-05-15 17:27:26 -06:00
Charles Allen 051c3ccede Add futures to SQLMetadataSegmentManager and SQLMetadataRuleManager 2015-05-15 16:08:22 -07:00
Charles Allen 03df582fe4 Modify SegmentMetadataQuery.md to refer to flat data instead of `TSV` 2015-05-15 13:49:51 -07:00
Xavier Léauté 87924c7c66 Merge pull request #1369 from druid-io/add-toc
Add missing toc entry for data ingestion
2015-05-15 10:18:00 -07:00
fjy 614e79a0da Add missing toc entry 2015-05-15 11:16:51 -06:00
Charles Allen 29ba05c04f Abstractify HadoopTask
* Add `invokeForeignLoader` to commonize the way tasks are attempted to be launched in a foreign class loader
* Add `buildClassLoader` to accomplish the common tasks for hadoop jobs when building a ClassLoader
2015-05-14 17:04:43 -07:00
Xavier Léauté 3c3db7229c Merge pull request #1355 from himanshug/long_max_min_aggregators
Long max/min aggregators
2015-05-13 12:08:11 -07:00
Himanshu Gupta 4b907a93c5 updating the aggregators doc 2015-05-13 09:25:57 -05:00
Himanshu Gupta cebb550796 additional UTs for [DoubleMax/DoubleMin] aggregation 2015-05-13 09:25:41 -05:00
Himanshu Gupta d0ec945129 adding aliases doubleMax and doubleMin for max and min respectively
renamed all [Max/Min]*.java to [DoubleMax/DoubleMin]*.java and created [Max/Min]AggregatorFactory.java which can be removed when we dont need the min/max aggregator type backward compatibility
2015-05-13 09:25:41 -05:00
Himanshu Gupta 2de38f7d29 UTs for long[Max/Min] aggregation 2015-05-13 09:25:22 -05:00
Himanshu Gupta 00436f93e2 long max/min aggregators implementation 2015-05-13 09:25:22 -05:00
Xavier Léauté ad286cc02e Merge pull request #1357 from druid-io/oh8
update pom to 0.8
2015-05-11 22:04:03 -07:00
fjy 7a6acf5c1b update pom to 0.8 2015-05-11 19:41:58 -06:00
Fangjin Yang 9fb9b8a510 Merge pull request #1353 from himanshug/alerts_doc
documenting druid alerts schema
2015-05-09 19:05:32 -07:00
Himanshu Gupta f2adb22350 documenting druid alerts schema 2015-05-09 21:03:10 -05:00
Xavier Léauté eb76889a5a Merge pull request #1349 from druid-io/fix-toc
Add back some links in TOC
2015-05-08 13:34:38 -07:00
Fangjin Yang a2dc58cd2d Merge pull request #1345 from pjain1/unit_test_warn_fix
fix warn msg and some unit tests
2015-05-08 08:06:20 -07:00
fjy 70f089594f Add back some links in TOC 2015-05-07 16:38:09 -07:00
Parag Jain 01448d264c Fix warn msg and added some unit tests 2015-05-07 17:10:05 -05:00
Xavier Léauté ed8cfbf74d Merge pull request #1348 from druid-io/fix-typo
fix typos with batch ingestion in docs
2015-05-07 15:07:48 -07:00
fjy b19435d172 fix typos with batch ingestion in docs 2015-05-07 14:46:17 -07:00
Xavier Léauté 8fcc5a2d51 Merge pull request #1347 from gianm/task-shutdown-doc-fix
Tasks are not actually sigkilled.
2015-05-07 08:51:46 -07:00
Gian Merlino 1519a1c930 Tasks are not actually sigkilled. 2015-05-07 08:44:28 -07:00
Xavier Léauté 33265d63e1 Merge pull request #1262 from metamx/fix-null-dimension
fix handling of dimension having only null values
2015-05-06 13:51:26 -07:00
Fangjin Yang 7b649f6993 Merge pull request #1305 from davrodpin/azure-storage-overall-improvements
Overall improvement on Azure Deep Storage extension.
2015-05-05 22:26:58 -07:00
David Rodrigues 11a76169b4 Overall improvement on Azure Deep Storage extension.
* Remove hard-coded azure path manipulation from the puller.
  * Fix segment size not being zero after uploading it do Azure.
  * Remove both index and desc files only on a success upload to Azure.
  * Add Azure container name to load spec.
      This patch would help future-proof azure deep-storage module and avoid
      having to introduce ugly backwards-compatibility fixes when we want to
      support multiple containers or moving data between containers.
2015-05-05 15:17:25 -07:00
Fangjin Yang 7c4054aaa3 Merge pull request #1343 from metamx/fix-npe
fix NPE
2015-05-05 11:02:44 -07:00
nishant 34be1e96fa fix NPE
review comments

Add test

fix test for java8
2015-05-05 23:11:13 +05:30
Fangjin Yang 7608bf5799 Merge pull request #1342 from guobingkun/unit_test
Fix a potential issue in DeterminePartitionsJob, and two unit tests, reformat code
2015-05-05 09:24:23 -07:00
Bingkun Guo 1ee550dd91 Fix a potential issue in DeterminePartitionsJob by making HadoopDruidIndexerConfig non-static, and two unit tests for DeterminPartitionsJob and LocalDataSegmentKiller 2015-05-04 20:00:29 -07:00
Fangjin Yang d7562fd4d1 Merge pull request #1337 from gianm/delay-firehose-connect
Realtime: Delay firehose connection until job is started.
2015-05-04 17:18:28 -07:00
Gian Merlino e69d82a2b4 Realtime: Delay firehose connection until job is started.
Some firehoses (like the Kafka firehose) acquire input resources when they
connect, so it helps to delay this until after plumber.startJob() runs.
2015-05-04 10:54:07 -07:00
Gian Merlino 8eb441ec08 RealtimeManager: Include partitionNum in chief thread name. 2015-05-04 10:53:48 -07:00
Neo 8f8400e24e fix handling of dimension having only null values
fixes #1211

fix value matcher

more improvements

more fixes for partial null column

fix handling of dimension having only null values

fixes #1211

fix value matcher

more improvements

more fixes for partial null column

review comment

IndexMaker speedups
* About 15% speedup

Conflicts:
	processing/src/main/java/io/druid/segment/IndexMaker.java

fix handling of dimension having only null values

fixes #1211

fix value matcher

more improvements

more fixes for partial null column

fix handling of dimension having only null values

fixes #1211

fix value matcher

more improvements

more fixes for partial null column

review comment

review comments

review comment

fix failing tests

review comment

fix compilation
2015-05-04 22:07:45 +05:30
Fangjin Yang 6be596c45e Merge pull request #1336 from metamx/fix-1330
fixes #1330
2015-05-04 09:06:32 -07:00
nishant 50158357ff fixes #1330
fixes #1330,
Avoid creating Period instance as creating a Period from Long.MAX_VALUE
throws arithmetic exception.
After this query metric will emit duration in seconds instead of
minutes.
2015-05-04 20:34:28 +05:30
Xavier Léauté 2ec87838d2 Merge pull request #1333 from himanshug/convert_props_ut
UTs for ConvertProperties
2015-05-03 15:11:53 -07:00
Himanshu Gupta eca69fd084 remove validation query config from docs as its not valid anymore 2015-05-03 08:41:35 -05:00
Himanshu Gupta aa10626b61 adding druid.db.tables.xxx renames and druid.db.connectory.*validation* from ConvertProperties 2015-05-03 08:41:15 -05:00
Himanshu Gupta 8722f4cc18 UTs for ConvertProperties 2015-05-03 08:40:17 -05:00
Xavier Léauté 592ba565e0 Merge pull request #1334 from himanshug/fix_default_indexing_service_name
fix doc for druid.[host,port,service] etc
2015-05-02 23:05:14 -07:00
Himanshu Gupta fd3b23072b fixing defaults for druid.[host,port,service] in docs etc 2015-05-02 15:44:03 -05:00
Himanshu Gupta ce7ad41aaa removing port number from druid.host in production-cluster-configuration as its gives the intuition that port name is mandatory to be specified which is not true anymore 2015-05-02 15:34:36 -05:00
Fangjin Yang f734471f22 Merge pull request #1331 from metamx/fixIrcFirehoseNameNick
fix IRCFirehoseFactory json name/nick mismatch
2015-05-01 15:35:08 -07:00
Charles Allen 27e25fe513 fix IRCFirehoseFactory json name/nick mismatch
* Now it is nick as per wikipedia example
2015-05-01 12:35:44 -07:00
Fangjin Yang 15ed308a4b Merge pull request #1322 from himanshug/fix_audit_tbl_idx
fixing the typo for audit table (type, created_date) index creation
2015-04-30 13:22:04 -07:00
Xavier Léauté a2bde3af1b Merge pull request #1327 from druid-io/more-coord-logs
Additional coordinator logs to figure out when racy things might be hap...
2015-04-30 10:51:09 -07:00
Fangjin Yang 85335227fb Merge pull request #1326 from himanshug/add_audit_tbl_config
add audit table name configuration doc
2015-04-30 10:25:20 -07:00