Commit Graph

6755 Commits

Author SHA1 Message Date
Himanshu 2c3753ccca Merge pull request #1815 from metamx/jar-upload-race
Fix Race in jar upload during hadoop indexing
2015-10-23 14:34:23 -05:00
Xavier Léauté 72c408cf2d Merge pull request #1770 from metamx/merge-time
Add segment merge time as a metric
2015-10-22 22:03:41 -07:00
Himanshu 853f95f64c Merge pull request #1845 from metamx/moreVerboseRuleAuditLogging
Add more verbose logging to SQLMetadataRuleManager
2015-10-22 16:12:46 -05:00
Himanshu 6a7f8fa054 Merge pull request #1846 from metamx/notifyWhenSegmentPollStarts
Add debug logging to start of segment manager polling
2015-10-22 13:52:26 -05:00
Nishant 3641a0e553 Fix Race in jar upload during hadoop indexing - https://github.com/druid-io/druid/issues/582
few fixes

delete intermediate file early

better exception handling

use static pattern instead of compiling it every time

Add retry for transient exceptions

remove usage of deprecated method.

Add test

fix imports

fix javadoc

review comment.

review comment: handle crazy snapshot naming

review comments

remove default retry count in favour of already present constant

review comment

make random intermediate and final paths.

review comment, use temporaryFolder where possible
2015-10-22 21:41:07 +05:30
Nishant 7cecc55045 Add segment merge time as a metric
Add merge and persist cpu time

Fix typo

review comment

move cpu time measuring to VMUtils

review comments.
2015-10-22 12:28:03 +05:30
Xavier Léauté 58a4d39b8f Merge pull request #1843 from gianm/config-doc-fix
"druid.manager.segment" should be "druid.manager.segments"
2015-10-21 16:20:55 -07:00
Charles Allen 6ceab03fc4 Add debug logging to start of segment manager polling 2015-10-21 16:17:49 -07:00
Charles Allen 1cad571354 Add more verbose logging to SQLMetadataRuleManager 2015-10-21 16:11:40 -07:00
Gian Merlino d068ec3b9d "druid.manager.segment" should be "druid.manager.segments" 2015-10-21 15:50:44 -07:00
Bingkun Guo 4914925d65 New extension loading mechanism
1) Remove maven client from downloading extensions at runtime.
2) Provide a way to load Druid extensions and hadoop dependencies through file system.
3) Refactor pull-deps so that it can download extensions into extension directories.
4) Add documents on how to use this new extension loading mechanism.
5) Change the way how Druid tarball is generated. Now all the extensions + hadoop-client 2.3.0
are packaged within the Druid tarball.
2015-10-21 14:22:36 -05:00
Himanshu b7c68ec449 Merge pull request #1842 from metamx/DRUID-1841
Do not pass `druid.indexer.runner.javaOpts` to Peon as a property
2015-10-21 13:15:36 -05:00
Himanshu 8dd30e6e18 Merge pull request #1832 from guobingkun/improve_granularity_doc
add examples for duration and period granularities
2015-10-21 13:13:24 -05:00
Bingkun Guo 2de5e9cefb add examples for duration and period granularities 2015-10-21 11:23:00 -05:00
Xavier Léauté e4ac78e43d bump next snapshot to 0.9.0 2015-10-20 13:46:13 -07:00
Himanshu 0292db648d Merge pull request #1833 from metamx/improve-log
Improve alert message in CachingClusteredClient - Add Datasource info.
2015-10-20 15:40:57 -05:00
Charles Allen 532e1c9fd5 Do not pass `druid.indexer.runner.javaOpts` to Peon as a property
* Still places `druid.indexer.runner.javaOpts` on the command line, but the Peon no longer tries to have the property `druid.indexer.runner.javaOpts` set
* Fixes https://github.com/druid-io/druid/issues/1841
2015-10-20 09:24:01 -07:00
Fangjin Yang 092b5b19d2 Merge pull request #1838 from druid-io/update-paper-again
more edits to radstack paper
2015-10-18 19:53:31 -07:00
fjy c40dd73a59 more edits to radstack paper 2015-10-18 19:52:44 -07:00
Fangjin Yang 170cce69d4 Merge pull request #1834 from guobingkun/fix_doc
fix ingestion faq link
2015-10-18 17:31:22 -07:00
Fangjin Yang ccd17f818a Merge pull request #1837 from druid-io/update-paper
add more details to radstack paper
2015-10-18 17:31:08 -07:00
fjy 89785b2f52 add more details to paper 2015-10-18 17:30:24 -07:00
Bingkun Guo 620e334d0f fix ingestion faq link 2015-10-16 10:14:14 -05:00
Nishant bf214f23b2 Improve message for alert - Add Datasource info. 2015-10-16 19:43:21 +05:30
dclim 46ecdfa757 add comment explaining logic 2015-10-15 16:04:06 -06:00
Charles Allen 28d7233b3e Merge pull request #1786 from rasahner/testEnhancements
enhance test support and update realtime test to use serverTime
2015-10-15 14:32:23 -07:00
Charles Allen ff0fbec40a Merge pull request #1831 from rasahner/lookupLookup
fix doubled word
2015-10-15 14:32:00 -07:00
sahner 83d31844db fix doubled word 2015-10-15 15:59:07 -05:00
sahner f31ae89724 enhance test support and update realtime test to use serverTime 2015-10-15 13:43:42 -05:00
Xavier Léauté 4c2c7a2c37 update version to 0.8.3 2015-10-14 21:40:55 -07:00
Himanshu a68397adce Merge pull request #1829 from metamx/update-coveralls
update coveralls plugin
2015-10-14 14:52:26 -05:00
Xavier Léauté 5a98d4e650 update coveralls plugin 2015-10-14 10:25:23 -07:00
Charles Allen f432b8e3f9 Add hashCode and equals to UniformGranularitySpec
* Also add hashCode != 0 to AllGranularity and NoneGranularity
2015-10-13 16:42:21 -07:00
Gian Merlino c9d6994040 Merge pull request #1821 from himanshug/storage_adapter_update
cache max data timestamp in QueryableIndexStorageAdapter
2015-10-13 10:52:43 -07:00
Xavier Léauté febf264531 Merge pull request #1822 from himanshug/outer_query_multiple_interval_fix
support multiple non-consecutive intervals in outer query of nested group-by
2015-10-13 10:44:52 -07:00
Nishant 273ec21d3d Merge pull request #1811 from metamx/ServerDiscoverySelectorIPv6
Server discovery selector ipv6 friendly
2015-10-13 23:12:05 +05:30
Xavier Léauté 75061dad67 Merge pull request #1823 from himanshug/datasource_pathspec_querygranularity
For dataSource inputSpec in hadoop batch ingestion, use configured query granularity for reading existing segments instead of NONE
2015-10-13 10:28:15 -07:00
Himanshu Gupta 490de1f98a support multiple non-consecutive intervals in outer query of nested group-by 2015-10-13 10:16:06 -05:00
Himanshu Gupta 0368260018 For dataSource inputSpec in hadoop batch ingestion, use configured query granularity for reading existing segments instead of NONE 2015-10-12 22:19:44 -05:00
Himanshu Gupta fbba30eb60 cache max data timestamp in QueryableIndexStorageAdapter so that TimestampCheckingOffset
does not have to get it per cursor.
2015-10-12 15:34:22 -05:00
Himanshu Gupta 24f33938d8 Removing the md files created for redirection 2015-10-12 15:21:55 -05:00
Charles Allen bf11723a52 Update usages of io.druid.client.selector.Server to build URL or URI directly instead of using String.format 2015-10-12 12:30:56 -07:00
Xavier Léauté f4e4dac434 Merge pull request #1818 from metamx/moreSerdeTestsForLookupExtraction
Add hashCode and equals to stock lookups
2015-10-12 10:55:38 -07:00
Charles Allen 8ed5d2c06a Add hashCode and equals to stock lookups 2015-10-12 10:29:39 -07:00
Fangjin Yang 95d59b9bc3 Merge pull request #1812 from metamx/bumpServerMetricsVersion
Bump server-metrics to 0.2.5 to catch a few fixes.
2015-10-09 11:22:25 -07:00
Xavier Léauté 968b640261 Merge pull request #1814 from gianm/rt-docs
Adjust realtime constraints in the docs.
2015-10-09 10:59:31 -07:00
Gian Merlino 933cbdf780 Adjust realtime constraints in the docs. 2015-10-09 10:52:52 -07:00
Charles Allen e9b81430f4 Bump server-metrics to 0.2.5 to catch a few fixes. 2015-10-08 11:05:51 -07:00
Xavier Léauté 283ddfcf71 Merge pull request #1808 from metamx/revert-jetty
Revert "update jetty to 9.2.13.v20150730 (latest Java 7 compatible ve…
2015-10-08 10:08:23 -07:00
Charles Allen e450877a78 Make ServerDiscoverySelector more IPv6 friendly 2015-10-08 10:03:50 -07:00