Commit Graph

6165 Commits

Author SHA1 Message Date
Charles Allen c523733c3f Merge pull request #1859 from rasahner/baseOnCommunity
some changes for support of our integration tests
2015-10-26 14:19:26 -07:00
Himanshu Gupta e9cfb7f46f refer to top level property for hadoop version instead of hardcoding 2.3.0 2015-10-26 15:51:48 -05:00
Fangjin Yang ea4ed5692c Merge pull request #1863 from guobingkun/add_loadqueue_full_doc
[doc] add description for /druid/coordinator/v1/loadqueue?full
2015-10-26 12:30:37 -07:00
Bingkun Guo 44aad069da add description for /druid/coordinator/v1/loadqueue?full 2015-10-26 14:19:13 -05:00
Fangjin Yang 7e1cde25b6 Merge pull request #1820 from himanshug/doc_files
Removing the md files created for redirection
2015-10-26 09:37:11 -07:00
Fangjin Yang 5a082b2f5e Merge pull request #1824 from metamx/UniformGranularitySpecHashEquals
Add hashCode and equals to UniformGranularitySpec
2015-10-26 09:34:01 -07:00
Fangjin Yang 5f23703216 Merge pull request #1638 from guobingkun/remove_maven_client_code
Remove Maven client at runtime + Provide a way to load Druid extensions through local file system
2015-10-26 09:30:05 -07:00
sahner 6c9ba72dea some changes for support of our tests 2015-10-26 07:48:56 -05:00
Gian Merlino f88d59b5c0 Merge pull request #1854 from b-slim/patch-2
Fix documentation about lookup
2015-10-23 16:49:08 -07:00
Slim 16f84161da Fix documentation about lookup 2015-10-23 16:40:54 -07:00
Himanshu 2c3753ccca Merge pull request #1815 from metamx/jar-upload-race
Fix Race in jar upload during hadoop indexing
2015-10-23 14:34:23 -05:00
Xavier Léauté 72c408cf2d Merge pull request #1770 from metamx/merge-time
Add segment merge time as a metric
2015-10-22 22:03:41 -07:00
Himanshu 853f95f64c Merge pull request #1845 from metamx/moreVerboseRuleAuditLogging
Add more verbose logging to SQLMetadataRuleManager
2015-10-22 16:12:46 -05:00
Himanshu 6a7f8fa054 Merge pull request #1846 from metamx/notifyWhenSegmentPollStarts
Add debug logging to start of segment manager polling
2015-10-22 13:52:26 -05:00
Nishant 3641a0e553 Fix Race in jar upload during hadoop indexing - https://github.com/druid-io/druid/issues/582
few fixes

delete intermediate file early

better exception handling

use static pattern instead of compiling it every time

Add retry for transient exceptions

remove usage of deprecated method.

Add test

fix imports

fix javadoc

review comment.

review comment: handle crazy snapshot naming

review comments

remove default retry count in favour of already present constant

review comment

make random intermediate and final paths.

review comment, use temporaryFolder where possible
2015-10-22 21:41:07 +05:30
Nishant 7cecc55045 Add segment merge time as a metric
Add merge and persist cpu time

Fix typo

review comment

move cpu time measuring to VMUtils

review comments.
2015-10-22 12:28:03 +05:30
Xavier Léauté 58a4d39b8f Merge pull request #1843 from gianm/config-doc-fix
"druid.manager.segment" should be "druid.manager.segments"
2015-10-21 16:20:55 -07:00
Charles Allen 6ceab03fc4 Add debug logging to start of segment manager polling 2015-10-21 16:17:49 -07:00
Charles Allen 1cad571354 Add more verbose logging to SQLMetadataRuleManager 2015-10-21 16:11:40 -07:00
Gian Merlino d068ec3b9d "druid.manager.segment" should be "druid.manager.segments" 2015-10-21 15:50:44 -07:00
Bingkun Guo 4914925d65 New extension loading mechanism
1) Remove maven client from downloading extensions at runtime.
2) Provide a way to load Druid extensions and hadoop dependencies through file system.
3) Refactor pull-deps so that it can download extensions into extension directories.
4) Add documents on how to use this new extension loading mechanism.
5) Change the way how Druid tarball is generated. Now all the extensions + hadoop-client 2.3.0
are packaged within the Druid tarball.
2015-10-21 14:22:36 -05:00
Himanshu b7c68ec449 Merge pull request #1842 from metamx/DRUID-1841
Do not pass `druid.indexer.runner.javaOpts` to Peon as a property
2015-10-21 13:15:36 -05:00
Himanshu 8dd30e6e18 Merge pull request #1832 from guobingkun/improve_granularity_doc
add examples for duration and period granularities
2015-10-21 13:13:24 -05:00
Bingkun Guo 2de5e9cefb add examples for duration and period granularities 2015-10-21 11:23:00 -05:00
Xavier Léauté e4ac78e43d bump next snapshot to 0.9.0 2015-10-20 13:46:13 -07:00
Himanshu 0292db648d Merge pull request #1833 from metamx/improve-log
Improve alert message in CachingClusteredClient - Add Datasource info.
2015-10-20 15:40:57 -05:00
Charles Allen 532e1c9fd5 Do not pass `druid.indexer.runner.javaOpts` to Peon as a property
* Still places `druid.indexer.runner.javaOpts` on the command line, but the Peon no longer tries to have the property `druid.indexer.runner.javaOpts` set
* Fixes https://github.com/druid-io/druid/issues/1841
2015-10-20 09:24:01 -07:00
Fangjin Yang 092b5b19d2 Merge pull request #1838 from druid-io/update-paper-again
more edits to radstack paper
2015-10-18 19:53:31 -07:00
fjy c40dd73a59 more edits to radstack paper 2015-10-18 19:52:44 -07:00
Fangjin Yang 170cce69d4 Merge pull request #1834 from guobingkun/fix_doc
fix ingestion faq link
2015-10-18 17:31:22 -07:00
Fangjin Yang ccd17f818a Merge pull request #1837 from druid-io/update-paper
add more details to radstack paper
2015-10-18 17:31:08 -07:00
fjy 89785b2f52 add more details to paper 2015-10-18 17:30:24 -07:00
Bingkun Guo 620e334d0f fix ingestion faq link 2015-10-16 10:14:14 -05:00
Nishant bf214f23b2 Improve message for alert - Add Datasource info. 2015-10-16 19:43:21 +05:30
dclim 46ecdfa757 add comment explaining logic 2015-10-15 16:04:06 -06:00
Charles Allen 28d7233b3e Merge pull request #1786 from rasahner/testEnhancements
enhance test support and update realtime test to use serverTime
2015-10-15 14:32:23 -07:00
Charles Allen ff0fbec40a Merge pull request #1831 from rasahner/lookupLookup
fix doubled word
2015-10-15 14:32:00 -07:00
sahner 83d31844db fix doubled word 2015-10-15 15:59:07 -05:00
sahner f31ae89724 enhance test support and update realtime test to use serverTime 2015-10-15 13:43:42 -05:00
Xavier Léauté 4c2c7a2c37 update version to 0.8.3 2015-10-14 21:40:55 -07:00
Himanshu a68397adce Merge pull request #1829 from metamx/update-coveralls
update coveralls plugin
2015-10-14 14:52:26 -05:00
Xavier Léauté 5a98d4e650 update coveralls plugin 2015-10-14 10:25:23 -07:00
Charles Allen f432b8e3f9 Add hashCode and equals to UniformGranularitySpec
* Also add hashCode != 0 to AllGranularity and NoneGranularity
2015-10-13 16:42:21 -07:00
Gian Merlino c9d6994040 Merge pull request #1821 from himanshug/storage_adapter_update
cache max data timestamp in QueryableIndexStorageAdapter
2015-10-13 10:52:43 -07:00
Xavier Léauté febf264531 Merge pull request #1822 from himanshug/outer_query_multiple_interval_fix
support multiple non-consecutive intervals in outer query of nested group-by
2015-10-13 10:44:52 -07:00
Nishant 273ec21d3d Merge pull request #1811 from metamx/ServerDiscoverySelectorIPv6
Server discovery selector ipv6 friendly
2015-10-13 23:12:05 +05:30
Xavier Léauté 75061dad67 Merge pull request #1823 from himanshug/datasource_pathspec_querygranularity
For dataSource inputSpec in hadoop batch ingestion, use configured query granularity for reading existing segments instead of NONE
2015-10-13 10:28:15 -07:00
Himanshu Gupta 490de1f98a support multiple non-consecutive intervals in outer query of nested group-by 2015-10-13 10:16:06 -05:00
Himanshu Gupta 0368260018 For dataSource inputSpec in hadoop batch ingestion, use configured query granularity for reading existing segments instead of NONE 2015-10-12 22:19:44 -05:00
Himanshu Gupta fbba30eb60 cache max data timestamp in QueryableIndexStorageAdapter so that TimestampCheckingOffset
does not have to get it per cursor.
2015-10-12 15:34:22 -05:00