513bc76252
RTR: Ensure that there is only one cleanup task scheduled for a worker at once.
...
This is accomplished by making sure that scheduleTasksCleanupForWorker is only called
from the PathChildrenCache event thread, having it cancel existing cleanup tasks when
it adds a new one, and having tasks check on finish that the thing they are removing
from the task list is actually themselves.
2015-10-27 21:16:58 -07:00
59872bd0cd
Merge pull request #1809 from metamx/fifoPriorityExecutorService
...
Make PrioritizedExecutorService optionally FIFO
2015-10-27 15:19:32 -07:00
ea2267e08c
Merge pull request #1868 from gianm/fix-announcements
...
Historical and MiddleManager server announcements should not remove parents.
2015-10-27 14:50:05 -07:00
060402a216
Merge pull request #1855 from himanshug/fix_having_specs
...
fix [GreaterThan,LessThan,Equals] HavingSpecs
2015-10-27 14:46:04 -07:00
7df7370935
Merge pull request #1862 from metamx/indexingServiceMMGone
...
Add timeout to shutdown request to middle manager for indexing service
2015-10-27 14:38:01 -07:00
7a2ceef690
Add special handler to allow logger messages during shutdown
...
* Adds a special PropertyChecker interface which is ONLY for setting string properties at the very start of psvm
2015-10-27 14:33:36 -07:00
ecdafa87c5
Make PrioritizedExecutorService optionally FIFO
2015-10-27 14:16:22 -07:00
67d58f6d8d
Update CoordinatorRuleManager for http-client 1.0.4
2015-10-27 14:08:45 -07:00
44a2b204df
Add timeout to shutdown request to middle manager for indexing service
2015-10-27 13:56:03 -07:00
a71c7270b9
making [GreaterThan,LessThan,Equals] HavingSpecs more robust by carefully using long vs float for comparison
2015-10-27 13:15:13 -05:00
4b92752deb
Historical and MiddleManager server announcements should not remove parents.
...
Removing parent paths causes watchers of the "announcements" path to get stuck
and stop seeing new updates.
2015-10-27 08:06:11 -07:00
4f746ddf63
Merge pull request #1864 from himanshug/hdfs_storage_hadoop_version
...
hdfs-storage refer to top level property for hadoop version instead of hardcoding to 2.3.0
2015-10-26 23:25:53 -07:00
c0eb485880
Merge pull request #1867 from himanshug/hdfs_class_setup_test_fix
...
fixing hadoop test scope dependencies in indexing-hadoop
2015-10-26 23:21:45 -07:00
aeffeaf3e2
fixing hadoop test scope dependencies in indexing-hadoop
2015-10-26 17:09:39 -05:00
c523733c3f
Merge pull request #1859 from rasahner/baseOnCommunity
...
some changes for support of our integration tests
2015-10-26 14:19:26 -07:00
e9cfb7f46f
refer to top level property for hadoop version instead of hardcoding 2.3.0
2015-10-26 15:51:48 -05:00
ea4ed5692c
Merge pull request #1863 from guobingkun/add_loadqueue_full_doc
...
[doc] add description for /druid/coordinator/v1/loadqueue?full
2015-10-26 12:30:37 -07:00
44aad069da
add description for /druid/coordinator/v1/loadqueue?full
2015-10-26 14:19:13 -05:00
7e1cde25b6
Merge pull request #1820 from himanshug/doc_files
...
Removing the md files created for redirection
2015-10-26 09:37:11 -07:00
5a082b2f5e
Merge pull request #1824 from metamx/UniformGranularitySpecHashEquals
...
Add hashCode and equals to UniformGranularitySpec
2015-10-26 09:34:01 -07:00
5f23703216
Merge pull request #1638 from guobingkun/remove_maven_client_code
...
Remove Maven client at runtime + Provide a way to load Druid extensions through local file system
2015-10-26 09:30:05 -07:00
6c9ba72dea
some changes for support of our tests
2015-10-26 07:48:56 -05:00
f88d59b5c0
Merge pull request #1854 from b-slim/patch-2
...
Fix documentation about lookup
2015-10-23 16:49:08 -07:00
16f84161da
Fix documentation about lookup
2015-10-23 16:40:54 -07:00
2c3753ccca
Merge pull request #1815 from metamx/jar-upload-race
...
Fix Race in jar upload during hadoop indexing
2015-10-23 14:34:23 -05:00
72c408cf2d
Merge pull request #1770 from metamx/merge-time
...
Add segment merge time as a metric
2015-10-22 22:03:41 -07:00
853f95f64c
Merge pull request #1845 from metamx/moreVerboseRuleAuditLogging
...
Add more verbose logging to SQLMetadataRuleManager
2015-10-22 16:12:46 -05:00
6a7f8fa054
Merge pull request #1846 from metamx/notifyWhenSegmentPollStarts
...
Add debug logging to start of segment manager polling
2015-10-22 13:52:26 -05:00
3641a0e553
Fix Race in jar upload during hadoop indexing - https://github.com/druid-io/druid/issues/582
...
few fixes
delete intermediate file early
better exception handling
use static pattern instead of compiling it every time
Add retry for transient exceptions
remove usage of deprecated method.
Add test
fix imports
fix javadoc
review comment.
review comment: handle crazy snapshot naming
review comments
remove default retry count in favour of already present constant
review comment
make random intermediate and final paths.
review comment, use temporaryFolder where possible
2015-10-22 21:41:07 +05:30
7cecc55045
Add segment merge time as a metric
...
Add merge and persist cpu time
Fix typo
review comment
move cpu time measuring to VMUtils
review comments.
2015-10-22 12:28:03 +05:30
58a4d39b8f
Merge pull request #1843 from gianm/config-doc-fix
...
"druid.manager.segment" should be "druid.manager.segments"
2015-10-21 16:20:55 -07:00
6ceab03fc4
Add debug logging to start of segment manager polling
2015-10-21 16:17:49 -07:00
1cad571354
Add more verbose logging to SQLMetadataRuleManager
2015-10-21 16:11:40 -07:00
d068ec3b9d
"druid.manager.segment" should be "druid.manager.segments"
2015-10-21 15:50:44 -07:00
4914925d65
New extension loading mechanism
...
1) Remove maven client from downloading extensions at runtime.
2) Provide a way to load Druid extensions and hadoop dependencies through file system.
3) Refactor pull-deps so that it can download extensions into extension directories.
4) Add documents on how to use this new extension loading mechanism.
5) Change the way how Druid tarball is generated. Now all the extensions + hadoop-client 2.3.0
are packaged within the Druid tarball.
2015-10-21 14:22:36 -05:00
b7c68ec449
Merge pull request #1842 from metamx/DRUID-1841
...
Do not pass `druid.indexer.runner.javaOpts` to Peon as a property
2015-10-21 13:15:36 -05:00
8dd30e6e18
Merge pull request #1832 from guobingkun/improve_granularity_doc
...
add examples for duration and period granularities
2015-10-21 13:13:24 -05:00
2de5e9cefb
add examples for duration and period granularities
2015-10-21 11:23:00 -05:00
e4ac78e43d
bump next snapshot to 0.9.0
2015-10-20 13:46:13 -07:00
0292db648d
Merge pull request #1833 from metamx/improve-log
...
Improve alert message in CachingClusteredClient - Add Datasource info.
2015-10-20 15:40:57 -05:00
532e1c9fd5
Do not pass `druid.indexer.runner.javaOpts` to Peon as a property
...
* Still places `druid.indexer.runner.javaOpts` on the command line, but the Peon no longer tries to have the property `druid.indexer.runner.javaOpts` set
* Fixes https://github.com/druid-io/druid/issues/1841
2015-10-20 09:24:01 -07:00
092b5b19d2
Merge pull request #1838 from druid-io/update-paper-again
...
more edits to radstack paper
2015-10-18 19:53:31 -07:00
c40dd73a59
more edits to radstack paper
2015-10-18 19:52:44 -07:00
170cce69d4
Merge pull request #1834 from guobingkun/fix_doc
...
fix ingestion faq link
2015-10-18 17:31:22 -07:00
ccd17f818a
Merge pull request #1837 from druid-io/update-paper
...
add more details to radstack paper
2015-10-18 17:31:08 -07:00
89785b2f52
add more details to paper
2015-10-18 17:30:24 -07:00
620e334d0f
fix ingestion faq link
2015-10-16 10:14:14 -05:00
bf214f23b2
Improve message for alert - Add Datasource info.
2015-10-16 19:43:21 +05:30
46ecdfa757
add comment explaining logic
2015-10-15 16:04:06 -06:00
28d7233b3e
Merge pull request #1786 from rasahner/testEnhancements
...
enhance test support and update realtime test to use serverTime
2015-10-15 14:32:23 -07:00
Gian Merlino
Xavier Léauté
Fangjin Yang
Charles Allen
Himanshu Gupta
Bingkun Guo
sahner
Slim
Nishant
Xavier Léauté
dclim