Commit Graph

5854 Commits

Author SHA1 Message Date
Xavier Léauté c4d0e8d29b remove unnecessary pom verbiage 2015-08-25 16:07:03 -07:00
Xavier Léauté d5143c0807 update java-util to 0.27.2 2015-08-25 16:07:02 -07:00
Xavier Léauté 21aadb8927 update joda to 2.8.2 2015-08-25 16:07:02 -07:00
Xavier Léauté dc11f907c9 update jdbi to 2.63.1 2015-08-25 16:07:02 -07:00
Xavier Léauté 123f6340d5 update coveralls plugin to 3.2.0 2015-08-25 16:07:02 -07:00
Xavier Léauté 3a83a0fe40 update irc library to 1.0-0014 2015-08-25 16:07:02 -07:00
Xavier Léauté 2fa87c4bba update joda-time to 2.8 2015-08-25 16:07:02 -07:00
Xavier Léauté f681b2022d update aws-sdk to 1.10.12 2015-08-25 16:07:01 -07:00
Xavier Léauté 8be5fe091f update slf4j to 1.7.12 2015-08-25 16:07:01 -07:00
Xavier Léauté 172a44b794 update log4j to 2.3 2015-08-25 16:07:01 -07:00
Xavier Léauté 51f6a9a2c9 update jackson to 2.6.1 2015-08-25 16:07:01 -07:00
Xavier Léauté ac4a856a17 update jetty to 9.2.13.v20150730 (latest Java 7 compatible version) 2015-08-25 16:07:01 -07:00
Xavier Léauté 8b294d4d98 update mapdb to 1.0.8 2015-08-25 16:07:00 -07:00
Xavier Léauté edaaf528ab update jets3t to 0.9.4 2015-08-25 16:07:00 -07:00
Xavier Léauté 9a0c15c52c update airline to 0.7 2015-08-25 16:07:00 -07:00
Xavier Léauté d601038271 update druid-api to 0.3.11 2015-08-25 16:07:00 -07:00
Gian Merlino 33681525e3 TaskActionToolbox: Remove allowOlderVersions switch, lift interval constraint.
allowOlderVersions has been stuck true for a while due to a bug (introduced in
566a3a61), but I think it's actually OK this way. I think it's reasonable to
expect tasks to choose versions in some way that makes sense, so long as they
don't choose one larger than their taskLock version. This is still verified.

The interval constraint was introduced to force tasks to break up their
segment insert lists into manageable chunks. They are already doing this, and
I think it's reasonable to expect them to do so without enforcement.

Lifting these constraints paves the way for transactional insertion of segments
that have varying versions and may be for varying intervals.
2015-08-25 14:17:38 -07:00
Fangjin Yang e21954a70f Merge pull request #1619 from metamx/update-server-metrics
update server metrics
2015-08-25 13:58:28 -07:00
Xavier Léauté c325b194c0 Merge pull request #1661 from pjain1/poll_rules
Poll rules immediately after change
2015-08-25 13:46:55 -07:00
Charles Allen 85aeda834c Code cleanup for CachingClusteredClientTest 2015-08-25 12:49:55 -07:00
Fangjin Yang 2c8b3901be Merge pull request #1665 from gianm/consolidate-sql-retrying
Consolidate SQL retrying by moving logic into the connectors.
2015-08-25 12:43:48 -07:00
Gian Merlino 2bf9a70bfa Consolidate SQL retrying by moving logic into the connectors.
Also change boolean removeLock to void addLock in MetadataStorageActionHandler.
2015-08-25 12:42:29 -07:00
Xavier Léauté de8f806cc1 Merge pull request #1654 from gianm/index-add-taskResource
Add ability to provide taskResource for IndexTask.
2015-08-25 10:25:35 -07:00
Fangjin Yang 2122cd09b1 Merge pull request #1664 from rasahner/docTimedFirehose
add documentation about TimedShutoff firehose
2015-08-24 19:19:08 -07:00
sahner 3def847e28 add documentation about TimedShutoff firehose 2015-08-24 20:41:42 -05:00
Paul Otto 2301b60365 Add ability to provide taskResource for IndexTask. 2015-08-24 17:38:31 -07:00
Josh Yudaken 5e42aee49e Add documentation for pathFormat in batch ingestion 2015-08-24 14:39:57 -07:00
Parag Jain 073c32f01b Poll rules immediately after change 2015-08-24 16:08:25 -05:00
Gian Merlino 3331987b10 Merge pull request #1648 from himanshug/fix_comma_multiple_inputs
handle commas in the path before calling MultipleInputs.addInputPaths
2015-08-24 09:08:50 -07:00
Himanshu Gupta 5b5a76ef6c adding unit test for HdfsDataSegmentKiller.testKill(..) 2015-08-23 22:21:03 -05:00
Himanshu Gupta c2bebfe39e delete version, interval, dataSource directories on segment deletion if possible, so that they are not left behind and consume ns quota on HDFS 2015-08-23 22:06:12 -05:00
Fangjin Yang 0c11097b4f Merge pull request #1655 from druid-io/add-postgresql-docs
add postgresql setup docs
2015-08-21 13:37:53 -07:00
Xavier Léauté 5a48376788 add postgresql setup docs 2015-08-21 13:35:58 -07:00
Fangjin Yang 6ff6fd80e8 Merge pull request #1647 from himanshug/approx_histo_test
Approx histogram "integration" unit test
2015-08-21 11:19:12 -07:00
Fangjin Yang e3964cd9f6 Merge pull request #1653 from metamx/fix-success-flag
fix success flag emitted in router query metrics
2015-08-21 07:56:57 -07:00
Nishant 6d85a62ed2 fix success flag emitted in router query metrics 2015-08-21 12:25:57 +05:30
Himanshu 5bf4b81481 Merge pull request #1650 from druid-io/workaround-assembly-bug
remove maven metadata from embedded repo
2015-08-20 22:15:59 -05:00
Himanshu Gupta b3c570e78d update BatchDeltaIngestion.testDeltaIngestion(..) to check for proper glob path handling 2015-08-20 21:36:34 -05:00
Himanshu Gupta 85e3ce9096 split hadoop glob path before adding it to MultipleInputs
This can be safely reverted once https://issues.apache.org/jira/browse/MAPREDUCE-5061 is fixed
2015-08-20 21:36:34 -05:00
Himanshu Gupta a603bd9547 HadoopGlobPathSplitter implementation to split hadoop glob paths
This can be safely reverted once https://issues.apache.org/jira/browse/MAPREDUCE-5061 is fixed
2015-08-20 21:36:34 -05:00
Xavier Léauté 0eed015142 remove maven metadata from embedded repo
workaround for maven assembly bug
https://issues.apache.org/jira/browse/MASSEMBLY-677
2015-08-20 15:36:42 -07:00
Nishant e6b20db62d Support for JSON Smile format for EventReceiverFirehoseFactory
Support for Smile format for EventReceiverFireshoseFactory.
would help in decreasing network load on middle managers ingesting high
data volumes.

review comments
2015-08-20 19:52:45 +05:30
Himanshu Gupta 9b54124cd0 pseudo integration tests for approximate histogram 2015-08-20 01:27:20 -05:00
Himanshu Gupta c57c07f28a add ability for client code to provide InputStream of input data in addition to File
It would be needed when input data file does not reside in the same jar
but you could still use getResourceAsStream() to read the data inside a file
2015-08-20 00:54:58 -05:00
Fangjin Yang 1ecec1da5a Merge pull request #1645 from himanshug/approx_histo_doc_update
update approx-histogram document to explain how to ignore rows with no value
2015-08-19 13:44:16 -07:00
Himanshu Gupta 0daeb830b0 update approx-histogram document to explain how to ignore rows with no value at ingestion time 2015-08-19 15:20:37 -05:00
Gian Merlino 38b8ccab04 Merge pull request #1643 from himanshug/msg_update
helpful cause explaining why SegmentDescriptorInfo did not exist
2015-08-19 12:20:33 -07:00
Charles Allen 03f4c3e816 Merge pull request #1644 from druid-io/fix-tar-long-files
fix assembly tar with long filenames on some platforms
2015-08-19 12:11:57 -07:00
Xavier Léauté 21fa1ac6d6 fix assembly tar mode on some platforms 2015-08-19 10:13:16 -07:00
Himanshu Gupta cf3ec8eb46 helpful cause explaining why SegmentDescriptorInfo did not exist 2015-08-19 10:29:04 -05:00