Commit Graph

5534 Commits

Author SHA1 Message Date
Fangjin Yang 44d63e4f7e Merge pull request #1528 from solimant/master
fix #1525 - typo: "HadoopBatchIndexer"
2015-07-14 21:07:19 -07:00
Tim 3b692fb6f7 fix #1525 - typo: "HadoopBatchIndexer" 2015-07-14 20:48:24 -07:00
Fangjin Yang ab705504ef Merge pull request #1527 from metamx/integrationTestDocChange
Minor change to integration-tests README formatting
2015-07-14 17:03:11 -07:00
Charles Allen 80a18243dd Minor change to integration-tests README formatting 2015-07-14 17:01:06 -07:00
Fangjin Yang 62ce73ce59 Merge pull request #1522 from gianm/dependency-docs
Clearer language around external dependencies in tutorials.
2015-07-14 14:08:03 -07:00
Gian Merlino 183f51fe58 Clearer language around external dependencies in tutorials. 2015-07-14 10:50:45 -07:00
Fangjin Yang 798c3320d0 Merge pull request #1475 from himanshug/derby_in_examples
for example/tutorial, use derby instead of mysql
2015-07-14 10:18:21 -07:00
Fangjin Yang da8e86146e Merge pull request #1505 from metamx/improve-test
Modify test to check for multiple shards for same interval
2015-07-14 08:50:47 -07:00
Fangjin Yang 3f7ba58227 Merge pull request #1504 from metamx/fix-1447
fix for #1447
2015-07-14 08:50:08 -07:00
Fangjin Yang 14a07077a2 Merge pull request #1519 from solimant/master
add section: "What to Do When You Have a Firewall"
2015-07-13 23:20:59 -07:00
solimant 91c15a90a9 add section: "What to Do When You Have a Firewall" 2015-07-13 22:12:16 -07:00
Himanshu e2ddfb7a1a Merge pull request #1511 from pjain1/remove_test
remove flaky overlord test
2015-07-13 18:38:34 -05:00
Himanshu 1affdf7bec Merge pull request #1502 from samjhecht/poll-alerting
add alert on errors polling for rules
2015-07-13 18:37:37 -05:00
Parag Jain 59dec89f6a remove flaky overlord test 2015-07-13 15:32:12 -05:00
samjhecht fc438e5a72 add alert on errors polling for rules
reset retrystarttime after alerting
2015-07-13 09:03:51 -07:00
Himanshu 725086cc89 Merge pull request #1506 from gianm/realtime-plumber-nulls
Consider null inputRows and parse errors as unparseable during realtime ingestion.
2015-07-13 10:12:12 -05:00
Gian Merlino 9068bcd062 Consider null inputRows and parse errors as unparseable during realtime ingestion.
Also, harmonize exception handling between the RealtimeIndexTask and the RealtimeManager.
Conditions other than null inputRows and parse errors bubble up in both.
2015-07-11 20:40:03 -07:00
Himanshu cac722968e Merge pull request #1503 from metamx/fix-leaking-zk-nodes
Fix leaking Status Path nodes in ZK
2015-07-10 17:40:18 -05:00
Fangjin Yang 9f19e96658 Merge pull request #1477 from pjain1/overlord_test
overlord and task master test
2015-07-10 14:27:14 -07:00
Parag Jain 55c4fe64f3 overlord and task master test 2015-07-10 16:17:45 -05:00
Himanshu e9b627bf55 Merge pull request #1476 from pjain1/improved_tests
all the review comments have been taken care of, so merging.
2015-07-09 16:25:30 -05:00
Nishant 1766341648 Modify test to check for multiple shards for same interval
Modify test to check for multiple shards for same interval.
2015-07-09 20:35:31 +05:30
Parag Jain 58cc3954ff improved coordinator and datasourceresource tests 2015-07-09 09:46:54 -05:00
Nishant 5fe27fe4ad fix for #1447
fixes #1447
2015-07-09 19:05:48 +05:30
Nishant 8d7a566bae Fix leaking Status Path nodes in ZK
- remove  ZK status path nodes for workers after they are removed
2015-07-09 17:20:09 +05:30
Xavier Léauté b3d360f990 Merge pull request #1499 from metamx/fix-groupby-caching
fix groupBy caching to work with renamed aggregators
2015-07-08 23:52:11 -07:00
Nishant 184b12bee8 fix groupBy caching to work with renamed aggregators
Issue - while storing results in cache we store the event map which
contains aggregator names mapped to values. Now when someone fire same
query after renaming aggs, the cache key will be same but the event
will contain metric values mapped to older names which leads to wrong
results.
Fix - modify cache to not store raw event but the actual list of values
only.

review comments + fix dimension renaming

review comment
2015-07-09 11:48:26 +05:30
Xavier Léauté 31d05e33a1 Merge pull request #1500 from metamx/fix-1466
emit alert on errors when polling segments
2015-07-07 14:50:29 -07:00
Gian Merlino 448d245a44 Merge pull request #1497 from druid-io/rework-realtime-eg
rework the realtime examples a bit; add more faq
2015-07-07 14:09:33 -07:00
fjy 08d00cc80f rework the realtime examples a bit; add more faq 2015-07-07 14:07:14 -07:00
Fangjin Yang 1a3163ad7f Merge pull request #1501 from himanshug/fix_doc_link
make concepts link in toc more robust
2015-07-07 13:47:26 -07:00
Himanshu Gupta db00533bc8 make concepts link in toc more robust 2015-07-07 14:53:22 -05:00
Charles Allen b2bc46be17 Merge pull request #1484 from tubemogul/feature/1463
JobHelper.ensurePaths will set job properties from config (tuningConf…
2015-07-07 10:58:16 -07:00
Xavier Léauté 3e960dcc01 Merge pull request #1496 from druid-io/more-docs
Add more docs based on proposed wishlist
2015-07-07 10:03:02 -07:00
Nishant fe36f7f852 emit alert for DB polling error 2015-07-07 19:51:36 +05:30
Charles Allen 66d105940d Merge pull request #1465 from gianm/hadoop-indexer-config-hdfs
read hadoop-indexer configuration file from HDFS
2015-07-06 11:25:13 -07:00
Fangjin Yang d846f3ced6 Merge pull request #1498 from rasahner/doc_localFirehose
say explicitly that local firehose searches dirs recursively for files
2015-07-05 15:34:36 -07:00
sahner acd20e8c00 say explicitly that local firehose searches directories recursively for files 2015-07-05 14:46:44 -05:00
fjy 42ac41d55e add more docs based on proposed wishlist 2015-07-02 17:46:08 -07:00
Nishant e7f2cb3190 Merge pull request #1494 from krismolendyke/patch-1
Make postAggregations example a list type.
2015-07-03 01:28:40 +05:30
Kris Molendyke 5b5e3caba9 Make postAggregations example a list type. 2015-07-02 14:37:23 -04:00
Fangjin Yang 3ce32f97ec Merge pull request #1493 from metamx/cleanupTestFiles
I'm not your mom, indexing-service/test... cleanup after yourself
2015-07-02 10:03:12 -07:00
Xavier Léauté b9eebfd73b Merge pull request #1488 from metamx/testingFriendlylog4j2XML
Add optional log4j2 for debugging
2015-07-01 15:39:06 -07:00
Charles Allen c0b60c0d2f I'm not your mom, indexing-service/test... cleanup after yourself 2015-07-01 15:00:09 -07:00
Charles Allen fdbc1adb0a Merge pull request #1491 from metamx/remove-unused
ModuleList is already part of Initialization
2015-07-01 13:50:51 -07:00
Michael Schiff 6ad451a44a JobHelper.ensurePaths will set job properties from config (tuningConfig.jobProperties) before adding input paths to the config.
Adding input paths will create Path and FileSystem instances which may depend on the values in the job config.
This allows all properties to be set from the spec file, avoiding having to directly edit cluster xml files.

IndexGeneratorJob.run adds job properties before adding input paths (adding input paths may depend on having job properies set)

JobHelperTest confirms that JobHelper.ensurePaths adds job properties

javadoc for addInputPaths to explain relationship with
addJobProperties
2015-07-01 12:45:32 -07:00
Xavier Léauté 9789417612 ModuleList is already part of Initialization 2015-07-01 11:37:40 -07:00
Xavier Léauté 2c463ae435 Merge pull request #1489 from metamx/moveTestPackages
Move some test packages
2015-07-01 11:18:09 -07:00
Fangjin Yang eec972afa3 Merge pull request #1490 from metamx/smallCommentInDimExtrTopN
Add coments to DimExtractionTopNAlgorithm
2015-07-01 10:47:49 -07:00
Charles Allen 5e19a615f1 Add coments to DimExtractionTopNAlgorithm 2015-07-01 10:32:45 -07:00