Commit Graph

5671 Commits

Author SHA1 Message Date
Gian Merlino 9068bcd062 Consider null inputRows and parse errors as unparseable during realtime ingestion.
Also, harmonize exception handling between the RealtimeIndexTask and the RealtimeManager.
Conditions other than null inputRows and parse errors bubble up in both.
2015-07-11 20:40:03 -07:00
Himanshu cac722968e Merge pull request #1503 from metamx/fix-leaking-zk-nodes
Fix leaking Status Path nodes in ZK
2015-07-10 17:40:18 -05:00
Fangjin Yang 9f19e96658 Merge pull request #1477 from pjain1/overlord_test
overlord and task master test
2015-07-10 14:27:14 -07:00
Parag Jain 55c4fe64f3 overlord and task master test 2015-07-10 16:17:45 -05:00
Himanshu e9b627bf55 Merge pull request #1476 from pjain1/improved_tests
all the review comments have been taken care of, so merging.
2015-07-09 16:25:30 -05:00
Nishant 1766341648 Modify test to check for multiple shards for same interval
Modify test to check for multiple shards for same interval.
2015-07-09 20:35:31 +05:30
Parag Jain 58cc3954ff improved coordinator and datasourceresource tests 2015-07-09 09:46:54 -05:00
Nishant 5fe27fe4ad fix for #1447
fixes #1447
2015-07-09 19:05:48 +05:30
Nishant 8d7a566bae Fix leaking Status Path nodes in ZK
- remove  ZK status path nodes for workers after they are removed
2015-07-09 17:20:09 +05:30
Xavier Léauté b3d360f990 Merge pull request #1499 from metamx/fix-groupby-caching
fix groupBy caching to work with renamed aggregators
2015-07-08 23:52:11 -07:00
Nishant 184b12bee8 fix groupBy caching to work with renamed aggregators
Issue - while storing results in cache we store the event map which
contains aggregator names mapped to values. Now when someone fire same
query after renaming aggs, the cache key will be same but the event
will contain metric values mapped to older names which leads to wrong
results.
Fix - modify cache to not store raw event but the actual list of values
only.

review comments + fix dimension renaming

review comment
2015-07-09 11:48:26 +05:30
Xavier Léauté 31d05e33a1 Merge pull request #1500 from metamx/fix-1466
emit alert on errors when polling segments
2015-07-07 14:50:29 -07:00
Gian Merlino 448d245a44 Merge pull request #1497 from druid-io/rework-realtime-eg
rework the realtime examples a bit; add more faq
2015-07-07 14:09:33 -07:00
fjy 08d00cc80f rework the realtime examples a bit; add more faq 2015-07-07 14:07:14 -07:00
Fangjin Yang 1a3163ad7f Merge pull request #1501 from himanshug/fix_doc_link
make concepts link in toc more robust
2015-07-07 13:47:26 -07:00
Himanshu Gupta db00533bc8 make concepts link in toc more robust 2015-07-07 14:53:22 -05:00
Charles Allen b2bc46be17 Merge pull request #1484 from tubemogul/feature/1463
JobHelper.ensurePaths will set job properties from config (tuningConf…
2015-07-07 10:58:16 -07:00
Xavier Léauté 3e960dcc01 Merge pull request #1496 from druid-io/more-docs
Add more docs based on proposed wishlist
2015-07-07 10:03:02 -07:00
Nishant fe36f7f852 emit alert for DB polling error 2015-07-07 19:51:36 +05:30
Charles Allen 66d105940d Merge pull request #1465 from gianm/hadoop-indexer-config-hdfs
read hadoop-indexer configuration file from HDFS
2015-07-06 11:25:13 -07:00
Fangjin Yang d846f3ced6 Merge pull request #1498 from rasahner/doc_localFirehose
say explicitly that local firehose searches dirs recursively for files
2015-07-05 15:34:36 -07:00
sahner acd20e8c00 say explicitly that local firehose searches directories recursively for files 2015-07-05 14:46:44 -05:00
fjy 42ac41d55e add more docs based on proposed wishlist 2015-07-02 17:46:08 -07:00
Nishant e7f2cb3190 Merge pull request #1494 from krismolendyke/patch-1
Make postAggregations example a list type.
2015-07-03 01:28:40 +05:30
Kris Molendyke 5b5e3caba9 Make postAggregations example a list type. 2015-07-02 14:37:23 -04:00
Fangjin Yang 3ce32f97ec Merge pull request #1493 from metamx/cleanupTestFiles
I'm not your mom, indexing-service/test... cleanup after yourself
2015-07-02 10:03:12 -07:00
Xavier Léauté b9eebfd73b Merge pull request #1488 from metamx/testingFriendlylog4j2XML
Add optional log4j2 for debugging
2015-07-01 15:39:06 -07:00
Charles Allen c0b60c0d2f I'm not your mom, indexing-service/test... cleanup after yourself 2015-07-01 15:00:09 -07:00
Charles Allen fdbc1adb0a Merge pull request #1491 from metamx/remove-unused
ModuleList is already part of Initialization
2015-07-01 13:50:51 -07:00
Michael Schiff 6ad451a44a JobHelper.ensurePaths will set job properties from config (tuningConfig.jobProperties) before adding input paths to the config.
Adding input paths will create Path and FileSystem instances which may depend on the values in the job config.
This allows all properties to be set from the spec file, avoiding having to directly edit cluster xml files.

IndexGeneratorJob.run adds job properties before adding input paths (adding input paths may depend on having job properies set)

JobHelperTest confirms that JobHelper.ensurePaths adds job properties

javadoc for addInputPaths to explain relationship with
addJobProperties
2015-07-01 12:45:32 -07:00
Xavier Léauté 9789417612 ModuleList is already part of Initialization 2015-07-01 11:37:40 -07:00
Xavier Léauté 2c463ae435 Merge pull request #1489 from metamx/moveTestPackages
Move some test packages
2015-07-01 11:18:09 -07:00
Fangjin Yang eec972afa3 Merge pull request #1490 from metamx/smallCommentInDimExtrTopN
Add coments to DimExtractionTopNAlgorithm
2015-07-01 10:47:49 -07:00
Charles Allen 5e19a615f1 Add coments to DimExtractionTopNAlgorithm 2015-07-01 10:32:45 -07:00
Charles Allen 7a2a8a3d6e Move extraction tests to more reasonable package 2015-07-01 10:30:50 -07:00
Charles Allen a37d631cea Add log4j2 for debugging which can be specified with `-Dlog4j.configurationFile=/some/path/druid/common/src/main/resources/log4j2.debug.xml` during testing and development 2015-07-01 10:29:22 -07:00
Charles Allen f2919b98b1 Merge pull request #1471 from metamx/direct-client-metrics
add query/node/time metrics to DirectDruidClient
2015-06-30 22:06:44 -07:00
Himanshu Gupta 473bc101d7 for example/tutorial, use derby instead of mysql 2015-06-30 20:47:32 -05:00
Fangjin Yang b4eec5b47d Merge pull request #1483 from himanshug/fix_doc_links
fix toc links per the shortened names from commit d2346b6834
2015-06-30 12:18:40 -07:00
Himanshu Gupta 12f5d1743e fix toc links per the shortened names from commit d2346b6834 2015-06-30 14:16:40 -05:00
Bingkun Guo 282a0f9760 Unit tests for KillTask and MetadataTaskStorage 2015-06-29 17:55:41 -05:00
Himanshu b5b9ca1446 Merge pull request #1470 from pjain1/rtindex_test
Realtime Index Task test
2015-06-29 16:51:35 -05:00
fjy 8c551ed889 very minor fix to the TOC 2015-06-29 10:49:45 -07:00
fjy e42d5ac785 Merge branch 'master' of https://github.com/druid-io/druid 2015-06-29 10:49:30 -07:00
Fangjin Yang 2f522f8c8d Merge pull request #1479 from himanshug/fix_doc_imgs
fixing the links to doc images
2015-06-29 10:23:06 -07:00
Himanshu Gupta 4114b4902e fixing the links to doc images 2015-06-29 12:17:42 -05:00
Bingkun Guo 4a0ae7d8d5 Fix inconsistent druid property names for "druid.metadata.storage.tables.xxx" between document and code 2015-06-29 10:12:30 -05:00
Himanshu 8172bdff1c Merge pull request #1468 from guobingkun/fix_npe_for_storage_action_handler
Fix npe thrown from SQLMetadataStorageActionHandler
2015-06-29 09:57:51 -05:00
Parag Jain 284b80b09e Realtime Index Task test 2015-06-29 09:52:41 -05:00
Xavier Léauté 2da12de598 add back query/node/(time|ttfb) docs 2015-06-26 17:58:47 -07:00