Commit Graph

5120 Commits

Author SHA1 Message Date
Dia Kharrat 3a6dc99384 log invalid rows in mapper of Hadoop indexer 2015-03-19 22:31:04 -07:00
Dia Kharrat 58d5f5e7f0 Honor ignoreInvalidRows in Hadoop indexer
The reducer of the hadoop indexer now ignores lines with parsing
exceptions (if enabled by the indexer config).
2015-03-19 22:31:04 -07:00
Fangjin Yang 46eae49bf5 Merge pull request #1229 from himanshug/remove_map_writable_parser
Removing MapWritableInputRowParser from indexing-hadoop
2015-03-19 17:40:59 -07:00
Himanshu Gupta 8c1f0834ba Removing MapWritableInputRowParser from indexing-hadoop it should really be an extension if user needs 2015-03-19 18:37:08 -05:00
Xavier Léauté a98187f798 Merge pull request #1177 from himanshug/custom_input_format1
Feature:  Make hadoop input format configurable for batch ingestion
2015-03-19 15:49:36 -07:00
fjy b389cfe404 [maven-release-plugin] prepare for next development iteration 2015-03-19 12:38:17 -07:00
fjy 60e7d543cc [maven-release-plugin] prepare release druid-0.7.1-rc1 2015-03-19 12:38:13 -07:00
fjy 6a47c1530c update versions to prepare for rc release 2015-03-19 11:39:38 -07:00
fjy db06bda5e0 fix ingestion docs 2015-03-18 17:23:22 -07:00
fjy 3e664a4c32 fix plumber docs 2015-03-18 15:56:27 -07:00
fjy 70f009e517 Merge branch 'master' of https://github.com/druid-io/druid 2015-03-18 15:54:31 -07:00
fjy 8de3eab832 fix doc formatting 2015-03-18 15:53:00 -07:00
Himanshu Gupta 3f7a7ba5d3 For batch hadoop indexing, make hadoop input format configuration. Given input format must extend from org.apache.hadoop.mapreduce.InputFormat 2015-03-18 16:09:45 -05:00
Fangjin Yang 4467d1c9cc Merge pull request #1225 from b-slim/fix_http_client
Using new release of the http-client.
2015-03-18 08:31:01 -07:00
Slim Bouguerra 03547b4088 Using new release of the http-client.
This new version 1.0.1 it has a bug fix that was  causing can not add a handler exceptions.
Bug description can be found [here](https://github.com/metamx/http-client/pull/16)
2015-03-18 09:33:45 -05:00
Fangjin Yang 6bcdf7f60f Merge pull request #1223 from metamx/AnnounceIdUUID
Add consistency to UUIDUtils handling
2015-03-17 16:09:58 -07:00
Charles Allen 868100c79c Add consistency to UUIDUtils handling
* Use "_" instead of "-"
2015-03-17 16:05:46 -07:00
Fangjin Yang 65e05071b6 Merge pull request #1205 from druid-io/update-jets3t
Update jets3t version to support aws v4 auth
2015-03-17 15:39:17 -07:00
Fangjin Yang 8d0dfd9af1 Merge pull request #1221 from metamx/AnnounceIdUUID
Change announcement ID to a UUID instead of Timestamp
2015-03-17 15:38:53 -07:00
Fangjin Yang b0e33ac879 Merge pull request #1206 from metamx/group-by-NPE-fix
fix race in groupByParallelQueryRunner
2015-03-17 15:35:48 -07:00
Charles Allen 79b1443cc3 Change announcement ID to a UUID instead of Timestamp
* Also add a UUIDUtils to the common package
2015-03-17 15:34:04 -07:00
Xavier Léauté 9d6b728054 Merge pull request #1215 from metamx/log-audit-IP-Address
Add remote ip address in audit log.
2015-03-17 13:59:31 -07:00
Xavier Léauté c847b3b861 Merge pull request #1218 from himanshug/task_storage_config_fix
add correct guice init of TaskStorageConfig to CliPeon
2015-03-17 13:08:43 -07:00
Xavier Léauté f60f77d0f5 Merge pull request #1214 from druid-io/fix-arb-gran
This fixes arbitrary gran spec breaking for the benchmarking blog post and other places
2015-03-17 12:28:19 -07:00
fjy bfe10bd156 This fixes arbitrary gran spec breaking 2015-03-17 12:19:43 -07:00
Himanshu Gupta 4a8f5dfa0f add correct guice init of TaskStorageConfig to CliPeon 2015-03-17 14:03:54 -05:00
nishantmonu51 f9821d242f also log author ip address in audit log 2015-03-17 23:15:15 +05:30
nishantmonu51 39e60b3405 fix race in groupByParallelQueryRunner
add UT and use a queue for better concurrency
2015-03-17 20:57:05 +05:30
fjy 2c834b878e Update jets3t version to support aws v4 auth 2015-03-16 10:50:04 -07:00
fjy 36b4c6a371 fix set up with first tutorial 2015-03-13 13:54:45 -07:00
Fangjin Yang e7d8f8034e Merge pull request #1201 from metamx/make-task-id-more-unique
randomize task ID to fix spurious test failure
2015-03-13 11:36:55 -07:00
Xavier Léauté ddfafa0711 randomize task ID to fix spurious test failure 2015-03-12 18:08:48 -07:00
Fangjin Yang a508c0955f Merge pull request #1195 from himanshug/task_storage_config_fix
correctly parse recentlyFinishedThreshold from config
2015-03-12 16:50:49 -07:00
cheddar 526a386f50 Merge pull request #1193 from metamx/reduce-test-verbosity
move test output to file for cleaner build logs
2015-03-12 15:42:34 -07:00
Xavier Léauté 8c94fad5ee Merge pull request #1197 from metamx/fix-build-link
fix build badge link
2015-03-12 14:54:41 -07:00
Xavier Léauté 48c1757cc3 fix build badge link 2015-03-12 14:54:01 -07:00
Xavier Léauté 7fb4b1d2bb Merge pull request #1144 from metamx/javaLoggingManager
Add log4j2 hooks to other loggings
2015-03-12 14:38:51 -07:00
Charles Allen edfcea18d8 Add log4j2 hooks to standard java logging 2015-03-12 14:29:41 -07:00
Fangjin Yang 3892a94506 Merge pull request #1100 from metamx/audit-config-changes
Auditing Rules and Dynamic Configuration Changes
2015-03-12 12:57:54 -07:00
nishantmonu51 3ec4a30ab5 initial commit
review comments

more refactoring and cleaning of redundant code

add UT + docs + more refactoring

fixes + review comments

more cleanup

end points to fetch history

review comments

remove unnecessary changes

review comments rename header name

review comments + add test for MetadataRulesManager

review comments docs
2015-03-12 22:50:29 +05:30
Xavier Léauté 127b6fd857 Merge pull request #1172 from himanshug/segment_metadata_eager
force eager the processing of segment metadata query on the processing executor
2015-03-12 10:19:48 -07:00
Fangjin Yang 199b11ad0b Merge pull request #1196 from metamx/kafka-update
update to kafka 0.8.2.1, because it's better™
2015-03-12 10:19:29 -07:00
Xavier Léauté 11b3230602 update to kafka 0.8.2.1, because it's better™ 2015-03-12 09:59:24 -07:00
Himanshu Gupta 23545fc01c correctly parse recentlyFinishedThreshold from config 2015-03-12 09:46:57 -05:00
Fangjin Yang 43d263930d Merge pull request #1194 from metamx/add-coverage-badge
add coverage badge to readme
2015-03-11 20:40:54 -07:00
Xavier Léauté 963b701e87 add coverage badge 2015-03-11 20:35:56 -07:00
Xavier Léauté fc613771d2 move test output to file for cleaner build logs
- removes the need for special test log4j2.xml
2015-03-11 17:56:19 -07:00
Xavier Léauté 75e92fd4dc Merge pull request #1192 from metamx/fix-bad-rebase
fix file missing from previous PR rebase
2015-03-11 17:44:17 -07:00
Xavier Léauté 0a5a3fe2dc fix file missing from rebase 2015-03-11 17:30:11 -07:00
Fangjin Yang a1d38f8526 Merge pull request #1159 from metamx/time-extraction
Add time extraction functions to project time as a dimension
2015-03-11 16:50:02 -07:00