Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-02-13 13:34:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
8,201 Commits 116 Branches 508 Tags
Commit Graph

44 Commits

Author SHA1 Message Date
Darío
ce7bf3f325 Update batch-ingestion.md (#4963) 
I've had problems ingesting several S3 files with Druid. After checking I saw this: https://groups.google.com/forum/#!msg/druid-user/4L62vjor4NM/p8Z_R3lEAQAJ and realised that the docs hasn't been updated. This issue might have been solved with new Druid versions, but for those who are still using older ones (0.9.2), it's nice having this change made :)
 2017-10-18 16:44:09 -07:00
Roman Leventov
05d58689ad Remove the ability to create segments in v8 format (#4420) 
* Remove ability to create segments in v8 format

* Fix IndexGeneratorJobTest

* Fix parameterized test name in IndexMergerTest

* Remove extra legacy merging stuff

* Remove legacy serializer builders

* Remove ConciseBitmapIndexMergerTest and RoaringBitmapIndexMergerTest
 2017-06-26 13:21:39 -07:00
Gian Merlino
bcd20441be Make buildV9Directly the default. (#3688) 2016-11-14 09:29:32 -08:00
Akash Dwivedi
3a83e0513e Doc update(batch-ingestion) to include useExplicitVersion. (#3557) 2016-10-07 14:48:00 -07:00
Gian Merlino
27bd5cb13a Add forceExtendableShardSpecs option to Hadoop indexing, IndexTask. (#3473) 
Fixes #3241.
 2016-09-21 13:40:04 -06:00
Slim
ba6ddf307e Adding hadoop kerberos authentification. (#3419) 
* adding kerberos authentication

* make the 2 functions identical
 2016-09-13 10:42:50 -07:00
Dave Li
c4e8440c22 Adds long compression methods (#3148) 
* add read

* update deprecated guava calls

* add write and vsizeserde

* add benchmark

* separate encoding and compression

* add header and reformat

* update doc

* address PR comment

* fix buffer order

* generate benchmark files

* separate encoding strategy and format

* fix benchmark

* modify supplier write to channel

* add float NONE handling

* address PR comment

* address PR comment 2
 2016-08-30 16:17:46 -07:00
Gian Merlino
e5397ed316 Link up Hadoop class loading docs better. (#3302) 2016-07-29 10:19:54 -07:00
Gian Merlino
ea03906fcf Configurable compressRunOnSerialization for Roaring bitmaps. (#3228) 
Defaults to true, which is a change in behavior (this used to be false and unconfigurable).
 2016-07-08 10:24:19 +05:30
Fangjin Yang
abd951df1a Document how to use roaring bitmaps (#2824) 
* Document how to use roaring bitmaps

This fixes #2408.
While not all indexSpec properties are explained, it does explain how roaring bitmaps can be turned on.

* fix

* fix

* fix

* fix
 2016-04-12 19:28:02 -07:00
Sébastien Launay
37d2ab623e Merge pull request #2815 from slaunay/documentation/hadoop-classpath-issue-fix-with-configuration 
Doc for mapreduce.job.user.classpath.first=true
 2016-04-12 10:51:51 -07:00
Himanshu Gupta
004b00bb96 config to explicitly specify classpath for hadoop container during hadoop ingestion 2016-03-25 10:51:28 -05:00
Gian Merlino
2dfd3877c0 Fix a bunch of broken links in the docs. 2016-03-23 10:21:28 -07:00
binlijin
bce600f5d5 Single dimension hash-based partitioning 2016-03-22 13:15:33 +08:00
dclim
df29667a89 add combineText property and cleanup batch ingestion doc 2016-03-08 13:10:34 -07:00
Björn Zettergren
2462c82c0e New defaults for maxRowsInMemory rowFlushBoundary 
To bring consistency to docs and source this commit changes the default
values for maxRowsInMemory and rowFlushBoundary to 75000 after
discussion in PR https://github.com/druid-io/druid/pull/2457.

The previous default was 500000 and it's lower now on the grounds that
it's better for a default to be somewhat less efficient, and work,
than to reach for the stars and possibly result in
"OutOfMemoryError: java heap space" errors.
 2016-03-01 13:50:28 +01:00
Robin
1d57e3267d some minor doc changes 2016-02-09 08:20:53 -06:00
fjy
003f54e268 add doc rendering 2016-02-04 14:21:59 -08:00
fjy
1aa363cea7 new quickstart 2016-02-04 09:37:38 -08:00
Björn Zettergren
d373573c25 DOCs: Missing 'type' for leaveIntermediate 
Added missing 'Boolean' as type for leaveIntermediate row in table TuningConfig
 2016-01-29 14:42:19 +01:00
binlijin
cd1c71ceb4 rename persistBackgroundCount to numBackgroundPersistThreads 2016-01-22 14:29:41 +08:00
Charles Allen
2a69a58570 Merge pull request #2149 from binlijin/master 
Do persist IncrementalIndex in another thread in IndexGeneratorReducer
 2016-01-20 17:06:42 -08:00
Logan Linn
c3bdaefe1f Update batch-ingestion.md 
Fix documented type of the `dataGranularity` config
 2016-01-19 17:20:47 -08:00
binlijin
8e43e2c446 Do persist IncrementalIndex in another thread in IndexGeneratorReducer 2016-01-20 09:20:09 +08:00
Kurt Young
82ff98c2bf add config for build v9 directly and update docs 2016-01-16 11:26:34 +08:00
Zhao Weinan
5e57ddb8cc Adding avro support to realtime & hadoop batch indexing. 2016-01-05 10:21:27 +08:00
fjy
88f6b9b5ad Multiple improvements for docs 2016-01-02 21:54:54 -08:00
Himanshu Gupta
48de9dfafa doc update to make it easy to find how to do re-indexing or delta ingestion 2015-12-30 23:58:09 -06:00
Himanshu Gupta
efe3c9f4a5 update the examples for batch reindexing/delta ingestion to use "intervals" instead of deprecated "interval" 2015-12-06 00:22:20 -06:00
Himanshu Gupta
61aaa09012 support multiple intervals in dataSource input spec 2015-12-03 21:28:04 -06:00
fjy
8f231fd3e3 cleanup druid codebase 2015-11-04 13:59:53 -08:00
Bingkun Guo
4914925d65 New extension loading mechanism 
1) Remove maven client from downloading extensions at runtime.
2) Provide a way to load Druid extensions and hadoop dependencies through file system.
3) Refactor pull-deps so that it can download extensions into extension directories.
4) Add documents on how to use this new extension loading mechanism.
5) Change the way how Druid tarball is generated. Now all the extensions + hadoop-client 2.3.0
are packaged within the Druid tarball.
 2015-10-21 14:22:36 -05:00
Gian Merlino
b29cbf97a6 Docs: Suggest hadoopyString parser for Hadoop. 2015-09-16 10:19:42 -07:00
Xavier Léauté
d89b0fa76a Merge pull request #1662 from qix/pathFormat-doc 
Add documentation for pathFormat in batch ingestion
 2015-08-31 11:14:54 -07:00
Josh Yudaken
29c29b42d3 Add default value and link to joda docs 2015-08-31 11:09:54 -07:00
Bingkun
ae1f104c10 Fix batch ingestion doc 2015-08-26 15:16:21 -05:00
Josh Yudaken
5e42aee49e Add documentation for pathFormat in batch ingestion 2015-08-24 14:39:57 -07:00
Himanshu Gupta
cfd81bfac7 updating the docs on how to do hadoop batch re-ingesion and delta ingestion 2015-08-16 14:07:35 -05:00
Himanshu Gupta
7ee509bcd0 fix mysql references in tutorial docs 2015-07-30 22:05:05 -05:00
Himanshu Gupta
119ec13d23 updating hadoop tuningConfig doc with useCombiner flag 2015-07-22 13:55:00 -05:00
Tim
3b692fb6f7 fix #1525 - typo: "HadoopBatchIndexer" 2015-07-14 20:48:24 -07:00
Himanshu Gupta
be4ecc4b91 in batch ingestion metadataUpdateSpec->type is derby, mysql etc and not metadata 2015-05-29 22:16:18 -05:00
Xavier Léauté
d2346b6834 shorten links and file names 
* remove redundant parts in file names
* delete unsupported "Druid-Personal-Demo-Cluster"
 2015-05-29 20:55:42 -05:00
Himanshu Gupta
8edc2aaca3 renaming all *.md filenames to only have lowercase and dashes 
so that they are editable on case-insensitive os as well
 2015-05-29 20:55:42 -05:00