druid

Commit Graph

Author	SHA1	Message	Date
Xavier Léauté	c4402cc84d	path should already be a proper uri works around issues when config cannot properly initialize early in the indexing process	2014-03-27 14:54:14 -07:00
fjy	21235ae533	fix configuration conversion bugs and docs and hdfs configs	2013-10-29 17:34:24 -04:00
cheddar	c47fe202c7	Fix HadoopDruidIndexer to work with the new way of things There are multiple and sundry changes in here. First, "HadoopDruidIndexer" has been split into two pieces, (1) CliHadoop which pulls the hadoop version and builds up the right classpath with the proper hadoop version to run the indexer and (2) CliInternalHadoopIndexer which actually runs the indexer. In order to work around a bunch of jets3t version conflicts with Hadoop and Druid, I needed to extract the S3 deep storage stuff into its own module. I then also moved the HDFS stuff into its own module so that I could eliminate the dependency on Hadoop for druid-server. In doing these changes, I wanted to make the extensions buildable with only the druid-api jar, so a few other things had to move out of Druid and into druid-api. They are all API-level things, however, so they really belong in druid-api instead. Lastly, I removed the druid-realtime module and put it all in druid-server.	2013-10-09 15:15:44 -05:00

Author

SHA1

Message

Date

Xavier Léauté

c4402cc84d

path should already be a proper uri

works around issues when config cannot properly initialize early
in the indexing process

2014-03-27 14:54:14 -07:00

fjy

21235ae533

fix configuration conversion bugs and docs and hdfs configs

2013-10-29 17:34:24 -04:00

cheddar

c47fe202c7

Fix HadoopDruidIndexer to work with the new way of things

There are multiple and sundry changes in here.

First, "HadoopDruidIndexer" has been split into two pieces, (1) CliHadoop which pulls the hadoop version and builds up the right classpath with the proper hadoop version to run the indexer and (2) CliInternalHadoopIndexer which actually runs the indexer.

In order to work around a bunch of jets3t version conflicts with Hadoop and Druid, I needed to extract the S3 deep storage stuff into its own module.  I then also moved the HDFS stuff into its own module so that I could eliminate the dependency on Hadoop for druid-server.

In doing these changes, I wanted to make the extensions buildable with only the druid-api jar, so a few other things had to move out of Druid and into druid-api.  They are all API-level things, however, so they really belong in druid-api instead.

Lastly, I removed the druid-realtime module and put it all in druid-server.

2013-10-09 15:15:44 -05:00

3 Commits