druid

mirror of https://github.com/apache/druid.git synced 2025-02-10 12:05:00 +00:00

History

Deep Ganguli 017d4779d6 Implemented Hadoop Index Task which takes as input a HadoopDruidIndexConfig and

generates index segments.

The HadoopIndexTask run method wraps a HadoopDruidIndexerJob run method. The
key modifications to the HadoopDruidIndexerJob are as follows:

- The UpDaterJobSpec field of the config that is used to set up the indexer job
  is set to null. This ensures that the job does not push a list of published
segments to the database, in order to allow the indexing service to handle this
later.
- Set the version field of the config file based on the TaskContext. Also
  changed config.setVersion method to take a string (as opposed to a Date) as
input, and propogated this change where necessary.
- Set the SegmentOutputDir field of the config file based on the TaskToolbox,
  to allow the indexing service to handle where to write the segments too.
- Added a method to IndexGeneratorJob called getPublishedSegments, that simply
  returns a list of published segments without publishing this list to the
database.

2013-01-23 19:27:14 -08:00

src

Implemented Hadoop Index Task which takes as input a HadoopDruidIndexConfig and

2013-01-23 19:27:14 -08:00

pom.xml

fix pom breakage

2013-01-15 12:04:12 -08:00

README

Initial commit of OSS Druid Code

2012-10-24 03:39:51 -04:00

README

The file is empty.