Add documentation for pathFormat in batch ingestion

This commit is contained in:
Josh Yudaken 2015-08-24 14:35:41 -07:00
parent 3331987b10
commit 5e42aee49e
1 changed files with 1 additions and 0 deletions

View File

@ -157,6 +157,7 @@ Is a type of inputSpec that expects data to be laid out in a specific path forma
|dataGranularity|Object|specifies the granularity to expect the data at, e.g. hour means to expect directories `y=XXXX/m=XX/d=XX/H=XX`.|yes| |dataGranularity|Object|specifies the granularity to expect the data at, e.g. hour means to expect directories `y=XXXX/m=XX/d=XX/H=XX`.|yes|
|inputPath|String|Base path to append the expected time path to.|yes| |inputPath|String|Base path to append the expected time path to.|yes|
|filePattern|String|Pattern that files should match to be included.|yes| |filePattern|String|Pattern that files should match to be included.|yes|
|pathFormat|String|Joda date-time format for each directory.|no|
For example, if the sample config were run with the interval 2012-06-01/2012-06-02, it would expect data at the paths For example, if the sample config were run with the interval 2012-06-01/2012-06-02, it would expect data at the paths