From 5e42aee49ebb7f5fc70d19c632ee51275d011b50 Mon Sep 17 00:00:00 2001 From: Josh Yudaken Date: Mon, 24 Aug 2015 14:35:41 -0700 Subject: [PATCH 1/2] Add documentation for pathFormat in batch ingestion --- docs/content/ingestion/batch-ingestion.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/content/ingestion/batch-ingestion.md b/docs/content/ingestion/batch-ingestion.md index 4af56f2f21d..4aa3875a5ac 100644 --- a/docs/content/ingestion/batch-ingestion.md +++ b/docs/content/ingestion/batch-ingestion.md @@ -157,6 +157,7 @@ Is a type of inputSpec that expects data to be laid out in a specific path forma |dataGranularity|Object|specifies the granularity to expect the data at, e.g. hour means to expect directories `y=XXXX/m=XX/d=XX/H=XX`.|yes| |inputPath|String|Base path to append the expected time path to.|yes| |filePattern|String|Pattern that files should match to be included.|yes| +|pathFormat|String|Joda date-time format for each directory.|no| For example, if the sample config were run with the interval 2012-06-01/2012-06-02, it would expect data at the paths From 29c29b42d30cdbecb870180000265bf356d1059b Mon Sep 17 00:00:00 2001 From: Josh Yudaken Date: Mon, 31 Aug 2015 11:09:54 -0700 Subject: [PATCH 2/2] Add default value and link to joda docs --- docs/content/ingestion/batch-ingestion.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/content/ingestion/batch-ingestion.md b/docs/content/ingestion/batch-ingestion.md index 4aa3875a5ac..71b24fa2fac 100644 --- a/docs/content/ingestion/batch-ingestion.md +++ b/docs/content/ingestion/batch-ingestion.md @@ -157,7 +157,7 @@ Is a type of inputSpec that expects data to be laid out in a specific path forma |dataGranularity|Object|specifies the granularity to expect the data at, e.g. hour means to expect directories `y=XXXX/m=XX/d=XX/H=XX`.|yes| |inputPath|String|Base path to append the expected time path to.|yes| |filePattern|String|Pattern that files should match to be included.|yes| -|pathFormat|String|Joda date-time format for each directory.|no| +|pathFormat|String|Joda date-time format for each directory. Default value is `"'y'=yyyy/'m'=MM/'d'=dd/'H'=HH"`, or see [Joda documentation](http://www.joda.org/joda-time/apidocs/org/joda/time/format/DateTimeFormat.html)|no| For example, if the sample config were run with the interval 2012-06-01/2012-06-02, it would expect data at the paths