druid/docs/ingestion
Gian Merlino d87d92bc43
Add system fields to input sources. (#15276)
* Add system fields to input sources.

Main changes:

1) The SystemField enum defines system fields "__file_uri", "__file_path",
   and "__file_bucket". They are associated with each input entity.

2) The SystemFieldInputSource interface can be added to any InputSource
   to make it system-field-capable. It sets up serialization of a list
   of configured "systemFields" in the JSON form of the input source, and
   provides a method getSystemFieldValue for computing the value of each
   system field. Cloud object, HDFS, HTTP, and Local now have this.

* Fix various LocalInputSource calls.

* Fix style stuff.

* Fixups.

* Fix tests and coverage.
2023-11-02 10:31:28 -07:00
..
data-formats.md Add docs for ingesting Kafka topic name (#14894) 2023-08-24 19:19:59 +05:30
faq.md API reference refactor (#14372) 2023-06-26 15:48:54 -07:00
hadoop.md Removes support for Hadoop 2 (#14763) 2023-08-09 17:47:52 +05:30
index.md API reference refactor (#14372) 2023-06-26 15:48:54 -07:00
ingestion-spec.md docs: add concurent compaction docs (#15218) 2023-10-27 10:29:34 -07:00
input-sources.md Add system fields to input sources. (#15276) 2023-11-02 10:31:28 -07:00
native-batch-firehose.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
native-batch-simple-task.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
native-batch.md [Docs] Improvements to JSON-based batch Ingestion page (#15286) 2023-10-31 14:50:45 -07:00
partitioning.md Add missing MSQ error code fields to docs (#13308) 2022-11-10 21:03:04 +05:30
rollup.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
schema-design.md set druid.expressions.useStrictBooleans to true by default (#14734) 2023-08-22 00:19:56 -07:00
schema-model.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
standalone-realtime.md Reduce visibility of Tranquility documentation (#11134) 2021-05-03 16:48:24 -07:00
tasks.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
tranquility.md Reduce visibility of Tranquility documentation (#11134) 2021-05-03 16:48:24 -07:00