Commit Graph

1323 Commits

Author SHA1 Message Date
Joey Echeverria e7e15facc4 Added detailed documentation for the ExecuteFlumeSource/Sink processors
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:17 -04:00
Joey Echeverria 286e4738b8 Implemented Joe's review feedback:
* Renamed processors to ExecuteFlume*
* Added a LICENSE and NOTICE file to the nar
* Fixed the version number inconsistency in the POMs

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:17 -04:00
Joey Echeverria 16134a2dfe More review feedback from Ryan:
* Removed unnecessary call to configure our channel
* Removed call to context.yield() when Flume reports a backoff
* Handled the session factory changing when using a event driven source.

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:17 -04:00
Joey Echeverria c4dd1e65b1 Moved the source/sink stoppign to @OnStopped methods
* Made the spoolDirectory test stronger

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:16 -04:00
Joey Echeverria 3af73c9b82 Updated with Ryan's feedback:
* Moved away from any reliance on MemoryChannels in favor of
  modeling the ProcessSession/Relationship as the channel directly
  in all cases.
* Fixed version numbers in nifi-flume-* pom files.

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:16 -04:00
Joey Echeverria 419f9455a2 NIFI-589: Set java.io.tmpdir to ${build.project.directory}
This lets us use TemporaryDirectory and get the benefits of cleaning
up temporary files using `mvn clean`

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:16 -04:00
Joey Echeverria 3529bb3317 NIFI-589: Updated with first review feedback
* Switched to using `getResourceAsStream()` where possible
* Removed trailing whitespace from added files
* Added missing license headers
* Added RAT exception to testdata files
* Fixed POM errors that broke the build
* Switched to using TemporaryFolder instead of putting files in
  `target`
* Used try-with-resources where needed to autoclose streams
* Moved logging configuration to properties files
* Removed AbstractFlumeTest
* Fixed logging levels in test code

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:16 -04:00
Joey Echeverria 3b9e482466 Fix poms, versions, add batching to sink processor
* Fix pom issues caused by the rebase.
* Update the Flume bundle's version to 0.1.0
* Add support for batching to the sink processor

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:16 -04:00
Joey Echeverria cf29029a4d Added the sink's relationships to the relationship set. Added error checkign and logging for sink/source creation. Fixed an issue with transaction managemetn in the sink. Reformatted per coding standard.
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:16 -04:00
Joey Echeverria b251ab4425 Added processors that can run Flume sources and Flume sinks.
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-14 14:50:16 -04:00
Mark Payne 483b3dddfb Merge branch 'develop' of http://git-wip-us.apache.org/repos/asf/incubator-nifi into develop 2015-07-14 08:40:22 -04:00
Mark Payne 4dc126aff8 NIFI-685: This is merged. This closes #67 2015-07-14 08:40:04 -04:00
joewitt 8ff69ca2d1 NIFI-751 PR #70 removed extraneous reference to abstract properties pulling in hadoop conf 2015-07-14 07:41:07 -04:00
Alan Jackoway bb64e70e6f NIFI-751 Add Processor To Convert Avro Formats
Implemented a new NiFi processor that allows avro records to be converted from one Avro schema
to another. This supports..
* Flattening records using . notation like "parent.id"
* Simple type conversions to String or base primitive types.
* Specifying field renames using dynamic properties.

Signed-off-by: joewitt <joewitt@apache.org>
2015-07-14 07:22:34 -04:00
Mark Payne 8bd20510ee NIFI-762: Allow user to set keystore and truststore properties instead of setting sslcontext 2015-07-13 14:17:42 -04:00
joewitt 7f6f404baa NIFI-685 This closes #67. Was merged/closed in JIRA but not github 2015-07-11 09:44:56 -04:00
Matt Gilman de8ec6f92c NIFI-656-RC1 prepare for next development iteration 2015-07-08 14:44:55 -04:00
Matt Gilman e4f51eac9d NIFI-656-RC1 prepare release nifi-0.2.0-incubating-RC1 2015-07-08 14:44:44 -04:00
Aldrin Piri 48a4c2a320 Adding Linux configuration information as well as linking to the administration guide within the development quickstart. 2015-07-08 14:22:17 -04:00
Aldrin Piri df92dff8bb NIFI-705 Preventing the processor from initializing each time it is waiting for the request. 2015-07-08 13:12:04 -04:00
Mark Payne 3125036d3f Merge branch 'develop' of http://git-wip-us.apache.org/repos/asf/incubator-nifi into develop 2015-07-07 21:08:34 -04:00
Mark Payne c0f1104679 NIFI-753: when truncating value, take null values into account 2015-07-07 20:44:03 -04:00
danbress 9fa03b4324 Merge branch 'NIFI-735' into develop 2015-07-06 20:25:54 -04:00
Bryan Bende 0d2842e4f9 NIFI-750 adding a way to specify attribute names when constructing the spout 2015-07-04 12:38:33 -04:00
Mark Payne 208402472d NIFI-745: Only call methods with @OnDisabled once, regardless of whether or not they succeed 2015-07-03 15:00:31 -04:00
Mark Payne f3b55d46d6 Merge branch 'NIFI-717' into develop 2015-07-03 13:50:43 -04:00
Bryan Bende 63a9008527 NIFI-743 Moving OnShutdown to OnStopped for GetSolr and GetHttp
Adding OnRemoved methods to GetSolr and GetHttp

Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-07-03 13:37:44 -04:00
Mark Payne a2b9d70ac4 NIFI-717: Set working directory to $NIFI_HOME before running starting nifi in linux 2015-07-03 13:33:06 -04:00
Mark Payne 8da7327188 NIFI-720: Ensure that if Reporting Task stopped while @OnScheduled method is failing that it does not start running when configuration is fixed 2015-07-03 13:14:16 -04:00
Mark Payne 2a4e5e1285 NIFI-685: Fixed checkstyle violation of using import with * 2015-07-03 12:55:32 -04:00
Andrew Hulbert 2ac61c5972 Adding a plain socket factory for use with regular proxies 2015-07-03 12:48:46 -04:00
Andrew Hulbert 05772a07cf newline 2015-07-03 12:48:45 -04:00
Andrew Hulbert 159615bb8e initial proxy server commit 2015-07-03 12:48:44 -04:00
Mark Payne 74b4800937 NIFI-749: Ignore line endings in unit test 2015-07-03 12:45:33 -04:00
Aldrin Piri 136974af7c NIFI-472: Refining the mechanism to carry out running as a different user pushing the handling of this primarily to the controlling script rather than the Java code. Making changes to the assembly such that permissions are provided on a group level control basis. 2015-07-03 10:39:40 -04:00
Mark Payne 322ac6fba6 Merge branch 'develop' of http://git-wip-us.apache.org/repos/asf/incubator-nifi into develop 2015-07-03 09:38:19 -04:00
Matt Gilman b171849467 Merge branch 'develop' of https://git-wip-us.apache.org/repos/asf/incubator-nifi into develop 2015-07-03 09:09:15 -04:00
Mark Payne 786bc1d612 NIFI-733: Make use of Client Name, Zookeeper Timeout, Kafka Timeout properties and add new Group ID property 2015-07-03 09:04:52 -04:00
Joe Skora 9d6458ab28 NIFI-679: Incorporate Basic Authentication handling into InvokeHTTP processor.
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-07-03 08:51:46 -04:00
Aldrin Piri 063afe2a0d NIFI-741: Adding a link to the contributor guide in the Community section of navigation. 2015-07-03 00:55:15 -04:00
Matt Gilman eddc071b8e Merge branch 'develop' into NIFI-724 2015-07-02 16:27:05 -04:00
Matt Gilman 566c4fe8d7 NIFI-695:
- Providing immediate feedback when canceling a request to [en|dis]able a controller service.
- Reporting to the user after a request has been canceled.
2015-07-02 13:45:14 -04:00
Matt Gilman c3dff40902 NIFI-694:
- Ensuring bulletins are not lost when updating a reporting task.
2015-07-02 10:22:42 -04:00
Matt Gilman 4fd1e9494e NIFI-694:
- Fixing bug when clearing bulletins from the reporting task table.
- Allowed ENABLING state to trigger transition to next step of the enable/disable request.
2015-07-01 14:25:12 -04:00
Mark Payne e7c0461b15 NIFI-724: Ensure that bulletins generated for reporting tasks and controller services are shown at Controller level as well as component level 2015-07-01 12:54:18 -04:00
Mark Payne a09180799d NIFI-719: merged with develop 2015-07-01 10:44:42 -04:00
Matt Gilman 59aa8ffe10 NIFI-694:
- Showing bulletins in the controller service and reporting task tables.
- Fixed issue typo when emitting controller service bulletins.
2015-06-30 14:14:57 -04:00
joewitt 50215707f7 This closes #69 NIFI-738 2015-06-29 22:16:44 -04:00
Ryan Blue 2e32e0e2b8 NIFI-738: Improve error handling for CSV and JSON conversion.
Changes:
* Send bad record information on the "incompatible" relationship
* Use an attribute, "errors" for summarized error messages
* Send no error content for now, original content can't be accessed
* Summarize similar error messages with "N similar failures"
* Add similar error handling to CSV conversion

Signed-off-by: joewitt <joewitt@apache.org>
2015-06-29 22:00:22 -04:00
danbress c769742d9b NIFI-735: removing call to OnRemoved and updating unit tests 2015-06-28 16:42:52 -04:00