Commit Graph

2335 Commits

Author SHA1 Message Date
Mark Payne 9766558cab
NIFI-4526: Allow Target URI's of Remote Process Groups to be changed. This closes #2298 2017-11-27 10:50:32 -05:00
Matthew Burgess 16a23f5a0f NIFI-4589: Allow multiple keys in FetchDistributedMapCache, add subMap operation to API
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2260.
2017-11-21 20:13:35 +00:00
Mark Payne 412b3fbbe2 NIFI-4459: This closes #2240. Catch Exception if trying to iterate over many confluent schemas and unable to load one; in this case log a WARNING and continue on; also updated Jersey client to newest
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-21 12:52:05 -05:00
m-hogue 73702004b9 NIFI-3515: This closes #2257. Added EventDriven annotation to PutFile
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-21 12:40:13 -05:00
Janosch Woschitz e8b2387cb2 NIFI-4623: This closes #2281. Removed obsolete instability warning in documentation of newer (>= 0_10) Kafka processors
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-21 12:16:54 -05:00
m-hogue 020f9d0596 NIFI-4584: Added @EventDriven to InvokeGRPC
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2265.
2017-11-21 11:29:42 +01:00
Matthew Burgess 8f2501ffac NIFI-4612: Allow AvroSchemaRegistry to disable name validation
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2275.
2017-11-21 11:14:19 +01:00
Matt Gilman ff5325b923
NIFI-4614: - Updating the types of resources that are filtered out for viewing purposes. Updates include resources with no values and resources that contain wildcards.
This closes #2277.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-20 10:20:01 -05:00
Matt Gilman 439e13a8d5
NIFI-4567:
- Adding new properties to allow the referenced attribute of a user/group to be configurable when detecting group membership.
- Expanding on documentation regarding the new properties.

This closes #2274.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-20 10:09:53 -05:00
Matt Gilman 6b75921725 NIFI-4617:
- Ensuring a charset is specified when convert a string into bytes.
- Ensuring the aggregate snapshot is non null before attempting to promote the runStatus.

This closes #2278.
2017-11-20 09:39:23 -05:00
Andy LoPresto 5d643edfab
NIFI-4501
- Changed request header handling logic.
- Removed unnecessary Maven dependency.
- This closes #2279
2017-11-17 20:36:55 -05:00
sbouchex c89d793364
NIFI-4615
- processor status is set to the ProcessorStatusDTO object
- This closes #2276
2017-11-17 15:44:09 -05:00
Matt Gilman 2da72f1524
NIFI-4593: - Ensuring the necessary jackson dependencies are bundled.
This closes #2263.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-16 15:44:37 -05:00
Matthew Burgess 53de8c93ba NIFI-4603 - Externalize Max HTTP Header Size to nifi.properties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2271.
2017-11-15 10:12:39 +01:00
Andy LoPresto 7f8007f22a NIFI-4608 Removed unnecessary NiFiProperties mocking given enhancements to StringEncryptor.
Fixed checkstyle issues.
Fixed test failure in FingerprintFactoryTest.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2273.
2017-11-15 10:09:18 +01:00
Pierre Villard b9c53083c4 NIFI-4576 - rewording processors / cores
NIFI-4576: Rewording processor load average to core load average

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2267
2017-11-14 13:08:53 -05:00
Mike Thomsen ad2d12a20c NIFI-4578 Added strategy for dealing with nullable fields in PutHBaseRecord.
NIFI-4578 Added changes from code review.

This closes #2256.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-11-14 13:59:30 +09:00
Pierre Villard 9e9c129c21 NIFI-4577 - ValidateCsv - add attributes to indicate number of valid/invalid lines
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2268
2017-11-13 21:48:30 -05:00
Mark Payne af3a578711
NIFI-4598: When we retrieve the 'controller' from a remote NiFi instance in order to determine which ports are available, cache those results for up to some configurable amount of time (default 30 secs) so that we don't constantly issue HTTP Requests to the remote nifi
This closes #2270.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-13 14:46:38 -05:00
dlukyanov c7a5a09b8a groovyx initial version
NIFI-3688 license update to ASF
NIFI-3688 add groovyx dependency
NIFI-3688 comments from @alopresto
- reformat code https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide#ContributorGuide-EclipseUsers
- enabled java-doc
NIFI-3688
- try fix mess with licenses
- remove commented import
- remove unused var `sql`
NIFI-3688 the properties/skip javadoc/src
NIFI-3688 remove not used sql var
NIFI-3688
- first test case
NIFI-3688
+ 2 more tests based on current groovy tests
NIFI-3688 comment from @mattyb149
- processor renamed to ExecuteGroovyScript
NIFI-3688 fix script path validation
NIFI-3688
- refactor to compile on validation
- prepare 4 test cases with database
NIFI-3688 new test cases with groovy and sql
NIFI-3688 documentation
NIFI-3688
- refactor groovy extended methods
- add more test cases
NIFI-3688
- codestyle
- javadoc
- refactor flowfile voids to self-reference
- fix test cases
NIFI-3688 minor comments changes
NIFI-3688 rename additional documentation according to processor classname
NIFI-3688 exclude json test file from rat check
NIFI-3688 codestyle
NIFI-3688 add nar bundle to root pom.xml and to nifi-assembly/pom.xml
NIFI-3688
- fix & extend additional documentation
- fix pom.xml to bundle groovy into nar
NIFI-3688 add examples into additional processor documentation
NIFI-3688 fix pom.xml to exclude unnecessary libs from nar bundle
NIFI-3688 add restricted annotation
NIFI-3688 change version from 1.2.0-SNAPSHOT to 1.3.0-SNAPSHOT after rebase
NIFI-3688 new method in ProcessSession: public OutputStream write(FlowFile source)

NIFI-3688 change version from 1.3.0-SNAPSHOT to 1.4.0-SNAPSHOT after rebase

NIFI-3688 fix for @mattyb149 comment: The bundles referred to here and below are not included with this NAR and should be removed.

NIFI-3688 fix for @mattyb149 comment: This unused line can be removed

NIFI-3688
- removed `require flowfile` property
- fixed test cases according to deprecated property

change version to 1.5.0-SNAPSHOT

[NIFI-3688] Commented by mistake

[NIFI-3688] remove unused class

[NIFI-3688] fix javadoc comments

[NIFI-3688] refactor CTL & SQL properties

b3eecec901

2916ce1ec8

8e15392e2f

NIFI-3688: Checkstyle and typo fixes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #1662
2017-11-13 14:32:58 -05:00
Mark Payne 2d3e5abf81
NIFI-3155, NIFI-4571: Fix issue of Remote Group Port having ID the same as on the remote system, by adding an additional targetId field RemoteGroupPort's; this also fixes issue of stats being mixed together for RPG's with the same URL. This closes #2253 2017-11-13 13:54:34 -05:00
Mike Thomsen fe3f288944 NIFI-4588 Added the ability to use update operators like $push and $set to PutMongo.
Removed commented out code

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2259
2017-11-13 11:44:22 -05:00
Matt Gilman 387dce5ad0 NIFI-4591:
- Ensuring View Details button is visible if the user has read access and the service is defined in the current Process Group.

This closes #2262

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-11-09 16:41:45 -05:00
Mark Bean f11e03886f NIFI-4072 replace keyword RELEASE with actual version number
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2258.
2017-11-09 21:04:50 +01:00
Matt Gilman 9ecb26a52b NIFI-4587 - Updating styles to allow for newlines in Process Group, Processor, Controller Service, and Reporting Task comments.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2261.
2017-11-09 20:25:13 +01:00
Koji Kawamura 37ef2839e0 NIFI-4545: Improve Hive processors provenance transit URL
Incorporated review comments:

- Added 'input' to equals() method so that the same table name can appear
as input and output tables.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2239
2017-11-09 12:53:28 -05:00
Julian Gimbel d0502285f2 NIFI-4568 Added existing but missing property WORKING_DIR
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2250.
2017-11-08 09:50:14 +01:00
Mark Payne f4a1c9b547 NIFI-4454: Added Process Groups' variables to search capability
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2254
2017-11-06 11:27:05 -05:00
Matthew Burgess 5cd8a3e729 NIFI-4473: Fixed SelectHiveQL flowfile handling during error conditions
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2247.
2017-11-03 17:03:27 +01:00
Andrew Lim b5d7aecfac NIFI-4560 Added mime.type and record.count Write Attributes to ValidateRecord doc
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2249.
2017-11-03 11:10:00 +01:00
Koji Kawamura 2a69b35f12 NIFI-4548: Add REMOTE_INVOCATION provenance event type
This commit includes changes to DeleteHDFS to report REMOTE_INVOCATION
event. In order to do so, the processor had to be changed to create
output FlowFile because a provenance event needs a FlowFile it
associates with.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2234.
2017-11-02 19:32:22 +01:00
Koji Kawamura 116c846342 NIFI-4543: Improve HBase processors provenance transit URL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2237.
2017-11-02 18:24:40 +01:00
Koji Kawamura 77a51e1a9e NIFI-4544: Improve HDFS processors provenance transit URL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2238.
2017-11-02 10:10:03 +01:00
Koji Kawamura 6413337918 NIFI-4490: Ensure driver settings are correct before connecting binlog
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2244.
2017-11-02 09:16:56 +01:00
Andrew Lim 9a850c7ed2 NIFI-4552 Add mime.type and record.count Write Attributes to QueryRecord doc
NIFI-4552 minor checkstyle violation

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2242
2017-11-01 14:49:02 -04:00
Pierre Villard 448f03edae NIFI-4343 - allow multiple URLs in SiteToSite reporting tasks
using SiteToSiteClient.Builder().urls() instead of url()

Updated validator to use parseClusterUrls method

This closes #2121.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-10-30 22:13:06 +09:00
Koji Kawamura a73b5bda42 NIFI-4546: Make ReportingTask aware of node type in a cluster
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2235.
2017-10-30 11:22:03 +01:00
Koji Kawamura d914ad2924 NIFI-4547: Add ProvenanceEventConsumer utility class
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2236.
2017-10-30 09:50:44 +01:00
Andrew Lim fb94e983b6 NIFI-2938 Added Write Attributes to RouteText doc and edited Grouping Regular Expression property description
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2232.
2017-10-30 09:29:52 +01:00
Pierre Villard 68715a0dd4 NIFI-4513 - add EL support for proxy settings in InvokeHttp
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2223
2017-10-27 18:15:27 -04:00
Jeff Storck d6744b9ee5
NIFI-4528 The ref attribute in the request to view content sent by the client will now be inspected for the proxy context path. If found, it will be removed so the request can be successfully made within the cluster.
This closes #2228.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-27 16:06:28 -04:00
patricker e3482cc772 NIFI-4534 Choose Character Set for CSV Record Read/Write streams
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2229.
2017-10-27 10:34:15 +02:00
Matthew Burgess 856dedab12 NIFI-4522: Add SQL Statement property to PutSQL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2225.
2017-10-27 09:17:51 +02:00
Matt Gilman 1625f719e6 NIFI-4518:
- Ensuring the last selected variable id is reset when closing the dialog.

This closes #2227

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-26 20:53:37 -04:00
Matt Gilman f2bd9f87ba
NIFI-4518:
- Addressing issues when handling the done callback for controller service references.
2017-10-26 12:43:02 -04:00
Matt Gilman 32c0e2be3b
NIFI-4518:
- When the URI is too long, invoking the bulletin board multiple times for all specified component ids.
2017-10-26 10:27:57 -04:00
Mark Owens 10f27cd5f0 NIFI-2979 PriorityAttributePrioritizer violates Comparator contract. This closes #2220.
Modified the return value when both objects priority values are null to
zero to match the expected return value based upon the Comparator
contract.
2017-10-25 11:31:09 -04:00
JohannesDaniel c06dee2321 NIFI-3248: Improvement of GetSolr Processor
This closes #2199.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-10-23 18:53:54 +09:00
Christopher Currie c894246e03 NIFI-3950 Refactor AWS bundle
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2140.
2017-10-21 12:58:40 -07:00
Mark Payne 2acf6bdf7a NIFI-3689: Fixed threading bug in TestWriteAheadStorePartition - multiple threads were simultaneously attempting to update HashMap. Changed impl to ConcurrentHashMap.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2214.
2017-10-20 18:15:02 +02:00
Jeff Storck fb839fff56
NIFI-4499 Updated default content-viewer URL property to be relative rather than assuming it is deployed at the root context. This closes #2217 2017-10-19 15:34:39 -04:00
Mark Payne 95e86c1f51 NIFI-4495: Expose the option for supressing null values on the JSON Writer
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2218.
2017-10-19 10:20:40 +02:00
Matt Gilman 53e63eaf7c NIFI-4481:
- Adding support for visualizing if a component is scheduled for primary node only.
This closes #2210.
2017-10-18 15:25:23 -04:00
Matt Gilman b8a3862078 NIFI-4497:
- Fixing issue preventing separators in sub context menus.

This closes #2216

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-18 13:42:58 -04:00
Matthew Burgess 1a1e01c568 NIFI-4473 - fixed NPE in parametrized queries
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2215
2017-10-18 10:13:03 -04:00
Matthew Burgess 4edafad6e5 NIFI-4473: Add support for large result sets and normalizing Avro names to SelectHiveQL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2212.
2017-10-18 13:37:31 +02:00
patricker fd00df3d2f NIFI-4465 ConvertExcelToCSV Data Formatting and Delimiters
This closes #2194.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-10-17 14:56:49 +09:00
Mark Payne b950eed1a5 NIFI-4439: This closes #2190. When a Provenance Event File is rolled over, we were failing to close the resource before attempting to compress it. Fixed that.
NIFI-4439: Addressed threading bug that can occur when rolling over provenance record writer

Signed-off-by: joewitt <joewitt@apache.org>
2017-10-16 17:18:01 -04:00
Andrew Lim ba8f17bac0 NIFI-4488 Corrected misspelling in PutMongoRecord description
This closes #2211

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-16 12:04:16 -04:00
Matt Gilman 6baea8ccff
NIFI-4444:
- Upgrading to Jersey 2.x.
- Updating NOTICE files where necessary.
- Fixing checkstyle issues.

This closes #2206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-10-12 10:27:02 -07:00
Bryan Bende 9324a2a742 NIFI-4476 Improving logic for determining when to yield in PutTCP/UDP/Syslog/Splunk
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2204.
2017-10-10 09:02:02 +02:00
Bryan Bende 883c223ced NIFI-4386 Fixing connection handling in FetchFileTransfer
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2203.
2017-10-10 08:50:57 +02:00
Takanobu Asanuma 13e42678b6 NIFI-4338. This closes #2143. add docs for ssl configurations in HDFS processors
remove redundant additionalDetails.html and add docs to CapabilityDescription in HDFS processors

revert the modified CapabilityDescriptions in HDFS processors and add it to AbstractHadoopProcessor
2017-10-10 00:17:44 -04:00
yuri1969 b5e1fa7ff6 NIFI-4470 - Variables Registry: Increase space...
...between Bulletin icon and Controller Service name

This closes #2200

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-09 10:10:17 -04:00
Mark Payne acf05e0636 NIFI-4468: If an entire batch of Provenance Events are read by the Site-to-Site Provenance Reporting Task and none of them match the filters, then the reporting did not update its state, so it would be stuck in this cycle indefinitely. Made fix so that if any event is read from the provenance repository, regardless of whether or not it matches the filters, we update the state to keep track of what has been processed
This closes #2198.

Signed-off-by: Joe Skora <jskora@apache.org>
2017-10-08 15:34:48 -04:00
Omer Hadari 6201c06c99
NIFI-4392 Create a MetricReportingTask with GraphiteMetricService
This closes #2171.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-08 10:44:11 -04:00
Bryan Bende 5930c0c212
NIFI-4346 Modifying HBase_1_1_2_LookupService to use HBase_1_1_2_ClientService, instead of extend it
This closes #2125.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:49 -04:00
Mike Thomsen eb97a68110
NIFI-4346 Created a LookupService that uses HBase as its back end.
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:44 -04:00
Pierre Villard 39c5c5ab42 NIFI-4301 - This closes #2095. bumped jython-shaded version to 2.7.1
Signed-off-by: joewitt <joewitt@apache.org>
2017-10-06 16:02:10 -04:00
Giovanni Lanzani 59b60e62d8
NIFI-4450 - Update Kite SDK version
This closes #2187.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-06 15:37:22 -04:00
Mark Payne 7ad7520150 NIFI-4437: This closes #2183. When using ConsumeKafka_0_11 and no message demarcator, ensure that we add FlowFile Attributes for any Message Header that matches the 'Headers to Add as Attributes (Regex)' property
Signed-off-by: joewitt <joewitt@apache.org>
2017-10-06 15:06:32 -04:00
Mark Payne 582df7f4e8 NIFI-4008: This closes #2189. Update ConsumeKafkaRecord 0.11 so that it can consume multiple records from a single Kafka message
NIFI-4008: Ensure that we always check if a Kafka message's value is null before dereferencing it

Signed-off-by: joewitt <joewitt@apache.org>
2017-10-06 15:03:37 -04:00
joewitt 1d5df4a5ec NIFI-4466 fixed incorrect license header back to ASF and addressed some whitespace formatting in a couple of those poms. This closes #2197. 2017-10-06 11:15:59 -04:00
sbouchex 4ca0fe289e NIFI-4451 Upgraded Cassandra driver
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2188
2017-10-05 17:26:04 -04:00
Mark Owens 701597775f NIFI-1547: DistributedMapCacheServer: Ambiguous error on
misconfiguration

Updated PersistentMapCache constructor in PersistentMapCache.java to
catch an OverlappingFileLockException and present a more useful error
message before propagating the exception forward. The log message alerts
user to possible duplicated persistencePath in call to
PersistentMapCache.

Created a test method to verify the exception is thrown as expected.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2192
2017-10-05 16:44:43 -04:00
patricker 0876cf12b1 NIFI-3432: Handle Multiple Result Sets in ExecuteSQL
NIFI-3432

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #1471
2017-10-05 16:05:22 -04:00
Andy LoPresto d4168f5ff1
NIFI-4297
- Upgraded immediately actionable dependency versions from Meterian report.
- Upgraded jackson-core test dependencies for HBase and Elasticsearch modules.
- Only 3 instances of jackson-core < 2.8.6 (Google Cloud Platform and Spark Receiver modules).
- Upgraded version of poi dependency in nifi-email-processors to 3.16.
- Resolving dependency issues after rebasing against 1.5.0-SNAPSHOT.
- Removed jackson-databind from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.version} in all referenced artifacts.
- Removed jackson-mapper-asl from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.old.version} in all referenced artifacts.
- Removed Jasypt from <dependencyManagement> and added explicit version in test dependency for legacy compatibility.
- This closes #2084
2017-10-05 15:23:52 -04:00
yuri1969 5e2fb8cff1
NIFI-4423 - Add a confirmation of a Counter reset action. This closes #2178 2017-10-05 13:55:59 -04:00
yuri1969 c29ee4a6fa
NIFI-3803 - Allow use of up/down arrow keys...
...during selection in Add Processor dialog

* Added navigation logic to both Add Processor and Add CS dialogs.
* No extending to the SlickGrid library done.
* Ported the new functionality to the Add Reporting Task dialog.
* Mimicked SlickGrid's PageUp/Down behavior.
* This closes #2170
2017-10-05 09:45:26 -04:00
Pierre Villard ea2c91f9d0 NIFI-4372 Wait processor - recommend prioritizer in documentation. This closes #2139. 2017-10-04 16:02:52 -04:00
Giovanni Lanzani f1bd866005
NIFI-4443 Increase StoreInKiteDataset flexibility
* The configuration property CONF_XML_FILE now support Expression
  Language and reuse a Hadoop validator;
* The ADDITIONAL_CLASSPATH_RESOURCES property has been added, so that
  things such as writing to Azure Blob Storage should become possible.

This closes #2186.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-04 15:49:51 -04:00
Noe 0a47a3bde5
NIFI-3349 retry stale connections
This closes #2149.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-04 12:47:28 -04:00
Mark Payne e773fa5513 NIFI-4328: Fix to pom.xml for swagger maven plugin. This closes #2191. 2017-10-03 13:23:58 -04:00
Matt Gilman 697c382d9b
NIFI-4328:
- Upgrading swagger and the corresponding maven plugin to address issues discovered in recursive domain models.
2017-10-03 09:50:11 -04:00
Koji Kawamura 58e4fb576e NIFI-4008: Allow 0 or more records within a message. This closes #1891. 2017-10-02 15:40:29 -04:00
Jeff Storck 2694adcca9 Merge branch 'NIFI-4412-RC2' 2017-10-02 13:58:54 -04:00
Mark Payne b3be2459e4 NIFI-4330: Fixed checkstyle violations (tabs instead of spaces). This closes #2185. 2017-09-29 10:33:56 -04:00
gardellajuanpablo 2d5b8c7267 NIFI-4330 ConsumeKafka* throw NullPointerException if Kafka message has a null value
It is possible null values to be stored in Kafka topics. Fixed handle this scenario.
Notice without this fix, the consumer is unable to consume more messages (at least
without removing messages from the queue).
2017-09-29 10:57:53 -03:00
Mark Owens feaf44b623
NIFI-2184 JettyServer should confirm "docs" path exists before using it in .createDocsWebApp().
Refactored the createDocsWebApp method of the JettyServer.java class. Previously NiFi would fail to
start up and instead throw an IllegalStatException if the 'docs' directory did not exist in the
installation directory. With the update, if the 'docs' directory is missing, an attempt to create
the missing directory will be made and if successful will enable NIFI to startup successfully, barring
any other startup errors of course. The side effect of this change is that the help documentation
under the 'General' heading of the help page will be missing.

Three small helper methods were extracted from the original method.  Each related to a section of the
original code that could throw an exception. In each case if an exception is now thrown a more helpful
log message will be output and the process will be closed via the startUpfailure method rather than
throwing an exception.

This closes #2164.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-09-28 14:49:29 -07:00
Jeff Storck a57911d3db NIFI-4412-RC2 prepare for next development iteration 2017-09-28 13:45:36 -04:00
Jeff Storck e6508ba7d3 NIFI-4412-RC2 prepare release nifi-1.4.0-RC2 2017-09-28 13:45:21 -04:00
Pierre Villard bdab3cda0a NIFI-4340 - fix record path evaluation when array is [ null ]
This closes #2122.
2017-09-28 13:39:55 -04:00
Matt Gilman 6c798d18ef NIFI-4382:
- Adding support for KnoxSSO.
- Updated the docs for nifi.security.user.knox.audiences.
- The KnoxSSO cookie is removed prior to request replication.

This closes #2177
2017-09-27 16:22:18 -04:00
Matt Gilman d47bbd12ce
NIFI-4413: - Using the incoming request to determine the appropriate scheme for the data reference URI. Necessary for cases where the NiFi instance is behind a proxy running a different scheme.
This closes #2179.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-09-27 09:51:06 -04:00
m-hogue b7b6d9082c
NIFI-2529: Added support for SSLContextService protocols in HandleHttpRequest
Forced HandleHTTPRequest to use RestrictedSSLContextService and removed extraneous SSL algorithm checks
Throw RuntimeException if the chosen SSL protocol isn't supported by HandleHttpRequest

This closes #1985.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-09-26 18:48:19 -07:00
Andy LoPresto 2c1f5b49e4 NIFI-3116 This closes #2108. Added initial regression test for StringEncryptor to ensure continued functionality during removal of Jasypt.
Added external compatibility regression test for StringEncryptor to ensure continued functionality during removal of Jasypt.
Documents custom salt lengths and iteration counts for each encryption method.
Added (ignored) failing tests for keyed encryption (Jasypt does not support keyed encryption).
Changed StringEncryptor to non-final class and added protected default constructor.
Added failing test for initialization status.
Added utility methods in CipherUtility.
Moved PBE cipher providers (and tests) from nifi-standard-processors to nifi-security-utils module.
Implemented PBE and keyed encryption/decryption logic.
Moved Scrypt unit test back into scrypt package.
Resolved test failures in limited strength cryptographic environment.
Implemented keyed encryption/decryption and enabled unit tests.
Removed Jasypt dependency from production scope (kept in test scope for backward compatibility tests).

Signed-off-by: joewitt <joewitt@apache.org>
2017-09-26 10:55:29 -04:00
Arun Manivannan 3b1b326b13 NIFI-4416 CSVRecordReader does not accept escaped character as delimiter
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2172
2017-09-25 22:32:15 -04:00
Matthew Burgess 1ca4fa3a83
NIFI-4345: Removed lookup-services dependency from MongoDB Services NAR, cleaned up deps
- Added nifi-lookup-service-api to nifi-nar-bundles POM

This closes #2174.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-09-25 14:52:33 -04:00
Bryan Bende 6eab91923e NIFI-4418 Adding ListenUDPRecord processor. This closes #2173. 2017-09-25 13:19:23 -04:00
Koji Kawamura c6f4421c8e NIFI-2829: Fixed PutSQL time unit test.
The unit test for DATE type used GMT timezone, that causes an assertion error in timezones such as EST (-5).
We need to use local timezone instead of GMT, as Derby and PutSQL uses local timezone.

The unit test failed before as follows:
- Unit test code, passed: '2002-02-02 GMT'
- PutSQL code convertedi it to local: '2002-02-01 EST', and stored as '2002-02-01' in Derby database without timezone info
- Unit test code SELECT the inserted value, passed a GMT calender, then got epoch timestamp, which was '2002-01-31'

Support negative long value for timezones ahead of UTC.

- For timezones such as '+0800', it's possible that a local time e.g. '02:03:04' can be a negative epoch value. This commit changes LONG_PATTERN so that it can accept nevative values.
- Changed time values in unit tests to verify negative epoch values, and avoid using the same digits among different time unit for better readability.

This closes #2082
2017-09-23 17:41:42 -04:00