Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,487 Commits 147 Branches 203 Tags 407 MiB
Commit Graph

731 Commits

Author SHA1 Message Date
Matt Gilman 69a564e4c8
NIFI-5009: 
- Fixing required permission for PutParquet.

NIFI-5008:
- Ensuring all restricted components are tagged as such.

This closes #2583.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-03-26 09:47:54 -04:00
Otto Fowler 98c295dfc7
NIFI-5013 create test jar for standard processors 
remove unnec TestServer instances

This closes #2580.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2018-03-24 10:18:46 -04:00
Marco Gaido 758e44682f NIFI-4631: Use java.nio.file.Files in ListFile to improve performance 
This closes #2565.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-23 11:00:21 -04:00
sbouchex 9c9215982f NIFI-4999: Added request URI into the "restlistener.request.uri" attribute 
This closes #2574.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-21 13:17:17 -04:00
Andy LoPresto d09145e3e3 NIFI-4557 Added Expression Language support for PGP private keyring passphrase in EncryptContent. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2566.
 2018-03-20 11:23:45 +01:00
Derek Straka 5bdb7cf6e7 NIFI-4912: This closes #2494. Update jackson version to latest stable version (2.9.4) 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-03-19 10:22:50 -04:00
Pierre Villard 4687e0fb35 NIFI-4981 Allow using FF's content as message in PutEmail 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2556.
 2018-03-18 11:35:43 -07:00
Mark Bean 8b2c5b7246 NIFI-4950 Defining behavior for MergeContent when more than 1 FlowFile has the same fragment.index value 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2557.
 2018-03-16 18:31:43 +00:00
Marco Gaido 86f162b611 NIFI-4959: Remove flowfiles and close connection for Bad Requests causing IOException 
This closes #2544.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-16 12:24:00 -04:00
Bryan Bende de71a41bd0 NIFI-4935 Refactoring to support specifying schema branch or schema version when using schema by name strategy 
This closes #2523.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-15 16:16:12 -04:00
Deon Huang 37ad48844a NIFI-4962 FlattenJson processor add unexpected backslash after flatten 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2538.
 2018-03-13 22:33:53 +01:00
Pierre Villard 11a7d5c09f NIFI-4955 - Preserve columns ordering with CSV and ValidateRecord 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2528
 2018-03-13 17:09:07 -04:00
m-hogue 6471f66acd NIFI-3402 - Added etag support to InvokeHTTP 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2150.
 2018-03-13 10:00:11 +01:00
Deon Huang 7aabb99bcc NIFI-4800 Expose the flattenMode as property in FlattenJSON processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2530.
 2018-03-13 09:28:22 +01:00
Matt Gilman b1217f529b NIFI-4885: 
- Introducing more granular restricted component access policies.

This closes #2515.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-12 14:19:42 -04:00
joewitt c71409fb5d
NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max 
NIFI-4936 updated dependency handling pushing down delcarations where they belong
This closes #2512
 2018-03-09 16:34:53 -05:00
Andy LoPresto e9d585a785
NIFI-4870 Upgraded activemq-client and activemq-broker versions to 5.15.3. 
- Updated copyright dates in NOTICE files.
- This closes #2469.
 2018-03-09 13:59:13 -05:00
Jeff Storck e916594b69 NIFI-4872 Added annotation for specifying scenarios in which components can cause high usage of system resources. 
- Initial set of components marked with the HighResourceUsageScenario annotation.
- Added customized descriptions to SystemResourceConsideration annotations for MergeContent, SplitContent, SplitJson, SplitText, and SplitXml.

This closes #2475.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-05 15:32:23 -05:00
Matthew Burgess dd58a376c9 NIFI-4773 - Fixed column type map initialization in QueryDatabaseTable 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2504.
 2018-03-02 17:32:14 +01:00
Matthew Burgess 62732cbb88 NIFI-4903 - Fixed timestamp bug with fetch processors using Oracle 12+ 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2488.
 2018-02-22 20:56:30 +01:00
Pierre Villard ff95be2a11 NIFI-4815 - Add EL support to ExecuteProcess 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2432
 2018-02-21 12:47:33 -05:00
Matthew Burgess 2a5e21c11b NIFI-4836 - Allow output of FlowFiles during result set processing in QueryDatabaseTable 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2447.
 2018-02-17 15:56:05 +01:00
Andy LoPresto 28067a29fd
NIFI-4869 Added SAX utility method for SplitXML processor. 
Added unit tests.
Added test resources to RAT exclude list.
This closes #2466
 2018-02-13 15:29:29 -05:00
Matthew Burgess b5ca7adbb9 NIFI-978: Support parameterized statements in ExecuteSQL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2433.
 2018-02-12 20:44:31 +01:00
Matthew Burgess 7d6bbce123 NIFI-4830: Fixed logic errors in BLOB/CLOB processing in JdbcCommon 
This closes #2459.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-02-09 11:45:12 +09:00
Mark Payne 4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap 
This closes #2460.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-08 17:38:13 -05:00
Mike Moser a2f2ddd6b8 NIFI-4699 Use a filter in PostHTTP to pull flowfiles from queue whose URL is the same 
This closes #2412.
 2018-02-08 18:36:11 +00:00
Matthew Burgess 16e56ccfca NIFI-4080: Restored customValidate in ValidateCSV for schema property with no EL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2226.
 2018-02-08 11:56:56 +01:00
Marco Gaido ba192d22da enable EL on FF level 2018-02-08 11:56:49 +01:00
Matthew Burgess 836c324258 NIFI-4080: Added EL support to fields in ValidateCSV 2018-02-08 11:56:42 +01:00
Matt Gilman f3013d0764
NIFI-4837: 
- When Jetty initializes fails, performing a shutdown sequence to ensure all allocated resources are released.

This closes #2455.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-07 16:40:23 -05:00
Koji Kawamura e9af6c6ad8 NIFI-4828: Fix MergeContent to process all ready bins 
Before this fix, MergeContent only processed the first bin even if there
were multiple bins.

There were two unit tests marked with Ignore those had been
failing because of this.

This closes #2444.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-02-07 15:45:39 -05:00
Koji Kawamura dbbf78f22c
NIFI-4848: Update HttpComponents version 
- httpclient 4.5.3 -> 4.5.5
- httpcore 4.4.4 -> 4.4.9
  - ThreadSafe annotation is removed since 4.4.5, HTTPCLIENT-1743.
    Removed the annotation from DebugFlow processor.
- httpasyncclient 4.1.2 -> 4.1.3
- This closes #2453
 2018-02-07 08:55:43 -05:00
Deon Huang b5938062a8 NIFI-4395 GenerateTableFetch can't fetch column type by state after instance reboot 
Add multiple states recover

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2442
 2018-02-02 11:15:46 -05:00
Marco Gaido 37271e8241 NIFI-4790 - support HTTPS Proxy in InvokeHTTP 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2426.
 2018-01-24 17:51:28 +01:00
Matthew Burgess 84848f7cbb NIFI-4773: Moved DB Fetch processors' connection code from setup to onTrigger 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2422.
 2018-01-23 15:10:34 +01:00
Mark Payne 6f282c6843
NIFI-4803: Ensure that we set the FileCountAttribute of BinManager to the proper value, regardless of the merge strategy 
This closes #2423.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-01-22 15:37:31 -05:00
joewitt 41ce788812 NIFI-4751 changed to next minor release version snapshot 2018-01-12 15:15:32 -05:00
joewitt 36405e888c NIFI-4751-RC1 prepare for next development iteration 2018-01-08 23:39:49 -07:00
joewitt 46d30c7e92 NIFI-4751-RC1 prepare release nifi-1.5.0-RC1 2018-01-08 23:39:32 -07:00
Mike Moser 6e7544bd37 NIFI-4697 This closes #2381. clarified some PostHTTP documentation 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-01-08 21:47:27 -07:00
Mark Payne 953e922d32 NIFI-4749: This closes #2386. Pass the record reader's schema along to the ResultSetRecordSet so that it is able to resolve the schema for Record fields 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-01-08 19:47:18 -07:00
Andy LoPresto a7f1eb89c2
NIFI-4727 Added CountText processor and unit test. 
This closes #2371.

Signed-off-by: Kevin Doran <kdoran.apache@gmail.org>
 2018-01-08 14:26:14 -08:00
Mike Thomsen d9866c75e2 NIFI-4649 Added FlattenJson processor. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2307

Replaced star imports, removed unused import

Added explanation for invalid Expression
 2018-01-05 18:14:30 -05:00
Mark Payne 3b10a8479e Fixed bug in unit tests that were causing test failures 2018-01-05 09:59:01 -05:00
Matthew Burgess ce4374ee00
NIFI-4738: Fixed logic bug in JdbcCommon for 9-digit unsigned ints. This closes #2373 2018-01-04 15:20:35 -05:00
Pierre Villard 99d767aa44 NIFI-4383 - Fix UpdateRecord when updating arrays elements. This closes #2208. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-01-04 14:30:14 -05:00
joewitt 6ee6b5e57c NIFI-4734 refactored couchbase bundle, jms bundle, removed jms test-lib usage, fixed broken SeeAlso and service links causing docs warns. Corrected L&N in each bundle. This closes #2369. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-01-04 09:16:17 -05:00
Koji Kawamura 1959586389 NIFI-4729: This closes #2366. ConvertJSONToSQL converted boolean values in reverse 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-01-02 22:01:40 -05:00
Mark Payne c91d99884a NIFI-4717: Several minor bug fixes and performance improvements around record-oriented processors 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2359
 2017-12-29 10:43:21 -05:00
Mike Moser c59a967623 NIFI-4504, NIFI-4505 added removeAndGet, removeByPatternAndGet, and keySet methods to MapCache API 
cleaned up some warnings on deprecated nifi.stream.io classes

This closes #2284.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-12-29 00:23:09 +09:00
Marco Gaido 2fbe922a2b NIFI-2169: This closes #2343. Cache compiled regexp for RouteText 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-12-26 18:02:02 -05:00
Norito Agetsuma f04ddcf442 NIFI-4539 - ExtractGrok - Add support returning only named captures 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2233.
 2017-12-19 15:49:14 +01:00
Matthew Burgess 612675e428 NIFI-4684 - Added SQL Parameter Attribute Prefix property to ConvertJSONToSQL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2333.
 2017-12-19 10:32:52 +01:00
trixpan 44a3ac9eff NIFI-4706 - This closes #2348. Bump ParCEFone version 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-12-18 10:13:34 -05:00
Josh Anderton f50a07ec88 NIFI-4655: This closes #2347. Fixed NPE in the InvokeHTTP processor caused when an SSLContextService was assigned without keystore properties 
- Added check for keystore properties and only initialized keystore when necessary.
- Added TestInvokeHttpTwoWaySSL test class to test with two-way SSL
- Modified TestInvokeHttpSSL to test with one-way SSL

Signed-off-by: joewitt <joewitt@apache.org>
 2017-12-18 09:11:53 -05:00
Marco Gaido 463dcd8812 NIFI-4629: This closes #2345. Put flowfiles without the grouping attribute in the default group 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-12-15 10:35:13 -05:00
Koji Kawamura 57947d64cd NIFI-4694: Make PutSFTP Disable Directory Listing a normal property. This closes #2338. 2017-12-14 15:05:40 -05:00
Mike Thomsen d7347a2dc3 NIFI-4644 Fixed LookupService API to allow for more than String/String lookup pairs. This closes #2304. 2017-12-13 16:04:23 -05:00
Mark Payne 1fc1d38fd8 NIFI-4562: This closes #2331. If an Exception is thrown when merging FlowFiles, ensure that we remove the 'bundle' flowfile before exiting the method 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-12-08 15:35:36 -05:00
joewitt a774f1df69 NIFI-4673 changed offending tests to be integration tests and fixed travis config to run the build only once and during appropriate script phase instead of install. Reviewed by Bende. 2017-12-06 16:13:42 -05:00
joewitt 7e61c6333c
NIFI-2375 updated to latest Tika across codebase. Fixed 
tests and updated L&N for Tika parsers.  Turned unstable grpc test to IT
 test. Updated deps due to Tika testing findings. This closes #2320
 2017-12-06 11:53:15 -05:00
joewitt cdc1facf39
NIFI-4664, NIFI-4662, NIFI-4660, NIFI-4659 moved tests which are timing/threading/network dependent and brittle to integration tests and un-ignored tests that are IT. Updated travis to reduce impact on infra and appveyor now skips test runs so is just to prove build works on windows. This closes #2319 
squash
 2017-12-06 10:53:09 -05:00
Mark Payne 45df23b1e0 NIFI-4607, NIFI-3975, NIFI-4602, NIFI-4606: This closes #2272. Fixed bug in TailFile that caused new Primary Node to not pull current Clustered State when File Location was set to Remote. Fixed bug that caused TailFile to occasionally become 'stuck' when the file it is tailing is renamed and a new file is created with the same name. Removed the 'Rolling Strategy' property from TailFile because it is not actually used in the processor anymore. Deleted MonitorMemoryTest because the unit test was testing the behavior of FlowController more than the behavior of the reporting task itself and in order to do so had a dependency in the pom.xml on nifi-framework-core, which means that it no longer compiles when FlowController is modified. 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-11-30 11:10:46 -05:00
Matthew Burgess 3b15ed855c NIFI-4559: Add non-zero status relationship to ExecuteStreamCommand 
NIFI-4559: Removed Penalize Non-zero Status property and updated doc per review comments
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2246
 2017-11-30 10:12:00 -05:00
sbouchex 33281300cd NIFI-4597 This closes #2283. correcting imports, checkstyle issues, and adding validator 
Add a property to override HTTP return code in ListenHTTP processor

Signed-off-by: joewitt <joewitt@apache.org>
 2017-11-30 10:02:32 -05:00
Matt Gilman 3df3ff6c61 NIFI-4646: This closes #2306. 
- Ensuring the reason behind the SchemaNotFoundException is reported when interacting with the configured SchemaRegistry.

Signed-off-by: joewitt <joewitt@apache.org>
 2017-11-30 09:02:21 -05:00
Matthew Burgess 16a23f5a0f NIFI-4589: Allow multiple keys in FetchDistributedMapCache, add subMap operation to API 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2260.
 2017-11-21 20:13:35 +00:00
m-hogue 73702004b9 NIFI-3515: This closes #2257. Added EventDriven annotation to PutFile 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-11-21 12:40:13 -05:00
Andy LoPresto 5d643edfab
NIFI-4501 
- Changed request header handling logic.
- Removed unnecessary Maven dependency.
- This closes #2279
 2017-11-17 20:36:55 -05:00
Pierre Villard 9e9c129c21 NIFI-4577 - ValidateCsv - add attributes to indicate number of valid/invalid lines 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2268
 2017-11-13 21:48:30 -05:00
Julian Gimbel d0502285f2 NIFI-4568 Added existing but missing property WORKING_DIR 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2250.
 2017-11-08 09:50:14 +01:00
Andrew Lim b5d7aecfac NIFI-4560 Added mime.type and record.count Write Attributes to ValidateRecord doc 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2249.
 2017-11-03 11:10:00 +01:00
Andrew Lim 9a850c7ed2 NIFI-4552 Add mime.type and record.count Write Attributes to QueryRecord doc 
NIFI-4552 minor checkstyle violation

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2242
 2017-11-01 14:49:02 -04:00
Andrew Lim fb94e983b6 NIFI-2938 Added Write Attributes to RouteText doc and edited Grouping Regular Expression property description 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2232.
 2017-10-30 09:29:52 +01:00
Pierre Villard 68715a0dd4 NIFI-4513 - add EL support for proxy settings in InvokeHttp 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2223
 2017-10-27 18:15:27 -04:00
Matthew Burgess 856dedab12 NIFI-4522: Add SQL Statement property to PutSQL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2225.
 2017-10-27 09:17:51 +02:00
Matt Gilman 6baea8ccff
NIFI-4444: 
- Upgrading to Jersey 2.x.
- Updating NOTICE files where necessary.
- Fixing checkstyle issues.

This closes #2206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-10-12 10:27:02 -07:00
Bryan Bende 9324a2a742 NIFI-4476 Improving logic for determining when to yield in PutTCP/UDP/Syslog/Splunk 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2204.
 2017-10-10 09:02:02 +02:00
Bryan Bende 883c223ced NIFI-4386 Fixing connection handling in FetchFileTransfer 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2203.
 2017-10-10 08:50:57 +02:00
patricker 0876cf12b1 NIFI-3432: Handle Multiple Result Sets in ExecuteSQL 
NIFI-3432

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #1471
 2017-10-05 16:05:22 -04:00
Andy LoPresto d4168f5ff1
NIFI-4297 
- Upgraded immediately actionable dependency versions from Meterian report.
- Upgraded jackson-core test dependencies for HBase and Elasticsearch modules.
- Only 3 instances of jackson-core < 2.8.6 (Google Cloud Platform and Spark Receiver modules).
- Upgraded version of poi dependency in nifi-email-processors to 3.16.
- Resolving dependency issues after rebasing against 1.5.0-SNAPSHOT.
- Removed jackson-databind from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.version} in all referenced artifacts.
- Removed jackson-mapper-asl from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.old.version} in all referenced artifacts.
- Removed Jasypt from <dependencyManagement> and added explicit version in test dependency for legacy compatibility.
- This closes #2084
 2017-10-05 15:23:52 -04:00
Pierre Villard ea2c91f9d0 NIFI-4372 Wait processor - recommend prioritizer in documentation. This closes #2139. 2017-10-04 16:02:52 -04:00
Jeff Storck 2694adcca9 Merge branch 'NIFI-4412-RC2' 2017-10-02 13:58:54 -04:00
Jeff Storck a57911d3db NIFI-4412-RC2 prepare for next development iteration 2017-09-28 13:45:36 -04:00
Jeff Storck e6508ba7d3 NIFI-4412-RC2 prepare release nifi-1.4.0-RC2 2017-09-28 13:45:21 -04:00
Pierre Villard bdab3cda0a NIFI-4340 - fix record path evaluation when array is [ null ] 
This closes #2122.
 2017-09-28 13:39:55 -04:00
m-hogue b7b6d9082c
NIFI-2529: Added support for SSLContextService protocols in HandleHttpRequest 
Forced HandleHTTPRequest to use RestrictedSSLContextService and removed extraneous SSL algorithm checks
Throw RuntimeException if the chosen SSL protocol isn't supported by HandleHttpRequest

This closes #1985.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-09-26 18:48:19 -07:00
Andy LoPresto 2c1f5b49e4 NIFI-3116 This closes #2108. Added initial regression test for StringEncryptor to ensure continued functionality during removal of Jasypt. 
Added external compatibility regression test for StringEncryptor to ensure continued functionality during removal of Jasypt.
Documents custom salt lengths and iteration counts for each encryption method.
Added (ignored) failing tests for keyed encryption (Jasypt does not support keyed encryption).
Changed StringEncryptor to non-final class and added protected default constructor.
Added failing test for initialization status.
Added utility methods in CipherUtility.
Moved PBE cipher providers (and tests) from nifi-standard-processors to nifi-security-utils module.
Implemented PBE and keyed encryption/decryption logic.
Moved Scrypt unit test back into scrypt package.
Resolved test failures in limited strength cryptographic environment.
Implemented keyed encryption/decryption and enabled unit tests.
Removed Jasypt dependency from production scope (kept in test scope for backward compatibility tests).

Signed-off-by: joewitt <joewitt@apache.org>
 2017-09-26 10:55:29 -04:00
Bryan Bende 6eab91923e NIFI-4418 Adding ListenUDPRecord processor. This closes #2173. 2017-09-25 13:19:23 -04:00
Koji Kawamura c6f4421c8e NIFI-2829: Fixed PutSQL time unit test. 
The unit test for DATE type used GMT timezone, that causes an assertion error in timezones such as EST (-5).
We need to use local timezone instead of GMT, as Derby and PutSQL uses local timezone.

The unit test failed before as follows:
- Unit test code, passed: '2002-02-02 GMT'
- PutSQL code convertedi it to local: '2002-02-01 EST', and stored as '2002-02-01' in Derby database without timezone info
- Unit test code SELECT the inserted value, passed a GMT calender, then got epoch timestamp, which was '2002-01-31'

Support negative long value for timezones ahead of UTC.

- For timezones such as '+0800', it's possible that a local time e.g. '02:03:04' can be a negative epoch value. This commit changes LONG_PATTERN so that it can accept nevative values.
- Changed time values in unit tests to verify negative epoch values, and avoid using the same digits among different time unit for better readability.

This closes #2082
 2017-09-23 17:41:42 -04:00
Deon Huang a29348f2a4 NIFI-4395 - GenerateTableFetch can't fetch column type by state after instance reboot 
NIFI-4395: Updated unit test for GenerateTableFetch
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2166
 2017-09-22 14:34:00 -04:00
Mark Payne 05b5dd1488 NIFI-4409: Ensure that when record schema is inherited, the schema from teh ResultSet is used instead of the schema from the RecordReader because the schema from the RecordReader mmay not match the actual data 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2169
 2017-09-22 12:41:17 -04:00
Bryan Bende 329dbe3a64 NIFI-4405 Adding charset property to GenerateFlowFile 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2168.
 2017-09-21 17:10:47 +02:00
Koji Kawamura 7b07eb0577 NIFI-4228: Fix PutDatabaseRecord to ignore unmatched fields 
- Unmatched fields were ignored, but the number of prepared statement
  place holders were not correct.
- Added unit test code for generateUpdate.
- Added unit test code with "Ignore Unmatched Columns".

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2165.
 2017-09-21 16:11:07 +02:00
Koji Kawamura 1e70e24267 NIFI-4352: Add CLOB and NCLOB support to PutSQL and ExecuteSQL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2145.
 2017-09-14 11:02:48 +02:00
Gino Lisignoli 897b8ab601 NIFI-4374: Added buffer size to FTP connections 
This closes #2141.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-09-11 23:43:56 +09:00
Joe Percivall 9367c28064 NIFI-2162 Updating OkHttp to 3.8.1 and OkHttp-Digest to 1.13 and refactoring InvokeHttp to adjust for changes 
This closes #2004

Signed-off-by: Tony Kurc <tkurc@apache.org>
 2017-09-10 22:50:37 -04:00
Mark Payne 9ebf2cfaf1 NIFI-4306: Allow root field to be updated to a child field by adding property with name / and value /child, for instance 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2103.
 2017-09-08 18:50:49 +02:00
Koji Kawamura 1f67cbf628 NIFI-4004: Use RecordReaderFactory without FlowFile. 
- Removed FlowFile from RecordReaderFactory, RecordSetWriterFactory and SchemaAccessStrategy.
- Renamed variable 'allowableValue' to 'strategy' to represent its meaning better.
- Removed creation of temporal FlowFile to resolve Record Schema from ConsumerLease.

- Removed unnecessary 'InputStream content' argument from
  RecordSetWriterFactory.getSchema method.

This closes #1877.
 2017-09-08 12:37:40 -04:00