Peter Wicks
a0d1aae603
NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:20:44 -04:00
Peter Wicks
1470a52b1b
NIFI-2582 NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2583 Tweaks
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:19:56 -04:00
joewitt
d9633757a6
NIFI-2574 fix spring context definitions
2016-08-17 03:38:31 -07:00
joewitt
7d7401add4
NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it.
2016-08-17 00:10:07 -07:00
Peter Wicks
b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format
...
This closes #869 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 10:26:24 -04:00
Mark Payne
6af768d0a1
NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim.
2016-08-15 17:02:15 -04:00
Peter Wicks
44057f097a
NIFI-2356 ConvertJSONToSQL assumes IS_AUTOINCREMENT
...
This closes #862 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 14:17:16 -04:00
Matt Burgess
d544274881
NIFI-2531: Fixed JdbcCommon handling of BigInteger objects for Avro
...
This closes #823 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-10 15:19:34 -04:00
Joey Frazee
bb24312709
NIFI-2142 Added Guava cache for XSLT stylesheets in TransformXml
...
This closes #609
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-10 11:13:30 -04:00
Matt Burgess
557d6365bf
NIFI-2518: Added unit test showing issue
...
NIFI-2518: Added support for fractional seconds to AbstractDatabaseFetchProcessor
This closes #821
2016-08-10 11:10:17 -04:00
Bryan Rosander
2dc094765d
NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5
...
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12
This closes #809 .
2016-08-09 22:43:29 +02:00
Kirk Tarou
e2f649cfea
NIFI-2470 This closes #802 .
...
Fixed WritesAttributes section to include all attributes with the
correct attribute names and descriptions
2016-08-07 23:58:09 -04:00
joewitt
6bcc415eb8
NIFI-2457 removed old state file mechanism and fixed state reset logic
...
This closes #768 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-02 12:11:43 -04:00
joewitt
05a99a93cb
NIFI-2208 This closes #754 . refactored as per comments on JIRA. Reduced API expsosure and tightened lifecycle management.
2016-08-01 14:17:26 -04:00
Yolanda M. Davis
8412d2662a
NIFI-2208 - initial commit Custom Property Expression Language support with Variable Registry, includes bug fix for NIFI-2057
...
This closes #529
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-29 17:10:20 -04:00
Yolanda M. Davis
35c0e1436e
NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue
...
This closes #674
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-07-21 10:35:42 +09:00
Matt Burgess
f1ba240326
NIFI-2156: Add ListDatabaseTables processor
...
This closes #642
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-19 13:00:43 -04:00
Matt Burgess
01cae23745
NIFI-2157: Add GenerateTableFetch processor
...
This closes #645
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-17 17:54:42 -04:00
Koji Kawamura
e89ee11199
NIFI-619: Make MonitorActivity more cluster friendly
...
With this commit, MonitorActivity can be configured as:
- Monitor activity per node individually
- Monitor cluster wide activity
- Send notification flow-file from all of nodes
- or only from a primary node
Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
timestamp stored in Zookeeper
This closes #575
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-15 12:47:37 -04:00
Aldrin Piri
d1129706e2
NIFI-1896 This closes #650 . Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points.
2016-07-14 18:24:48 -04:00
Yolanda M. Davis
048ba5366c
NIFI-2020 - initial commit for custom transformation support
...
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #564
2016-07-14 18:04:14 -04:00
Andy LoPresto
4e3580f58e
NIFI-1688 Resolved issue in PostHTTP -- now uses SSLContextService's protocol setting. Modified construction of SSLSocketFactory to avoid hardcoding supported protocol. Added debug information for supported cipher suites.
...
This closes #624 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-07-14 16:43:48 -04:00
joewitt
f987b21609
NIFI-1157 searched for and resolved all remaining references to deprecated items that were clearly addressable.
2016-07-14 09:32:35 -04:00
Mark Payne
32b8a9b9f4
NIFI-1877, NIFI-1306: Add fields to FlowFile for FIFO Prioritizer, Oldest/Newest FlowFile first prioritizers to work properly
...
This closes #546
2016-07-05 14:59:08 -04:00
Joe Gresock
e3d13ecf50
NIFI-920: Adding InvalidPathException handling to UnpackContent
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-06-27 13:49:49 -04:00
Matt Gilman
f0811ca45a
NIFI-1554:
...
- Addressing access controls for the Controller resource.
- Addressing access controls for RAW site to site clients.
- Addressing access controls for downloading content (from provenance and queue).
- Addressing access controls for accessing queues.
- Addressing access controls for cluster endpoints.
- Addressing access controls for counter endpoints.
- Removing redundant authorization calls.
NIFI-2044:
- Requiring revision when creating components.
- Requiring component creation over POST requests.
NIFI-1901
- Continuing to restore access control tests.
- Converting access control tests to itegration tests.
- Restoring contrib check to travis build.
- This closes #567
2016-06-23 17:09:54 -04:00
jpercivall
f0662a24ef
NIFI-2092 Fixing unit tests which try to clean up directories before stopping the FlowController that has locks opened.
...
This closes #568
2016-06-23 16:40:00 -04:00
Bryan Bende
4f2643f668
NIFI-2061 Added methods to AbstractPolicyBasedAuthorizer to generate and inherit a fingerprint
...
- Updated StandardFlowSynchronizer to compare authorization fingerprints
- This closes #566
2016-06-23 14:36:04 -04:00
Oleg Zhurakousky
1eeef0e1c0
NIFI-2067 ignored intermittently failing MemoryTest left comment with the explanation as to why it was not removed
...
This closes #555
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-06-21 22:18:13 -04:00
Pierre Villard
ef192cc859
NIFI-1751 Added proxy authentication in InvokeHttp processor
...
This closes #398 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-06-21 14:09:02 -04:00
Andy LoPresto
a6e96953f6
Removed duplicate dependency declaration from nifi-standard-processors/pom.xml.
...
This closes #551 .
2016-06-21 19:25:01 +02:00
jpercivall
cd846c8d62
NIFI-1834 adding fixes to PutTCP
...
This closes #543
2016-06-21 12:05:39 -04:00
Matt Brown
a7c912ac18
PutTCP Processor created.
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-06-21 12:05:13 -04:00
Yolanda M. Davis
cb3aa8f5c9
NIFI-1850 - Initial Commit for JSON-to-JSON Schema Converter Editor (merge from 0.7.0 - refactor for masterless cluster). This closes #511
2016-06-20 20:30:25 -04:00
ricky
f5060a6d63
NIFI-1568: Add Filter Capability to UnpackContent
...
Adds a "File Filter" property to the `UnpackContent` processor
to allow users to specify which files are eligible for extraction.
By default, all files will be extracted.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
Refactor how Unpacker is initialized
Re-uses unpackers to avoid creating them each time a
flowfile is received. Moved the package formats into
an enum for clarity.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
Fix packaging format enum warning
The `AUTO_DETECT_FORMAT` enum for PackagingFormat
is not valid for initilization. When this value
is set, then we use the mime.type to determine
which packaging format to use.
We never pass `AUTO_DETECT_FORMAT` to the
`initUnpacker` method.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #248
2016-06-20 10:44:38 -04:00
Pierre Villard
e6250d18cf
NIFI-1620 Allow empty Content-Type in InvokeHTTP processor
...
This closes #272 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-06-18 12:47:07 -04:00
Adam Lamar
db9a79f79d
NIFI-1578: Create PutSlack processor
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #256
2016-06-17 15:32:17 -04:00
Joshi
541bbc0932
NIFI-1549: Fix JMSConsumer exception
...
This closes #539
2016-06-17 12:16:36 -04:00
Oleg Zhurakousky
8e4a4532df
NIFI-1690 Changed MonitorMemory to use allowable values for pool names
...
- removed dead code from MonitorMemory
- added MonitorMemoryTest
- minor refactoring in MonitorMemory
- initial fix for NIFI-1731 (WARN/INFO logging) that was required by MonitorMemoryTest
NIFI-1690 polishing
NIFI-1690 address PR comments, removed default value for MEMORY_POOL_PROPERTY
NIFI-1690 addressed latest PR comments
NIFI-1690 fixed breaking changes
Fixed checkstyle issue in StandardProcessScheduler. (+2 squashed commits)
Squashed commits:
[03829c4] Fixed checkstyle issues.
[cb20fe6
]
This closes #328 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-06-16 15:17:13 -07:00
Joe Skora
4723f8e24c
NIFI-1829 - Create new DebugFlow processor.
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #458
2016-06-16 17:23:19 -04:00
Andy LoPresto
8b0c5a4911
NIFI-1981 Resolved issue where cluster communication without client certificates would fail even if needClientAuth set to false.
...
Fixed IDE setting for import wildcarding on Groovy files. (+4 squashed commits)
Squashed commits:
[4c3b174] NIFI-1981 Lowered logging level of client auth setting on cluster connection receive.
[b50f473] NIFI-1981 Finished logic to suppress exception on missing client certificates when clientAuth is set to WANT.
Added unit tests for CertificateUtil methods.
[ace35a2] NIFI-1981 Added test scope dependency on BouncyCastle and BC PKIX modules for CertificateUtils tests.
[2c463d1] NIFI-1981 Added ClientAuth enum and CertificateUtil methods to extract this setting from an SSLSocket.
Added logic to compare X509Certificate DNs regardless of RDN element order.
Added logic to suppress peer certificate exceptions when client authentication is not required.
Removed duplicate dependency in pom.xml.
2016-06-14 11:18:31 -04:00
Mike Moser
cc95e5d8c5
NIFI-1937 GetHTTP configurable redirect cookie policy
...
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #479
2016-06-11 11:22:33 -04:00
Matt Burgess
3b99e12352
NIFI-1973 Allow ExecuteSQL to use flow file content as SQL query
...
This closes #498 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-06-07 17:26:58 -04:00
Mark Bean
1ac44a0a4b
NIFI-1118 adding SplitText features of size limit and header marker characters
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #444
2016-06-07 11:37:23 -04:00
Oleg Zhurakousky
cee2426df6
NIFI-1956 added 'keyboard-interactive' option to SFTPTransfer
...
This closes #487 .
2016-06-06 19:32:16 +02:00
Thad Guidry
c090cdf29a
Added details about data size in description.
...
added "in bytes" to further explain the Segment Size property.
This closes #494
2016-06-06 09:50:57 -04:00
jpercivall
54c5c28cbb
NIFI-1943 added proper ReadsAttribute to PutFile
...
This closes #480
2016-06-02 13:04:14 -04:00
jpercivall
4f101294eb
NIFI-1265 Fixing InvokeHttp tests.
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-06-02 09:49:57 -04:00
Matt Gilman
e587c99855
NIFI-1265:
...
- Upgrading to Jetty 9.3.
2016-06-02 09:49:57 -04:00
Andre F de Miranda
bcead3500d
NIFI-1945 - Corrects minor issue in "<Hash Attribute Name>" description
...
This closes #481 .
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2016-06-01 21:13:59 +02:00
Oleg Zhurakousky
93795bc7ba
NIFI-1915 Fixed '$' escape logic.
...
Fixed '$' escape logic (if not followed by number) to use Matcher.quoteReplacement(java.lang.String) to
suppress its special meaning so it could be treated as literal.
This closes #466 .
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2016-06-01 20:17:59 +02:00
jpercivall
e1b654655a
NIFI-1913 Properly removing flowfile in HandleHttpRequest when the Context Map fails to register the request
...
This closes #462
2016-05-24 10:54:46 -04:00
Oleg Zhurakousky
f40a090073
NIFI-1905 enabled ExecuteProcess to terminate process
...
NIFI-1905 polishing
NIFI-1905 changed WARN to INFO during shutdown
This closes #456
2016-05-22 10:36:03 -04:00
DomenicPuzio
afc8c645a1
NIFI-1498: putFile - Flowfiles routed to failure relationship produce INFO level log messages
...
This closes #445 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-19 16:21:45 -04:00
Aldrin Piri
1bd2cf0d09
NIFI-1811 Renaming MockProcessorLogger to MockComponentLogger for consistency. Removing unused imports from ExecuteScript causing checkstyle failures.
2016-05-19 14:38:41 -04:00
Pierre Villard
372ffb8aa0
NIFI-1811 Removed ProcessorLog and updated dependent interfaces
...
This closes #403 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-19 13:08:09 -04:00
Koji Kawamura
7bd2c64adb
NIFI-1865 Close StreamThrottler when processor stops.
...
- Also, replaced copyrighted sample texts for tests
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-05-10 22:02:15 -04:00
Pierre Villard
9064b97631
NIFI-1816 Added provenance event SEND in HandleHttpResponse
...
This closes #389
2016-05-07 11:51:26 -04:00
Pierre Villard
63a0d0c211
NIFI-1732 set jetty timeout to Long.MAX_VALUE
...
This closes #337
2016-05-06 19:38:52 -04:00
Pierre Villard
e2bbea1c53
NIFI-1814 Extended caught exceptions
...
This closes #382
2016-05-06 18:00:40 -04:00
Yolanda M. Davis
defb6f5b61
NIFI-361 - Create Processors to mutate JSON data
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #354
2016-05-03 14:38:11 -04:00
Andy LoPresto
a4409d366c
Fixed typo in ScryptCipherProviderGroovyTest Javadoc.
...
This closes #380 .
2016-04-27 16:05:16 -07:00
Andy LoPresto
f94b0f2ed2
NIFI-1789 Temporarily ignored incorrectly failing TestPutUDP#testUnknownHostname.
...
This closes #373 .
2016-04-20 19:20:41 -07:00
Pierre Villard
b5a8f4f73b
NIFI-1787 fixed typo
...
This closes #367
2016-04-20 06:57:43 -04:00
Oleg Zhurakousky
5b2490f1e8
NIFI-1738 hot patch to fix reflection mistake that was made while modifying @jvwing test
2016-04-18 08:59:44 -04:00
Pierre Villard
5e55a543eb
NIFI-1724 Added properties to configure log level when file not found and permission denied on FetchFile processor
...
NIFI-1724 Added unit test for logging with level
This closes #348
2016-04-18 08:15:27 -04:00
Hejki
1a57b37dc9
NIFI-1738 - Repair logger names for ControllerStatusReportingTask
...
NIFI-1738 amending this commit with tests provided by @jvwing
This closes #334
2016-04-17 15:53:13 -04:00
Pierre Villard
ad56f1f853
NIFI-1776 Allowed application/x-gzip as Gzip mime type
...
This closes #358
2016-04-17 14:36:13 -04:00
Toivo Adams
678d64d1d4
NIFI-1685 Optimize database Junit tests to reduce execution time. Removed commented blocks.
...
This closes #304 .
Signed-off-by: Joe Skora <jskora@apache.org>
2016-04-16 20:15:42 -04:00
Andy LoPresto
378ccf53c2
NIFI-1753 Replaced usage of javax.security.cert.X509Certificate with java.security.cert.X509Certificate and resolved user-reported ClassCastException when handling client certificates during TLS mutual authentication.
...
Fixed nifi-utils pom.xml comment about additional dependencies. (+5 squashed commits)
Squashed commits:
[965b766] NIFI-1753 Removed temporary work-around of duplicate certificate conversion util method and added nifi-security-utils as dependency of nifi-utils.
[cd35f9b] NIFI-1753 Replaced legacy X.509 certificate declarations with new declarations in SSLSocketChannel and EndpointConnectionPool.
Temporary work-around of duplicate certificate conversion util method because nifi-utils cannot depend on nifi-security-utils.
[6420897] NIFI-1753 Replaced legacy X.509 certificate declarations with new declarations in PostHTTP.
[b9868ef] NIFI-1753 Added convenience method for extracting DN from peer certificate chain in SSL socket (canonical implementation to reduce code duplication and references to legacy certificate implementations).
Refactored logic retrieving legacy X.509 certificates with reference to convenience method in NodeProtocolSenderImpl.
Replaced logic retrieving legacy X.509 certificates with reference to convenience method in SocketProtocolListener.
Cleaned up exception handling in SocketProtocolListener.
Replaced legacy X.509 certificate declarations with new declarations in HandleHttpRequest (needs manual test).
[e2d1c35] NIFI-1753 Added convenience methods for converting legacy X.509 certificates and abstract certificates to correct X.509 format.
Added unit tests for certificate manipulation.
Replaced logic retrieving legacy X.509 certificates with new logic in NodeProtocolSenderImpl.
Added bcpkix (Bouncy Castle PKI implementation) dependency to nifi-standard-processors pom.
This closes #346 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-04-13 18:30:21 -07:00
Zachary Jaffee
41583e6dc0
NIFI-400 remove deprecated processor EvaluateRegularExpression
...
This closes #77
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-08 09:11:20 -04:00
Bryan Bende
3adb45eafc
NIFI-1630 This closes #332 . Making TestPutUDP select an open port for testing to avoid conflicts
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-06 23:39:30 -04:00
Matt Brown
b0cc6ae7e8
NIFI-1630 PutUDP processor created.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-04-06 11:04:01 -04:00
Aldrin Piri
3effc6cca5
NIFI-1689 Correcting TimeUnit conversion to be milliseconds instead of the incorrect microseconds and using historical modified times to avoid issues with second granularity of HFS+
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-05 09:38:48 -04:00
Mike Moser
1c025dd4be
NIFI-1714 use standard HttpClient cookie policy instead of default
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-04-04 13:13:17 -04:00
Matt Gilman
2de7f3f884
Updating versions to 1.0.0-SNAPSHOT.
2016-04-04 11:36:20 -04:00
Matt Burgess
65b26e6f41
NIFI-1691: Add Fetch Size property to QueryDatabaseTable
...
This closes #307
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-03-29 10:51:30 -04:00
Aldrin Piri
e977729b56
NIFI-1634-rc2 prepare for next development iteration
2016-03-23 18:56:34 -04:00
Aldrin Piri
0b9bd20d31
NIFI-1634-rc2 prepare release nifi-0.6.0-RC2
2016-03-23 18:56:22 -04:00
Aldrin Piri
4babd067c1
NIFI-1664 Preferring System.nanoTime to System.currentTimeMillis and providing explicit handling of timestamps for files in those tests that are testing other attributes of the ListFile process besides timestamp which could lead to erroneous transmissions depending on exactly when files were created.
...
Adding unsalted_128_raw.enc and salted_128_raw.enc to the list of exclusions for the RAT plugin which caused issues in the Windows environment for contrib-checks.
This closes #297 .
2016-03-22 14:13:37 -04:00
Mark Payne
736896246c
NIFI-1649: Addressed bug in SplitText that resulted in improper handling of input data if Remove Trailing Newlines is true and there is a FlowFile that is only made up of newlines
2016-03-21 13:26:32 -04:00
Joey Frazee
3a4546c08a
NIFI-1617 Add source filename metadata to IdentifyMimeType
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-03-18 00:23:16 -04:00
Michal Klempa
e12e7a55b7
NIFI-1562 ExecuteStreamCommand and ExecuteProcess now support empty command line arguments
...
This closes #247
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-03-17 23:15:12 -04:00
Pierre Villard
e7a254f78e
NIFI-1332 Fixed HTTP-204 handling + unit test
...
This closes #259 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-03-17 23:03:51 -04:00
Matt Burgess
98395de74f
NIFI-1575: Add QueryDatabaseTable processor
2016-03-16 15:55:57 -04:00
Mark Payne
68cfc8c612
NIFI-1632: Fixed NPE that occurs if a capturing group is optional and not matched; updated docs to illustrate how this is handled
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-16 15:19:17 -04:00
Mark Payne
56f79e1e85
NIFI-1588: Reworked how ListHDFS store state so that only 2 timestamps are stored and no paths
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-14 15:59:24 -04:00
joewitt
730d999d4b
NIFI-627 minor formating adjustments and removed exception based handling logic. This closes #268 . This closes #274 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-13 13:28:48 -04:00
Mike Moser
0cb4047add
NIFI-627 removed flowfile penalization which could skew behavior when processor's Time Duration was less than Penalty Duration, improved over throttle penalization NIFI-990 corrected failure path NIFI-1329 refactored using FlowFileFilter to avoid repeatedly returning flowfiles to the input queue, producing misleading stats and excessive Tasks/Time used
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-13 13:28:43 -04:00
Bryan Bende
1373bf6725
NIFI-899 Rewrite of ListenUDP to use new listener framework, includes the following changes:
...
- Adding Network Interface property to AbstractListenEventProcessor and ListenSyslog
- Adding sending host and sending port to DatagramChannelDispatcher
- Creation of common base class AbstractListenEventBatchingProcessor
- Refactor of ListenUDP, ListenTCP, and ListenRELP to all extend from AbstractListenEventBatchingProcessor
- Changing DatagramChannelDispatcher, socket handlers, and RELP handler to use offer() when queueing instead of put(), and log an error if the offer failed
This closes #266
2016-03-11 09:07:05 -05:00
Bryan Bende
6f5fb59479
NIFI-1420 Adding Splunk bundle containing PutSplunk, and GetSplunk, and adding a ListenTCP processor to standard processors. Refactored internal code from PutSyslog to create a generic AbstractPutEventProcessor which PutSplunk extends from.
...
This closes #233
2016-03-07 18:21:17 -05:00
Matt Burgess
a7e6820fd9
NIFI-1596: ExecuteSQL Error Creating Schema
2016-03-07 10:42:21 -05:00
Bryan Bende
19e53962ca
NIFI-1579 Performance improvements for ListenSyslog which include removing an unnecessary yield and exposing a configurable size for the internal queue used by the processor, changing ListenSyslog to use a 20ms poll and use a long poll when batching, also including same improvements for ListenRELP
2016-03-04 09:17:45 -05:00
Mark Payne
28c2a3e5a6
NIFI-1256: Added a 'Satisfies Expression' option for Matching Strategy of RouteText
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-02-25 15:59:57 -05:00
Tony Kurc
c7e24c7569
NIFI-1513: fixed some easy to fix errors
...
Addressing checkstyle issue.
This closes #221
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-02-25 15:21:40 -05:00
Jeremy Dyer
32f476aaa7
NIFI-1357 Add Snappy compression to "CompressContent" Processor
...
This closes #164 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-02-25 12:47:01 -05:00
joewitt
86ab4428f0
NIFI-1520 by default skip javadoc and source jar generation in nars and wars
...
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #234
2016-02-18 18:45:26 -05:00
puspendu.banerjee@gmail.com
1c73d9090a
NIFI-1501 : Test Monitor Activity has spurious failures.
...
Added Timeout for the test. So, in case something goes South, threshold will never be more that that Timeout period.
Reviewed with amendments for whitespace by Tony Kurc (tkurc@apache.org ). This closes #225
2016-02-17 21:55:10 -05:00
Michal Klempa
c2998a71ec
NIFI-1514 Fixed ExecuteStreamCommand when expressions in command arguments are used, contents are not split by command separator
...
This closes #223 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-02-17 17:48:23 -05:00
Tony Kurc
ad73b5c9d9
NIFI-1379-RC3 prepare for next development iteration
2016-02-12 17:28:10 -05:00
Tony Kurc
8309dba80b
NIFI-1379-RC3 prepare release nifi-0.5.0-RC3
2016-02-12 17:27:59 -05:00
Tony Kurc
cae5b109c0
NIFI-1507: Update bouncycastle license reference
2016-02-12 16:58:26 -05:00
Aldrin Piri
1a512cd1e6
NIFI-1484 Making use of timestamps at various points of execution to provide listing of all but the latest files which are held until a subsequent execution.
...
Correcting nifi-amqp-nar bundle's pom description.
This closes #212 .
2016-02-10 10:25:47 -05:00
ledor473
eb6f9f0fec
NIFI-1423 Allow to penalize FlowFiles that are routed to No Retry relationship
...
This closes #183
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-02-08 11:20:08 -05:00
Aldrin Piri
2673370cba
NIFI-1483 Correcting logic in terms of when local persistence files are removed during the migration process.
...
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #206
2016-02-07 17:40:12 -05:00
Tony Kurc
5be83166ee
NIFI-1485: Updated 'header' section of NiFi NOTICE files
2016-02-07 13:52:00 -05:00
Tony Kurc
303f8eabf1
NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys
2016-02-06 08:49:48 -05:00
Andy LoPresto
b407379670
NIFI-1257 Resolved legacy compatibility issue with NiFi legacy KDF salt length dependent on cipher block size.
...
Replaced screenshot for NiFiLegacy salt encoding.
Added description of legacy salt length determination in admin guide.
Added logic for NiFiLegacyCipherProvider to generate and validate salts of the length determined by the cipher block size.
Changed EncryptContent to default to Bcrypt KDF.
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-02-05 23:38:58 -05:00
Aldrin Piri
4df6512126
Merge branch 'NIFI-259'
2016-02-05 14:09:29 -05:00
Aldrin Piri
16f1852453
NIFI-259 Updating logger message for AbstractListProcessor to reference State Manager in onTrigger instead of the distributed cache.
2016-02-05 12:55:06 -05:00
Andy LoPresto
498b5023ce
NIFI-1257 NIFI-1259
...
Added utility method to return the maximum acceptable password length for PBE ciphers on JVM with limited strength crypto because BC implementation is undocumented (based on empirical evidence).
Updated EncryptionMethod definitions to accurately reflect need for unlimited strength crypto according to algorithm key length.
Added processor logic to invoke keyed cipher.
Added EncryptContent processor property for raw hex key (always visible until NIFI-1121).
Added validations for KDF (keyed and PBE) and hex key.
Added utility method to return list of valid key lengths for algorithm.
Added description to allowable values for KDF and encryption method in EncryptContent processor.
Added IV read/write to KeyedCipherProvider and changed from interface to abstract class.
Added salt read/write logic to NifiLegacy and OpenSSL cipher providers.
Changed RandomIVPBECipherProvider from interface to abstract class.
Updated strong KDF implementations.
Renamed CipherFactory to CipherProviderFactory.
Added unit test for registered KDF resolution from factory.
Updated default iteration count for PBKDF2 cipher provider.
Implemented Scrypt cipher provider.
Added salt translator from mcrypt format to Java format.
Added unit tests for salt formatting and validation.
Added surefire block to groovy unit test profile to enforce 3072 MB heap for Scrypt test.
Added local Java implementation of Scrypt KDF (and underlying PBKDF2 KDF) from Will Glozer.
Defined interface for KeyedCipherProvider.
Implemented AES implementation for KeyedCipherProvider.
Added Ruby script to test/resources for external compatibility check.
Added key length check to PBKDF2 cipher provider.
Changed default PRF to SHA-512.
Added salt and key length check to PBKDF2 cipher provider.
Added utility method to check key length validity for cipher families.
Added Bcrypt implementation.
Implemented PBKDF2 cipher provider.
Added default constructor with strong choices for PBKDF2 cipher provider.
Implemented NiFiLegacyCipherProvider and added unit tests.
Added key length parameter to PBKDF2 cipher provider.
Added PRF resolution to PBKDF2 cipher provider.
Added RandomIVPBECipherProvider to allow for non-deterministic IVs.
Added new keyed encryption methods and added boolean field for compatibility with new KDFs.
Added CipherFactory.
Improved Javadoc in NiFi legacy cipher provider and OpenSSL cipher provider.
Added KeyedCipherProvider interface.
Added OpenSSL PKCS#5 v1.5 EVP_BytesToKey cipher provider and unit test.
This closes #201 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-02-04 19:40:55 -05:00
jpercivall
29fb9c9393
NIFI-259 Corrected some logic in AbstractListProcessor regarding being elected primary node and improved readability in GetHBase a smidge
2016-02-04 16:07:18 -05:00
jpercivall
88d4d2ce5f
NIFI-259 Corrected GetHttp state managment and added a new unit test
2016-02-03 20:04:39 -05:00
Matt Gilman
55b77fe03b
NIFI-1223: - Removing conf directory from unit test.
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-02-03 16:05:38 -05:00
Mark Payne
ef80549d63
Merge branch 'NIFI-1093' of https://github.com/olegz/nifi into NIFI-1093
2016-02-01 11:51:27 -05:00
Daniel Cave
171b9c4e94
NIFI-1093 - Added settings for processing JSON documents when validating against database columns to fail, log a warning, or ignore unmatched columns. Added tests for new settings.
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2016-02-01 11:45:15 -05:00
joewitt
1bf7a585b2
NIFI-1456 This closes #198 . reduced tests to 10MB instead of 100MB datasets and resolved IO issues which impact test stability
2016-01-31 21:56:53 -05:00
Richard Miskin
8ef337b65e
NIFI-1434 Prevent array index exception in PutEmail
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-01-30 10:56:31 -05:00
Oleg Zhurakousky
0126800201
NIFI-1093 added support for handling non-required columns
...
Mostly based on contribution from Daniel Cave
2016-01-29 13:41:27 -05:00
jpercivall
be27c07c7f
NIFI-1382 Created FetchDistributedMapCache processor
2016-01-29 12:12:23 -05:00
Mark Payne
a0224f1b4c
NIFI-1431: Added documentation about how ETag and LastModified dates are used by the Processor
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-28 16:02:05 -05:00
jpercivall
ee30b27cc8
NIFI-1396 Correcting PostHttp chunked encoding functionality
2016-01-28 14:50:22 -05:00
Matt Burgess
aa6bc5d505
NIFI-1409: Fix missing transfer on error in ExecuteSql
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-01-27 18:23:32 -05:00
Andy LoPresto
93aac8cff3
NIFI-1365
...
Added Groovy support for unit tests to pom with skeleton test.
Added Groovy unit tests for OCSPCertificateValidator.
Implemented positive & negative unit tests with cache injection for valid/revoked OCSP certificate.
Modified pom.xml to support Groovy unit tests with custom variable.
mvn clean test -Dgroovy=test
Added local cache injection into Groovy tests for OCSP certificate validation (see NIFI-1324 and NIFI-1364).
Set Java version to 1.7 for Groovy test src/target.
Moved Groovy unit test profile from nifi-web-security to root pom.
Added null check for algorithm argument in PGPUtil.
Changed buffer length check from ">= 0" to "> -1" because it was confusing other developers.
Resolved contrib-check line length issues.
Fixed contrib-check issues in OpenPGPKeyBasedEncryptorTest.
This closes #163
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-26 17:37:59 -05:00
Mark Payne
0e92607466
Merge branch 'NIFI-1412' of https://github.com/mattyb149/nifi into NIFI-1412
2016-01-26 12:30:19 -05:00
Richard Miskin
c16c8db459
NIFI-1421 Make namespace ordering deterministic in SplitXML
2016-01-26 05:35:07 +00:00
Bryan Bende
b7f7e6ed80
NIFI-1436 This closes #189 . Combining stop() and close() into a single method to simplify, and adding checks on stopped flag in the run method of SocketChannelDispatcher and DatagramChannelDispatcher to ensure the run() method exits as soon as possible upon close() being called
...
NIFI-1436 Adding synchronization on keys set in close() method based on Selector JavaDoc
Signed-off-by: joewitt <joewitt@apache.org>
2016-01-25 22:50:25 -05:00
joewitt
beb92492be
NIFI-1421 This closes #184 . Added content assertion to test and removed extra space
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2016-01-25 16:04:47 -05:00
Mark Payne
4a5fb37b33
Merge branch 'NIFI-1421' of https://github.com/rpmiskin/nifi into NIFI-1421
2016-01-25 15:38:08 -05:00
Matt Burgess
91e7ba84e0
NIFI-1412: Fix error during Avro conversion where no fields are present
2016-01-25 08:35:14 -05:00
Aldrin Piri
8d37af07b9
NIFI-1381 Removing the hardcoded jms:// prefix and instead deferring to the URI specified by the processor properties of PutJMS
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-01-24 23:10:47 -05:00
jpercivall
0db2dc9fc3
NIFI-1405 Adding option to invokeHttp to control using chunked encoding for http PUT and POST calls
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-24 15:52:05 -05:00
Richard Miskin
dfed7e727d
NIFI-1421 Added missing copyright notice to new test input
2016-01-23 08:52:54 +00:00
Mark Payne
93e2c52195
NIFI-1415: Do not enfoce that a password or Private Key Passphrase is set
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-22 20:46:14 -05:00
Mark Payne
92e6961b50
NIFI-1416: If FetchSFTP's Remote File has a directory name in it, do not include that as part of the 'filename' attribute but instead add a 'path' attribute
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-22 18:15:19 -05:00
Bryan Bende
1089f0a956
NIFI-1273 Adding ListenRELP processor which includes refactoring code that was previously part of ListenSyslog into a reusable framework for implementing listener processors, as well as back-end code for handling the RELP protocol. Addressing some feedback from review and fixing logging statements Addressing review feedback, added AsyncChannelDispatcher and made ChannelHandlerFactory use generics for the dispatcher This closes #179
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-22 16:28:58 -05:00
Oleg Zhurakousky
3db6fffa68
NIFI-1378: fixed JMS URI validation simplified JmsFactory check for SSL and scheme-less URIs ensured URI validation is handled by ActiveMqConnectionFactory ensured informative error messages are shown to the userm removed unneeded test, cleaned up unused imports
...
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #167
2016-01-21 22:29:50 -05:00
Richard Miskin
68a9375f3e
NIFI-1421 Update SplitXML to support namespace declarations
2016-01-21 22:19:15 +00:00
Mark Payne
f6ec437bc7
Merge branch 'master' into NIFI-259
2016-01-21 09:32:02 -05:00
Aldrin Piri
bc75dd3c17
NIFI-1406 Collecting the number of bytes sent regardless if one or multiple FlowFiles are sent.
...
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #176
2016-01-20 21:08:15 -05:00
Mark Payne
348831b20c
Merge branch 'NIFI-1414'
2016-01-20 17:31:34 -05:00
smarthi
e1588d4136
[NIFI-1411] - TestJdbcTypesDerby: java.sql.SQLSyntaxErrorException: TYPE 'DATETIME' does not exist
2016-01-20 16:51:58 -05:00
Aldrin Piri
9ebcc9e4fa
NIFI-1393 Providing the ability to send using gzip Content-Encoding in PostHTTP if the endpoint server supports it regardless if the processor is configured to send as a FlowFile This closes #175
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-20 16:46:57 -05:00
Mark Payne
d696391f76
NIFI-259: Update ZooKeeperStateServer so that the thread starting it doesn't block indefinitely, as this was causing NiFi to not shut down properly; applied patch for NIFI-1415
2016-01-20 11:52:41 -05:00
Mark Payne
7ef8af9eea
NIFI-259: Applied patch for NIFI-1414
2016-01-20 09:14:04 -05:00
Mark Payne
1845f6df8d
NIFI-1414: Ensure that the DirectoryStream is closed after streaming contents of a directory
2016-01-20 09:12:14 -05:00
Jeremy Dyer
8f688d4921
NIFI-1360 Add expression language support for "MergeContent" "Correlation Attribute Field" property
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-19 10:46:37 -08:00
Mark Payne
d6a21537c1
NIFI-259: Do not require the State File anymore, since state management is being used now
2016-01-19 11:03:31 -05:00
smarthi
9e9182aa63
- Unit test creates resources in HOME directory This closes #174
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-19 09:44:03 -05:00
Mark Payne
16dcf4595c
Merge branch 'master' into NIFI-259
2016-01-18 08:48:30 -05:00
Mark Payne
eba25ecaca
NIFI-259, NIFI-1339: Added OnConfigurationRestored annotation, always invoke onPropertyModified even on restart when properties are changed from defaults, as was done previously
2016-01-17 14:40:27 -05:00
Jeremy Dyer
ecb81ec113
NIFI-1362 Set mime.type attribute on response FlowFile based on InvokeHTTP response Content-Type
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-15 16:40:36 -05:00
Mark Payne
0cd6f80f36
NIFI-259: Bug fixes
2016-01-13 15:11:53 -05:00
Mark Payne
0151b1eed1
NIFI-259: Fixed checkstyle violations
2016-01-13 13:57:47 -05:00
Mark Payne
d39067ede6
NIFI-259: Update GetHBase to use new State Management feature; updated docs; bug fixes
2016-01-13 13:30:05 -05:00
Mark Payne
bbce596d74
NIFI-259: Updated GetHBase to use new State Management; bug fixes; updated docs
2016-01-13 12:47:08 -05:00
Andy LoPresto
c757c4d6ea
NIFI-1385: Resolved test for missing file which was failing on Windows due to differing error message.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2016-01-12 19:16:29 -05:00
Mark Payne
774c29a4da
NIFI-259: Added Stateful annotation as described on ticket
2016-01-12 15:28:35 -05:00
Mark Payne
b4bc105ea9
Merge branch 'nifi-1283' of https://github.com/jvwing/nifi
2016-01-12 10:49:04 -05:00
Mark Payne
f6b34cbbc5
NIFI-259: Removed bad unit test
2016-01-12 10:40:00 -05:00
Mark Payne
e559c68766
NIFI-259: Began updating processors to use new state management
2016-01-12 10:21:47 -05:00
Matt Gilman
44ffddd8b9
NIFI-1324:
...
- Addressing lengthy lines contrib-check issue.
- This closes #162
2016-01-12 09:42:31 -05:00
Andy LoPresto
ffbfffce6d
NIFI-1324:
...
Changed Maven dependencies for BouncyCastle bcprov and bcpg from jdk16:1.46 to jdk15on:1.53 (kept nifi-web-security on jdk16:1.46 because jdk15on:1.53 splits OCSP logic into new module bcpkix).
Added individual unit tests for PGP public keyring validation.
Passes all legacy unit tests.
Added TODOs for customizable brick encryption and refactoring shared code.
Cleaned up magic numbers to constants.
Added unit tests for OpenPGPPasswordBasedEncryptor (internal consistency and legacy file decrypt).
Began refactoring shared encrypt code from OpenPGP* implementations.
Extracted encrypt utility method from OpenPGPPasswordBasedEncryptor to PGPUtil class.
Added test resources (signed and unsigned key-encrypted files).
Added unit tests for OpenPGPKeyBasedEncryptor (internal consistency and external file decrypt).
Changed BC dependency for nifi-web-security to bcprov-jdk15on:1.53 and bcpkix-jdk15on:1.53.
Updated OCSPValidator to use new BC logic for OCSP validation. This code compiles but should be fully audited, as the legacy OCSP validation was not completely implemented.
Added skeleton of OCSP validator unit tests with successful keypair and certificate generation and signing code.
Added further unit tests for issued certificates.
Annotated unimplemented unit tests with note about Groovy integration.
Refactored Jersey call in OCSPCertificateValidator to internal method.
Added toString() to NiFi local OcspRequest.
Implemented positive & negative unit tests with cache injection for valid/revoked OCSP certificate.
Resolved contrib-check issues.
Removed ignored code in unit test.
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-12 09:22:51 -05:00
jpercivall
6b54753dbb
NIFI-1316 adding option to DetectDuplicate to not cache the entry identifier
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-11 22:59:24 -05:00
James Wing
c526656a22
NIFI-1283 Fixing ControllerStatusReportingTask loggers to use fully-qualified class name
2016-01-11 13:39:15 -08:00
Mark Payne
d2a969e3d6
NIFI-259: Initial implementation of State Management feature
2016-01-11 16:38:52 -05:00
joewitt
0c68e2c3a8
NIFI-1378 added validator to ensure the JMS URI has a scheme set
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-10 16:07:56 -05:00
Aldrin Piri
317b2f4a4a
NIFI-1361 Exposing Content-Type as a processor property for both InvokeHTTP and PostHTTP. This makes use of the mime.type attribute via the EL expression ${mime.type}, making more apparent to the user how this header is derived and allowing the explicit setting of a value.
2016-01-08 10:43:14 -05:00
jpercivall
6c46f22b62
NIFI-1327 NIFI-1353 Updating version of OkHttp and OkHttp-Digest
2016-01-07 15:51:49 -05:00
Aldrin Piri
47453d2c47
NIFI-1145 Providing delays in tests where resources are being initialized to allow heavily taxed environments sufficient time.
2016-01-07 12:05:23 -05:00
Andy LoPresto
8f0e7a1ac5
NIFI-1354
...
Generated new self-signed RSA-2048 key for FQDN localhost in keystore and exported to truststore.
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-06 18:16:37 -05:00
Joe Skora
de2dd93f26
NIFI-1300 Corrects inconsistent error behavior in PutJMS and added PutJMS unit testing
...
Reviewed by Tony Kurc (tkurc@apache.org ) This closes #145
2016-01-04 00:26:21 -05:00
gresockj
34bd2061f7
NIFI-1291: Adding BinFiles in nifi-processor-utilities, deprecating version in nifi-standard-processors. This closes #155 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-01-03 23:05:28 -05:00
Aldrin Piri
c696cb09b6
NIFI-1212 Treating text/csv files as plain text so they may also be displayed. This closes #154 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-01-03 16:12:06 -05:00
ricky
236a2b72b6
NIFI-1335: Allow UnpackContent to Handle application/x-tar mime.type
...
- Add additinal `mime.type` for tar archives (application/x-tar)
- Update `UnpackContent` tests to verify auto-detect format property
2016-01-03 11:42:18 -05:00
joewitt
e16a9a0c68
NIFI-1343 added unit tests to verify behavior
2016-01-01 14:08:46 -05:00
Mark Payne
02b325b07e
NIFI-1343: Make comparisons case sensitive if configured to do so. This closes #153 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-01-01 13:34:07 -05:00
James Harrison
03730adb3f
NIFI-1338 - Clarifying documentation for InvokeHTTP
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-31 13:48:00 -05:00
Bryan Bende
3189a13da1
NIFI-1328 Explicitly setting the parameters based on type in PutSQL, falling back to setObject()
...
This closes #146
2015-12-23 13:08:56 -05:00
Bryan Bende
8d46041a13
NIFI-1319 Updating JdbcCommon to check meta.isSigned(i) to determine if Avro schema should use a long or int
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-12-23 10:03:30 -05:00
joewitt
f4ac8d75c5
NIFI-1312-RC1 prepare for next development iteration
2015-12-19 00:41:04 -05:00
joewitt
d624ea4866
NIFI-1312-RC1 prepare release nifi-0.4.1-RC1
2015-12-19 00:40:53 -05:00
Mark Payne
bd4f31a4c2
NIFI-1279: Take the FlowFile's 1-up id into account for the newest and oldest flowfile prioritizers
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-18 12:08:31 -05:00
joewitt
d755e43ec8
NIFI-1122_nifi-0.4.0-RC2prepare for next development iteration
2015-12-08 13:00:10 -05:00
joewitt
b66c029090
NIFI-1122_nifi-0.4.0-RC2prepare release nifi-0.4.0-RC2
2015-12-08 12:59:59 -05:00
Mark Payne
d1395ea7ee
NIFI-1269: Ensure that we roll back session if not transferring FlowFile
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-07 21:18:33 -05:00
Mark Payne
0c7617b686
NIFI-1267: TestListFile attempts to ensure that files that are not readable are skipped but the assumptions made are not valid if running as root; removed this check, since it is not reliable
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-07 20:42:07 -05:00
Mark Payne
46623c2bf3
Merge branch 'NIFI-1261'
2015-12-07 15:13:12 -05:00
Mark Payne
bfe6fad502
NIFI-1261: Use consistent file separators for ListFile / TestListFile based on what the Operating System uses
2015-12-07 10:19:49 -05:00
Mark Payne
bd3fd870ac
NIFI-1263: Windows considers last mod time on both rolled over files to be the same, due to the way that windows computes the lastMod time. On linux and os x it is done differently. This is easily solved by adding a small sleep to the unit test before 'rolling over' the file so that the last mod date is different on all OS's, which yields the same behavior on all OS's
2015-12-07 09:53:33 -05:00
Andy LoPresto
f83e6d33c5
NIFI-1242:
...
Added logic and test resources to debug JCE unlimited strength cryptography policy issues and incorporated into processor property validation.
Excluded test resources from RAT check
Added KeyDerivationFunction enum.
Added kdf property in EncryptContent processor and provided to PasswordBasedEncryptor.
Added logic in PasswordBasedEncryptor to handle variable KDF.
Added unit tests for EncryptContent processor.
Added test resources and excluded from RAT check.
plain.txt: This is a plaintext message.
0s @ 12:20:32 $ openssl enc -aes-256-cbc -e -in plain.txt -out salted_raw.enc -k thisIsABadPassword -p
salt=31DC301A6C7B8A0B
key=CB878A6E167A5B530B8F2BD175E6359E3092AFF7C83274A22A5B421D79E599AC
iv =0C614A72FC06B454B84E035B3FA8F877
0s @ 12:20:44 $ xxd salted_raw.enc
0000000: 5361 6c74 6564 5f5f 31dc 301a 6c7b 8a0b Salted__1.0.l{..
0000010: 616b c65d f767 504d c085 ba7a c517 d0cb ak.].gPM...z....
0000020: 7832 211e f573 b6f1 ded2 8f59 88e8 088f x2!..s.....Y....
0s @ 20:14:00 $ openssl enc -aes-256-cbc -e -in plain.txt -out unsalted_raw.enc -k thisIsABadPassword -p -nosalt
key=711E85689CE7AFF6F410AEA43ABC5446842F685B84879B2E00F977C22B9E9A7D
iv =0C90ABF8ECE84B92BAA2CD448EC760F0
0s @ 20:14:17 $ xxd unsalted_raw.enc
0000000: 70cd 2984 fdbb 0e7c c01b 7206 88b1 6b50 p.)....|..r...kP
0000010: 5eeb e4f3 4036 773b 00ce dd8e 85d8 f90a ^...@6w;........
This closes #140
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-12-04 19:45:10 -05:00
Mark Payne
ee14d8f9dd
Merge branch 'NIFI-1249'
2015-12-04 16:38:49 -05:00
Mike Moser
14b3349e8d
NIFI-1254 remove Destination Type property from GetJMSQueue and GetJMSTopic
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-12-04 15:11:47 -05:00
Mark Payne
f378ee9021
NIFI-1249: Allow Processors to add their own variables to those referencable by Expression Language. Make ReplaceText allow users to reference back-references of regex matches
2015-12-04 13:17:37 -05:00
Mark Payne
dce039b54f
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-12-03 16:35:33 -05:00
Mark Payne
76914ead03
Merge branch 'NIFI-1246'
2015-12-03 16:35:19 -05:00
Mark Payne
3b7512ebac
NIFI-1246: When calculating relative paths, ensure that we have an absolute path
2015-12-03 16:06:03 -05:00
joewitt
3656c883c7
NIFI-1240 removing explicit reference to SUN provider. Not necessary for our use and ties us to Sun or JREs with Sun JCE available. Favoring no-args constructor instantiation of SecureRandom for greater flexibility in choosing from available CSPs. Deprecating the associated public constant for the PRNG.
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-12-03 14:46:02 -05:00
Daniel Cave
6bdcd3913f
nifi-1247 Correction for check of UnmatchedFieldBehaviour in generateUpdate to match generateInsert correct functionality
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-12-03 14:12:23 -05:00
Mark Payne
dae25accb7
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-12-03 12:13:33 -05:00
Mark Payne
ca79c146fd
NIFI-1241: Fixed checkstyle violation that slipped through
2015-12-03 12:13:23 -05:00
Bryan Bende
4653908b22
NIFI-1227 Adding SSL/TLS support to Syslog processors
...
-Removing connection creation from PutSyslog onScheduled, and reusing constructor in SSLSocketChannel
-Reducing visiblity of inner classes
2015-12-03 11:42:33 -05:00
Mark Payne
eceb1d20c7
NIFI-1241: Incorporate Boolean, Numeric, and Decimal data types for PutSQL
2015-12-03 10:02:36 -05:00
Mark Payne
6b75eda9ab
NIFI-1244: Incorporate Schema Name property
2015-12-03 09:48:27 -05:00
Andy LoPresto
bde270a911
NIFI-1240:
...
Added explicit reference to Sun Java Cryptographic Service Provider in PasswordBasedEncryptor.
Removed manual seeding of SecureRandom in PasswordBasedEncryptor.
This closes #138 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-12-02 19:37:09 -05:00
Mark Payne
02dc7e82b2
NIFI-1239: Fixed bug that caused the cache to hold 0 elements instead of 100
2015-12-02 16:39:40 -05:00
Bryan Bende
6a8c2dba12
NIFI-1237 Reducing number of messages sent in testBatching() to be less than size of ListenSyslog's internal queue
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-01 22:53:42 -05:00
Tony Kurc
3a7ddc6a35
NIFI-1054: Fixed DOS line endings in xml, java and js source files
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-01 22:49:51 -05:00
Mark Payne
e5281f1fc1
NIFI-1221: Support batching of Syslog messages
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-11-30 17:32:49 -05:00
Mark Payne
c59087bc3a
Merge branch 'NIFI-1049'
2015-11-30 16:02:36 -05:00
Mark Payne
07c619cf40
NIFI-1049: Added unit test to verify that reported bug was fixed; corrected a typo in log message
2015-11-30 15:37:58 -05:00
joewitt
67aed5eb92
NIFI-1224: made TestExecuteSQL about 25 seconds faster. Same logic just less to process
...
Reviewed and Amended (removed trailing whitespace) by Tony Kurc (tkurc@apache.org )
2015-11-26 00:33:54 -05:00
joewitt
a3cb803147
NIFI-1224: reduced size of test set produced and removed ignored memory test
...
Reviewed and amended (removed unused imports for checkstyle) by Tony Kurc (tkurc@apache.org )
2015-11-25 23:09:49 -05:00
joewitt
6692645209
NIFI-631: addressed environment specific unit test problems
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-25 22:06:45 -05:00
Joe Skora
226ac64ef9
NIFI-631: Correct the WritesAttributes descriptions.
...
Reviewed and Ammended (based on comments from dev list) by Tony Kurc (tkurc@apache.org )
2015-11-25 18:03:19 -05:00
Mark Payne
ba83bf9c05
NIFI-631: Initial implementation of FetchFile processor
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-25 18:03:19 -05:00
Joe Skora
4c4d62c61f
NIFI-631: Added ListFile processor.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-25 18:03:19 -05:00
Bryan Bende
4281a51c83
Merge branch 'NIFI-1208'
2015-11-23 21:35:57 -05:00
Mark Payne
4e2c94d659
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-23 14:18:50 -05:00
Mark Payne
2516b1dad2
NIFI-1171: Ensure that we pick up changes when files roll over and ensure that we don't pick up the rolled over file multiple times
2015-11-23 14:11:14 -05:00
Bryan Bende
3ffb455903
NIFI-1208 Adding context.yield() to Listen and Put syslog when there is nothing to do in onTrigger()
2015-11-23 10:30:33 -05:00
Joseph Percivall
cdd2c4f22c
NIFI-1086: Changed behavior on retrieval with no input file to RETRIEVE events, removed @TriggerWhenEmpty
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-21 19:20:33 -05:00
Bryan Bende
f1f67f6395
Fixing one-character typo in syslog attribute name
2015-11-20 10:45:21 -05:00
Joseph Percivall
8c2323dc8d
NIFI-1086 Provide refactoring of InvokeHTTP
...
NIFI-980 Add support for HTTP Digest authentication to InvokeHttp
NIFI-1080 Provide additional InvokeHttp unit tests
NIFI-1133 InvokeHTTP Processor does not save Location header for 3xx responses
NIFI-1009 InvokeHTTP should be able to be scheduled without any incoming connection for GET operations
NIFI-61 Multiple improvements for InvokeHTTP inclusive of providing unique tx.id across clusters, dynamic HTTP header properties
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-19 01:40:21 -05:00
Joe Percivall
fb335ea282
NIFI-1165: Fix for tests TestRouteText and PutHDFS which did not succeed on Windows
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-19 01:01:34 -05:00
Mark Payne
e862f7ff03
NIFI-1165: Use FileChannel instead of RandomAccessFile in order to avoid locking files in Windows
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-19 01:01:28 -05:00
Joseph Percivall
1e5cc070a3
NIFI-1081 Adding option to ExecuteStreamCommand to put output value to an attribute
...
Reviewed and amended (comments,whitespace,and some code readability (discussed in ticket)) by Tony Kurc (tkurc@apache.org )
2015-11-18 23:23:10 -05:00
Mark Payne
69bce2c2db
NIFI-1168: Ensure that processors with only looping
...
connections are scheduled to run, even if the connections have no FlowFiles;
expose these details to processor developers; update documentation
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-18 14:53:30 -05:00
Aldrin Piri
773576e041
NIFI-1108 Providing additional annotations on processors to ensure utilization of the InputRequirement annotation.
2015-11-18 13:56:21 -05:00
Mark Payne
911e1c5412
NIFI-1108: Updated processors to include the @InputRequirement annotation
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-18 13:47:59 -05:00
Tony Kurc
528dab78d6
NIFI-1073: Fixing coverity discovered errors. Resource leaks, and statics
...
Reviewed by Bryan Bende (bbende@apache.org )
2015-11-14 18:56:43 -05:00
Aldrin Piri
01539ed323
NIFI-1163: Providing handling of SSLContext creation in GetHTTP in case of only performing a one-way SSL request and accompanying test to verify the configuration/usage.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-14 18:47:50 -05:00
Tony Kurc
e6086420aa
NIFI-1158 Default timestamp based on now
2015-11-12 23:11:43 -05:00
Mark Payne
0900fb80c9
NIFI-1153: If no incoming FlowFile, don't try to transfer null
...
Reviewed by Bryan Bende (bbende@apache.org )
Amended based on review (change to a log message) by Tony Kurc (tkurc@apache.org )
2015-11-12 22:41:57 -05:00
joewitt
02102ea1c2
Revert "NIFI-1134". This was removed because they looked like floating classes. But in reality they are used to make jars which we use to test the build. However, we really need the test to work differently but until that is fixed these must stay.
...
This reverts commit 41f3875347
.
2015-11-12 18:00:40 -05:00
Mark Payne
7a165b62cc
Merge branch 'NIFI-994'
2015-11-11 16:05:40 -05:00
Mark Payne
e7c6c7cae9
NIFI-1083: Added a Grouping Regular Expression property for grouping lines of text
2015-11-11 10:19:07 -05:00
Joseph Percivall
3e538d9007
NIFI-1083 Created a processor that routes lines of text based on different matching and routing strategies
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-11 09:12:47 -05:00
Joseph Percivall
d887d8fdf0
NIFI-993 added expression language support to GetHTTP for the filename and URL properties
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-11 08:05:23 -05:00
Mark Payne
7b9c8df6c5
NIFI-994: Fixed issue that could result in data duplication if more than 1 rollover of tailed file has occurred on restart of Processor
2015-11-10 16:53:29 -05:00
Mark Payne
72008035b1
Merge branch 'NIFI-1000'
2015-11-10 15:02:02 -05:00
Mark Payne
8f942fcdcc
NIFI-1000: Fixed checkstyle violation in TestGetJSMQueue use activemq-broker with test scope and activemq-client with default scope rather than pulling in activemq-all; this reduces size of standard nar from 30 MB to 18 MB
2015-11-10 14:31:20 -05:00
Oleg Zhurakousky
8699e35108
NIFI-1000 addressed PR comments
2015-11-10 12:13:16 -05:00
Oleg Zhurakousky
ef0be5a5d6
NIFI-1000 Fixed JmsFactory to properly obtain destiniation name
...
Re-enabled JMS Tests that were annotated with @Ignore
2015-11-09 18:35:31 -05:00
joewitt
41f3875347
NIFI-1134
2015-11-09 15:37:40 -05:00
joewitt
99629646fe
NIFI-1122 moved to 0.4.0-SNAPSHOT
2015-11-06 23:41:15 -05:00
Bryan Bende
618f22e110
NIFI-274 - Fixing TestListenSyslog, fixing default buffer size to be bytes, adding syslog.protocol to attributes
...
- Adding syslog.port to ListenSyslog attributes, logging at warn level when rejecting tcp connections
- Adding @InputRequirement to processors and adding appropriate send and receive provenance events
2015-11-04 18:01:59 -05:00
Tony Kurc
5611dac3f8
NIFI-274 - added use of Selectors for TCP and UDP connections. Added a max connections to the TCP thread
...
- Added comments and code review changes
- fixed fixbugs bug
2015-11-04 18:00:18 -05:00
Bryan Bende
9c542432da
NIFI-274 Adding ListenSyslog and PutSyslog to standard processors.
...
- Refactoring connection handling on put side, removing number of buffers from properties and basing it off concurrent tasks for the processor.
- Refactoring some of the TCP handling so it keeps reading from a connection until the client closes it
- Adding an error queue
- Adding a sender field on the syslog event to record the system that sent the message
2015-11-04 17:56:13 -05:00
Mark Payne
fedbe40313
NIFI-1103: Added InputRequirement annotation
2015-11-04 11:11:33 -05:00