Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,882 Commits 146 Branches 201 Tags 402 MiB
Commit Graph

3882 Commits

Author SHA1 Message Date
Andrew Lim 0c27a0888d
NIFI-3880 Added complete TLS Toolkit options to Admin Guide. 
This closes #1965.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-30 14:45:35 -07:00
Pierre Villard 902b6e205d NIFI-4131 - GFT warning message when badly setting relationships 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1954
 2017-06-30 15:12:10 -04:00
Mark Payne 7f4cfd51ea NIFI-3897: If swapping data into queue and an unexpected exception/error is thrown, do not lose track of the swap file 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1960.
 2017-06-30 13:53:05 +02:00
Mark Payne cdc154f7c8 NIFI-4046: If we are unable to parse out any records from a Kafka Mesaage with ConsumeKafkaRecord, then we should route all of the bytes received to 'parse.failure' 
NIFI-4046: Addressed issue of Record Writer failing with ConsumeKafkaRecord

This closes #1906.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-06-30 17:56:14 +09:00
m-hogue 58a623dfa2 NIFI-4037 added InvokeGRPC processor, with proto service IDL 
NIFI-4038 added ListenGRPC processor

This closes #1947

Signed-off-by: Tony Kurc <tkurc@apache.org>
 2017-06-29 22:01:22 -04:00
yuri1969 3bf1d12706
NIFI-4125 Added secure transform feature and configuration to TransformXML processor to mitigate XXE file system leaks. 
This closes #1946.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-29 10:40:33 -07:00
Andrew Lim 3089d9dce0 NIFI-4138 Add Component Alignment to User Guide 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1959
 2017-06-29 11:54:56 -04:00
Mike Thomsen 5172797448 NIFI-4122 Added the ability to combine multiple Mongo result documents into a single output JSON array. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1948.
 2017-06-29 12:43:52 +02:00
Sreeram Garlapati 82ef671953 NIFI-4007 - Update azure EventHubs client to latest version 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1880.
 2017-06-29 09:30:39 +02:00
Michael Andre Pearce bdfd710692 NIFI-3983 - Support ability to make JMS 2.0 durable subscriptions on Topic 
Add logic in Consumer adding support for all topic consumer combinations, non-durable, durable, shared, durable-shared.
Add new optional config option to supply subscription name.
Add new optional config option to supply clientId.

This closes #1863.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-06-29 10:23:15 +09:00
Matt Burgess 9bfa7469cb NIFI-4137: Add support for UTF-8 in GetFTP and PutFTP 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1957
 2017-06-28 16:41:14 -04:00
Matt Gilman c99c036c20 NIFI-4045: 
- Addressing issues causing the eventId to not be relayed when submitting a lineage request under certain conditions.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1903.
 2017-06-27 21:48:55 +02:00
Andre F de Miranda 1e7eceee84 NIFI-4126 - Add SupportBatching, SideEffectFree and EventDriven annotations to ExtractGrok 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1950.
 2017-06-27 20:56:56 +02:00
yuri1969 202eb5ccbe
NIFI-4119 - Improve UX of canvas label configuration by providing immediate focus to value field 
This closes #1940.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-27 10:38:35 -07:00
kwydler c37aed4de2 NIFI-4128 Added "All" MessageAttributeNames to GetSQS processor ReceiveMessageRequest 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1949.
 2017-06-26 22:25:16 -07:00
Andy LoPresto 2b5aaec6d9
NIFI-3716 Updated flowanalyzer version to 1.4.0-SNAPSHOT in pom.xml. 2017-06-26 17:06:49 -07:00
Eric 7314066b6a
NIFI-3716 Created flow analyzer in NiFi Toolkit. 
This closes #1747.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-26 15:24:30 -07:00
Scott Aslan 24e2981012 [NIFI-4117] update connection config prioritizers to be contained within their parent element 
This closes #1944.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2017-06-26 20:25:50 +02:00
Steve Champagne 68b42c9e54 NIFI-4055: Add a compression option to AvroRecordSetWriter 
This closes #1909.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2017-06-26 19:16:31 +02:00
Koji Kawamura 91ed96f8c4 NIFI-4040: Continue if SFTP failed getting user home directory 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1898.
 2017-06-26 19:09:22 +02:00
Koji Kawamura 69613f29c9
NIFI-4050: Fixed NPE at AbstractConfiguredComponent.validate 
This closes #1905.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-23 13:58:22 -04:00
Pierre Villard 47165afc0c
NIFI-4073 - fix duplicated stack trace 
This closes #1916.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-23 11:20:07 -04:00
Mark Payne 8878d732dd NIFI-4103: Return an empty Optional if an IP address cannot be found 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1933
 2017-06-23 11:14:57 -04:00
Andy LoPresto ff65b42e88 NIFI-4110 Added Thread.sleep() to ensure provenance event indexing occurs before retrieval and unit test passes. 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1935
 2017-06-23 08:48:34 -04:00
patricker 7c27d4c588 NIFI-3992: Added Original Headers to Include/Exclude 
Some headers can cause problems with message parsing, specifically the 'Content-Type' header.
If an email contains attachments, ConsumeEWS may generate emails where the attachments cannot be extracted.

This closes #1867.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-06-23 17:38:19 +09:00
Andy LoPresto 253ea2e73b NIFI-4095 Changed minimum capture group count in ExtractText from 1 to 0. 
Added unit test and removed obsolete test.
Added custom validation to enforce capture group if "include capture group 0" is false.
 2017-06-22 23:31:35 +02:00
Koji Kawamura 5c755c006b
NIFI-4017: Emit provenance event from Notify. 
This closes #1890.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-22 16:49:31 -04:00
Pierre Villard f54e146561
NIFI-4085 Add exception in log message when (S)FTP listing fails 
This closes #1929.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-22 16:06:18 -04:00
Niels Zeilemaker 5b82b735ab
NIFI-4106 Increase log level of user authentication rejection to warn. 
This closes #1934.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-22 14:03:25 -04:00
Jeff Storck 668a64cd56 NIFI-1586 Implements autopurging of transaction log and snapshot files 
When NiFi is clustered, and autopurge.purgeInterval is greater than 1, the DatadirCleanupManager will be started in order to automatically purge transaction log and snapshot files based on the autopurge settings in zookeeper.properties

This closes #1928.
 2017-06-22 09:30:38 -04:00
Jeff Storck c99100c934
NIFI-4010 Enables EL on Fetch/List/PutSFTP and List/Fetch/Put/DeleteHDFS processor properties 
FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes #1148
This closes #1930.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-21 17:14:49 -04:00
Maurizio Colleluori 59a32948ea
NIFI-2923 Added evaluation of attribute expressions for Kerberos principal and keytab 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-21 17:14:28 -04:00
Maurizio Colleluori 86fa1bba4f
NIFI-2923 Add expression language support to Kerberos parameters used by processors 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-21 17:14:27 -04:00
Mark Payne 73e601bc55 NIFI-4102: If first line read does not match Grok expression, skip line 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1932
 2017-06-21 15:10:22 -04:00
Pierre Villard ba3372a1dc NIFI-4079 Add concat in Record Path Guide. This closes #1920. 2017-06-21 14:56:07 -04:00
Joe Percivall 77e49b749e NIFI-4075 Updating 'addRemoteProcessGroup' in StandardFlowSerializer to properly use ScheduledStateLookup. This closes #1922. 2017-06-21 14:20:22 -04:00
Bryan Bende aabd4a25d2 NIFI-4043 Initial commit of nifi-redis-bundle 
NIFI-4061 Initial version of RedisStateProvider
- Adding PropertyContext and updating existing contexts to extend it
- Added embedded Redis for unit testing
- Added wrapped StateProvider with NAR ClassLoader in StandardStateManagerProvider
- Updating state-management.xml with config for RedisStateProvider
- Renaming tests that use RedisServer to be IT tests so they don't run all the time

This closes #1918.
 2017-06-21 12:47:19 -04:00
Matt Gilman 6bc6f955c0 NIFI-4059: 
- Introducing the LdapUserGroupProvider.
- Updating documentation accordingly.
- Moving the IdentityMapping utilities so they were accessible.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1923.
 2017-06-19 19:25:33 +02:00
Scott Aslan ad6af1d941 NIFI-3994 Add Create Template to the context menu 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1883.
 2017-06-17 16:46:31 -07:00
Wesley-Lawrence 5a7e6c6ac1 NIFI-4064 Make sure that Funnels with queued incoming FlowFiles, but no outgoing connections yield rather than continually check to run. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1914.
 2017-06-17 15:50:40 +02:00
Chris Herrera 2800df30d3 NIFI-2692 
- Removing problematic timeout for SMTP Listen
- Converting anonymous method to lambda
- Adding debug and error logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1924.
 2017-06-17 15:22:33 +02:00
Matt Gilman 490e1da5db NIFI-4019: 
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
 2017-06-15 14:17:35 -04:00
Mark Payne c0ad5bcc7b NIFI-1921: Fixed bug in how average lineage duration was calculated for cluster stat 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1912
 2017-06-13 12:29:03 -04:00
Bryan Bende 2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure 2017-06-12 16:36:23 -04:00
Koji Kawamura de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient 
To be used with cache engines that does not have revision number.

NIFI-4049: Refactor AtomicDistributedMapCacheClient

Removed old methods completely.

This closes #1904.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-12 10:34:48 -04:00
Yolanda M. Davis 8ef4fddddd
NIFI-3696 - ConfigMigration and FileManager tools 
This closes #1889.

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2017-06-12 09:50:02 -04:00
Koji Kawamura 7761903352 NIFI-4041: Add file.size attribute to ListFTP and ListSFTP 
This closes #1899.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-06-12 10:53:09 +09:00
Mark Payne e7dcb6f6c5 NIFI-3921: Allow Record Writers to inherit schema from Record 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1902
 2017-06-09 16:13:25 -04:00
Matt Gilman 4ed7511bee
NIFI-3653: - Introducing UserGroup and Policy provider interfaces. 
- Introducing FileUserGroupProvider and FileAccessPolicyProvider.
- Refactoring FileAuthorizer to utilize the file based implementations.
- Introducing the StandardManagedAuthorizer.
- Decorating the configured ManagedAuthorizer to ensure integrity checks are still performed.
- Loading user groups if possible to use during access decisions.
- Merging responses for requests for AccessPolicies, Users, and UserGroups.
- Adding unit tests as appropriate.
- Adding methods to the User, Group, and AccessPolicy builder that more easily supports generating UUIDs.
- Fixing typo when seeding policies during startup.
- Fixing type in documentation and error messages.

This closes #1897.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-09 13:54:10 -04:00
Andrew Lim f447fc73fa NIFI-4048 Added nifi.cluster.node.protocol.max.threads to Cluster Node Properties section of Admin Guide 
This closes #1908

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2017-06-09 12:59:22 -04:00