ba56774fa1
NIFI-4151: Updated UpdateAttribute to only create JAXB Context once; Minor performance tweaks to standard validators and StatusMerge.prettyPrint; updated AbstractConfiguredComponent to not create a new ValidationContext each time that validate is called but only when needed; updated FlowController, StandardControllerServiceProvider, and StandardProcessGroup so that component lookups can be performed using a ConcurrentMap at FlowController level instead of having to perform a depth-first search through all ProcessGroups when calling findProcessor(), findProcessGroup(), findXYZ()
...
This closes #1979
2017-07-06 13:43:56 -04:00
cff81c0cd2
NIFI-4153: Use a LinkedBlockingQueue instead of a SynchronousQueue for Request Replicator's thread pool so that requests will queue when all threads are active, instead of throwing an Exception. This closes #1980
2017-07-06 10:11:48 -04:00
e6b166a3a2
NIFI-552: added regex properties for include and ignore filters in LogAttribute
...
This closes #1981
Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-07-05 21:21:50 -04:00
47eece5798
NIFI-3193: added ability to authenticate using cert common names
...
This closes #1971 .
Signed-off-by: Tony Kurc <tkurc@apache.org>
Also reviewed by Pierre Villard <pierre.villard.fr@gmail.com>
2017-07-05 15:28:54 -04:00
7843b885ee
NIFI-4144 - added min/max age to ListHDFS processor
...
This closes #1966 .
Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-07-04 21:18:43 -04:00
8b5342dec0
NIFI-3974 - Added charset in LogAttribute
...
This closes #1967
Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-07-02 12:03:07 -04:00
902b6e205d
NIFI-4131 - GFT warning message when badly setting relationships
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1954
2017-06-30 15:12:10 -04:00
7f4cfd51ea
NIFI-3897: If swapping data into queue and an unexpected exception/error is thrown, do not lose track of the swap file
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1960 .
2017-06-30 13:53:05 +02:00
cdc154f7c8
NIFI-4046: If we are unable to parse out any records from a Kafka Mesaage with ConsumeKafkaRecord, then we should route all of the bytes received to 'parse.failure'
...
NIFI-4046: Addressed issue of Record Writer failing with ConsumeKafkaRecord
This closes #1906 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-30 17:56:14 +09:00
58a623dfa2
NIFI-4037 added InvokeGRPC processor, with proto service IDL
...
NIFI-4038 added ListenGRPC processor
This closes #1947
Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-06-29 22:01:22 -04:00
3bf1d12706
NIFI-4125 Added secure transform feature and configuration to TransformXML processor to mitigate XXE file system leaks.
...
This closes #1946 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-29 10:40:33 -07:00
5172797448
NIFI-4122 Added the ability to combine multiple Mongo result documents into a single output JSON array.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1948 .
2017-06-29 12:43:52 +02:00
82ef671953
NIFI-4007 - Update azure EventHubs client to latest version
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1880 .
2017-06-29 09:30:39 +02:00
bdfd710692
NIFI-3983 - Support ability to make JMS 2.0 durable subscriptions on Topic
...
Add logic in Consumer adding support for all topic consumer combinations, non-durable, durable, shared, durable-shared.
Add new optional config option to supply subscription name.
Add new optional config option to supply clientId.
This closes #1863 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-29 10:23:15 +09:00
9bfa7469cb
NIFI-4137: Add support for UTF-8 in GetFTP and PutFTP
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1957
2017-06-28 16:41:14 -04:00
c99c036c20
NIFI-4045:
...
- Addressing issues causing the eventId to not be relayed when submitting a lineage request under certain conditions.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1903 .
2017-06-27 21:48:55 +02:00
1e7eceee84
NIFI-4126 - Add SupportBatching, SideEffectFree and EventDriven annotations to ExtractGrok
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1950 .
2017-06-27 20:56:56 +02:00
202eb5ccbe
NIFI-4119 - Improve UX of canvas label configuration by providing immediate focus to value field
...
This closes #1940 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-27 10:38:35 -07:00
c37aed4de2
NIFI-4128 Added "All" MessageAttributeNames to GetSQS processor ReceiveMessageRequest
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #1949 .
2017-06-26 22:25:16 -07:00
24e2981012
[NIFI-4117] update connection config prioritizers to be contained within their parent element
...
This closes #1944 .
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2017-06-26 20:25:50 +02:00
68b42c9e54
NIFI-4055: Add a compression option to AvroRecordSetWriter
...
This closes #1909 .
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2017-06-26 19:16:31 +02:00
91ed96f8c4
NIFI-4040: Continue if SFTP failed getting user home directory
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1898 .
2017-06-26 19:09:22 +02:00
69613f29c9
NIFI-4050: Fixed NPE at AbstractConfiguredComponent.validate
...
This closes #1905 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-23 13:58:22 -04:00
47165afc0c
NIFI-4073 - fix duplicated stack trace
...
This closes #1916 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-23 11:20:07 -04:00
8878d732dd
NIFI-4103: Return an empty Optional if an IP address cannot be found
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1933
2017-06-23 11:14:57 -04:00
ff65b42e88
NIFI-4110 Added Thread.sleep() to ensure provenance event indexing occurs before retrieval and unit test passes.
...
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
This closes #1935
2017-06-23 08:48:34 -04:00
7c27d4c588
NIFI-3992: Added Original Headers to Include/Exclude
...
Some headers can cause problems with message parsing, specifically the 'Content-Type' header.
If an email contains attachments, ConsumeEWS may generate emails where the attachments cannot be extracted.
This closes #1867 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-23 17:38:19 +09:00
253ea2e73b
NIFI-4095 Changed minimum capture group count in ExtractText from 1 to 0.
...
Added unit test and removed obsolete test.
Added custom validation to enforce capture group if "include capture group 0" is false.
2017-06-22 23:31:35 +02:00
5c755c006b
NIFI-4017: Emit provenance event from Notify.
...
This closes #1890 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 16:49:31 -04:00
f54e146561
NIFI-4085 Add exception in log message when (S)FTP listing fails
...
This closes #1929 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 16:06:18 -04:00
5b82b735ab
NIFI-4106 Increase log level of user authentication rejection to warn.
...
This closes #1934 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 14:03:25 -04:00
668a64cd56
NIFI-1586 Implements autopurging of transaction log and snapshot files
...
When NiFi is clustered, and autopurge.purgeInterval is greater than 1, the DatadirCleanupManager will be started in order to automatically purge transaction log and snapshot files based on the autopurge settings in zookeeper.properties
This closes #1928 .
2017-06-22 09:30:38 -04:00
c99100c934
NIFI-4010 Enables EL on Fetch/List/PutSFTP and List/Fetch/Put/DeleteHDFS processor properties
...
FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period
This closes #1148
This closes #1930 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:49 -04:00
59a32948ea
NIFI-2923 Added evaluation of attribute expressions for Kerberos principal and keytab
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:28 -04:00
86fa1bba4f
NIFI-2923 Add expression language support to Kerberos parameters used by processors
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:27 -04:00
73e601bc55
NIFI-4102: If first line read does not match Grok expression, skip line
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1932
2017-06-21 15:10:22 -04:00
77e49b749e
NIFI-4075 Updating 'addRemoteProcessGroup' in StandardFlowSerializer to properly use ScheduledStateLookup. This closes #1922 .
2017-06-21 14:20:22 -04:00
aabd4a25d2
NIFI-4043 Initial commit of nifi-redis-bundle
...
NIFI-4061 Initial version of RedisStateProvider
- Adding PropertyContext and updating existing contexts to extend it
- Added embedded Redis for unit testing
- Added wrapped StateProvider with NAR ClassLoader in StandardStateManagerProvider
- Updating state-management.xml with config for RedisStateProvider
- Renaming tests that use RedisServer to be IT tests so they don't run all the time
This closes #1918 .
2017-06-21 12:47:19 -04:00
6bc6f955c0
NIFI-4059:
...
- Introducing the LdapUserGroupProvider.
- Updating documentation accordingly.
- Moving the IdentityMapping utilities so they were accessible.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1923 .
2017-06-19 19:25:33 +02:00
ad6af1d941
NIFI-3994 Add Create Template to the context menu
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #1883 .
2017-06-17 16:46:31 -07:00
5a7e6c6ac1
NIFI-4064 Make sure that Funnels with queued incoming FlowFiles, but no outgoing connections yield rather than continually check to run.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1914 .
2017-06-17 15:50:40 +02:00
2800df30d3
NIFI-2692
...
- Removing problematic timeout for SMTP Listen
- Converting anonymous method to lambda
- Adding debug and error logging
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1924 .
2017-06-17 15:22:33 +02:00
490e1da5db
NIFI-4019:
...
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
2017-06-15 14:17:35 -04:00
c0ad5bcc7b
NIFI-1921: Fixed bug in how average lineage duration was calculated for cluster stat
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1912
2017-06-13 12:29:03 -04:00
2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure
2017-06-12 16:36:23 -04:00
de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient
...
To be used with cache engines that does not have revision number.
NIFI-4049: Refactor AtomicDistributedMapCacheClient
Removed old methods completely.
This closes #1904 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-12 10:34:48 -04:00
7761903352
NIFI-4041: Add file.size attribute to ListFTP and ListSFTP
...
This closes #1899 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-12 10:53:09 +09:00
e7dcb6f6c5
NIFI-3921: Allow Record Writers to inherit schema from Record
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1902
2017-06-09 16:13:25 -04:00
4ed7511bee
NIFI-3653: - Introducing UserGroup and Policy provider interfaces.
...
- Introducing FileUserGroupProvider and FileAccessPolicyProvider.
- Refactoring FileAuthorizer to utilize the file based implementations.
- Introducing the StandardManagedAuthorizer.
- Decorating the configured ManagedAuthorizer to ensure integrity checks are still performed.
- Loading user groups if possible to use during access decisions.
- Merging responses for requests for AccessPolicies, Users, and UserGroups.
- Adding unit tests as appropriate.
- Adding methods to the User, Group, and AccessPolicy builder that more easily supports generating UUIDs.
- Fixing typo when seeding policies during startup.
- Fixing type in documentation and error messages.
This closes #1897 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-09 13:54:10 -04:00
d8dc2bb00b
NIFI-4047: Addressed issue with inconsistent Lexical policy between used cached schemas and non-cached schemas
...
This closes #1907
Signed-off-by: Joe Percivall <JPercivall@apache.org>
2017-06-09 12:05:11 -04:00
Mark Payne
m-hogue
Pierre Villard
yuri1969
Mike Thomsen
Sreeram Garlapati
Michael Andre Pearce
Matt Burgess
Matt Gilman
Andre F de Miranda
kwydler
Scott Aslan
Steve Champagne
Koji Kawamura
Andy LoPresto
patricker
Niels Zeilemaker
Jeff Storck
Maurizio Colleluori
Joe Percivall
Bryan Bende
Wesley-Lawrence
Chris Herrera