Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-09 03:25:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,657 Commits 147 Branches 203 Tags
Commit Graph

3657 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andy LoPresto
253ea2e73b NIFI-4095 Changed minimum capture group count in ExtractText from 1 to 0. 
Added unit test and removed obsolete test.
Added custom validation to enforce capture group if "include capture group 0" is false.
 2017-06-22 23:31:35 +02:00
Koji Kawamura
5c755c006b
NIFI-4017: Emit provenance event from Notify. 
This closes #1890.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-22 16:49:31 -04:00
Pierre Villard
f54e146561
NIFI-4085 Add exception in log message when (S)FTP listing fails 
This closes #1929.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-22 16:06:18 -04:00
Niels Zeilemaker
5b82b735ab
NIFI-4106 Increase log level of user authentication rejection to warn. 
This closes #1934.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-22 14:03:25 -04:00
Jeff Storck
668a64cd56 NIFI-1586 Implements autopurging of transaction log and snapshot files 
When NiFi is clustered, and autopurge.purgeInterval is greater than 1, the DatadirCleanupManager will be started in order to automatically purge transaction log and snapshot files based on the autopurge settings in zookeeper.properties

This closes #1928.
 2017-06-22 09:30:38 -04:00
Jeff Storck
c99100c934
NIFI-4010 Enables EL on Fetch/List/PutSFTP and List/Fetch/Put/DeleteHDFS processor properties 
FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes #1148
This closes #1930.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-21 17:14:49 -04:00
Maurizio Colleluori
59a32948ea
NIFI-2923 Added evaluation of attribute expressions for Kerberos principal and keytab 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-21 17:14:28 -04:00
Maurizio Colleluori
86fa1bba4f
NIFI-2923 Add expression language support to Kerberos parameters used by processors 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-21 17:14:27 -04:00
Mark Payne
73e601bc55 NIFI-4102: If first line read does not match Grok expression, skip line 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1932
 2017-06-21 15:10:22 -04:00
Pierre Villard
ba3372a1dc NIFI-4079 Add concat in Record Path Guide. This closes #1920. 2017-06-21 14:56:07 -04:00
Joe Percivall
77e49b749e NIFI-4075 Updating 'addRemoteProcessGroup' in StandardFlowSerializer to properly use ScheduledStateLookup. This closes #1922. 2017-06-21 14:20:22 -04:00
Bryan Bende
aabd4a25d2 NIFI-4043 Initial commit of nifi-redis-bundle 
NIFI-4061 Initial version of RedisStateProvider
- Adding PropertyContext and updating existing contexts to extend it
- Added embedded Redis for unit testing
- Added wrapped StateProvider with NAR ClassLoader in StandardStateManagerProvider
- Updating state-management.xml with config for RedisStateProvider
- Renaming tests that use RedisServer to be IT tests so they don't run all the time

This closes #1918.
 2017-06-21 12:47:19 -04:00
Matt Gilman
6bc6f955c0 NIFI-4059: 
- Introducing the LdapUserGroupProvider.
- Updating documentation accordingly.
- Moving the IdentityMapping utilities so they were accessible.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1923.
 2017-06-19 19:25:33 +02:00
Scott Aslan
ad6af1d941 NIFI-3994 Add Create Template to the context menu 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1883.
 2017-06-17 16:46:31 -07:00
Wesley-Lawrence
5a7e6c6ac1 NIFI-4064 Make sure that Funnels with queued incoming FlowFiles, but no outgoing connections yield rather than continually check to run. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1914.
 2017-06-17 15:50:40 +02:00
Chris Herrera
2800df30d3 NIFI-2692 
- Removing problematic timeout for SMTP Listen
- Converting anonymous method to lambda
- Adding debug and error logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1924.
 2017-06-17 15:22:33 +02:00
Matt Gilman
490e1da5db NIFI-4019: 
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
 2017-06-15 14:17:35 -04:00
Mark Payne
c0ad5bcc7b NIFI-1921: Fixed bug in how average lineage duration was calculated for cluster stat 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1912
 2017-06-13 12:29:03 -04:00
Bryan Bende
2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure 2017-06-12 16:36:23 -04:00
Koji Kawamura
de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient 
To be used with cache engines that does not have revision number.

NIFI-4049: Refactor AtomicDistributedMapCacheClient

Removed old methods completely.

This closes #1904.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-12 10:34:48 -04:00
Yolanda M. Davis
8ef4fddddd
NIFI-3696 - ConfigMigration and FileManager tools 
This closes #1889.

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2017-06-12 09:50:02 -04:00
Koji Kawamura
7761903352 NIFI-4041: Add file.size attribute to ListFTP and ListSFTP 
This closes #1899.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-06-12 10:53:09 +09:00
Mark Payne
e7dcb6f6c5 NIFI-3921: Allow Record Writers to inherit schema from Record 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1902
 2017-06-09 16:13:25 -04:00
Matt Gilman
4ed7511bee
NIFI-3653: - Introducing UserGroup and Policy provider interfaces. 
- Introducing FileUserGroupProvider and FileAccessPolicyProvider.
- Refactoring FileAuthorizer to utilize the file based implementations.
- Introducing the StandardManagedAuthorizer.
- Decorating the configured ManagedAuthorizer to ensure integrity checks are still performed.
- Loading user groups if possible to use during access decisions.
- Merging responses for requests for AccessPolicies, Users, and UserGroups.
- Adding unit tests as appropriate.
- Adding methods to the User, Group, and AccessPolicy builder that more easily supports generating UUIDs.
- Fixing typo when seeding policies during startup.
- Fixing type in documentation and error messages.

This closes #1897.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-09 13:54:10 -04:00
Andrew Lim
f447fc73fa NIFI-4048 Added nifi.cluster.node.protocol.max.threads to Cluster Node Properties section of Admin Guide 
This closes #1908

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2017-06-09 12:59:22 -04:00
Mark Payne
d8dc2bb00b NIFI-4047: Addressed issue with inconsistent Lexical policy between used cached schemas and non-cached schemas 
This closes #1907

Signed-off-by: Joe Percivall <JPercivall@apache.org>
 2017-06-09 12:05:11 -04:00
Matt Gilman
cc741d2be6
NIFI-3997: 
- Bumping to next minor version.
 2017-06-08 15:22:51 -04:00
Matt Gilman
1bf0a1a849
Merge branch 'NIFI-3997-RC1' 2017-06-08 14:30:10 -04:00
Bryan Bende
b0c9428776 NIFI-4030 Populating default values on GenericRecord from Avro schema if not present in RecordSchema 
This closes #1896.
 2017-06-07 13:59:40 -04:00
Steve Champagne
45e035686f
NIFI-4029: Allow null Avro default values in HortonworksSchemaRegistry 
This closes #1894.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-07 12:03:53 -04:00
Matt Gilman
c86190c513 NIFI-4027: - Fixing the positioning of the tooltips in the component toolbar. 
This closes #1893

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2017-06-06 17:35:43 -04:00
Joe Gresock
3ef0fa48da NIFI-4014: Correcting Event Type text in S2S provenance reporting task 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1887.
 2017-06-06 12:06:04 +02:00
Koji Kawamura
e1880785d0
NIFI-4021: Fix StandardFlowSynchronizerSpec to pass independently. 
This closes #1892.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-05 19:25:07 -07:00
Andy LoPresto
f31f2a5f26
NIFI-3836 Added check for root user in test that depends on unreadable file. 
This closes #1865.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-05 18:58:07 -07:00
Matt Gilman
6ee12e9b47
NIFI-3997-RC1prepare for next development iteration 2017-06-05 11:07:43 -04:00
Matt Gilman
ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1 rel/nifi-1.3.0 nifi-1.3.0-RC1 2017-06-05 11:07:28 -04:00
Andre F de Miranda
082b99640e NIFI-4001 - Bump ParCEFone version 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1875.
 2017-06-03 12:11:38 +02:00
Andre F de Miranda
4d78052dd4 NIFI-1709 - Introduce logic to probe Linux version using /etc/os-release to nifi.sh 
Add explicit paths to support SLES 11 SP4 / OpenSUSE init.d layout

This closes #1794
 2017-06-03 08:12:52 +10:00
Aldrin Piri
39ad7a369e
NIFI-4011 Updating Docker Hub image version information to accommodate next release. 
This closes #1884.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2017-06-02 15:04:41 -04:00
Mark Payne
32314d70fd NIFI-4009: Added support for several key functions in RecordPath 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1881
 2017-06-02 14:06:05 -04:00
Matt Burgess
0bddcfe730
NIFI-4002: Add PutElasticsearchHttpRecord processor 
This closes #1878

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2017-06-02 13:01:13 -04:00
Andrew Lim
de6a98618a NIFI-479 Add UI Extension Section to Developer Guide 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1882
 2017-06-02 12:05:20 -04:00
Mark Payne
239bbfbb9d NIFI-3989: This closes #1869. Avoid calling Long.parseLong, etc. in order to determine if a String is a valid number because we don't want the Exceptions that occur if it is not 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-06-02 10:09:38 -04:00
Mark Payne
37be0b9820 NIFI-3990: This closes #1870. Avoided creating garbage when we can avoid it in the JSON and csv readers and json writer 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-06-02 10:01:40 -04:00
Mark Payne
067e9dfeb0
NIFI-4003: Expose configuration option for cache size and duration NIFI-4003: Addressed remaining spots where client does not cache information 
This closes #1879.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-01 15:31:35 -04:00
Mark Payne
2595d816c4 NIFI-3986: This closes #1868. When we encounted EOFException from sequential record reader event iterator, just treat it as not having any more events 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-06-01 15:08:12 -04:00
Mark Payne
7035694e37
NIFI-3995: Updated Hwx Encoded Schema Ref Writer to write 13 bytes for header instead of 14; added unit test to verify 
This closes #1876.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-01 10:29:58 -04:00
Mark Payne
a0b2311ff6 NIFI-3995: This closes #1873. No longer use the 14th byte in the header for hwx content-encoded schema reference 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-31 13:41:25 -04:00
Matt Gilman
7bcccb10f4 NIFI-3719: 
- Removing the usage of SimpleDateFormat when formatting hours/minutes/seconds as the current timezone could cause unintended results.

This closes #1871.
 2017-05-30 15:01:39 -04:00
Mark Payne
2b435cdfc6 NIFI-3985: This closes #1864. Added 'Starting Position' property to SiteToSiteReportingTask; also added additionalDetails.html that explains the schema and updated the reporting task to stop publishing when the user clicks 'stops' instead of running indefinitely until the reporting task has caught up 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-26 21:05:45 -05:00