f54e146561
NIFI-4085 Add exception in log message when (S)FTP listing fails
...
This closes #1929 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 16:06:18 -04:00
5b82b735ab
NIFI-4106 Increase log level of user authentication rejection to warn.
...
This closes #1934 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 14:03:25 -04:00
668a64cd56
NIFI-1586 Implements autopurging of transaction log and snapshot files
...
When NiFi is clustered, and autopurge.purgeInterval is greater than 1, the DatadirCleanupManager will be started in order to automatically purge transaction log and snapshot files based on the autopurge settings in zookeeper.properties
This closes #1928 .
2017-06-22 09:30:38 -04:00
c99100c934
NIFI-4010 Enables EL on Fetch/List/PutSFTP and List/Fetch/Put/DeleteHDFS processor properties
...
FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period
This closes #1148
This closes #1930 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:49 -04:00
59a32948ea
NIFI-2923 Added evaluation of attribute expressions for Kerberos principal and keytab
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:28 -04:00
86fa1bba4f
NIFI-2923 Add expression language support to Kerberos parameters used by processors
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:27 -04:00
73e601bc55
NIFI-4102: If first line read does not match Grok expression, skip line
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1932
2017-06-21 15:10:22 -04:00
77e49b749e
NIFI-4075 Updating 'addRemoteProcessGroup' in StandardFlowSerializer to properly use ScheduledStateLookup. This closes #1922 .
2017-06-21 14:20:22 -04:00
aabd4a25d2
NIFI-4043 Initial commit of nifi-redis-bundle
...
NIFI-4061 Initial version of RedisStateProvider
- Adding PropertyContext and updating existing contexts to extend it
- Added embedded Redis for unit testing
- Added wrapped StateProvider with NAR ClassLoader in StandardStateManagerProvider
- Updating state-management.xml with config for RedisStateProvider
- Renaming tests that use RedisServer to be IT tests so they don't run all the time
This closes #1918 .
2017-06-21 12:47:19 -04:00
6bc6f955c0
NIFI-4059:
...
- Introducing the LdapUserGroupProvider.
- Updating documentation accordingly.
- Moving the IdentityMapping utilities so they were accessible.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1923 .
2017-06-19 19:25:33 +02:00
ad6af1d941
NIFI-3994 Add Create Template to the context menu
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #1883 .
2017-06-17 16:46:31 -07:00
5a7e6c6ac1
NIFI-4064 Make sure that Funnels with queued incoming FlowFiles, but no outgoing connections yield rather than continually check to run.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1914 .
2017-06-17 15:50:40 +02:00
2800df30d3
NIFI-2692
...
- Removing problematic timeout for SMTP Listen
- Converting anonymous method to lambda
- Adding debug and error logging
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1924 .
2017-06-17 15:22:33 +02:00
490e1da5db
NIFI-4019:
...
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
2017-06-15 14:17:35 -04:00
c0ad5bcc7b
NIFI-1921: Fixed bug in how average lineage duration was calculated for cluster stat
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1912
2017-06-13 12:29:03 -04:00
2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure
2017-06-12 16:36:23 -04:00
de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient
...
To be used with cache engines that does not have revision number.
NIFI-4049: Refactor AtomicDistributedMapCacheClient
Removed old methods completely.
This closes #1904 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-12 10:34:48 -04:00
7761903352
NIFI-4041: Add file.size attribute to ListFTP and ListSFTP
...
This closes #1899 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-12 10:53:09 +09:00
e7dcb6f6c5
NIFI-3921: Allow Record Writers to inherit schema from Record
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1902
2017-06-09 16:13:25 -04:00
4ed7511bee
NIFI-3653: - Introducing UserGroup and Policy provider interfaces.
...
- Introducing FileUserGroupProvider and FileAccessPolicyProvider.
- Refactoring FileAuthorizer to utilize the file based implementations.
- Introducing the StandardManagedAuthorizer.
- Decorating the configured ManagedAuthorizer to ensure integrity checks are still performed.
- Loading user groups if possible to use during access decisions.
- Merging responses for requests for AccessPolicies, Users, and UserGroups.
- Adding unit tests as appropriate.
- Adding methods to the User, Group, and AccessPolicy builder that more easily supports generating UUIDs.
- Fixing typo when seeding policies during startup.
- Fixing type in documentation and error messages.
This closes #1897 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-09 13:54:10 -04:00
d8dc2bb00b
NIFI-4047: Addressed issue with inconsistent Lexical policy between used cached schemas and non-cached schemas
...
This closes #1907
Signed-off-by: Joe Percivall <JPercivall@apache.org>
2017-06-09 12:05:11 -04:00
cc741d2be6
NIFI-3997:
...
- Bumping to next minor version.
2017-06-08 15:22:51 -04:00
1bf0a1a849
Merge branch 'NIFI-3997-RC1'
2017-06-08 14:30:10 -04:00
b0c9428776
NIFI-4030 Populating default values on GenericRecord from Avro schema if not present in RecordSchema
...
This closes #1896 .
2017-06-07 13:59:40 -04:00
45e035686f
NIFI-4029: Allow null Avro default values in HortonworksSchemaRegistry
...
This closes #1894 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-07 12:03:53 -04:00
c86190c513
NIFI-4027: - Fixing the positioning of the tooltips in the component toolbar.
...
This closes #1893
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-06-06 17:35:43 -04:00
3ef0fa48da
NIFI-4014: Correcting Event Type text in S2S provenance reporting task
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1887 .
2017-06-06 12:06:04 +02:00
e1880785d0
NIFI-4021: Fix StandardFlowSynchronizerSpec to pass independently.
...
This closes #1892 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-05 19:25:07 -07:00
6ee12e9b47
NIFI-3997-RC1prepare for next development iteration
2017-06-05 11:07:43 -04:00
ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1
2017-06-05 11:07:28 -04:00
082b99640e
NIFI-4001 - Bump ParCEFone version
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1875 .
2017-06-03 12:11:38 +02:00
4d78052dd4
NIFI-1709 - Introduce logic to probe Linux version using /etc/os-release to nifi.sh
...
Add explicit paths to support SLES 11 SP4 / OpenSUSE init.d layout
This closes #1794
2017-06-03 08:12:52 +10:00
32314d70fd
NIFI-4009: Added support for several key functions in RecordPath
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1881
2017-06-02 14:06:05 -04:00
0bddcfe730
NIFI-4002: Add PutElasticsearchHttpRecord processor
...
This closes #1878
Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-06-02 13:01:13 -04:00
37be0b9820
NIFI-3990: This closes #1870 . Avoided creating garbage when we can avoid it in the JSON and csv readers and json writer
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-02 10:01:40 -04:00
067e9dfeb0
NIFI-4003: Expose configuration option for cache size and duration NIFI-4003: Addressed remaining spots where client does not cache information
...
This closes #1879 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 15:31:35 -04:00
2595d816c4
NIFI-3986: This closes #1868 . When we encounted EOFException from sequential record reader event iterator, just treat it as not having any more events
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-01 15:08:12 -04:00
7035694e37
NIFI-3995: Updated Hwx Encoded Schema Ref Writer to write 13 bytes for header instead of 14; added unit test to verify
...
This closes #1876 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 10:29:58 -04:00
a0b2311ff6
NIFI-3995: This closes #1873 . No longer use the 14th byte in the header for hwx content-encoded schema reference
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-31 13:41:25 -04:00
2b435cdfc6
NIFI-3985: This closes #1864 . Added 'Starting Position' property to SiteToSiteReportingTask; also added additionalDetails.html that explains the schema and updated the reporting task to stop publishing when the user clicks 'stops' instead of running indefinitely until the reporting task has caught up
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-26 21:05:45 -05:00
dd50745a9f
NIFI-3984 - upgraded version of schema-registry client to 0.2.1
...
This closes #1866 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-26 17:59:53 -04:00
80dfe0257f
ExtractGrok - Include exception message when compile fails
...
This closes : #1845
Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-05-27 00:56:25 +10:00
e85081ed20
NIFI-3979 Documenting how ListHDFS maintains state and performs listings
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1860 .
2017-05-26 10:40:22 +02:00
5cb928131c
NIFI-3981: When serializing flow to cluster, use the Scheduled State of ports as they are configured to be, not the current state, since the current state may change as soon as the FlowController has finished initializing
...
This closes #1861 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-25 16:45:20 -04:00
13b59b5621
NIFI-3958: Decimal logical type with undefined precision and scale.
...
- Oracle NUMBER can return 0 precision and -127 or 0 scale with variable scale NUMBER such as ROWNUM or function result
- Added 'Default Decimal Precision' and 'Default Decimal Scale' property to ExecuteSQL and QueryDatabaseTable to apply default precision and scale if those are unknown
- Coerce BigDecimal scale to field schema logical type, so that BigDecimals having different scale can be written
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1851
2017-05-25 14:37:17 -04:00
36911957dc
NIFI-3972: This closes #1855 . When enabling Controller Services on startup, wait until service is enabled (or until 30 seconds elapses, whichever comes first) before returning. This avoids having Service A depend on Service B and then attempting to start Service A before Service B is fully enabled
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-25 13:32:02 -04:00
eb25c8547a
NIFI-3972: Ensure that we wait until service state becomes enabled before triggering completable future that says that it's enabled
2017-05-25 13:31:53 -04:00
44fdc0e4ef
NIFI-3640 uri eventhub changes
...
This closes #1617
2017-05-25 13:14:51 -04:00
4d0667380a
NIFI-3404: Improved UX of LookupAttributes.
...
- Added dependency notice.
- Added EL evaluation at SimpleKeyValueLookupService.
- Updated documentation.
- Updated CommonsConfigurationLookupService to throw LookupFailureException if it fails to get configuration so that error messages can be displayed at each processor bulletin.
- Added calling getConfiguration at OnEnabled of CommonsConfigurationLookupService, so that the service will stay in Enabling state if there is any issue.
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
46e2420d74
NIFI-3404 Added LookupAttribute processor and lookup controller services
...
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
Pierre Villard
Niels Zeilemaker
Jeff Storck
Maurizio Colleluori
Mark Payne
Joe Percivall
Bryan Bende
Matt Gilman
Scott Aslan
Wesley-Lawrence
Chris Herrera
Koji Kawamura
Steve Champagne
Joe Gresock
Andre F de Miranda
Matt Burgess
Yolanda M. Davis
Joseph Niemiec
Joey Frazee