nifi/nifi-nar-bundles/nifi-extension-utils
Tamas Palfy b55998afc1 NIFI-8081 Added new Listing Strategy to ListFTP and ListSFTP: Time Window
NIFI-8081 Added new Listing Strategy to ListFTP and ListSFTP: Adjusted Time Window. User can specify the time zone or time difference (compared to where NiFi runs) of the system hosting the files and based on the calculates the current time there. Lists files modified before this adjusted current time (and after the last listing).
NIFI-8081 'Time Adjustment' validated not to be set if listing strategy is not 'Adjusted Time Window'. Extracted validator to a separate class. Added more tests. Minor refactor. Typo fix.
NIFI-8081 Improved validation.
NIFI-8081 'Time Adjustment' is not necessary - in fact it can cause problems. SFTP (and usually FTP - which has a more general bug at the moment) returns a timestamp that doesn't really need adjustment. (SFTP in particular returns the an 'epoch' time.) Everything remains the same - the new listing strategy relies on a sliding time window, but without the unnecessary option to adjust for the modification time.
NIFI-8081 Resolved conflicts after rebasing to main.
NIFI-8081 Renamed 'AbstractListProcessor.listByAdjustedSlidingTimeWindow' to 'listByTimeWindow'. Post main rebase correction.
NIFI-8081 Updated user doc for the BY_TIME_WINDOW strategy to warn user on it's reliance of accurate time.

This closes #4721.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-02-04 17:04:37 +01:00
..
nifi-database-test-utils NIFI-7692 updating for next dev release 1.13.0 2020-08-18 14:48:02 -07:00
nifi-database-utils NIFI-8023: Convert java.sql.Date between UTC/local time zone normalized forms before/after database operations 2021-01-26 14:39:02 -06:00
nifi-hadoop-utils NIFI-8192 updating Copyright years for nifi things to include 2021 2021-02-03 12:56:28 +04:00
nifi-kerberos-test-utils NIFI-7799: Relogin with Kerberos on connect exception in DBCPConnectionPool (#4519) 2020-09-17 13:33:54 -04:00
nifi-processor-utils NIFI-8081 Added new Listing Strategy to ListFTP and ListSFTP: Time Window 2021-02-04 17:04:37 +01:00
nifi-prometheus-utils NIFI-8073 Correcting isBackPressureEnabled in PrometheusMetricsUtil 2020-12-07 10:03:16 -05:00
nifi-record-utils NIFI-8023: Convert java.sql.Date between UTC/local time zone normalized forms before/after database operations 2021-01-26 14:39:02 -06:00
nifi-reporting-utils NIFI-7692 updating for next dev release 1.13.0 2020-08-18 14:48:02 -07:00
nifi-service-utils NIFI-7692 updating for next dev release 1.13.0 2020-08-18 14:48:02 -07:00
nifi-syslog-utils NIFI-7692 updating for next dev release 1.13.0 2020-08-18 14:48:02 -07:00
pom.xml NIFI-7799: Relogin with Kerberos on connect exception in DBCPConnectionPool (#4519) 2020-09-17 13:33:54 -04:00