Commit Graph

4848 Commits

Author SHA1 Message Date
Robert Kalmar 357a8667f9
NIFI-9663 Setting the "csv-escape" property has no effect in SelectHive3QL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5756.
2022-02-10 10:32:27 +01:00
exceptionfactory a2f6420f43
NIFI-9638 Refactored Google Guava usage in extensions
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5742
2022-02-09 16:39:53 -05:00
exceptionfactory e584d3cf04
NIFI-9660 Upgraded Apache Tika to 2.3.0
- Upgraded tika-core from 1.27 to 2.3.0
- Upgraded tika-parsers to tika-parsers-standard-package in nifi-media-processors
- Updated Tika metadata property references

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5754.
2022-02-09 11:11:46 +01:00
Noel Baek bbc78f1547
NIFI-9621: Added Ignore Reserved Characters to FlattenJson
- Upgraded to json-flattener from 0.12.0 to 0.13.0

This closes #5704

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-08 21:02:55 -06:00
Lehel 72e6accc12 NIFI-9327: Added timewindow query to QueryNiFiReportingTask and MetricsEventReportingTask 2022-02-08 17:41:34 +01:00
Paul Grey ad5b816626
NIFI-9644 Improved TestExecuteStateless increasing TestRunner.run() wait allowed
This closes #5741

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-04 21:37:59 -06:00
Mark Payne 94668dee6e
NIFI-9639: Determine how long it takes to find cluster coordinator and perform DNS lookup when sending heartbeats and include in the logs
This closes #5748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-04 20:19:07 -06:00
exceptionfactory ce66cf41e2
NIFI-6699 Corrected SFTP symbolic link handling (#5744)
- Added SFTP stat() request on symbolic links to check directory status
- Refactored and renamed TestServerSFTPTransfer class
2022-02-04 18:43:42 -05:00
exceptionfactory bab4309905
NIFI-9655 Add Queue Logging to ListenUDP (#5747)
* NIFI-9655 Added Queue Logging to ListenUDP

- Added TrackingLinkedBlockingQueue to track the largest queue size
- Updated AbstractListenEventProcessor to write debug log at most once per minute
- AbstractListenEventProcessor updates support both ListenUDP and ListenUDPRecord
2022-02-04 18:41:38 -05:00
markap14 230ed9c98d
NIFI-9628: Added a uiOnly flag when requesting Controller Service det… (#5712)
* NIFI-9628: Added a uiOnly flag when requesting Controller Service details and the list of Controller Services. This allows us to return much less data when retrieving these resources.

* NIFI-9628: Addressed review feedback; added uiOnly flag for controller service run-status and references also

* NIFI-9628: Fixed checkstyle issues by removing unused imports

This closes #5712
2022-02-03 15:53:23 -05:00
greyp9 9dbd066238
NIFI-9233 - Improve reliability of system integration tests (#5733) 2022-02-03 10:20:55 -05:00
Matthew Burgess 9d8b39529e
NIFI-9596: Fix newline bug in JythonScriptRunner
NIFI-9596: Added comment to indicate why the Apache header is missing

This closes #5682

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-02-02 08:46:29 -05:00
exceptionfactory ba0bf2ede0
NIFI-9650 Upgraded OkHttp from 4.9.2 to 4.9.3
- Added okhttp-bom to root Maven configuration
- Removed repeated okhttp.version property from specific dependencies

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5737.
2022-02-02 11:45:18 +01:00
exceptionfactory 43748a5523 NIFI-9638 Refactored Google Guava references
- Refactored nifi-framework and nifi-standard modules
- Replaced Google Cache with Caffeine Cache
- Replaced Google collections classes with standard Java collections

This closes #5730.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-02-01 15:17:50 -05:00
exceptionfactory dc7d9510cd NIFI-9610 Refactored nifi-processor-utils to separate modules
- Added nifi-bin-manager
- Added nifi-event-listen
- Added nifi-event-put
- Added nifi-listed-entity
- Added nifi-put-pattern
- Removed nifi-processor-utils

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5729.
2022-02-01 12:59:16 -05:00
greyp9 27ceda38bf
NIFI-9233 - Improve reliability of system integration tests (#5720) 2022-01-31 09:20:54 -05:00
Mark Payne 038811d0dd
NIFI-9629: Ensure that when we are setting default values on Avro GenericRecord objects that we convert from the schema's default value to the proper type
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5716.
2022-01-29 13:56:53 +01:00
exceptionfactory 43a24743cc
NIFI-9341 Corrected annotation syntax problem
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-28 13:24:41 -06:00
Bence Simon 49978cdd91
NIFI-9341 Added CEF RecordReader
This closes #5530

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-28 12:42:51 -06:00
exceptionfactory 6fca4eb3ce
NIFI-9624 Removed JCenter Repository
- Removed moquette-broker and refactored tests
- Upgraded docker-compose-rule-junit4 to 1.7.0 for Maven Central retrieval
- Changed JSTL dependency groupId for Maven Central retrieval

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5719.
2022-01-28 10:11:34 -05:00
exceptionfactory 95abc35463 NIFI-6266 Corrected proxy FTP connect handling
- Added ProxyFTPClient with connect method supporting unresolved hosts
- Added FTPClientProvider with implementation handling configuration and connection
- Added support for SOCKS with authentication in FTP components
- Refactored FTPTransfer using FTPClientProvider

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5655.
2022-01-27 17:36:27 -05:00
Nathan Gough 8f2a9f94fe
NIFI-9632 - Removed nifi-lumberjack-bundle
- Removed several unused socket classes from nifi-processor-utils

This closes #5722

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-27 14:43:19 -06:00
Timea Barna 3ccc9d29b6
NIFI-9455 Added aggregated predictions to Prometheus Flow Metrics
This closes #5582

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-27 10:07:01 -06:00
Mark Payne 3ea9faccc6
NIFI-8040: When changing version of a flow, stop processors that have a state of Starting in addition to those with a state of Running
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5718.
2022-01-27 15:06:40 +01:00
Paul Grey 0eff249870
NIFI-9611 Removed duplicate nifi-utils dependency
This closes #5721

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-26 19:07:29 -06:00
Nathan Gough 08153b8260
NIFI-9453 Refactored ListenBeats using Netty
This closes #5669

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-26 14:40:32 -06:00
exceptionfactory 9075fc2cd8
NIFI-9611 Removed unnecessary references to nifi-processor-utils
- Replaced nifi-processor-utils with nifi-utils where necessary
- Added direct dependencies on commons-lang3 where necessary

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5693.
2022-01-26 11:52:08 -05:00
Adam Kocsis 3eef7e0a3e
NIFI-9578 NiFi user list no longer breaks if a user and group have the same id (#5695)
- ids of the entities are prefixed by their types to avoid id conflict in 3rd party table library
   For some authorizers the UUID calculation for users and groups based only on the name of the entity and a global seed.
   This results the same UUID for a group and a user with the same name. The same ids are no longer causing any issue on the UI.
- group icon alignment is fixed for edit user dialog

This closes #5695
2022-01-25 14:52:07 -05:00
Peter Turcsanyi 96b53d8943
NIFI-9589: Support initial loading from the current max values in QueryDatabaseTable* processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5676.
2022-01-25 18:12:14 +01:00
exceptionfactory b40b5a7c96
NIFI-9625 This closes #5711. Refactored Distributed Cache Server and Client Tests
- Replaced TestServerAndClient with separate classes for Set Server and Map Server
- Implemented before and after annotations for starting and stopping server instances
NIFI-9625 Added check for cache directory existence before clean
NIFI-9625 Updated Map and Set Cache Server Tests to use random port

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-25 09:03:39 -07:00
Matthew Burgess bb24030f4a
NIFI-7840: Upgrade to Groovy 3.0.8 and Spock 2.1
This closes #5699

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-25 09:47:30 -06:00
Lehel ec26ec9904 NIFI-9569: SNMP manager UDP transportmapping changed to 0.0.0.0
This closes #5691.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-01-24 18:24:45 +01:00
exceptionfactory e2243500d3
NIFI-9618 Upgraded Checkstyle to 9.2.1
- Corrected several missing return statements
- Increased Maven heap size to 3 GB for ci-workflow

This closes #5700

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-21 20:08:16 -06:00
Bryan Bende 6ef6e71d05
NIFI-9501 Added REST end-point to retrieve a RuntimeManifest
- Switch ExtensionManifestParser implementation to use JAXB instead of Jackson XML
- Fix handling of older NARs that don't have newer fields in ExtensionManifest
- Add response merging for runtime-manifest REST end-point, remove commons-lang3 from c2 dependencies

This closes #5630

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-21 15:37:04 -06:00
Pierre Villard 695c3aabcb
NIFI-9593 - This closes #5679. Missing catch clauses in Confluent Schema Registry client
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-20 10:54:12 -07:00
Timea Barna ccd47de6dc
NIFI-9587 Added JSON format for Prometheus Flow Metrics
This closes #5673

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-20 11:14:01 -06:00
Adam Kocsis 3c2793be09
[NIFI-8006] Additional options on UI to leave current process group (#5678)
- 'Leave group' action button is added to 'Navigation'
- 'Leave group' action works with 'esc' hotkey if no modal, context menu, etc. is open
- 'esc' key closes context menu if it is open
- user guide is updated with new navigation options

This closes #5678
2022-01-20 10:58:05 -05:00
exceptionfactory a4791a55d4
NIFI-9600 Removed Elasticsearch 2 Processors
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5685.
2022-01-20 07:17:00 -05:00
exceptionfactory fc27b3138b
NIFI-9481 Excluded Data Transfer REST methods from DoSFilter
- Added DataTransferDoSFilter with request URI evaluation
- Added RequestFilterProvider and implementations to abstract Jetty Filter configuration

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5670.
2022-01-19 16:11:53 -05:00
Mark Payne 1d353435a5
NIFI-9594: When converting Record to Avro GenericRecord, ensure that any default values that are defined in the GenericRecord's schema get applied, regardless of whether or not the field exists in the associated RecordSchema.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5677.
2022-01-19 19:20:53 +01:00
Joe Witt 48c8193c4c
NIFI-9595 Removed nifi-kafka-0.x modules
This closes #5680

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-19 11:18:36 -06:00
exceptionfactory 8edb5faac9
NIFI-9591 This closes #5674. Removed nifi-kite-bundle
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 09:24:23 -07:00
Joe Witt 2f95eed8cb
NIFI-9575 This closes #5667. updating copyright year to 2022
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 09:14:09 -07:00
Tamas Palfy aa61494fc3
NIFI-9065 Add support for OAuth2AccessTokenProvider in InvokeHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5319.
2022-01-19 13:29:11 +01:00
sedadgn e603b0179b NIFI-7865 amqp$header is splitted in the wrong way for "," and "}"
This PR introduces 2 new properties for the ConsumeAMQP processor
And one new property for PublishAMQP

This allows to configure the processors to use escaping for commas and to consistently not use curly braces in the amqp$header attribute.

The default values ensure backwards compatibility.

This closes #5458.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-01-18 16:45:45 -05:00
exceptionfactory 405934dcd2
NIFI-9571 Corrected Session commit handling in PutTCP
- Added generic type to AbstractPutEventProcessor for compiler checking of event types
- Refactored createTransitUri to shared method in AbstractPutEventProcessor

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5658.
2022-01-18 15:31:36 -05:00
EC2 Default User 18f2384d0a
NIFI-9568 Updated nifi-jolt-transform-json-ui pom.xml to only include CSS and JS assets in WAR
This closes #5660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-18 09:57:30 -06:00
Pierre Villard 4847926a4b
NIFI-9544 - LookupRecord - fixed behavior when no matching value in the LRS
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5638.
2022-01-13 16:13:24 -05:00
exceptionfactory dd7131b257
NIFI-9435 Added registries and names include parameters to Flow Metrics
- Added optional includedRegistries query parameter to Flow Metrics Resource method supporting one or more registries
- Added optional includedNames query parameter to Flow Metrics Resource method supporting one or more metric family names
- Added sampleName and sampleLabelValue optional pattern parameters
- Added FilteringMetricFamilySamplesEnumeration to support streamed filtering
- Added PrometheusMetricsWriter and TextFormat implementation

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5571.
2022-01-13 15:59:00 -05:00
exceptionfactory 7c50f1429e
NIFI-9563 Enabled ListenTCP Pool Receive Buffers property
- Removed deprecation from ListenTCP Pool Receive Buffers property
- Added BufferAllocator configuration property for NettyEventServerFactory

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5653.
2022-01-13 19:50:44 +01:00