Commit Graph

91 Commits

Author SHA1 Message Date
Pierre Villard 3de6f960fb
NIFI-11501 Upgraded Hive MQTT client from 1.3.0 to 1.3.1
This closes #7207

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:14:19 -05:00
Nandor Soma Abonyi 2b9f2071ed
NIFI-11270 Refactoring of the overly Paho-specific MQTT interface
This closes #7032.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-29 23:20:06 +02:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
exceptionfactory 2e55498771
NIFI-11154 Removed Default Schedule from ConsumeMQTT
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6936.
2023-02-09 11:15:11 +01:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
UcanInfosec ef0793c8fc
NIFI-10695 Update org.eclipse.paho.client.mqttv3 to 1.2.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6578.
2022-10-27 07:29:19 +02:00
Lehel Boér feb3148b68
NIFI-10628: Added Default Schedule Time and Run Duration to processors
This closes #6512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 14:57:46 -05:00
Nandor Soma Abonyi 298dd2024e
NIFI-10644 Add Message Demarcator-style processing in PublishMQTT
This closes #6530.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-16 23:20:28 +02:00
Nandor Soma Abonyi eecb6bfb38 NIFI-10650 Fix demarcator is appended to the end of the FlowFile's content by ConsumeMQTT
This closes #6534.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-15 18:10:04 +02:00
Joe Witt c6a9d70814
Merge branch 'NIFI-10521-RC4' 2022-10-06 14:13:30 -07:00
Nandor Soma Abonyi 2405b0ef71
NIFI-10543 Support broker failover in MQTT processors (#6447)
NIFI-10543 Support broker failover in MQTT processors

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-06 18:24:54 +02:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Peter Turcsanyi 5303aadda3
NIFI-10500: Improved property ordering in MQTT processors
Signed-off-by: Arpad Boda <aboda@apache.org>
2022-09-14 21:13:01 +02:00
Nandor Soma Abonyi eb68ffad70
NIFI-10411 Add record processing feature to PublishMQTT processor
This closes #6373.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-09 09:51:13 +02:00
Nandor Soma Abonyi 4d4a5ca4be
NIFI-10251 Add v5 protocol support for existing MQTT processors
This closes #6225.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-08-30 10:27:19 +02:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Mike Thomsen ae1731c79e
NIFI-9134 nifi-metrics-reporting-bundle to use JUnit 5
- NIFI-9129 Refactored as much of nifi-kudu-bundle to use JUnit 5 as possible without breaking the integration tests which use test libraries from the Kudu project that depend on JUnit 4
- NIFI-9109 Refactored nifi-extension-utils to use JUnit 5. Left two tests with JUnit 4 because they used APIs that don't appear to have analogues in JUnit 5
- NIFI-9112 Refactored nifi-groovyx-bundle to use JUnit 5
- NIFI-9142 Refactored nifi-ranger-bundle to use JUnit 5
- NIFI-9136 Refactored nifi-network-bundle to use JUnit 5

This closes #5794

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-26 08:18:08 -06:00
exceptionfactory fe1139b8bb
NIFI-9692 Upgraded Apache Commons Lang3 to 3.12.0
- Moved commons-lang3 version management to root Maven configuration
- Refactored limited usage of StringUtils is nifi-reporting-utils to remove commons-lang3
- Refactored limited usage of StringUtils in nifi-websocket-processors to remove commons-lang3

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5773
2022-02-16 09:28:21 -05:00
exceptionfactory 6fca4eb3ce
NIFI-9624 Removed JCenter Repository
- Removed moquette-broker and refactored tests
- Upgraded docker-compose-rule-junit4 to 1.7.0 for Maven Central retrieval
- Changed JSTL dependency groupId for Maven Central retrieval

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5719.
2022-01-28 10:11:34 -05:00
exceptionfactory 9075fc2cd8
NIFI-9611 Removed unnecessary references to nifi-processor-utils
- Replaced nifi-processor-utils with nifi-utils where necessary
- Added direct dependencies on commons-lang3 where necessary

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5693.
2022-01-26 11:52:08 -05:00
Peter Gyori 2dcff09f7f NIFI-9410: Fix for ConsumeMQTT processor in stateless environment
NIFI-9410: Added displayName to the QoS processor property

This closes #5549.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-11-24 10:05:43 +01:00
Joe Witt c055895952
NIFI-9344-RC3 prepare for next development iteration 2021-11-03 08:53:37 -07:00
Joe Witt 7fdc07cccd
NIFI-9344-RC3 prepare release nifi-1.15.0-RC3 2021-11-03 08:53:32 -07:00
exceptionfactory b4e0416b5e
NIFI-9228 Refactored tests using TemporaryKeyStoreBuilder
- Added TemporaryKeyStoreBuilder with File.deleteOnExit() for KeyStore and TrustStore files
- Removed JKS files from nifi-security-utils tests
- Refactored usage of KeyStoreUtils.createKeyStoreAndGetX509Certificate() to TemporaryKeyStoreBuilder
- Removed unnecesary hadoop-minikdc test dependency in security-utils
- Replaced Mini KDC Hex utility with Bouncy Castle Hex utility in unit tests

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5406
2021-09-21 16:07:13 -04:00
exceptionfactory ba775d28de
NIFI-9228 Refactored tests to use generated KeyStores
- Refactored multiple tests using KeyStoreUtils
- Removed static KeyStore and TrustStore files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5401
2021-09-21 11:06:19 -04:00
Joe Witt 97feacc181
NIFI-8767-RC2 prepare for next development iteration 2021-07-10 12:17:09 -07:00
Joe Witt fcbf1d5f97
NIFI-8767-RC2 prepare release nifi-1.14.0-RC2 2021-07-10 12:17:05 -07:00
Mark Payne ecacfdaa4c NIFI-8469: Introduced ProcessSession.commitAsync and updated processors to use it. Deprecated ProcessSession.commit()
- Updated Mock Framework to now fail tests that use ProcessSession.commit() unless they first call TestRunner.setAllowSynchronousSessionCommits(true)
- Updated stateless nifi in order to make use of async session commits
- Fixed bug that caused stateless to not properly handle Additional Classpath URLs and bug that caused warnings about validation to get generated when a flow that used controller services was initialized. While this is not really in scope of NIFI-8469, it was found when testing and blocked further progress so addresssed here.
- If Processor fails to progress when run from stateless, trigger from start of flow until that is no longer the case
- Introduced notion of TransactionThresholds that can limit the amount of data that a flow will bring in for a given invocation of stateless dataflow
- Several new system-level tests
2021-05-19 08:51:16 -04:00
exceptionfactory 6776765a92
NIFI-8538 Upgraded Apache Commons IO to 2.8.0
- Upgraded direct dependencies from 2.6 to 2.8.0
- Added dependency management configuration to use 2.8.0 for some modules
- Updated scripted Groovy tests to avoid copying unnecessary files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5073
2021-05-14 09:31:48 -04:00
Pierre Villard 0f8789b8b0
NIFI-8409 - ConsumeMQTT Processor Broker URI and Username Expression Language
This closes #4984

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-04-14 16:08:44 -05:00
Joe Witt 88fab00e29
NIFI-7873 merging release branch to latest and updating to 1.14.0-SNAPSHOT 2021-02-15 12:09:32 -07:00
Joe Witt 4afb2ba743
NIFI-7873-RC4 prepare for next development iteration 2021-02-15 12:09:31 -07:00
Joe Witt 487280bee9
NIFI-7873-RC4 prepare release nifi-1.13.0-RC4 2021-02-15 12:09:30 -07:00
Pierre Villard 93a5823f8a NIFI-7890 - Added record support to ConsumeMQTT processor
This closes #4738.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-21 11:16:07 +00:00
Pierre Villard 88de03aebb NIFI-7895 - Fix NPE in ConsumeMQTT with truststore only SSL CS
This closes #4587.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-20 00:29:30 +01:00
Pierre Villard 80eb570ee1 NIFI-7894 - ConsumeMQTT - allow EL on Client ID property with shared subscription
This closes #4586.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-06 16:46:17 +01:00
Pierre Villard c9d778a8ee NIFI-7889 - ConsumeMQTT - use offer instead of add
This closes #4578.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-06 14:15:27 +01:00
kpsngh1998 a95ffce6bd
NIFI-7534 Consume MQTT Processor. Support Expression Language for Topic Filter property
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4573.
2020-10-08 15:38:37 +02:00
Joe Witt 8baa5c9940
NIFI-7692 updating for next dev release 1.13.0 2020-08-18 14:48:02 -07:00
Joe Witt fb57bcbc11
NIFI-7692-RC1 prepare for next development iteration 2020-08-13 09:20:39 -07:00
Joe Witt 303d6c59ba
NIFI-7692-RC1 prepare release nifi-1.12.0-RC1 2020-08-13 09:20:36 -07:00
Joe Witt f694e6464f NIFI-7187 adding missing version strings from accumulo bundle pom
- Removed Cat X JSON.org dep inclusion which seems to not be necessary
- Updated a ton of easier/safer looking deps
- Updated tika due to CVE

This closes #4086

Signed-off-by: Mark Payne <markap14@hotmail.com>
2020-03-20 10:07:56 -04:00
Justin Miller 23b04ae968
NIFI-6856 - Make client ID a non-required field for the MQTTConsume and MQTTProduce processors. Generates a
random ID if not set.

Also add group ID field to ConsumeMQTT processor. Allows consumer to join consumer group at $share/<group_id>/<topic_filter>

add expression language support for the MQTT client ID

Setting client id in publish test fails because it is not a flowfile attribute.
Remove client id and autogenerate it when testing.

Since the evaluation is done in onScheduled, there is no flow file available and we're not using the attributes to make the expression language evaluation. You can change the scope to use the Variable Registry.

Co-Authored-By: Pierre Villard <pierre.villard.fr@gmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3879.
2020-02-26 15:54:53 -08:00
Joe Witt 3de77ebacc
NIFI-7021-RC3 prepare for next development iteration 2020-01-19 14:14:40 -05:00
Joe Witt 633408bce7
NIFI-7021-RC3 prepare release nifi-1.11.0-RC3 2020-01-19 14:14:38 -05:00