Commit Graph

6696 Commits

Author SHA1 Message Date
Mark Bean 5c150ffd78
NIFI-12925 Updated ListenHTTP to return 405 for TRACE and OPTIONS
This closes #8548

Signed-off-by: David Handermann <exceptionfactory@apache.org>d
2024-03-25 20:54:30 -05:00
Joseph Witt d5ff51b6e4
NIFI-12930 Catch FlowFileAccessException in FetchFile
when importing a fetched file we cannot be sure if the problem is reading the source file or writing to the content repository.  So we need to route to failure to allow flow designers to choose how to handle this.

This closes #8542

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-25 20:48:47 -05:00
exceptionfactory 407dd4d4bc
NIFI-12947 Upgraded MIME4J to 0.8.11
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8561.
2024-03-25 20:02:11 +01:00
Jim Steinebrey 08ff54f5fb Add auto commit property to QueryDatabaseTable and QueryDatabaseTable processors to allow disabling auto commit so PostgreSQL Fetch Size will work
NIFI-1931 Add proper default value for auto commit (false) to PostgreSQLDatabaseAdapter to allow FETCH_SIZE to be honored on reads.

NIFI-1931 Added customValidate code to check the auto commit property setting against the db adapter's required auto commit setting and give validation error message if they do not match.

NIFI-1931 Added automated test to check the Auto Commit customValidate error message.

NIFI-1931 remove clearDefaultValue() because it is not needed since required = false a;ready defaults it to null.

This closes #8534

Signed-off-by: Matt Burgess <mattyb149@apache.org>
2024-03-25 14:56:42 -04:00
Ricardo Ferreira 258715539e
NIFI-12944 - Add PeerAddress as Attribute into the flowfile
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8557.
2024-03-25 19:31:27 +01:00
exceptionfactory dd9d1c978f
NIFI-12943 Upgraded Hadoop from 3.3.6 to 3.4.0
This closes #8556

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-03-25 08:55:13 -07:00
Peter Turcsanyi a9e246956c
NIFI-12936 ListGCSBucket resets its tracking state after configuration change
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8550.
2024-03-25 16:44:12 +01:00
Peter Turcsanyi bffc342521
NIFI-12928 Added Simple Write strategy in PutAzureDataLakeStorage
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8540.
2024-03-25 15:07:00 +01:00
Peter Turcsanyi 8eb013a813
NIFI-12933 Rearranged properties on GCP processors
Also used current API methods for relationships/properties collections

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8545.
2024-03-25 10:34:35 +01:00
Peter Turcsanyi 635eb9ed2a
NIFI-12895 Added Timeout property to GetSmbFile and PutSmbFile
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8551.
2024-03-25 10:32:16 +01:00
Mark Bathori 8c0829d711
NIFI-12938: Upgrade Iceberg from 1.4.3 to 1.5.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8552.
2024-03-25 10:29:07 +01:00
dependabot[bot] 884dd8596a
NIFI-12932 Upgraded webpack-dev-middleware from 5.3.3 to 5.3.4
This closes #8543

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-21 23:08:50 -05:00
dependabot[bot] 2974d9c65e
NIFI-12931 Upgraded Commons Configuration from 2.9.0 to 2.10.1
This closes #8541

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-21 23:07:54 -05:00
exceptionfactory 6b061452e6
NIFI-12926 Upgraded Jackson from 2.16.2 to 2.17.0
This closes #8538

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-20 19:59:23 -05:00
Peter Turcsanyi d370b470b8
NIFI-12782 Migrated GCS processors' Proxy properties to ProxyConfigurationService
Extracted proxy service migration code into a common util module because the same logic was already used in AWS module,
and it is also reusable in other components for proxy property migration.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8400.
2024-03-19 08:56:42 +01:00
exceptionfactory d9bcc8b496
NIFI-12920 Removed nifi-cassandra-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8531.
2024-03-19 08:49:15 +01:00
James Mingardi-Elliott f5e44a99ac
NIFI-12912 snackbar bug (#8528)
Removed unnecessary rules and class. The snackbars will be styled by Angular Material.

Improved get-color-on-surface helper function.

This closes #8528
2024-03-18 17:33:03 -04:00
Freedom9339 12fc2f8508
NIFI-6379 Added SSL Context to PutSNS, DeleteSQS, GetSQS, and PutSQS
This closes #8505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-18 16:24:28 -05:00
lehelb 129130fc09
NIFI-12877 Added Sensitive Dynamic Property Support to RestLookUpService
This closes #8525

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-18 08:55:33 -05:00
bob 2303a15f8e
NIFI-12913 Corrected NPE for Python Log Listener ID
This closes #8526

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-18 08:30:02 -05:00
dependabot[bot] 68b880c74d
NIFI-12915 Upgraded follow-redirects from 1.15.5 to 1.15.6
This closes #8524

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-18 08:21:27 -05:00
Matt Gilman 940904e1ea
NIFI-12902: (#8521)
- Updating packaging to account for new build output.
2024-03-18 08:56:30 -04:00
bob 495a7dd7f5
NIFI-12514 Added Windows support for Python venv
This closes #8510

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-15 21:21:18 -05:00
exceptionfactory d62c8054d0
NIFI-12911 Upgraded Jagged from 0.3.0 to 0.3.2
This closes #8522.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-03-15 14:07:20 -07:00
Pierre Villard 82e11df835
NIFI-12909 Upgraded Nimbus JOSE+JWT from 9.33.0 to 9.37.3
This closes #8518

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-15 15:41:01 -05:00
Matt Gilman d97c794696
NIFI-12902: Migrating to @angular-devkit/build-angular:application (#8507)
* NIFI-12902:
- Migrating to @angular-devkit/build-angular:application to avoid and avoid sporadic webpack build issues.
- Updating roboto dependencies.

* NIFI-12902:
- Clean up.

This closes #8507
2024-03-15 16:15:48 -04:00
emiliosetiadarma 3719fddf84 NIFI-12700: refactored PutKudu to optimize memory handling for AUTO_FLUSH_SYNC flush mode (unbatched flush)
NIFI-12700: made changes based on PR comments. Simplified statements involving determination of whether or not there are flowfile failures/rowErrors. Separated out getting rowErrors from OperationResponses into its own function

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8322
2024-03-15 11:45:01 -04:00
tpalfy 42bd5243bb
NIFI-12887 Added Binary String Format property to PutDatabaseRecord
- Supports handling Strings as hexadecimal character sequences or base64-encoded binary data when inserting into a binary type column

This closes #8493

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-14 23:10:18 -05:00
EndzeitBegins 27fa595b25
NIFI-12901 Removed time units in description of time period properties
This closes #8504

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-14 23:02:44 -05:00
Scott Aslan 69e7a884a3
[NIFI-12822] table, border, theming updates (#8499)
* [NIFI-12822] table, border, theming updates

* remove nifi-button and replace with mat-icon-button

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/assets/styles/_app.scss

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/ui/canvas/graph-controls/operation-control/operation-control.component.scss

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/ui/canvas/graph-controls/navigation-control/navigation-control.component.scss

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

* review feedback

* final touches

---------

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

This closes #8499
2024-03-14 18:13:10 -04:00
tpalfy c093ea54b7
NIFI-12862 When building FlowAnalysisRuleViolationDTO objects (in StandardNiFiServiceFacade), violating component details will be left blank when user has no read permission for that component.
NIFI-12862 Expose subjectComponentType to frontend.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8475.
2024-03-14 18:31:07 +01:00
Peter Turcsanyi f8d3fcd66c
NIFI-10707 Added proxy support in PutBigQuery
Bumped GCP client library version
Added grpc-* jars in service api nar in order to avoid CNFE warning in io.grpc.LoadBalancerRegistry
Dependency clean-up in GCP modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8491.
2024-03-14 18:12:03 +01:00
bob 275dcc1e50
NIFI-12891: Update ElasticSearchClientService member variables on verify
This closes #8496

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-03-14 09:25:13 +00:00
James Mingardi-Elliott 06c0113063
NIFI-12870 Semantic colors (#8480)
Next step to color theming

Update theming to reference colors semantically

Material and Canvas palettes are reordered so that in all cases they go from 50 = lightest / least amount of color to 900 = darkest / most amount of color applied.

Usage of color has been changed so that Material's primary, accent, and warn values are used by semantic reference of 'default', 'lighter' and 'darker' rather than explicit number values.

The Canvas palettes still have values referenced directly because they are a special case.

Added SASS utilities:
- To help ensure color contrast for text and backgrounds by checking for a 4.5:1 contrast ratio.
- To provide helper functions that somewhat replicate Material designs approach to Surface and On Surface concepts. This is how the same Canvas palettes can be used for light and dark modes.

Some minor tweaks to the styling of the flow canvas to bring custom NiFi components and the Angular Material components closer together visually.

Moved the Canvas theme declaration to a separate file so the Material themes can be more easily swapped out without needing to redeclare the Canvas themes.

This closes #8480
2024-03-13 17:29:29 -04:00
kapkiai e96201ddd1
NIFI-12861 Documented that JASN1Reader requires the JDK
This closes #8469

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-11 19:47:45 -05:00
Mark Bathori 7e594d58dc
NIFI-12884 Corrected documentation for python debugging
This closes #8490

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-11 19:34:40 -05:00
exceptionfactory 90c7dba34f
NIFI-12871 Upgraded Commons Compress from 1.25.0 to 1.26.1
- Adjusted Excel Record Reader test failure to use OpenXML Exception instead of message matching

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8488.
2024-03-10 15:18:03 +01:00
dependabot[bot] 63cc0520dc
NIFI-12879 Upgraded Clojure from 1.11.1 to 1.11.2
This closes #8487

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 20:29:38 -06:00
EndzeitBegins fabf6bf536
NIFI-12617 Set default nifi.web.https.host to localhost
This closes #8486

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 15:51:58 -06:00
dan-s1 942d13c118
NIFI-12785 Corrected InvokeHTTP URL handling to avoid double encoding
This closes #8458

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 08:20:07 -06:00
exceptionfactory 04d213a00c
NIFI-12872 Upgraded Groovy from 4.0.18 to 4.0.19
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8481.
2024-03-07 17:23:30 +01:00
Emilio Setiadarma bee65b8447 NIFI-12825: implemented ListHBaseRegions processor
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8439
2024-03-06 18:56:40 -05:00
James Mingardi-Elliott 2a9c4c5de9
NIFI-12720 BUG - Dark mode skeleton loader styles (#8465)
* NIFI-12720

Set an explicit background color for the skeleton-loader element so there is sufficient contrast to show the animation in both light and dark themes.

* NIFI-12720

Updates based on comments

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/styles.scss

Co-authored-by: Scott Aslan <scottyaslan@users.noreply.github.com>

---------

Co-authored-by: Scott Aslan <scottyaslan@users.noreply.github.com>
2024-03-06 18:12:27 -05:00
James Mingardi-Elliott cc64c7adc6
NIFI-12865 BUG - Checkboxes are inconsistently styled with primary or accent (#8472)
Updated all the checkboxes to use color="primary" to keep them consistent.

Revert "NIFI-12865 BUG - Checkboxes are inconsistently styled with primary or accent"

This reverts commit 5833cb1a39837b59de2c664c74c48a579234e284.

Removed Registry changes
2024-03-06 17:16:28 -05:00
James Mingardi-Elliott e2e54f2bc8
NIFI-12721 Button UX (#8464)
* NIFI-12721 Button UX

Updated all the dialog buttons to change them from stroked and raised to basic. This better aligns with Angular Material guidelines and should address the confusion between disabled and cancelled.

* NiFi-12721 incremental update

Changed the combo editor and editor components to use the flat button styles. Missed them before because I was looking for dialogs.

Also caught a style bleed with button:disabled that should be button.nifi-button:disabled and updated that.

* Consolidated the button.nifi-button:disabled rules

Also ran Prettier to improve markup in a few spots
2024-03-06 17:11:07 -05:00
exceptionfactory c6cbdd91cd
NIFI-12868 Upgraded Commons DBCP from 2.11.0 to 2.12.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8478.
2024-03-06 18:21:19 +01:00
Jim Steinebrey bda9b6360d NIFI-12630 Fix NPE getLogger in ConsumeSlack and PublishSlack
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8474
2024-03-05 19:33:54 -05:00
David Handermann 26f5fa2be0
NIFI-11443 Route Python Framework Logging to SLF4J (#8407)
* NIFI-11443 Routed Python Framework Logging to SLF4J

- Changed Python logging to use standard output stream
- Adjusted Python logging format for simplified processing
- Updated PythonProcess to pipe standard error and standard output streams to reader
- Added Log Reader command with Virtual Thread for each Python Process
- Removed Python log properties from NiFi Properties configuration
2024-03-05 16:55:04 -05:00
Jim Steinebrey 97516de1e0 NIFI-12645 Fix to correctly invoke onStopped method of scripted processor
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8471
2024-03-04 16:30:14 -05:00
Mark Payne 55738f8522
NIFI-12740 Fixed Python to Java Object Binding
Fixed issue in NiFiPythonGateway that stems from the fact that the thread adding an object to the JavaObjectBindings was not necessarily the thread removing them. The algorithm that was in place assumed that the same thread would be used, in order to ensure that an object could be unbound before being accessed. The new algorithm binds each new object to all active method invocations and only unbinds the objects after all method invocations complete, regardless of thread. Additionally, found that many method calls could create new proxies on the Python side, just for getter methods whose values don't change. This is very expensive, so introduced a new @Idempotent annotation that can be added to interface methods such that we can cache the value and avoid the expensive overhead.

This closes #8456

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-04 15:28:12 -06:00