Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,204 Commits 143 Branches 197 Tags 389 MiB
Commit Graph

4204 Commits

Author SHA1 Message Date
Bryan Bende 69367ff0bf NIFI-4839 - Updating README and cleaning up descriptions and comments 
- Making registryClientId optional and auto selecting when only one is available
- Added delete-bucket command
- Added delete-flow command for registry
 2018-02-28 17:23:27 +01:00
Andrew Grande fe71c18ec5 NIFI-4839 - Support both public URLs and local files as inputs for import actions. 
- The handling of empty canvas got lost in the merge, causing errors with a new NiFi instance.
- Broaden support for input, now supportes both local files _and_ any public URL with a schema recognized by Java runtime.
 2018-02-28 17:23:18 +01:00
Bryan Bende c1c808002c NIFI-4839 
- Modified how the process group box is calculated
- Adding command to get the id of a registry client by name
- Refactoring how results are written to support option of simple or json output
- Added pg-set-var command
- Added pg-list command
- Added getDescription to every command and prints when asking for help on a command
- Adding verbose out to help command to print description for every command
 2018-02-28 17:23:10 +01:00
Andrew Grande e3cc7bee05 NIFI-4839 - Implemented auto-layout when importing the PG. Will find an available spot on a canvas which doesn't overlap with other components and is as close to the canvas center as possible. 2018-02-28 17:23:01 +01:00
Bryan Bende 9c3594ded6 NIFI-4839 - Fixing completer unit test 
- Added pg-get-version, pg-get-all-versions, pg-change-version
- Added info the Context to know if we are in interactive mode
 2018-02-28 17:22:52 +01:00
Andrew Grande 8b490134c7 NIFI-4839 - Rename the registry group to `registry` for better UX 2018-02-28 17:22:43 +01:00
Bryan Bende 9cf9e866ba NIFI-4839 Creating nifi-toolkit-cli to provide a CLI for interacting with NiFi and NiFi Registry 2018-02-28 17:22:28 +01:00
James Wing 77dc186097 NIFI-4876 - Adding Min Object Age to ListS3 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2491.
 2018-02-28 12:01:35 +01:00
Matt Gilman 19b5b60b0f NIFI-3502: 
- Ensuring D3 is available on the summary and users page.

This closes #2495

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-27 08:54:58 -05:00
Willie Engelbrecht 1ec7bcd286 NIFI-4910 Fixing slight spelling mistake in error message, needs a space 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2492.
 2018-02-26 21:01:32 -08:00
Mike Thomsen 3d9c470be3 NIFI-4827 Added support for reading queries from the flowfile body to GetMongo. 
NIFI-4827 Added changes from code review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2443
 2018-02-26 14:19:35 -05:00
mans2singh f7fe2da106 NIFI-4289 - InfluxDB Put processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2101.
 2018-02-24 14:46:35 +01:00
Matthew Burgess 62732cbb88 NIFI-4903 - Fixed timestamp bug with fetch processors using Oracle 12+ 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2488.
 2018-02-22 20:56:30 +01:00
Matt Gilman d75f118ae1 NIFI-4894: 
- Ensuring that any proxy paths are retained when querying for bulletins.

This closes #2482

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-21 13:09:59 -05:00
Pierre Villard ff95be2a11 NIFI-4815 - Add EL support to ExecuteProcess 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2432
 2018-02-21 12:47:33 -05:00
Pierre Villard bc37015693 NIFI-4814 - Add distinctive attribute to S2S reporting tasks 
NIFI-4814 - added UUID attribute

NIFI-4814 - added type attribute

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2431
 2018-02-21 11:14:38 -05:00
Matthew Burgess b4b970b876 NIFI-4816: Allow name to be updated for ReportingTasks 
This closes #2452

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-21 09:42:25 -05:00
Mike Thomsen 54b1659704 NIFI-4429 Added GetMongoAggregation to support running Mongo aggregations. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2180
 2018-02-21 08:58:38 -05:00
Matt Gilman 160bea8bf3
NIFI-4538: 
- Fixing broken unit test.
 2018-02-20 17:14:49 -05:00
Matt Gilman ba9e72ed8b NIFI-3502: 
- Preventing digest() during an ongoing apply() or digest() lifecycle.

This closes #2471

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-20 16:25:12 -05:00
Matt Gilman bf72d05825 NIFI-3502: 
- Ensuring that upon deselection, the monitor palette is updated accordingly.
 2018-02-20 14:51:44 -05:00
Matt Gilman 9cd631f963 NIFI-3502: 
- Upgrading to D3 version 4.
 2018-02-20 14:51:44 -05:00
yuri1969 91e98aa50b
NIFI-4538 - Add Process Group information to... 
...Search results

* Separated the search functionality.
* Added a unit test.
* Added the PG info to UI (a mere draft).
* Introduce the nearest versioned group
* Removed the top level group results in favour of the nearest versioned group.
* This closes #2364
 2018-02-20 12:42:09 -05:00
Mark Payne 9f95a10df9 NIFI-4794: Updated event writers to avoid creating a lot of byte[] by reusing buffers. Also removed synchronization on EventWriter when rolling over the writer and just moved the writing of the header to happen before making the writer available to any other threads. This reduces thread contention during rollover. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2437
 2018-02-19 09:31:11 -05:00
Mark Payne 0bcb241db3 NIFI-4774: Implementation of SequentialAccessWriteAheadLog and updates to WriteAheadFlowFileRepository to make use of the new implementation instead of MinimalLockingWriteAheadLog. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2416
 2018-02-19 09:26:01 -05:00
Mark Payne 14fef2de14 NIFI-4772: Refactored how the @OnScheduled methods of processors is invoked/monitored. The new method does away with the two previously created 8-thread thread pools and just uses the Timer-Driven thread pool that is used by other framework tasks. 
NIFI-4772: Introduced a new thread-pool with 2 threads that will be used for monitoring lifecycle task. This means that if all threads in the timer-driven thead pool are blocked by processors that don't complete their @OnScheduled methods, we have a separate thread pool that at least gives us a chance of interrupting those threads

NIFI-4772: Remove unused import
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2403
 2018-02-19 09:19:53 -05:00
Matthew Burgess 2a5e21c11b NIFI-4836 - Allow output of FlowFiles during result set processing in QueryDatabaseTable 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2447.
 2018-02-17 15:56:05 +01:00
zenfenaan 82e36f3c71 NIFI-4819: Added DeleteAzureBlobStorage that handles deletion of blob from an Azure Storage container 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2436.
 2018-02-17 15:49:01 +01:00
Bryan Bende b855d0acae
NIFI-4884 Fixing ordering during import from registry so that we set schedule strategy on a processor before setting scheduling duration. This closes #2472 2018-02-16 09:27:36 -05:00
Mike Thomsen 143d7e6829 NIFI-3538 Added DeleteHBaseRow 
This closes #2294.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-02-14 10:04:25 +09:00
Andy LoPresto 28067a29fd
NIFI-4869 Added SAX utility method for SplitXML processor. 
Added unit tests.
Added test resources to RAT exclude list.
This closes #2466
 2018-02-13 15:29:29 -05:00
Leah Anderson a3edd34db0 NIFI-4840 Fix formatting for expression language guide for toRadix and fromRadix 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2449.
 2018-02-13 09:33:53 +01:00
Matthew Burgess b5ca7adbb9 NIFI-978: Support parameterized statements in ExecuteSQL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2433.
 2018-02-12 20:44:31 +01:00
Koji Kawamura b4a9f52a4e
NIFI-4866: Fixed HBase performance issue 
HBase_1_1_2_ClientService performance dropped due to accessing HBase
admin upon every FlowFile transfer. Fixed that by getting master address
only once when the service is enabled and a connection is established.

This closes #2464
 2018-02-11 16:14:52 -05:00
Lori Buettner b7fdb235ee
NIFI-3367 Added token length check and unit test. 
This closes #2463.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-02-09 17:43:41 -08:00
Mark Payne 61c6f0305b
NIFI-4863: Bug fixes to the way that we handled Remote Group Ports when changing flow version / reverting local changes 
- Everywhere that we ignore adding remote ports we should ignore removing remote ports as well in flow diffs

This closes #2462.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-09 15:45:54 -05:00
Andy LoPresto 336d3cf1f2
NIFI-4856 Removed deprecated ByteArrayInputStream references in ByteCountingInputStreamTest. 
Added failing unit test for #available() at various states (initial, during read, after read).
Implemented #available() delegation.
All tests pass.

This closes #2461.

Signed-off-by: Kevin Doran <kdoran@apache.org>
 2018-02-09 10:49:58 -05:00
Bryan Bende 34b678d30d NIFI-4841 Fixing NPE when reverting local changes involving remote group ports. This closes #2454. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-02-09 10:26:19 -05:00
Matthew Burgess 25e0bbb68d NIFI-4853 - Fixed PutMongoRecord handling of nested records 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2457.
 2018-02-09 15:32:38 +01:00
Matthew Burgess 7d6bbce123 NIFI-4830: Fixed logic errors in BLOB/CLOB processing in JdbcCommon 
This closes #2459.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-02-09 11:45:12 +09:00
Mark Payne 4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap 
This closes #2460.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-08 17:38:13 -05:00
Mike Moser a2f2ddd6b8 NIFI-4699 Use a filter in PostHTTP to pull flowfiles from queue whose URL is the same 
This closes #2412.
 2018-02-08 18:36:11 +00:00
Matthew Burgess 16e56ccfca NIFI-4080: Restored customValidate in ValidateCSV for schema property with no EL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2226.
 2018-02-08 11:56:56 +01:00
Marco Gaido ba192d22da enable EL on FF level 2018-02-08 11:56:49 +01:00
Matthew Burgess 836c324258 NIFI-4080: Added EL support to fields in ValidateCSV 2018-02-08 11:56:42 +01:00
Koji Kawamura 270892f926 NIFI-4846: AvroTypeUtil to support more input types for logical decimal conversion 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2451
 2018-02-07 19:42:26 -05:00
Matt Gilman f3013d0764
NIFI-4837: 
- When Jetty initializes fails, performing a shutdown sequence to ensure all allocated resources are released.

This closes #2455.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-07 16:40:23 -05:00
Koji Kawamura e9af6c6ad8 NIFI-4828: Fix MergeContent to process all ready bins 
Before this fix, MergeContent only processed the first bin even if there
were multiple bins.

There were two unit tests marked with Ignore those had been
failing because of this.

This closes #2444.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-02-07 15:45:39 -05:00
Mark Payne d7da04209a Fix for unit tests that are causing build failures in certain environments 2018-02-07 15:08:52 -05:00
Koji Kawamura 2b062e211f NIFI-4844: Adjust BigDecimal scale to the target Avro schema 
- Applied the same scale adjustment not only to BigDecimal inputs, but
also to Double values.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2450
 2018-02-07 10:38:45 -05:00