Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-07 18:48:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,235 Commits 147 Branches 203 Tags
Commit Graph

2517 Commits

Author SHA1 Message Date
Jorge Machado
06cb354c5e NIFI-4960: fix object setting. This closes #2531. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-12 09:44:23 -04:00
Joe Skora
49c7af03c1 NIFI-3039 Provenance Repository - Fix PurgeOldEvent and Rollover Size Limits 
* Added low water mark for purgeOldEvents() to more quickly purge after a large spike in events.
* Adjusted rollover high water mark to avoid overrunning "nifi.provenance.repository.max.storage.size".
* Adjusted looping logic in mergeJournals() to use ".firstKey()" instead of ".entrySet().iterator().next()" to avoid unnecessary object creation.

Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #1240
 2018-03-09 21:49:13 +00:00
joewitt
c71409fb5d
NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max 
NIFI-4936 updated dependency handling pushing down delcarations where they belong
This closes #2512
 2018-03-09 16:34:53 -05:00
Andy LoPresto
e9d585a785
NIFI-4870 Upgraded activemq-client and activemq-broker versions to 5.15.3. 
- Updated copyright dates in NOTICE files.
- This closes #2469.
 2018-03-09 13:59:13 -05:00
Mike Thomsen
3cdd3f60f6 NIFI-4949 Converted nifi-mongodb-services' unit tests into integration tests so that the @Ignore annotation doesn't have to be removed to make them run. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2525.
 2018-03-09 09:36:15 +01:00
Kevin Doran
79fa4ad46f
NIFI-4835 Corrects Swagger spec response types in FlowResource 2018-03-08 14:30:31 -05:00
Kevin Doran
fdca7d0a01
NIFI-4859 Corrects Swagger Spec VersionedFlowState allowableValues 2018-03-08 14:30:30 -05:00
Pierre Villard
1f8af1bde3 NIFI-4948 - MongoDB Lookup Service throws an exception if there is no match 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2522
 2018-03-08 13:28:41 -05:00
Mike Thomsen
dae2b73d94 NIFI-4929 Converted the majority of MongoDB unit tests to integration tests so they can be reliably run with 'mvn -Pintegration-tests integration-test' 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2508.
 2018-03-08 19:23:44 +01:00
gardellajuanpablo
2e4ddbf3b2 NIFI-4893 Cannot convert Avro schemas to Record schemas with default arrays 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-06 14:09:39 -05:00
Takanobu Asanuma
bfecf0f06c
NIFI-4855: 
- Fix the layout of NiFi API document
- update the sub-title to be more detailed
- This closes #2503
 2018-03-06 10:30:18 -05:00
Matt Gilman
91f40febeb NIFI-4925: 
- Addressing memory leak from lingering authorization results that did not represent actual access attempts. This closes #2511.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-05 15:37:31 -05:00
Jeff Storck
e916594b69 NIFI-4872 Added annotation for specifying scenarios in which components can cause high usage of system resources. 
- Initial set of components marked with the HighResourceUsageScenario annotation.
- Added customized descriptions to SystemResourceConsideration annotations for MergeContent, SplitContent, SplitJson, SplitText, and SplitXml.

This closes #2475.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-05 15:32:23 -05:00
Matthew Burgess
dd58a376c9 NIFI-4773 - Fixed column type map initialization in QueryDatabaseTable 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2504.
 2018-03-02 17:32:14 +01:00
Bryan Bende
179e967b47 NIFI-4920 Skipping sensitive properties when updating component properties from versioned component. This closes #2505. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-02 11:15:39 -05:00
Mark Payne
74bb341abc NIFI-2630: Changed name of queue in unit test to be unique in order to avoid getting messages from another test if the other tests fails to properly shutdown the connection. This closes #2458. 2018-03-02 09:37:00 -05:00
Mike Moser
42e6fa42a3 NIFI-2630 Allow PublishJMS to send TextMessages 
- Added configurable character set encoding for JMS TextMessages
- Improved PublishJMS/ConsumeJMS documentation
- Validate character set in property validator instead of OnScheduled
 2018-03-02 09:11:58 -05:00
Pierre Villard
c58b025186 NIFI-4916 - ConvertExcelToCSVProcessor inherit parent attributes. This closes #2500. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-02 08:47:32 -05:00
Mark Payne
b4a4cc564e Fixed failing unit tests: Changed the queues used to unique names so that one test won't interfere with another; also changed JMSPublisherConsumerTest to JMSPublisherConsumerIT since it is an integration test between the publisher and consumer with ActiveMQ as the broker 2018-03-02 08:44:25 -05:00
Derek Straka
44bc2d41d7 NIFI-4880: Add the ability to map record based on the aliases. This closes #2474 
Signed-off-by: Derek Straka <derek@asterius.io>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-02-28 14:19:53 -05:00
James Wing
77dc186097 NIFI-4876 - Adding Min Object Age to ListS3 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2491.
 2018-02-28 12:01:35 +01:00
Matt Gilman
19b5b60b0f NIFI-3502: 
- Ensuring D3 is available on the summary and users page.

This closes #2495

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-27 08:54:58 -05:00
Mike Thomsen
3d9c470be3 NIFI-4827 Added support for reading queries from the flowfile body to GetMongo. 
NIFI-4827 Added changes from code review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2443
 2018-02-26 14:19:35 -05:00
mans2singh
f7fe2da106 NIFI-4289 - InfluxDB Put processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2101.
 2018-02-24 14:46:35 +01:00
Matthew Burgess
62732cbb88 NIFI-4903 - Fixed timestamp bug with fetch processors using Oracle 12+ 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2488.
 2018-02-22 20:56:30 +01:00
Matt Gilman
d75f118ae1 NIFI-4894: 
- Ensuring that any proxy paths are retained when querying for bulletins.

This closes #2482

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-21 13:09:59 -05:00
Pierre Villard
ff95be2a11 NIFI-4815 - Add EL support to ExecuteProcess 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2432
 2018-02-21 12:47:33 -05:00
Pierre Villard
bc37015693 NIFI-4814 - Add distinctive attribute to S2S reporting tasks 
NIFI-4814 - added UUID attribute

NIFI-4814 - added type attribute

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2431
 2018-02-21 11:14:38 -05:00
Matthew Burgess
b4b970b876 NIFI-4816: Allow name to be updated for ReportingTasks 
This closes #2452

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-21 09:42:25 -05:00
Mike Thomsen
54b1659704 NIFI-4429 Added GetMongoAggregation to support running Mongo aggregations. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2180
 2018-02-21 08:58:38 -05:00
Matt Gilman
160bea8bf3
NIFI-4538: 
- Fixing broken unit test.
 2018-02-20 17:14:49 -05:00
Matt Gilman
ba9e72ed8b NIFI-3502: 
- Preventing digest() during an ongoing apply() or digest() lifecycle.

This closes #2471

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-02-20 16:25:12 -05:00
Matt Gilman
bf72d05825 NIFI-3502: 
- Ensuring that upon deselection, the monitor palette is updated accordingly.
 2018-02-20 14:51:44 -05:00
Matt Gilman
9cd631f963 NIFI-3502: 
- Upgrading to D3 version 4.
 2018-02-20 14:51:44 -05:00
yuri1969
91e98aa50b
NIFI-4538 - Add Process Group information to... 
...Search results

* Separated the search functionality.
* Added a unit test.
* Added the PG info to UI (a mere draft).
* Introduce the nearest versioned group
* Removed the top level group results in favour of the nearest versioned group.
* This closes #2364
 2018-02-20 12:42:09 -05:00
Mark Payne
9f95a10df9 NIFI-4794: Updated event writers to avoid creating a lot of byte[] by reusing buffers. Also removed synchronization on EventWriter when rolling over the writer and just moved the writing of the header to happen before making the writer available to any other threads. This reduces thread contention during rollover. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2437
 2018-02-19 09:31:11 -05:00
Mark Payne
0bcb241db3 NIFI-4774: Implementation of SequentialAccessWriteAheadLog and updates to WriteAheadFlowFileRepository to make use of the new implementation instead of MinimalLockingWriteAheadLog. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2416
 2018-02-19 09:26:01 -05:00
Mark Payne
14fef2de14 NIFI-4772: Refactored how the @OnScheduled methods of processors is invoked/monitored. The new method does away with the two previously created 8-thread thread pools and just uses the Timer-Driven thread pool that is used by other framework tasks. 
NIFI-4772: Introduced a new thread-pool with 2 threads that will be used for monitoring lifecycle task. This means that if all threads in the timer-driven thead pool are blocked by processors that don't complete their @OnScheduled methods, we have a separate thread pool that at least gives us a chance of interrupting those threads

NIFI-4772: Remove unused import
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2403
 2018-02-19 09:19:53 -05:00
Matthew Burgess
2a5e21c11b NIFI-4836 - Allow output of FlowFiles during result set processing in QueryDatabaseTable 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2447.
 2018-02-17 15:56:05 +01:00
zenfenaan
82e36f3c71 NIFI-4819: Added DeleteAzureBlobStorage that handles deletion of blob from an Azure Storage container 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2436.
 2018-02-17 15:49:01 +01:00
Bryan Bende
b855d0acae
NIFI-4884 Fixing ordering during import from registry so that we set schedule strategy on a processor before setting scheduling duration. This closes #2472 2018-02-16 09:27:36 -05:00
Mike Thomsen
143d7e6829 NIFI-3538 Added DeleteHBaseRow 
This closes #2294.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-02-14 10:04:25 +09:00
Andy LoPresto
28067a29fd
NIFI-4869 Added SAX utility method for SplitXML processor. 
Added unit tests.
Added test resources to RAT exclude list.
This closes #2466
 2018-02-13 15:29:29 -05:00
Matthew Burgess
b5ca7adbb9 NIFI-978: Support parameterized statements in ExecuteSQL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2433.
 2018-02-12 20:44:31 +01:00
Koji Kawamura
b4a9f52a4e
NIFI-4866: Fixed HBase performance issue 
HBase_1_1_2_ClientService performance dropped due to accessing HBase
admin upon every FlowFile transfer. Fixed that by getting master address
only once when the service is enabled and a connection is established.

This closes #2464
 2018-02-11 16:14:52 -05:00
Mark Payne
61c6f0305b
NIFI-4863: Bug fixes to the way that we handled Remote Group Ports when changing flow version / reverting local changes 
- Everywhere that we ignore adding remote ports we should ignore removing remote ports as well in flow diffs

This closes #2462.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-09 15:45:54 -05:00
Bryan Bende
34b678d30d NIFI-4841 Fixing NPE when reverting local changes involving remote group ports. This closes #2454. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-02-09 10:26:19 -05:00
Matthew Burgess
25e0bbb68d NIFI-4853 - Fixed PutMongoRecord handling of nested records 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2457.
 2018-02-09 15:32:38 +01:00
Matthew Burgess
7d6bbce123 NIFI-4830: Fixed logic errors in BLOB/CLOB processing in JdbcCommon 
This closes #2459.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-02-09 11:45:12 +09:00
Mark Payne
4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap 
This closes #2460.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-08 17:38:13 -05:00