Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,275 Commits 146 Branches 201 Tags 409 MiB
Commit Graph

4275 Commits

Author SHA1 Message Date
Andy LoPresto d09145e3e3 NIFI-4557 Added Expression Language support for PGP private keyring passphrase in EncryptContent. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2566.
 2018-03-20 11:23:45 +01:00
Koji Kawamura 2590c88318 NIFI-4979 - Fix ReportLineageToAtlas documentation errors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2549.
 2018-03-19 17:56:13 +01:00
jugi92 78daaf40f8 NIFI-4991 This closes #2564. 
nifi.database.directory should be moved out of default location <root-level-nifi-dir>/database_repository to ease the update process.

Signed-off-by: joewitt <joewitt@apache.org>
 2018-03-19 11:41:56 -04:00
Mark Payne 39556e3513 NIFI-4902: This closes #2485. Updated ConsumeAMQP, PublishAMQP to use one connection per concurrent task instead of a single connection shared by all concurrent tasks. This offers far better throughput when the network latency is non-trivial. Also refactored to simplify code 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-03-19 11:40:49 -04:00
Derek Straka 5bdb7cf6e7 NIFI-4912: This closes #2494. Update jackson version to latest stable version (2.9.4) 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-03-19 10:22:50 -04:00
Internet 1091093133 NIFI-4777: get schema by id even if not latest 
This closes #2405.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-19 09:57:38 -04:00
Pierre Villard 4687e0fb35 NIFI-4981 Allow using FF's content as message in PutEmail 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2556.
 2018-03-18 11:35:43 -07:00
Mike Moser c9f1c9789d NIFI-4973 Added license comment to new file RemoteProcessGroupEntityMergerTest.java 2018-03-16 19:15:52 +00:00
Julian Gimbel 9cd0aab696 NIFI-4918: looping over several methods to try and fit the dynamic attribute. 
If failed, use first method and throw error if not working.

Array.length can never be less then 0

This closes #2499.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-16 14:40:59 -04:00
Mark Bean 8b2c5b7246 NIFI-4950 Defining behavior for MergeContent when more than 1 FlowFile has the same fragment.index value 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2557.
 2018-03-16 18:31:43 +00:00
Derek Straka c056ede6cc NIFI-4951: Update convertToAvroObject to use the DataTypeUtils conversion function 
The feature allows users to convert from non-integral types to the correct underlying type.  The
original behavior is maintained; however, now simple conversions take place automatically for some
logical types (date, time, and timestamp).

This closes #2526.

Signed-off-by: Derek Straka <derek@asterius.io>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-16 14:08:14 -04:00
Matt Gilman a1c917656e NIFI-4973: 
- Fixing RPG port merging.
- Adding unit tests.
- Removing unecessary sorting that wasn't maintained while clustered.

This closes #2551.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-16 13:03:09 -04:00
Marco Gaido 86f162b611 NIFI-4959: Remove flowfiles and close connection for Bad Requests causing IOException 
This closes #2544.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-16 12:24:00 -04:00
Mark Payne 3f0aa6e13c Changed some unit tests to Integration Tests because they are creating embedded JMS Brokers (implicitly) and commnicating with it. This becomes brittle in a full build, especially if any other unit test attempts to create a broker implicitly due to the way that the activemq broker implicit creation works. 2018-03-16 12:07:33 -04:00
Koji Kawamura ada069ce42 NIFI-4978: Fixed ReportLineageToAtlas NPE when unscheduled 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2548.
 2018-03-16 10:19:59 +01:00
Mark Payne 7d5f803ce6 Fixed checkstyle violation 2018-03-15 16:16:12 -04:00
Bryan Bende de71a41bd0 NIFI-4935 Refactoring to support specifying schema branch or schema version when using schema by name strategy 
This closes #2523.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-15 16:16:12 -04:00
Pierre Villard 930417b9dc NIFI-4809 - Implement a SiteToSiteMetricsReportingTask 
address review comments

NIFI-4809 - Added Record Writer property

added unit tests and additional details doc

review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2430
 2018-03-15 15:58:31 -04:00
Mark Payne 844da06344
NIFI-4849: Implemented REST Endpoint and associated backend code to generate a Diagnostics Report for a Processor 
Implemented review feedback. Refactored data model to make the API cleaner and delineate more along the lines of what permissions are required in order to see which details
Implementing review feedback
Removed sensitive information from the diagnostics reports
Fixed bug in merging logic for GCDiagnosticsSnapshots
This closes #2468
 2018-03-15 15:10:41 -04:00
Mark Payne 867ffdb52e NIFI-4976: If unable to retrieve message content, warn an error but acknowledge message. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2545.
 2018-03-14 22:50:34 +01:00
Koji Kawamura d3f54994a6 NIFI-4972 - SelectHiveQL to emit FETCH provenance event 
SelectHiveQL should emit FETCH instead of CONTENT_MODIFIED when it has
incoming connections.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2543.
 2018-03-14 10:17:19 +01:00
Jorge Machado b0e5e1644c NIFI-4821 - Upgrade poi to 3.17 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2534.
 2018-03-13 22:59:03 +01:00
Deon Huang 37ad48844a NIFI-4962 FlattenJson processor add unexpected backslash after flatten 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2538.
 2018-03-13 22:33:53 +01:00
Pierre Villard 11a7d5c09f NIFI-4955 - Preserve columns ordering with CSV and ValidateRecord 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2528
 2018-03-13 17:09:07 -04:00
Pierre Villard 95e543d4cc NIFI-4967 - CSVRecordReader does not read header with specific formats 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2536
 2018-03-13 16:54:46 -04:00
Pierre Villard c75604a564 NIFI-4966 - JacksonCSVRecordReader - NPE with some CSV formats 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2535
 2018-03-13 16:49:47 -04:00
Ed 29c2e18832 NIFI-4968: fix printing indefinite log errors 
After first failure in customValidate, stop printing logs until any property is changed

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2537
 2018-03-13 16:40:49 -04:00
Bryan Bende 9b098f3235
NIFI-4864 - Additional improvements to additonal resource loading 
This closes #2470.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-03-13 13:23:28 -04:00
zenfenan fad152f389
NIFI-4864 Fixing Additional Resources property pointing at a directory won't find new JARs 
NIFI-4864: Code refactor and improved additionalUrlsFingerprint implementation
Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-03-13 13:23:16 -04:00
Bryan Bende f1d7518547
NIFI-4969 Fixing error when importing versioned flow with a processor that uses event driven scheduling. This closes #2539 2018-03-13 13:15:24 -04:00
Mark Payne d14229e440 NIFI-4774: Allow user to choose which write-ahead log implementation should be used by the WriteAheadFlowFileRepository 
Removed TODO comment

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2487
 2018-03-13 13:03:39 -04:00
Ed c2616e6fe7
NIFI-4833 Add ScanHBase Processor 
- New processor for scanning HBase records based on verious params like range of rowkeys, range of timestamps. Supports result limit and reverse scan.
- Adds Atlas Support for ScanHBase processor
- Fixed not recent version of FF
- Formatting and Style changes
- Single line to multiline if-then statements
- Removed HTML formatting that is not used for doc generation
- Fixed issue with limitRows
- Fixed issue with filter expression
- Refactored "processRows"
- Fixed possible NPE for bulkSize var
- Changed provenance to "receive" to indicate new data from external source.
- Updated min/max timestamp custom validation
- JSON array support
- Removed in-memory caching for records. Now records are being written directly to FF
- Removed unfinished flowfile from session, transfered original to "failure". Test cases update as well

This closes #2478.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-03-13 10:07:07 -04:00
m-hogue 6471f66acd NIFI-3402 - Added etag support to InvokeHTTP 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2150.
 2018-03-13 10:00:11 +01:00
Deon Huang 7aabb99bcc NIFI-4800 Expose the flattenMode as property in FlattenJSON processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2530.
 2018-03-13 09:28:22 +01:00
joewitt d78d95ad6f NIFI-4885 fixing checkstyle issue 2018-03-12 22:22:59 -04:00
Pierre Villard 9158c19123 NIFI-4958 - This closes #2529. Fix Travis job status + atlas profile 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-03-12 16:33:20 -04:00
Ed 373cf090a4 NIFI-4953 - FetchHBaseRow - update log level for "not found" to DEBUG instead of ERROR 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2527.
 2018-03-12 20:21:40 +01:00
Matt Gilman b1217f529b NIFI-4885: 
- Introducing more granular restricted component access policies.

This closes #2515.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-12 14:19:42 -04:00
Matthew Burgess d4632bdd5d
NIFI-4944: Guard against race condition in Snappy for PutHiveStreaming 
NIFI-4944: Removed unnecessary synchronized block, added more comments
This closes #2519
 2018-03-12 13:22:40 -04:00
Matt Gilman 32a8db2253
NIFI-4936: 
- Moving definition of ranger version into root pom.

This closes #2532.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-03-12 10:39:54 -04:00
Jorge Machado 06cb354c5e NIFI-4960: fix object setting. This closes #2531. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-12 09:44:23 -04:00
Joe Skora 49c7af03c1 NIFI-3039 Provenance Repository - Fix PurgeOldEvent and Rollover Size Limits 
* Added low water mark for purgeOldEvents() to more quickly purge after a large spike in events.
* Adjusted rollover high water mark to avoid overrunning "nifi.provenance.repository.max.storage.size".
* Adjusted looping logic in mergeJournals() to use ".firstKey()" instead of ".entrySet().iterator().next()" to avoid unnecessary object creation.

Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #1240
 2018-03-09 21:49:13 +00:00
joewitt c71409fb5d
NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max 
NIFI-4936 updated dependency handling pushing down delcarations where they belong
This closes #2512
 2018-03-09 16:34:53 -05:00
Matt Gilman 8f66454455
NIFI-4945: 
- Upgrading spring security version.

This closes #2524.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-03-09 11:50:26 -08:00
Andy LoPresto e9d585a785
NIFI-4870 Upgraded activemq-client and activemq-broker versions to 5.15.3. 
- Updated copyright dates in NOTICE files.
- This closes #2469.
 2018-03-09 13:59:13 -05:00
Mike Thomsen 3cdd3f60f6 NIFI-4949 Converted nifi-mongodb-services' unit tests into integration tests so that the @Ignore annotation doesn't have to be removed to make them run. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2525.
 2018-03-09 09:36:15 +01:00
Kevin Doran 79fa4ad46f
NIFI-4835 Corrects Swagger spec response types in FlowResource 2018-03-08 14:30:31 -05:00
Kevin Doran fdca7d0a01
NIFI-4859 Corrects Swagger Spec VersionedFlowState allowableValues 2018-03-08 14:30:30 -05:00
Pierre Villard 1f8af1bde3 NIFI-4948 - MongoDB Lookup Service throws an exception if there is no match 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2522
 2018-03-08 13:28:41 -05:00
Mike Thomsen dae2b73d94 NIFI-4929 Converted the majority of MongoDB unit tests to integration tests so they can be reliably run with 'mvn -Pintegration-tests integration-test' 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2508.
 2018-03-08 19:23:44 +01:00