Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,023 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

4023 Commits

Author SHA1 Message Date
Koji Kawamura b4e0a6e206 NIFI-4205: Avoid duplicated data from TailFile 
Before this fix, it is possible that TailFile to produce duplicated data
if an already tailed file has newer timestamp and fewer or the same
amout of data.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2021.
 2017-07-20 12:14:05 +02:00
James Wing 1f330b4fe4 NIFI-11 Fixing checkstyle issue - usused import 2017-07-19 22:46:15 -07:00
mans2singh ea1fe1a9c0 NIFI-4188 New RethinkDB Get processor 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2012.
 2017-07-19 20:56:47 -07:00
Andre F de Miranda 451a88df43
NIFI-11 
- Capture Exception to prevent failed evaluations from yielding processor
- Further capture evaluation exceptions as per PR feedback
- Adjust jUnit to new exception behavior
- This closes #1644
 2017-07-19 11:50:48 -04:00
Bryan Bende f87d2a2f57 NIFI-4157 Improvements to PutTCP 
Signed-off-by: Bryan Bende <bbende@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1989.
 2017-07-19 12:25:42 +02:00
joewitt 59754500d5 NIFI-2829 ignoring unit test that appears broken. Commented on JIRA about the problem observed 2017-07-18 22:23:10 -04:00
Andre F de Miranda a307ea3a00 NIFI-4098 This closes #2013. Adjust ParseCEF to re-use bean validator in order to improve performance 2017-07-18 22:02:39 -04:00
Matt Burgess 844dbe4edb NIFI-4156: Fixed fragment.count in SplitText to equal emitted flow files 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2014.
 2017-07-18 11:31:16 +02:00
deonhuang a6e94de0bb NIFI-2829 - Add Date and Time Format Support for PutSQL 
Fix unit test for Date and Time type time zone problem
Enhance Time type to record milliseconds

This closes #1983.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-07-18 14:16:10 +09:00
patricker 03bff7c9fc NIFI-2829 Date and Time Format Support for PutSQL 
This closes #1524.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-07-18 14:11:37 +09:00
Jordan Moore 3da8b94ddd
NIFI-4057 Docker Image is twice as large as necessary 
* Merging unnecessary layers
  * MAINTAINER is deprecated
  * Using JRE as base since JDK is not necessary
  * Set GID=1000 since openjdk image already defines 50
  * Add ability to specify Apache mirror site to reduce load on Apache Archive
  * Created templates directory since this is not included in the binary

This closes #1910.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2017-07-17 17:18:32 -04:00
Mark Payne a9529adab1 NIFI-4093: Fixed bug where we used the wrong Enum to determine how to process an update to the FlowFile Repo 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2017-07-13 10:51:02 -04:00
Koji Kawamura 5c48655e69 NIFI-4112: Fix ConvertExcelToCSV to handle empty cells. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1973
 2017-07-13 10:40:01 -04:00
Koji Kawamura 8acee02393 NIFI-1613 
- Truncate text data types only.
- Added conversion from a boolean to number.
 2017-07-12 17:02:55 -04:00
Koji Kawamura 3844a821f1 NIFI-1613: ConvertJSONToSQL truncates numeric value wrongly. 
- Changed boolean value conversion to use Boolean.valueOf.
- Updated comments in source code to reflect current situation more clearly.
- Updated tests those have been added since the original commits were made.
 2017-07-12 17:02:55 -04:00
Toivo Adams 3b2e43b75c NIFI-1613 Initial version, try to improve conversion for different SQL types. New test and refactored existing test to reuse DBCP service. 
nifi-1613 Adding numeric and Date/time types conversion and test.
 2017-07-12 17:02:55 -04:00
Mark Payne b603cb955d NIFI-4060: Initial implementation of MergeRecord 
NIFI-4060: Addressed threading issue with RecordBin being updated after it is completed; fixed issue that caused mime.type attribute not to be written properly if all incoming flowfiles already have a different value for that attribute

NIFI-4060: Bug fixes; improved documentation; added a lot of debug information; updated StandardProcessSession to produce more accurate logs in case of a session being committed/rolled back with open input/output streams
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1958
 2017-07-12 16:36:48 -04:00
Matt Gilman eefad29167 NIFI-4127: 
- Introducing composite ConfigurableUserGroupProvider and UserGroupProvider.
- Adding appropriate unit tests.
- Updating object model to support per resource (user/group/policy) configuration.
- Updating UI to support per resource (user/group/policy) configuration.
- Adding necessary documentation.
- Updating documentation to clarify integrity checks.
- Providing an example of configuring a composite implementation.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1978.
 2017-07-11 18:13:04 +02:00
Joe Skora 325fe53fa1 NIFI-3677 - ExtractMediaMetadata should close TikaInputStream 
* Added finally block to close TikaInputStream.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1993.
 2017-07-11 18:04:50 +02:00
Jeff Storck 58fc5f24b8
NIFI-1586 Removed check for distributed ZK quorum before starting the DatadirCleanupMananger to enable autopurge during standalone ZK server usage. This closes #2001 2017-07-11 10:04:08 -04:00
m-hogue 07a6499dae NIFI-3218: fixed incorrect assertion for self-routing flowfiles in MockProcessSession 
Signed-off-by: Joe Skora <jskora@apache.org>

This closes #1988.
 2017-07-11 13:51:40 +00:00
m-hogue 58f60b3cf0 NIFI-3218: throw exception in MockProcessSession when transferring file to self 2017-07-11 13:51:13 +00:00
mans2singh 0fd51b4d12 NIFI-4145 Added writes attributes annotation 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1998.
 2017-07-10 21:25:26 -07:00
m-hogue 78fbb8f2ee
NIFI-3939: Reviewed and corrected all incorrect nifi-web-api resource response types. This closes #1999 2017-07-10 14:40:13 -04:00
Mark Payne 87e062ff55
NIFI-4167: StandardResourceClaimManager should not synchronize on a ResourceClaim in order to determine the claim count. This closes #1996 2017-07-10 14:33:07 -04:00
Tony Kurc 2dc45a4dd7 NIFI-4154 Fixing line endings in .java,.html files 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1982.
 2017-07-09 12:13:15 -07:00
mans2singh affc88e599 NIFI-4118 RethinkDB bundle with put processor 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1942.
 2017-07-09 11:10:23 -07:00
Mark Payne 9e296830ab
NIFI-4151: Ensure that we properly call invalidateValidationContext() when properties change; ensure that in the controller service provider we don't replace a controller service with a new node if the ID's match, as we won't be able to actually add the new one to the flow. This closes #1995 2017-07-07 16:41:32 -04:00
Yolanda M. Davis 6df97bbc88
NIFI-4135 - added hadoop-client and enhanced Authorizers entity to support classpath for resources entry 
NIFI-4135 - classpath under class

This closes #1956.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-07-07 10:08:48 -04:00
kwydler e89512e744 NIFI-4161: Adding expression evaluation to AWS PROXY_HOST and PROXY_HOST_PORT property usage 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1990.
 2017-07-07 13:28:33 +02:00
Koji Kawamura e84f9a2416 NIFI-4160: SFTPTransfer connection timeout for opening channel. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1991.
 2017-07-07 12:31:50 +02:00
Koji Kawamura 50c364a793 NIFI-4162: PutSQL batch update error message should include the cause 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1992.
 2017-07-07 12:25:10 +02:00
Pierre Villard 45f82dc855 NIFI-4111 - NiFi shutdown 
Fixed threads shutdown so that NiFi can shutdown gracefully

NIFI-4111 - Review - Handling SocketRemoteSiteListener (RAW S2S)

This closes #1963.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-07-07 14:23:18 +09:00
Mark Payne 3906d4e1d2 NIFI-1763: Initial implementation of ConfluentSchemaRegistry. 
NIFI-1763: Fixed bug where the Confluent Schema Registry Schema Access Writer was not being created

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1938
 2017-07-06 15:52:07 -04:00
Pierre Villard a3b72f1bb7
NIFI-4143 - externalize MAX_CONCURRENT_REQUESTS. This closes #1962 2017-07-06 15:38:55 -04:00
Mark Payne ba56774fa1
NIFI-4151: Updated UpdateAttribute to only create JAXB Context once; Minor performance tweaks to standard validators and StatusMerge.prettyPrint; updated AbstractConfiguredComponent to not create a new ValidationContext each time that validate is called but only when needed; updated FlowController, StandardControllerServiceProvider, and StandardProcessGroup so that component lookups can be performed using a ConcurrentMap at FlowController level instead of having to perform a depth-first search through all ProcessGroups when calling findProcessor(), findProcessGroup(), findXYZ() 
This closes #1979
 2017-07-06 13:43:56 -04:00
Mark Payne cff81c0cd2
NIFI-4153: Use a LinkedBlockingQueue instead of a SynchronousQueue for Request Replicator's thread pool so that requests will queue when all threads are active, instead of throwing an Exception. This closes #1980 2017-07-06 10:11:48 -04:00
m-hogue e6b166a3a2 NIFI-552: added regex properties for include and ignore filters in LogAttribute 
This closes #1981

Signed-off-by: Tony Kurc <tkurc@apache.org>
 2017-07-05 21:21:50 -04:00
m-hogue 47eece5798 NIFI-3193: added ability to authenticate using cert common names 
This closes #1971.

Signed-off-by: Tony Kurc <tkurc@apache.org>
Also reviewed by Pierre Villard <pierre.villard.fr@gmail.com>
 2017-07-05 15:28:54 -04:00
Pierre Villard 7843b885ee NIFI-4144 - added min/max age to ListHDFS processor 
This closes #1966.

Signed-off-by: Tony Kurc <tkurc@apache.org>
 2017-07-04 21:18:43 -04:00
Pierre Villard 8b5342dec0 NIFI-3974 - Added charset in LogAttribute 
This closes #1967

Signed-off-by: Tony Kurc <tkurc@apache.org>
 2017-07-02 12:03:07 -04:00
Andrew Lim 0c27a0888d
NIFI-3880 Added complete TLS Toolkit options to Admin Guide. 
This closes #1965.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-30 14:45:35 -07:00
Pierre Villard 902b6e205d NIFI-4131 - GFT warning message when badly setting relationships 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1954
 2017-06-30 15:12:10 -04:00
Mark Payne 7f4cfd51ea NIFI-3897: If swapping data into queue and an unexpected exception/error is thrown, do not lose track of the swap file 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1960.
 2017-06-30 13:53:05 +02:00
Mark Payne cdc154f7c8 NIFI-4046: If we are unable to parse out any records from a Kafka Mesaage with ConsumeKafkaRecord, then we should route all of the bytes received to 'parse.failure' 
NIFI-4046: Addressed issue of Record Writer failing with ConsumeKafkaRecord

This closes #1906.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-06-30 17:56:14 +09:00
m-hogue 58a623dfa2 NIFI-4037 added InvokeGRPC processor, with proto service IDL 
NIFI-4038 added ListenGRPC processor

This closes #1947

Signed-off-by: Tony Kurc <tkurc@apache.org>
 2017-06-29 22:01:22 -04:00
yuri1969 3bf1d12706
NIFI-4125 Added secure transform feature and configuration to TransformXML processor to mitigate XXE file system leaks. 
This closes #1946.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-06-29 10:40:33 -07:00
Andrew Lim 3089d9dce0 NIFI-4138 Add Component Alignment to User Guide 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1959
 2017-06-29 11:54:56 -04:00
Mike Thomsen 5172797448 NIFI-4122 Added the ability to combine multiple Mongo result documents into a single output JSON array. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1948.
 2017-06-29 12:43:52 +02:00
Sreeram Garlapati 82ef671953 NIFI-4007 - Update azure EventHubs client to latest version 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1880.
 2017-06-29 09:30:39 +02:00