ce4374ee00
NIFI-4738: Fixed logic bug in JdbcCommon for 9-digit unsigned ints. This closes #2373
2018-01-04 15:20:35 -05:00
99d767aa44
NIFI-4383 - Fix UpdateRecord when updating arrays elements. This closes #2208 .
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-04 14:30:14 -05:00
98af3dc4cd
NIFI-4595: This closes #2264 . Add ConsumeAzureEventHub.
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-04 14:14:17 -05:00
7a8dbb8b15
NIFI-4733:
...
- Resolving logic issue in two phase commit when updating variable registry. This closes #2370
2018-01-04 13:03:11 -05:00
c832a2ed7c
NIFI-4530: This closes #2329 . Initial support for two-way SSL user authentication in the Docker image.
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-04 10:37:37 -05:00
e439cfef10
NIFI-4389: This closes #2368 . Add Ivy to scripting NARs for Grape/Grab in Groovy
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-04 10:20:47 -05:00
a2a8fcb31c
NIFI-4092: This closes #2365 .
...
- Removing direct dependency on jaxb.
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-04 09:38:35 -05:00
6ee6b5e57c
NIFI-4734 refactored couchbase bundle, jms bundle, removed jms test-lib usage, fixed broken SeeAlso and service links causing docs warns. Corrected L&N in each bundle. This closes #2369 .
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-04 09:16:17 -05:00
42a1ee011b
NIFI-4323 This closes #2360 . Wrapped Get/ListHDFS hadoop operations in ugi.doAs calls
...
NIFI-3472 NIFI-4350 Removed explicit relogin code from HDFS/Hive/HBase components and updated SecurityUtils.loginKerberos to use UGI.loginUserFromKeytab. This brings those components in line with daemon-process-style usage, made possible by NiFi's InstanceClassloader isolation. Relogin (on ticket expiry/connection failure) can now be properly handled by hadoop-client code implicitly.
NIFI-3472 Added default value (true) for javax.security.auth.useSubjectCredsOnly to bootstrap.conf
NIFI-3472 Added javadoc explaining the removal of explicit relogin threads and usage of UGI.loginUserFromKeytab
Readded Relogin Period property to AbstractHadoopProcessor, and updated its documentation to indicate that it is now a deprecated property
Additional cleanup of code that referenced relogin periods
Marked KerberosTicketRenewer is deprecated
NIFI-3472 Cleaned up imports in TestPutHiveStreaming
2018-01-03 11:31:47 -05:00
7467bb7b0f
NIFI-4730 restructure of nifi-gcp-bundle
...
This closes #2367 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-03 11:21:52 -05:00
1959586389
NIFI-4729: This closes #2366 . ConvertJSONToSQL converted boolean values in reverse
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-02 22:01:40 -05:00
9f919b9b65
NIFI-4583 Restructure nifi-solr-processors
...
Make all methods static
NIFI-4583 Restructure nifi-solr-processors R2
This closes #2285 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-01-03 10:10:42 +09:00
84cecfbeea
NIFI-4707: Fixed ProcessGroup tree
...
- Removed duplicated creation of a ParentProcessGroupSearchNode for the
root ProcessGroup.
- Removed duplicated creation of a ParentProcessGroupSearchNode for each
component inside a ProcessGroup.
- Fixed ProcessGroup id hierarchy.
- Fixed filtering logic.
- Added unit tests for filtering by ProcessGroupId and Remote
Input/Output ports.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2351
2018-01-02 14:49:00 -05:00
97dc20e2d9
NIFI-4707: Changed process group parent stack to tree
2018-01-02 14:46:48 -05:00
d65e6b2563
NIFI-4707: Improved S2SProvenanceReportingTask
...
- Simplified consumeEvents method signature
- Refactored ComponentMapHolder methods visibility
- Renamed componentMap to componentNameMap
- Map more metadata from ConnectionStatus for Remote Input/Output Ports
- Support Process Group hierachy filtering
- Throw an exception when the reporting task fails to send provenance
data to keep current provenance event index so that events can be
consumed again
2018-01-02 14:46:42 -05:00
1f793923a4
NIFI-4707: Build full component map for ID -> Name association in provenance reporting"
...
NIFI-4707: Add process group ID/name to S2SProvReportingTask records
NIFI-4707: Added support for filtering provenance on process group ID
NIFI-4707: Fixed support for provenance in Atlas reporting task
NIFI-4707: Refactored common code into reporting-utils, fixed filtering
2018-01-02 14:46:36 -05:00
b7c9c88f9f
NIFI-4444:
...
- Ensure the /nifi-api/controller redirection filter executes before matching.
This closes # 2358.
Signed-off-by: Andy LoPresto <alopresto.apache@gmail.com>
2018-01-02 10:01:03 -05:00
482f371958
NIFI-4701 Add authorizers.xml support to toolkit.
...
Adds authorizers.xml to the files understood by the encrypt-config
tool in the NiFi Toolkit. If enabled, then the sensitive properties
for LdapUserGroupProvider in authorizers.xml will be encrypted.
Also fixes a bug wherein encrypt-config replaces multiple XML nodes
in login-indentity-providers.xml when LdapProvider is not the first
provider listed in the file.
Enable properties in authorizers.xml to be encrypted by the master key.
This closes #2350 .
Signed-off-by: Andy LoPresto <alopresto.apache@gmail.com>
2017-12-31 17:41:04 -05:00
c91d99884a
NIFI-4717: Several minor bug fixes and performance improvements around record-oriented processors
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2359
2017-12-29 10:43:21 -05:00
c59a967623
NIFI-4504, NIFI-4505 added removeAndGet, removeByPatternAndGet, and keySet methods to MapCache API
...
cleaned up some warnings on deprecated nifi.stream.io classes
This closes #2284 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-12-29 00:23:09 +09:00
2fbe922a2b
NIFI-2169: This closes #2343 . Cache compiled regexp for RouteText
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-26 18:02:02 -05:00
353fcdda9c
NIFI-3660: This closes #2356 . Support schema containing a map with an array value in ConvertAvroToORC
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-26 17:46:35 -05:00
49285d325f
NIFI-4719 - Incrementing Template encoding version to 1.2 to reflect changes incorporated in NIFI-3155
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2357 .
2017-12-23 18:15:49 +01:00
14d2291db8
NIFI-4496: Added JacksonCSVRecordReader to allow choice of CSV parser. This closes #2245 .
2017-12-22 08:56:29 -05:00
62e388aa4f
NIFI-4709 - Fixed ListAzureBlobStorage timestamp precision handling.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2354 .
2017-12-21 15:15:09 +01:00
e8f6ff440a
NIFI-4714 - Use lowercase hostname for validation.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2355 .
2017-12-21 14:38:36 +01:00
febb119fac
NIFI-4696 - Add Flowfile attribute EL support and per-table concurrency to PutHiveStreaming
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2342 .
2017-12-20 12:11:38 +01:00
1ee8d16a21
NIFI-4005: Azure Blob Storage SAS support, incorporating review comments. This closes #2353
...
- Renamed Azure to AzureStorageUtils.
- Fixed whitespacing in property description.
- Renamed SAS String to SAS Token.
2017-12-19 10:34:54 -05:00
17ddaf6be0
NIFI-4005 Add support for Azure Shared Access Signature (SAS) Tokens. Upgraded the client library from 5.0.0 to 5.2.0
2017-12-19 10:30:45 -05:00
f04ddcf442
NIFI-4539 - ExtractGrok - Add support returning only named captures
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2233 .
2017-12-19 15:49:14 +01:00
612675e428
NIFI-4684 - Added SQL Parameter Attribute Prefix property to ConvertJSONToSQL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2333 .
2017-12-19 10:32:52 +01:00
17718940d7
NIFI-4689 - Ensuring all provenance properties are represented in nifi.properties.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2352 .
2017-12-19 09:44:25 +01:00
9750cf2fcd
NIFI-3709: Added XMLENC to L&N file. Moved inclusion of nifi-atlas-nar to a profile named include-atlas. This closes #2335 .
2017-12-18 12:24:09 -05:00
fc73c60924
NIFI-3709: Export NiFi flow dataset lineage to Apache Atlas
2017-12-18 12:23:58 -05:00
44a3ac9eff
NIFI-4706 - This closes #2348 . Bump ParCEFone version
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-18 10:13:34 -05:00
406db4867a
NIFI-4702: When we check the next line for matches in Grok Reader, store the Map that is returned so that we don't have to re-evaluate the regexes the next time that nextRecord() is called
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2349
2017-12-18 09:41:05 -05:00
f50a07ec88
NIFI-4655: This closes #2347 . Fixed NPE in the InvokeHTTP processor caused when an SSLContextService was assigned without keystore properties
...
- Added check for keystore properties and only initialized keystore when necessary.
- Added TestInvokeHttpTwoWaySSL test class to test with two-way SSL
- Modified TestInvokeHttpSSL to test with one-way SSL
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-18 09:11:53 -05:00
9217e2fc63
NIFI-4619: Enable expression language on AWSCredentialsProviderControllerService properties
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #2344 .
2017-12-17 12:51:34 -08:00
463dcd8812
NIFI-4629: This closes #2345 . Put flowfiles without the grouping attribute in the default group
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-15 10:35:13 -05:00
15eeb22116
NIFI-4479 Added DeleteMongo processor.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2295
2017-12-14 20:18:20 -05:00
a12abc24e5
NIFI-4683 This closes #2339 . added a few missing license/notice entries for spark controller service and processor nars, removed dead code, cleaned up logging. This sign off is relevant to commit 52684c3ec3b7c0ee28c6cf64cfd178976996615a
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-14 16:23:41 -05:00
2192138b06
NIFI-4683: Add ability to execute Spark jobs via Livy
2017-12-14 16:23:41 -05:00
d543cfde25
NIFI-4675 Lifted restriction on demarcator and kafka.key usage together. This closes #2326 .
2017-12-14 15:15:13 -05:00
48ae4be015
NIFI-4475 Changing the get(batchSize) method in StandardProcessSession so that it checks all connections before returning nothing. This closes #2337 .
2017-12-14 15:08:55 -05:00
57947d64cd
NIFI-4694: Make PutSFTP Disable Directory Listing a normal property. This closes #2338 .
2017-12-14 15:05:40 -05:00
b8375a681a
NIFI-3377: NiFi RPG errors when switching between transport protocols. This closes #2340 .
2017-12-14 15:02:40 -05:00
2608351113
NIFI-4667 Fix LDAP Sync Interval
...
Corrects time unit conversion for the Sync Interval config property
for LdapUserGroupProvider in authorizers.xml.
Also enforces a minimum value of 10 secs for the Sync Interval to help
catch unintentional misconfigurations, for example users upgrading
from previous versions, where tiny Sync Interval values could be set
as a workaround for NIFI-4667.
This closes #2341
2017-12-14 15:01:52 -05:00
d7347a2dc3
NIFI-4644 Fixed LookupService API to allow for more than String/String lookup pairs. This closes #2304 .
2017-12-13 16:04:23 -05:00
bfe92b9000
NIFI-3970 added changes from a code review.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2334
2017-12-11 19:16:34 -05:00
63840377dd
NIFI-3970: Add CSVRecordLookupService
2017-12-11 19:14:27 -05:00
59d3c64195
NIFI-4636 Updated GetMongo to support expression language on limit, results per flowfile and batch fields.
...
NIFI-4636: Added unit tests
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2289
2017-12-11 12:49:42 -05:00
f772f2f093
NIFI-4671: This closes #2328 . Ensure that Avro Schemas that are created properly denote fields as being nullable iff the schemas says they are, for non-top-level fields
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-11 11:46:15 -05:00
600586d6be
NIFI-3366 This closes #2332 . Added parent/child flowfile relationship between the incoming flowfile and the files that are moved from the input directory to the output directory.
...
Updated to allow tests to check for evaluation of properties that support expression language.
Fixed bug with changeOwner attempting to operate on original file rather than the moved/copied file.
Added license header to MoveHDFSTest.java
Added test for moving a directory of files that contains a subdir, ensuring non-recursive behavior
Added to the description of the processor that it is non-recursive when a directory is used as input.
Added RAT exclude for test resource .dotfile to pom.xml
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-11 08:41:36 -05:00
3731fbee88
NIFI-3366 MoveHDFS processor supports expressions language for input and copy operations
...
Signed-off-by: Jeff Storck <jtswork@gmail.com>
2017-12-11 08:41:25 -05:00
c138987bb4
NIFI-4656, NIFI-4680: This closes #2330 . Fix error handling in consume/publish kafka processors. Address issue with HortonworksSchemaRegistry throwing RuntimeException when it should be IOException. Fixed bug in ConsumeerLease/ConsumKafkaRecord that caused it to report too many records received
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-08 16:01:14 -05:00
1fc1d38fd8
NIFI-4562: This closes #2331 . If an Exception is thrown when merging FlowFiles, ensure that we remove the 'bundle' flowfile before exiting the method
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-08 15:35:36 -05:00
3b74d2ddad
NIFI-4633: This closes #2327 . Ensure that everywhere that a FlowFile is passed into ProcessSession that we used the most up-to-date version of it
...
Ensure that when ProcessSession.clone(FlowFile) is called, we obtain the most recent version of the FlowFile before attempting to obtain FlowFile size.
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-08 15:30:01 -05:00
113ad5ecfa
NIFI-4639: Updated PublishKafka 1.0 processor to use a fresh writer for each output record as well. This closes #2292 .
2017-12-08 09:14:17 -05:00
c9cc76b5c8
NIFI-4639: fresh writer for each output record
2017-12-08 08:39:22 -05:00
8e6649ba15
NIFI-2776: This closes #2315 . When joining a cluster, if a processor is stopping but cluster indicates that processor should be running, cause processor to start when its last thread finishes
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-07 15:45:18 -05:00
a774f1df69
NIFI-4673 changed offending tests to be integration tests and fixed travis config to run the build only once and during appropriate script phase instead of install. Reviewed by Bende.
2017-12-06 16:13:42 -05:00
7e61c6333c
NIFI-2375 updated to latest Tika across codebase. Fixed
...
tests and updated L&N for Tika parsers. Turned unstable grpc test to IT
test. Updated deps due to Tika testing findings. This closes #2320
2017-12-06 11:53:15 -05:00
cdc1facf39
NIFI-4664, NIFI-4662, NIFI-4660, NIFI-4659 moved tests which are timing/threading/network dependent and brittle to integration tests and un-ignored tests that are IT. Updated travis to reduce impact on infra and appveyor now skips test runs so is just to prove build works on windows. This closes #2319
...
squash
2017-12-06 10:53:09 -05:00
a0f568b69c
NIFI-4661 no longer building and including the gprc elements by default. This closes #2318
2017-12-05 14:26:05 -05:00
9736cb9d33
NIFI-4663 This closes #2317 . Change log for document not found from warn to debug as we have a NOT_FOUND relationship
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-05 12:44:54 -05:00
00b11e82b7
NIFI-4600: This closes #2312 . Added nifi-kafka-1-0-nar and nifi-kafka-1-0-processors modules
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-04 16:51:59 -05:00
2c68d0e098
NIFI-4652 updating to latest apache version and updating key maven plugins, fixing versions for grpc to avoid extranous build dir, correcting checkstyle issues, resolving build problem with incorrect usage of activeByDefault in maven. Key change is now for the 'dir-only' profile it is now activated via a system property -Ddir-only instead of profile. No other activeByDefault profiles exist except to minifi the javascript but that usage is acceptible as-is. This closes #2313
2017-12-04 09:59:23 -05:00
596a329dc7
NIFI-4653: Fixed bug where Process Group DTO was not containing variables when created with the #createConciseProcessGroup method. This closes #2314 .
2017-12-04 09:31:54 -05:00
a458a139b3
NIFI-4650 This closes #2308 . Added independent hadoop.http.core.version property
...
This closes #2308
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-02 12:58:29 -05:00
9fdab10c7c
NIFI-4645 now being very specific to include if not ppc. This closes #2309
2017-12-01 12:47:40 -05:00
103a345e85
NIFI-4628 Add support for ListS3Version2 API
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #2300 .
2017-11-30 21:53:05 -08:00
dd981e87dd
NIFI-4642 updated tests to be more tolerant/variable to different system speeds. Many of these should be integration tests and not unit tests. This closes #2303 .
2017-11-30 14:59:58 -05:00
45df23b1e0
NIFI-4607, NIFI-3975, NIFI-4602, NIFI-4606: This closes #2272 . Fixed bug in TailFile that caused new Primary Node to not pull current Clustered State when File Location was set to Remote. Fixed bug that caused TailFile to occasionally become 'stuck' when the file it is tailing is renamed and a new file is created with the same name. Removed the 'Rolling Strategy' property from TailFile because it is not actually used in the processor anymore. Deleted MonitorMemoryTest because the unit test was testing the behavior of FlowController more than the behavior of the reporting task itself and in order to do so had a dependency in the pom.xml on nifi-framework-core, which means that it no longer compiles when FlowController is modified.
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-30 11:10:46 -05:00
3b15ed855c
NIFI-4559: Add non-zero status relationship to ExecuteStreamCommand
...
NIFI-4559: Removed Penalize Non-zero Status property and updated doc per review comments
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2246
2017-11-30 10:12:00 -05:00
33281300cd
NIFI-4597 This closes #2283 . correcting imports, checkstyle issues, and adding validator
...
Add a property to override HTTP return code in ListenHTTP processor
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-30 10:02:32 -05:00
3df3ff6c61
NIFI-4646: This closes #2306 .
...
- Ensuring the reason behind the SchemaNotFoundException is reported when interacting with the configured SchemaRegistry.
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-30 09:02:21 -05:00
9ea9996b36
NIFI-4645 make sure the grpc bundle is only built and nar included IF not building on powerpc arch. This closes #2305
2017-11-29 13:33:17 -05:00
73fa0429f0
NIFI-4640 Sub source w/ . in nifi.sh to be POSIX compliant
...
This closes #2302
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-11-28 20:02:58 -05:00
cec2764140
NIFI-4632: Add the local hostname to the list of validated host headers
...
This closes #2288 .
Signed-off-by: Andy LoPresto <alopresto.apache@gmail.com>
2017-11-27 19:08:29 -08:00
ecb9c5e929
NIFI-4445 on fast machines the engine ran for 0 millis so the test needs to allow this case
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2296
2017-11-27 11:47:54 -05:00
9766558cab
NIFI-4526: Allow Target URI's of Remote Process Groups to be changed. This closes #2298
2017-11-27 10:50:32 -05:00
16a23f5a0f
NIFI-4589: Allow multiple keys in FetchDistributedMapCache, add subMap operation to API
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #2260 .
2017-11-21 20:13:35 +00:00
412b3fbbe2
NIFI-4459: This closes #2240 . Catch Exception if trying to iterate over many confluent schemas and unable to load one; in this case log a WARNING and continue on; also updated Jersey client to newest
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-21 12:52:05 -05:00
73702004b9
NIFI-3515: This closes #2257 . Added EventDriven annotation to PutFile
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-21 12:40:13 -05:00
e8b2387cb2
NIFI-4623: This closes #2281 . Removed obsolete instability warning in documentation of newer (>= 0_10) Kafka processors
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-11-21 12:16:54 -05:00
020f9d0596
NIFI-4584: Added @EventDriven to InvokeGRPC
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2265 .
2017-11-21 11:29:42 +01:00
8f2501ffac
NIFI-4612: Allow AvroSchemaRegistry to disable name validation
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2275 .
2017-11-21 11:14:19 +01:00
ff5325b923
NIFI-4614: - Updating the types of resources that are filtered out for viewing purposes. Updates include resources with no values and resources that contain wildcards.
...
This closes #2277 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-20 10:20:01 -05:00
439e13a8d5
NIFI-4567:
...
- Adding new properties to allow the referenced attribute of a user/group to be configurable when detecting group membership.
- Expanding on documentation regarding the new properties.
This closes #2274 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-20 10:09:53 -05:00
6b75921725
NIFI-4617:
...
- Ensuring a charset is specified when convert a string into bytes.
- Ensuring the aggregate snapshot is non null before attempting to promote the runStatus.
This closes #2278 .
2017-11-20 09:39:23 -05:00
5d643edfab
NIFI-4501
...
- Changed request header handling logic.
- Removed unnecessary Maven dependency.
- This closes #2279
2017-11-17 20:36:55 -05:00
c89d793364
NIFI-4615
...
- processor status is set to the ProcessorStatusDTO object
- This closes #2276
2017-11-17 15:44:09 -05:00
2da72f1524
NIFI-4593: - Ensuring the necessary jackson dependencies are bundled.
...
This closes #2263 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-16 15:44:37 -05:00
53de8c93ba
NIFI-4603 - Externalize Max HTTP Header Size to nifi.properties
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2271 .
2017-11-15 10:12:39 +01:00
7f8007f22a
NIFI-4608 Removed unnecessary NiFiProperties mocking given enhancements to StringEncryptor.
...
Fixed checkstyle issues.
Fixed test failure in FingerprintFactoryTest.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2273 .
2017-11-15 10:09:18 +01:00
b9c53083c4
NIFI-4576 - rewording processors / cores
...
NIFI-4576: Rewording processor load average to core load average
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2267
2017-11-14 13:08:53 -05:00
ad2d12a20c
NIFI-4578 Added strategy for dealing with nullable fields in PutHBaseRecord.
...
NIFI-4578 Added changes from code review.
This closes #2256 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-11-14 13:59:30 +09:00
9e9c129c21
NIFI-4577 - ValidateCsv - add attributes to indicate number of valid/invalid lines
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2268
2017-11-13 21:48:30 -05:00
af3a578711
NIFI-4598: When we retrieve the 'controller' from a remote NiFi instance in order to determine which ports are available, cache those results for up to some configurable amount of time (default 30 secs) so that we don't constantly issue HTTP Requests to the remote nifi
...
This closes #2270 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-13 14:46:38 -05:00
c7a5a09b8a
groovyx initial version
...
NIFI-3688 license update to ASF
NIFI-3688 add groovyx dependency
NIFI-3688 comments from @alopresto
- reformat code https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide#ContributorGuide-EclipseUsers
- enabled java-doc
NIFI-3688
- try fix mess with licenses
- remove commented import
- remove unused var `sql`
NIFI-3688 the properties/skip javadoc/src
NIFI-3688 remove not used sql var
NIFI-3688
- first test case
NIFI-3688
+ 2 more tests based on current groovy tests
NIFI-3688 comment from @mattyb149
- processor renamed to ExecuteGroovyScript
NIFI-3688 fix script path validation
NIFI-3688
- refactor to compile on validation
- prepare 4 test cases with database
NIFI-3688 new test cases with groovy and sql
NIFI-3688 documentation
NIFI-3688
- refactor groovy extended methods
- add more test cases
NIFI-3688
- codestyle
- javadoc
- refactor flowfile voids to self-reference
- fix test cases
NIFI-3688 minor comments changes
NIFI-3688 rename additional documentation according to processor classname
NIFI-3688 exclude json test file from rat check
NIFI-3688 codestyle
NIFI-3688 add nar bundle to root pom.xml and to nifi-assembly/pom.xml
NIFI-3688
- fix & extend additional documentation
- fix pom.xml to bundle groovy into nar
NIFI-3688 add examples into additional processor documentation
NIFI-3688 fix pom.xml to exclude unnecessary libs from nar bundle
NIFI-3688 add restricted annotation
NIFI-3688 change version from 1.2.0-SNAPSHOT to 1.3.0-SNAPSHOT after rebase
NIFI-3688 new method in ProcessSession: public OutputStream write(FlowFile source)
NIFI-3688 change version from 1.3.0-SNAPSHOT to 1.4.0-SNAPSHOT after rebase
NIFI-3688 fix for @mattyb149 comment: The bundles referred to here and below are not included with this NAR and should be removed.
NIFI-3688 fix for @mattyb149 comment: This unused line can be removed
NIFI-3688
- removed `require flowfile` property
- fixed test cases according to deprecated property
change version to 1.5.0-SNAPSHOT
[NIFI-3688] Commented by mistake
[NIFI-3688] remove unused class
[NIFI-3688] fix javadoc comments
[NIFI-3688] refactor CTL & SQL properties
b3eecec9012916ce1ec88e15392e2fcloses #1662
2017-11-13 14:32:58 -05:00
2d3e5abf81
NIFI-3155, NIFI-4571: Fix issue of Remote Group Port having ID the same as on the remote system, by adding an additional targetId field RemoteGroupPort's; this also fixes issue of stats being mixed together for RPG's with the same URL. This closes #2253
2017-11-13 13:54:34 -05:00
fe3f288944
NIFI-4588 Added the ability to use update operators like $push and $set to PutMongo.
...
Removed commented out code
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2259
2017-11-13 11:44:22 -05:00
387dce5ad0
NIFI-4591:
...
- Ensuring View Details button is visible if the user has read access and the service is defined in the current Process Group.
This closes #2262
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-11-09 16:41:45 -05:00
f11e03886f
NIFI-4072 replace keyword RELEASE with actual version number
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2258 .
2017-11-09 21:04:50 +01:00
9ecb26a52b
NIFI-4587 - Updating styles to allow for newlines in Process Group, Processor, Controller Service, and Reporting Task comments.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2261 .
2017-11-09 20:25:13 +01:00
37ef2839e0
NIFI-4545: Improve Hive processors provenance transit URL
...
Incorporated review comments:
- Added 'input' to equals() method so that the same table name can appear
as input and output tables.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2239
2017-11-09 12:53:28 -05:00
d0502285f2
NIFI-4568 Added existing but missing property WORKING_DIR
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2250 .
2017-11-08 09:50:14 +01:00
f4a1c9b547
NIFI-4454: Added Process Groups' variables to search capability
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2254
2017-11-06 11:27:05 -05:00
5cd8a3e729
NIFI-4473: Fixed SelectHiveQL flowfile handling during error conditions
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2247 .
2017-11-03 17:03:27 +01:00
b5d7aecfac
NIFI-4560 Added mime.type and record.count Write Attributes to ValidateRecord doc
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2249 .
2017-11-03 11:10:00 +01:00
2a69b35f12
NIFI-4548: Add REMOTE_INVOCATION provenance event type
...
This commit includes changes to DeleteHDFS to report REMOTE_INVOCATION
event. In order to do so, the processor had to be changed to create
output FlowFile because a provenance event needs a FlowFile it
associates with.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2234 .
2017-11-02 19:32:22 +01:00
116c846342
NIFI-4543: Improve HBase processors provenance transit URL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2237 .
2017-11-02 18:24:40 +01:00
77a51e1a9e
NIFI-4544: Improve HDFS processors provenance transit URL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2238 .
2017-11-02 10:10:03 +01:00
6413337918
NIFI-4490: Ensure driver settings are correct before connecting binlog
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2244 .
2017-11-02 09:16:56 +01:00
9a850c7ed2
NIFI-4552 Add mime.type and record.count Write Attributes to QueryRecord doc
...
NIFI-4552 minor checkstyle violation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2242
2017-11-01 14:49:02 -04:00
448f03edae
NIFI-4343 - allow multiple URLs in SiteToSite reporting tasks
...
using SiteToSiteClient.Builder().urls() instead of url()
Updated validator to use parseClusterUrls method
This closes #2121 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-10-30 22:13:06 +09:00
a73b5bda42
NIFI-4546: Make ReportingTask aware of node type in a cluster
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2235 .
2017-10-30 11:22:03 +01:00
d914ad2924
NIFI-4547: Add ProvenanceEventConsumer utility class
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2236 .
2017-10-30 09:50:44 +01:00
fb94e983b6
NIFI-2938 Added Write Attributes to RouteText doc and edited Grouping Regular Expression property description
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2232 .
2017-10-30 09:29:52 +01:00
68715a0dd4
NIFI-4513 - add EL support for proxy settings in InvokeHttp
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2223
2017-10-27 18:15:27 -04:00
d6744b9ee5
NIFI-4528 The ref attribute in the request to view content sent by the client will now be inspected for the proxy context path. If found, it will be removed so the request can be successfully made within the cluster.
...
This closes #2228 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-27 16:06:28 -04:00
e3482cc772
NIFI-4534 Choose Character Set for CSV Record Read/Write streams
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2229 .
2017-10-27 10:34:15 +02:00
856dedab12
NIFI-4522: Add SQL Statement property to PutSQL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2225 .
2017-10-27 09:17:51 +02:00
1625f719e6
NIFI-4518:
...
- Ensuring the last selected variable id is reset when closing the dialog.
This closes #2227
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-26 20:53:37 -04:00
f2bd9f87ba
NIFI-4518:
...
- Addressing issues when handling the done callback for controller service references.
2017-10-26 12:43:02 -04:00
32c0e2be3b
NIFI-4518:
...
- When the URI is too long, invoking the bulletin board multiple times for all specified component ids.
2017-10-26 10:27:57 -04:00
10f27cd5f0
NIFI-2979 PriorityAttributePrioritizer violates Comparator contract. This closes #2220 .
...
Modified the return value when both objects priority values are null to
zero to match the expected return value based upon the Comparator
contract.
2017-10-25 11:31:09 -04:00
c06dee2321
NIFI-3248: Improvement of GetSolr Processor
...
This closes #2199 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-10-23 18:53:54 +09:00
c894246e03
NIFI-3950 Refactor AWS bundle
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #2140 .
2017-10-21 12:58:40 -07:00
2acf6bdf7a
NIFI-3689: Fixed threading bug in TestWriteAheadStorePartition - multiple threads were simultaneously attempting to update HashMap. Changed impl to ConcurrentHashMap.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2214 .
2017-10-20 18:15:02 +02:00
fb839fff56
NIFI-4499 Updated default content-viewer URL property to be relative rather than assuming it is deployed at the root context. This closes #2217
2017-10-19 15:34:39 -04:00
95e86c1f51
NIFI-4495: Expose the option for supressing null values on the JSON Writer
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2218 .
2017-10-19 10:20:40 +02:00
53e63eaf7c
NIFI-4481:
...
- Adding support for visualizing if a component is scheduled for primary node only.
This closes #2210 .
2017-10-18 15:25:23 -04:00
b8a3862078
NIFI-4497:
...
- Fixing issue preventing separators in sub context menus.
This closes #2216
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-18 13:42:58 -04:00
1a1e01c568
NIFI-4473 - fixed NPE in parametrized queries
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2215
2017-10-18 10:13:03 -04:00
4edafad6e5
NIFI-4473: Add support for large result sets and normalizing Avro names to SelectHiveQL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2212 .
2017-10-18 13:37:31 +02:00
fd00df3d2f
NIFI-4465 ConvertExcelToCSV Data Formatting and Delimiters
...
This closes #2194 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-10-17 14:56:49 +09:00
b950eed1a5
NIFI-4439: This closes #2190 . When a Provenance Event File is rolled over, we were failing to close the resource before attempting to compress it. Fixed that.
...
NIFI-4439: Addressed threading bug that can occur when rolling over provenance record writer
Signed-off-by: joewitt <joewitt@apache.org>
2017-10-16 17:18:01 -04:00
ba8f17bac0
NIFI-4488 Corrected misspelling in PutMongoRecord description
...
This closes #2211
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-16 12:04:16 -04:00
6baea8ccff
NIFI-4444:
...
- Upgrading to Jersey 2.x.
- Updating NOTICE files where necessary.
- Fixing checkstyle issues.
This closes #2206 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-10-12 10:27:02 -07:00
9324a2a742
NIFI-4476 Improving logic for determining when to yield in PutTCP/UDP/Syslog/Splunk
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2204 .
2017-10-10 09:02:02 +02:00
883c223ced
NIFI-4386 Fixing connection handling in FetchFileTransfer
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2203 .
2017-10-10 08:50:57 +02:00
13e42678b6
NIFI-4338. This closes #2143 . add docs for ssl configurations in HDFS processors
...
remove redundant additionalDetails.html and add docs to CapabilityDescription in HDFS processors
revert the modified CapabilityDescriptions in HDFS processors and add it to AbstractHadoopProcessor
2017-10-10 00:17:44 -04:00
b5e1fa7ff6
NIFI-4470 - Variables Registry: Increase space...
...
...between Bulletin icon and Controller Service name
This closes #2200
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-09 10:10:17 -04:00
acf05e0636
NIFI-4468: If an entire batch of Provenance Events are read by the Site-to-Site Provenance Reporting Task and none of them match the filters, then the reporting did not update its state, so it would be stuck in this cycle indefinitely. Made fix so that if any event is read from the provenance repository, regardless of whether or not it matches the filters, we update the state to keep track of what has been processed
...
This closes #2198 .
Signed-off-by: Joe Skora <jskora@apache.org>
2017-10-08 15:34:48 -04:00
6201c06c99
NIFI-4392 Create a MetricReportingTask with GraphiteMetricService
...
This closes #2171 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-08 10:44:11 -04:00
5930c0c212
NIFI-4346 Modifying HBase_1_1_2_LookupService to use HBase_1_1_2_ClientService, instead of extend it
...
This closes #2125 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:49 -04:00
eb97a68110
NIFI-4346 Created a LookupService that uses HBase as its back end.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:44 -04:00
39c5c5ab42
NIFI-4301 - This closes #2095 . bumped jython-shaded version to 2.7.1
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-10-06 16:02:10 -04:00
59b60e62d8
NIFI-4450 - Update Kite SDK version
...
This closes #2187 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-06 15:37:22 -04:00
Matthew Burgess
Pierre Villard
Koji Kawamura
Matt Gilman
Aldrin Piri
joewitt
Jeff Storck
U-WOODMARK\johannes.peter
Kevin Doran
Mark Payne
Mike Moser
Marco Gaido
Marco Gaido
Andrew Grande
Norito Agetsuma
trixpan
Josh Anderton
Mike Thomsen
jknulst
Joe Percivall
Gray Gwizdz
matthew-silverman
William Griffiths
Joey Frazee
aburkard
sbouchex
m-hogue
Janosch Woschitz
Andy LoPresto
dlukyanov
Mark Bean
Julian Gimbel
Andrew Lim
patricker
Mark Owens
JohannesDaniel
Christopher Currie
Bryan Bende
Takanobu Asanuma
yuri1969
Omer Hadari
Giovanni Lanzani