Commit Graph

130 Commits

Author SHA1 Message Date
Jeremy Dyer d05727b8c0 NIFI-2613 Apache POI processor for Excel to CSV
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #929.
2017-03-17 10:39:05 -07:00
joewitt 443803e729 NIFI-2564 corrected L&N to reference new BeanUtils dependency. 2017-03-09 22:00:41 -05:00
jpercivall b7f946e847 NIFI-1682 Adding AttributeRollingWindow processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1328.
2017-03-06 19:42:25 +01:00
Andre F de Miranda a32e1509b6 NIFI-3238 - Introduce ListenBeats processor and deprecates ListenLumberjack processor
NIFI-3238 - Rewords processor description

NIFI-3238: Removed unused imports

This closes #1418
2017-03-01 21:41:51 -05:00
smarthi dfd04e638b
[NIFI-3507]-Update NiFi-assembly Java Requirement to 1.8
This closes #1531.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-02-23 09:30:47 -05:00
Scott Aslan 364efa96cc
[NIFI-3501] Upgrade D3 to 3.5.17 and allow npm to pull it down at build time. This closes #1519 2017-02-21 10:17:34 -05:00
Oleg Zhurakousky 6a1854c975 NIFI-3354 Added support for simple AVRO/CSV/JSON transformers that utilize external Schema
Added support for simple Key/Value Schema Registry as Controller Service
Added support for registering multiple schemas as dynamic properties of Schema Registry  Controller Service
Added the following 8 processors
- ExtractAvroFieldsViaSchemaRegistry
- TransformAvroToCSVViaSchemaRegistry
- TransformAvroToJsonViaSchemaRegistry
- TransformCSVToAvroViaSchemaRegistry
- TransformCSVToJsonViaSchemaRegistry
- TransformJsonToAvroViaSchemaRegistry
- TransformJsonToCSVViaSchemaRegistry
- UpdateAttributeWithSchemaViaSchemaRegistry

polishing

NIFI-3354 Adding support for HDFS Schema Registry, unions and default values in the Avro Schema and NULL columns in the source CSV

NIFI-3354 Adding support for logicalTypes per the Avro 1.7.7 spec

NIFI-3354 polishing and restructuring CSVUtils

NIFI-3354 renamed processors to address PR comment

NIFI-3354 addressed latest PR comments
- removed HDFS-based ControllerService. It will be migrated into a separate bundle as a true extension.
- removed UpdateAttribute. . . processor
- added mime.type attribute to all Transform* processors

NIFI-3354 added missing L&N entries

This closes pr/1436
2017-02-17 14:32:06 -05:00
Aldrin Piri 76fcf5def1 NIFI-3385 - This closes #1440. Updating copyright statements to reflect the new year. 2017-02-16 00:10:02 -05:00
patricker b7cdc6b382 NIFI-2779 - Add processor to GetEmail Supporting Exchange Web Services
This closes: #1326

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-02-15 23:48:34 +11:00
Matt Burgess 7963df89eb NIFI-3288: Add Clojure support for ExecuteScript
This closes: #1402.

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-02-15 02:52:11 +11:00
Selim Namsi 2ef7c15b5d NIFI-2565: add Grok parser
This closes #1108.

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-02-14 21:11:03 +11:00
Gene Peters 897c70298a NIFI-3449: Adding Google Cloud Storage Bundle
* Credentials service with tests
* Abstract processor definitions
* GCS-themed processors and their corresponding tests

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1482.
2017-02-12 19:52:38 -08:00
Andre F de Miranda 68c2d7862f NIFI-3434 - Introduce the ability to skip the packaging of zip and tar.gz archive
via maven profile (i.e. -Pdir-only)
2017-02-07 11:42:03 +01:00
Andre F de Miranda 76e31dfd19 NIFI-3015 - This closes #1422. Corrects issue were RPM profile run.as property was not being used
This supersedes #1198
2017-02-06 09:36:52 -05:00
Oleg Zhurakousky f0856565ad NIFI-2615 polishing
- added missing POM entries to nifi POM and assembly POM
- added available port-discovery to tests amongs other minor polishings
2017-01-25 13:22:50 -05:00
Matt Gilman 6170f6442e NIFI-3291:
- Upgrading jQuery and it's plugins.
- Packaging at build time using npm.
2017-01-17 14:54:59 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
joewitt 22143e386d NIFI-2991 This closes #1265. was allowed to restore twitter4j json.org usage until April. Resolution for that will be in NIFI-3089 2016-11-23 10:21:41 -05:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Burgess dba9d5924a NIFI-3011: Added Elasticsearch5 processors
This closes #1233

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-21 15:58:40 -05:00
Koji Kawamura 26a5881d21 NIFI-1002: Added WebSocket support.
NIFI-1002: Added WebSocket support.

- Reflecting review comments
- Added displayName to peroperty descriptors

NIFI-1002: Added WebSocket support.

This closes #1184

- Reflecting review comments:
  - Removed unnecessary use of NarCloseable.withComponentNarLoader.
  - Removed intermediate on memory queue to make it simpler and more
    robust. Received messages in WebSocket layer now will be transferred
to downstream relationships directly.
2016-11-15 19:34:59 -05:00
joewitt b026f0bebe NIFI-2991 removed json.org references as appropriate for build. Twitter proc no longer deployed but reference kept in notice just in case someone uses it
This closes #1230

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 18:09:27 -05:00
joewitt 1c9077334f NIFI-2991 removed usage of json lib and components still using it
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 18:09:09 -05:00
Bryan Bende fe59b3415c NIFI-3003 Upgrading hadoop.version to 2.7.3 and fixing TDE issue with PutHDFS, ensuring clean up of instance class loaders, and adding classpath resource property to all HDFS processors
NIFI-3003 Addressing review feedback

NIFI-3003 added minor notice updates

This closes #1219
2016-11-15 16:23:27 -05:00
joewitt 8ad3125168 NIFI-2380 This closes #817. corrected licensing and notice and remove conflicting mail deps 2016-11-14 21:04:33 -05:00
Andre F de Miranda a347ebf87b NIFI-2380 - Introduce ExtractTNEFAttachment - A processor to extract
attachments embedded within a Transport Neutral Encapsulation Format (TNEF) attachment (i.e. winmail.dat)
2016-11-14 21:04:12 -05:00
joewitt 3e892c55ec NIFI-2971 This closes #1172. addressed RPM bundled deps and handling exception for bootstrap cl construction 2016-11-09 11:08:43 -05:00
James Wing a486fefb1e NIFI-2115 Detailed Version Info in About Box
* Java version and vendor
* OS name and version
* Release Tag
* Build revision (commit SHA), branch, and timestamp
* Handles formal releases, ad-hoc builds, and non-release source builds
* Standalone UI presence in About dialog, Summary -> System Diagnostics
* Cluster UI as Versions tab in Cluster dialog
* Reduce About Dialog Content
* Fix Missing Property Display Bugs
* Marking the build time as type string.
* This closes #583
2016-11-03 11:16:20 -04:00
Artem Ermakov 511f2a0c8b [NIFI-2812] Fix creating NiFi RPM
This closes: PR 1047
This resolves: NIFI-2812

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-11-03 02:26:20 +11:00
Andre F de Miranda b864d49f66 NIFI-2341 - Introduce ParseCEF processor
This closes #785
2016-10-20 17:16:57 -04:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
jpercivall 6ef1cca18f NIFI-2269 Fixing Datadog licensing 2016-08-25 22:43:00 -04:00
jpercivall e1da9fc11f NIFI-2667 Adding License and Notice information to Media Bundle Nar and Assembly
This closes #950
2016-08-25 22:42:37 -04:00
joewitt 1624dd8e4d NIFI-2666 This closes #947. updated where it says BSD to say MIT for bcrypt 2016-08-25 14:59:46 -04:00
Matt Burgess 3224b1a5dd NIFI-2668: This closes #945. Replaced JSR-107 JCache API JAR w Geronimo version, updated notices 2016-08-25 14:41:08 -04:00
joewitt 1745c1274b NIFI-2608 This closes #930. restructured the ConsumeKafka processor to follow new consumer API. Made nar classloading more precise to support spawned threads NIFI-2660. 2016-08-25 10:09:50 -04:00
Andy LoPresto c638191a47
NIFI-1831 Added internal logic and command-line tool to allow AES-encrypted sensitive configuration values in nifi.properties.
This closes #834.
2016-08-23 20:34:31 -07:00
jpercivall 6e82ec738c NIFI-2269 Fixing minor issues with style check, licensing, etc. 2016-08-22 21:34:51 -04:00
Ramiz 376d3c4ef4 NIFI-2269 Added datadog support
This closes #655

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-22 21:34:51 -04:00
Matt Burgess 2938a5353a NIFI-1663: Adding attribution for derived work for OrcFlowFileWriter 2016-08-10 14:51:05 -04:00
Bryan Rosander 2dc094765d NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12

This closes #809.
2016-08-09 22:43:29 +02:00
Matt Burgess 7575e87cb1 NIFI-2520 This closes #818. Added attribution for storm-hive and other Hive dependencies to NOTICEs 2016-08-09 15:27:24 -04:00
Andre F de Miranda 493919922e NIFI-1965 - Rename nifi-geo-bundle to nifi-enrich-bundle 2016-08-08 22:27:22 +02:00
Bryan Rosander fa4c6ab03c
NIFI-2193 - Added functionality to automate certificate generation, keystore and truststore generation, and nifi.properties keystore and truststore password population. Follow-on changes will be made under NIFI-2476.
This closes #695.

Signed-off-by: Andy LoPresto <alopresto@apache.org>

Defaulting to same keyStore, key password (+18 squashed commits)
Squashed commits:
[9d01ba0] NIFI-2193 - Fixing typo
[55440bc] NIFI-2193 - Standalone can run as long as there are no conflicting files/folders
[0ca34ed] NIFI-2193 - Fixing some filename, absolute path issues
[9d4f65b] NIFI-2193 - Incorporating feedback
[f7550b4] NIFI-2193 - Cleaning up imports
[59a7637] NIFI-2193 - Updating umask to allow owner to execute
[cf824e7] NIFI-2193 - Moving DN arg to CA service specific parent class
[921ee13] NIFI-2193 - Making keystore getInstance more consistent
[a283c4b] NIFI-2193 - Updating sample config files in assembly to reflect new structure
[8d3a21d] NIFI-2193 - Making TlsHelper static, adding option to use same password for Key, KeyStore
[b13d247] NIFI-2193 - Addressing PR feedback
[46ef8ed] NIFI-2193 - Removing commons-logging, log4j from notice
[d4cf41a] NIFI-2193 - Adding option to specify output file for CA certificate when using cli client
[b74bf25] NIFI-2193 - Removing Bouncy Castle from notice
[6e34f9a] NIFI-2193 - Adding CLI client for easier generation of client certificates
[2924fca] NIFI-2193 - nifi-toolkit-ssl -> nifi-toolkit-tls, removing unused constants
[886167e] NIFI-2193 - Adding slf4j to avoid runtime issue
[082de46] NIFI-2193 - Command line SSL config utility as well as certificate authority client/server
2016-08-03 21:34:11 -07:00
Bryan Bende c27763a12f NIFI-1733 Initial commit for nifi-ranger-bundle
- Adding Authorizer implementation for Ranger
- Adding build profile and assembly that controls the inclusion of Ranger in the final assembly
- Add properties to specify ranger admin identity and a flag to indicate if ranger is using kerberos, plugin is updated to perform a UGI login if ranger is using kerberos
- Adding LICENSE and NOTICE for Ranger NAR, and some other licensing clean up
- Adding tests for kerberos properties, adding test for RangerBasePluginWithPolicies, cleaning up code to use Java 8 features

This closes #574
2016-07-26 10:15:22 -04:00
Andre F de Miranda 4f672832c0 NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEmailHeaders processors - Introduce ListenSMTP (allows NiFi to receive data via email) - Addresses @ijokarumawak and @@JPercivall PR comments
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-21 10:26:30 -04:00
mans2singh 259f5bba47 NIFI-1972 - Ignite processor
This closes #502.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2016-07-20 18:39:19 +02:00
Aldrin Piri d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00