1606 Commits

Author SHA1 Message Date
Koji Kawamura
5af6eb17b0
NIFI-3162: Audit RPG and RPG port config changes.
- Added configure audits for Transport Protocol, HTTP Proxy Server Host,
  Port, User and Password in RemoteProcessGroup configuration
- Added configure audits for enabling/disabling individual remote port
- Added configure audits for Concurrent Tasks and Compressed in Remote
  Port configuration
- This closes #1476
2017-02-07 16:22:51 -05:00
Pierre Villard
93150d3efa
NIFI-3447 - PutSplunk - force connection close
This closes #1479.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-02-07 13:37:32 -05:00
Ryan Persaud
ea0f5690cc NIFI-3372 Adding capability for PutSQL to handle BIT fields generated by ConvertJSONToSQL.
This closes #1432.
2017-02-07 17:14:37 +01:00
Nick Carenza
46fa6a167a NIFI-3429 Quoting table identifier behind property
This closes #1464.
2017-02-07 16:48:38 +01:00
Oleg Zhurakousky
027fbf48b8 NIFI-3223 added support for expression language
- EXCHANGE
- ROUTING_KEY

This closes #1449.
2017-02-07 15:45:56 +01:00
Koji Kawamura
9a638cc865 NIFI-1125 InvokeHTTP throws NullPointerException
Added null check in onPropertyModified to avoid NPE.

This closes #1477.
2017-02-07 09:06:43 +01:00
Giovanni Lanzani
3d3faada5c NIFI-3408 Add exception class when InvokeHTTP fails 2017-02-07 09:04:48 +01:00
Giovanni Lanzani
31b943d2c1 NIFI-3408 Add exception class when InvokeHTTP fails
This closes #1467.
2017-02-07 08:51:22 +01:00
Joe Gresock
229b20f395 NIFI-3419: Routing flow files causing ZipException to failure in MergeContent
This closes #1454.
2017-02-06 19:34:49 +01:00
Nick Carenza
6466931c23 NIFI-3430 - added support for specifying sql.arg.N.format for timestamp fields according to java.time.format.DateTimeFormatter
This closes #1468.
2017-02-06 18:32:57 +01:00
James Wing
e4cee7ee0d NIFI-3427 Fix Provenance DateTime Sorting
This closes #1465.
2017-02-06 18:06:58 +01:00
Pierre Villard
adfaffc773 Updated documentation of ListenHTTP 2017-02-03 22:53:29 +00:00
Joe Skora
376af83a3d NIFI-3055 StandardRecordWriter Can Throw UTFDataFormatException
* Updated StandardRecordWriter, even though it is now deprecated to consider the encoding behavior of java.io.DataOutputStream.writeUTF() and truncate string values such that the UTF representation will not be longer than that DataOutputStream's 64K UTF format limit.
* Updated the new SchemaRecordWriter class to similarly truncate long Strings that will be written as UTF.
* Add tests to confirm handling of large UTF strings and various edge conditions of UTF string handling.

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1469.
2017-02-03 20:52:32 +00:00
Matt Burgess
2d6d7710c7 NIFI-3426: Add dynamic property support to DBCPConnectionPool
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1461.
2017-02-03 11:09:02 -08:00
Matt Burgess
6d4901cd26 NIFI-2881: Added EL support to DB Fetch processors
- Allow incoming flowfiles to GenerateTableFetch
- Incorporated review comments/discussions
- Updated documentation, added error attribute to GenerateTableFetch
- Corrected notes for column properties in fetch processors

This closes #1407.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-02-03 08:51:13 +09:00
Andre F de Miranda
ea3c294f94
NIFI-819 - Extend GetHTTP to use dynamically add HTTP headers to a request
This closes #1462.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-02-02 09:56:53 -05:00
Oleg Zhurakousky
390754c575 NIFI-3179 Added support for default UTF-8 char encoding
removed deprected usage of BAOS and BAIS

This closes #1452.
2017-01-31 15:33:20 +01:00
Oleg Zhurakousky
6518778c11 NIFI-3180 Fixed NPE in TemplateUtils
added null check for ProcessorDTO.getRelationship()
removed deprecated usage of ByteArrayInputStream

This closes #1451.
2017-01-30 22:10:50 +01:00
Ben Schofield
d5b139ffd4 NIFI-3418 Add records-per-transaction property to putHiveStreaming processor
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1455

Minor whitespace Checkstyle issue fixed
2017-01-30 11:46:42 -05:00
Pierre Villard
78a0e1e18b NIFI-3290 Reporting task to send bulletins with S2S
This closes #1401
2017-01-30 09:03:35 -05:00
Pierre Villard
89f1bd3189 NIFI-957 Added the possibility to use DefaultSchedule annotation in reporting tasks
This closes #1400
2017-01-30 08:35:39 -05:00
Koji Kawamura
63c763885c NIFI-3363: PutKafka NPE with User-Defined partition
- Marked PutKafka Partition Strategy property as deprecated, as Kafka 0.8 client doesn't use 'partitioner.class' as producer property, we don't have to specify it.
- Changed Partition Strategy property from a required one to a dynamic property, so that existing processor config can stay in valid state.
- Fixed partition property to work.
- Route a flow file if it failed to be published due to invalid partition.

This closes #1425
2017-01-27 12:48:23 -05:00
Matt Gilman
f8f66fa22b NIFI-3291:
- Removing dead code.

This closes #1438
2017-01-27 11:50:56 -05:00
Matt Gilman
0950186fbb NIFI-3291:
- Fixing overflow calculation to determine if scrollbars are necessary.
- Fixing styles with jquery ui slider usage.
2017-01-27 11:47:09 -05:00
Jeff Storck
bd4ea488bb NIFI-3387 Updated NOT_YET_CONNECTED value in DisconnectionCode enum
This closes #1448.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-01-27 08:44:11 +09:00
Andrew Psaltis
250c4a8941
NIFI-2615 Addressing documentation issues that caused checkstyle failures and the build to fail
This closes #1447.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-26 13:05:33 -08:00
Pierre Villard
c15111d985 NIFI-3390 Added support for multiple LDAP servers. This closes #1441 2017-01-26 08:59:18 -05:00
Andy LoPresto
506709922b
NIFI-2615 Fixed checkstyle violations and RAT (missing license) issues. 2017-01-25 19:03:13 -08:00
Oleg Zhurakousky
f0856565ad NIFI-2615 polishing
- added missing POM entries to nifi POM and assembly POM
- added available port-discovery to tests amongs other minor polishings
2017-01-25 13:22:50 -05:00
Andrew Psaltis
3626abd78a NIFI-2615 Adding GetTCP processor
NIFI-2615 Addressing changes from P/R. Specifically, removing .gitignore as it should not be there for a nar. Removed non-used class. Changed name in notice
2017-01-25 13:22:50 -05:00
Pierre Villard
1a6802a016 NIFI-3295 - ensures node is disconnected before trying to remove it. This closes #1444 2017-01-25 12:24:45 -05:00
Pierre Villard
e113511fef NIFI-3393 - replicates cluster/nodes/{id} to cluster coordinator. This closes #1443 2017-01-25 10:25:36 -05:00
Matt Gilman
7340078de2 NIFI-3251: Delete requires WRITE perms on parent
- Requiring WRITE permissions to the parent resource when attempting to remove a component.
- Updating expired certificates in the REST API integration tests.

This closes #1399.

Signed-off-by: James Wing <jvwing@gmail.com>
2017-01-24 13:24:29 -08:00
Mike Moser
ddda602620 NIFI-3350 optimized documentation extraction to reduce startup time
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1416.
2017-01-22 14:27:19 -08:00
Matt Gilman
79ca30be4a NIFI-3301: Provenance UI Cursor Styling
- Addressing inconsistent cursor styling and drag behavior in lineage graph.

This closes #1430.

Signed-off-by: James Wing <jvwing@gmail.com>
2017-01-20 18:40:36 -08:00
Scott Aslan
dc934cbb8e [NIFI-3359] Modularize all of nifi-web-ui except canvas directory
- Removing shell.jsp from summary.jsp.
- This closes #1428
2017-01-20 16:18:08 -05:00
Koji Kawamura
7f0171ffa2
NIFI-3216: Add N signals to Wait/Notify
- Support counters at Wait/Notify processors so that NiFi flow can be
  configured to wait for N signals
- Extract Wait/Notify logics into WaitNotifyProtocol
- Added FragmentAttributes to manage commonly used fragment attributes
- Changed existing split processors to set 'fragment.identifier' and
  'fragment.count', so that Wait can use those to wait for all splits
get processed

This closes #1420.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-19 15:17:59 -05:00
Matt Gilman
e62eeb7563 NIFI-3291:
- Fixing styles from our usage of jquery ui autocomplete.
- Fixing horizontal scroll bars.
- Fixing border around content repos.

This closes #1429
2017-01-19 11:13:44 -05:00
David W. Streever
bbc714e73b PutHiveQL and SelectHiveQL Processor enhancements. Added support for multiple statements in a script. Options for delimiters, quotes, escaping, include header and alternate header.
Add support in SelectHiveQL to get script content from the Flow File to bring consistency with patterns used for PutHiveQL and support extra query management.

Changed behavior of using Flowfile to match ExecuteSQL.  Handle query delimiter when embedded.  Added test case for embedded delimiter

Formatting and License Header

PutHiveQL and SelectHiveQL Processor enhancements. Added support for multiple statements in a script.  Options for delimiters, quotes, escaping, include header and alternate header.

Add support in SelectHiveQL to get script content from the Flow File to bring consistency with patterns used for PutHiveQL and support extra query management.

Changed behavior of using Flowfile to match ExecuteSQL.  Handle query delimiter when embedded.  Added test case for embedded delimiter

Removing dead code.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Comments to Clarify test case.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Final whitespace/formatting/typo changes

This closes #1316
2017-01-18 14:47:31 -05:00
Matt Gilman
e925b18fe6 NIFI-1135:
- Adding additional parameters to be able to limit the size of the provenance response. Specifically, whether the events should be summarized and whether events should be returned incrementally before the query has completed.
- Ensuring the cluster node address is included in provenance events returned.
- Ensuring there is a cluster coordinator before attempting to get the cluster node address.
- Removing exponential back off between provenance requests.
- Ensuring the content viewer url is retrieve before initializing the provenance table.

This closes #1413.
2017-01-18 10:34:56 -05:00
Matt Gilman
82cf0c6fa8 NIFI-3291:
- Ensuring we don't see a horizontal scrollbar.
- Ensuring slick-nifi-theme is bundled.

This closes #1408
2017-01-17 15:42:34 -05:00
Matt Gilman
6170f6442e NIFI-3291:
- Upgrading jQuery and it's plugins.
- Packaging at build time using npm.
2017-01-17 14:54:59 -05:00
Andrew Lim
ad98ac179f
NIFI-3340 Modify description of the Directory property for PutHDFS to say it will create the directory if it doesn't exist
This closes #1424.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-17 13:29:59 -05:00
Koji Kawamura
ef54a8ec69
NIFI-3214: Added fetch and replace to DistributedMapCache
- Using fetch and replace together can provide optimistic locking for
  concurrency control.
- Added fetch to get cache entry with its meta data such as revision
  number.
- Added replace to update cache only if it has not been updated.
- Added Map Cache protocol version 2 for those new operations.
- Existing operations such as get or put can work with protocol version
  1.

This closes #1410.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-16 12:15:06 -05:00
Andre F de Miranda
8c7539b20a Revert "NIFI-3352 - Address issue where ListenLumberjack was sending long numbers back to clients - instead of int"
This reverts commit 9609dafc34f40178d30480a41288fe4a89c2eb79.
2017-01-17 01:53:18 +11:00
afucs
9609dafc34 NIFI-3352 - Address issue where ListenLumberjack was sending long numbers back to clients - instead of int 2017-01-14 22:57:33 +11:00
Jeff Storck
def4918af0
NIFI-3330 Replaced two instances of multiple calls to getter methods during request attribute retrieval with a single call saved to a local variable to prevent null pointer exceptions during multiple invocations of a getter method.
This closes #1415.

Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-01-13 18:09:28 -05:00
Joe Skora
4d533a99b3 NIFI-2861 ControlRate should accept more than one flow file per execution
* Support multiple files per onTrigger call.

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1412.
2017-01-12 21:43:12 +00:00
Pierre Villard
2fbeabb95f
NIFI-3309 ensures that CS are deleted when a process group is deleted
This closes #1411.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-12 11:21:46 -05:00
Matt Gilman
a794166d21 NIFI-3118 - Sorting the garbage collection stats and content repository entries client side. Opting to not sort server side as the property of the DTO does not allow deterministic sorting. Consequently, order would need to be implemented every time that DTO is (de)serializaed which may happen in a number of places with zero master clustering.
This closes #1337.
2017-01-09 18:09:25 +01:00