Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,618 Commits 143 Branches 197 Tags 390 MiB
Commit Graph

3618 Commits

Author SHA1 Message Date
Mark Payne 32314d70fd NIFI-4009: Added support for several key functions in RecordPath 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1881
 2017-06-02 14:06:05 -04:00
Matt Burgess 0bddcfe730
NIFI-4002: Add PutElasticsearchHttpRecord processor 
This closes #1878

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2017-06-02 13:01:13 -04:00
Andrew Lim de6a98618a NIFI-479 Add UI Extension Section to Developer Guide 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1882
 2017-06-02 12:05:20 -04:00
Mark Payne 239bbfbb9d NIFI-3989: This closes #1869. Avoid calling Long.parseLong, etc. in order to determine if a String is a valid number because we don't want the Exceptions that occur if it is not 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-06-02 10:09:38 -04:00
Mark Payne 37be0b9820 NIFI-3990: This closes #1870. Avoided creating garbage when we can avoid it in the JSON and csv readers and json writer 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-06-02 10:01:40 -04:00
Mark Payne 067e9dfeb0
NIFI-4003: Expose configuration option for cache size and duration NIFI-4003: Addressed remaining spots where client does not cache information 
This closes #1879.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-01 15:31:35 -04:00
Mark Payne 2595d816c4 NIFI-3986: This closes #1868. When we encounted EOFException from sequential record reader event iterator, just treat it as not having any more events 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-06-01 15:08:12 -04:00
Mark Payne 7035694e37
NIFI-3995: Updated Hwx Encoded Schema Ref Writer to write 13 bytes for header instead of 14; added unit test to verify 
This closes #1876.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-06-01 10:29:58 -04:00
Mark Payne a0b2311ff6 NIFI-3995: This closes #1873. No longer use the 14th byte in the header for hwx content-encoded schema reference 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-31 13:41:25 -04:00
Matt Gilman 7bcccb10f4 NIFI-3719: 
- Removing the usage of SimpleDateFormat when formatting hours/minutes/seconds as the current timezone could cause unintended results.

This closes #1871.
 2017-05-30 15:01:39 -04:00
Mark Payne 2b435cdfc6 NIFI-3985: This closes #1864. Added 'Starting Position' property to SiteToSiteReportingTask; also added additionalDetails.html that explains the schema and updated the reporting task to stop publishing when the user clicks 'stops' instead of running indefinitely until the reporting task has caught up 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-26 21:05:45 -05:00
Yolanda M. Davis dd50745a9f
NIFI-3984 - upgraded version of schema-registry client to 0.2.1 
This closes #1866.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-26 17:59:53 -04:00
Pierre Villard 80dfe0257f ExtractGrok - Include exception message when compile fails 
This closes: #1845

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2017-05-27 00:56:25 +10:00
Andrew Lim 3966f5ce86 NIFI-3959 Corrected Anatomy of Processor and Process group screenshots and text 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1862
 2017-05-26 08:51:25 -04:00
Bryan Bende e85081ed20 NIFI-3979 Documenting how ListHDFS maintains state and performs listings 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1860.
 2017-05-26 10:40:22 +02:00
Joey Frazee 118f4e8cca NIFI-3978 Increase threadpool size for S2S HTTP tests 
This closes #1858.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-05-26 14:12:02 +09:00
Mark Payne 5cb928131c
NIFI-3981: When serializing flow to cluster, use the Scheduled State of ports as they are configured to be, not the current state, since the current state may change as soon as the FlowController has finished initializing 
This closes #1861.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-25 16:45:20 -04:00
Koji Kawamura 13b59b5621 NIFI-3958: Decimal logical type with undefined precision and scale. 
- Oracle NUMBER can return 0 precision and -127 or 0 scale with variable scale NUMBER such as ROWNUM or function result
- Added 'Default Decimal Precision' and 'Default Decimal Scale' property to ExecuteSQL and QueryDatabaseTable to apply default precision and scale if those are unknown
- Coerce BigDecimal scale to field schema logical type, so that BigDecimals having different scale can be written

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1851
 2017-05-25 14:37:17 -04:00
Mark Payne 36911957dc NIFI-3972: This closes #1855. When enabling Controller Services on startup, wait until service is enabled (or until 30 seconds elapses, whichever comes first) before returning. This avoids having Service A depend on Service B and then attempting to start Service A before Service B is fully enabled 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-25 13:32:02 -04:00
Mark Payne eb25c8547a NIFI-3972: Ensure that we wait until service state becomes enabled before triggering completable future that says that it's enabled 2017-05-25 13:31:53 -04:00
Joseph Niemiec 44fdc0e4ef NIFI-3640 uri eventhub changes 
This closes #1617
 2017-05-25 13:14:51 -04:00
Koji Kawamura 4d0667380a NIFI-3404: Improved UX of LookupAttributes. 
- Added dependency notice.
- Added EL evaluation at SimpleKeyValueLookupService.
- Updated documentation.
- Updated CommonsConfigurationLookupService to throw LookupFailureException if it fails to get configuration so that error messages can be displayed at each processor bulletin.
- Added calling getConfiguration at OnEnabled of CommonsConfigurationLookupService, so that the service will stay in Enabling state if there is any issue.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2017-05-25 10:05:32 -05:00
Joey Frazee 46e2420d74 NIFI-3404 Added LookupAttribute processor and lookup controller services 
Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2017-05-25 10:05:32 -05:00
Koji Kawamura 23cbc3b346 NIFI-3976: This closes #1857. Fix ConsumePOP3 and ConsumeIMAP to delete messages. 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-25 10:59:53 -04:00
Pierre Villard dc5e032368 NIFI-3791 - added back pressure data into S2SStatusReportingTask 
This closes #1745.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-05-25 18:20:11 +09:00
Andre F de Miranda c07850aec3 NIFI-2702 - Deprecates nifi-standard-bundle/*JMS and document the recommended alternative 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1643.
 2017-05-25 08:44:39 +02:00
Pierre Villard e05005584d NIFI-3809 - Added HTTP mode and HTTP proxy for S2S Reporting Tasks 
This closes #1754.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-05-25 15:31:49 +09:00
Pierre Villard b6eb0ac0fb NIFI-3859 - Provide filtering options in S2SProvenanceReportingTask 
This closes #1777.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-05-25 14:10:50 +09:00
Mark Payne eaefec6d81 NIFI-3971: This closes #1854. Fixed bug in calculating content size that was transferred when cloning a relationship 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-24 22:14:56 -04:00
Mark Payne 5aa3baca79 NIFI-3568: This closes #1577. Use a cached thread pool in order to allow ThreadPoolRequestReplicator to scale up the number of threads to some configurable max 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-24 21:21:45 -04:00
Scott Aslan 86728bac7e
[NIFI-3925] for the jquery.combo plugin: update the calculation of the width of the combo box options overlay and also updated the plugins styles to now leverage the css calc() to determine the exact width of .combotext and .combo-option-text elements. This closes #1848 2017-05-24 16:15:42 -04:00
Matt Gilman f97b3fe455
NIFI-3963: - Ensuring the RemoteGroupPort yields when the details cannot be refreshed from any of the configured remote instances. 
This closes #1853.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-24 15:58:22 -04:00
Bryan Bende ae3db82303
NIFI-3644 Fixing the result handler in HBase_1_1_2_ClientMapCacheService to use the offsets for the value bytes 
This closes #1645.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-24 14:59:28 -04:00
baolsen 152f002abf
Completed initial development of HBase_1_1_2_ClientMapCacheService.java which is compatible with DetectDuplicate (and other processors) 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-24 14:59:23 -04:00
Mike Moser 232380dbfd NIFI-1452 on timer-driven yield, use the greater of yield duration or run schedule 
This closes #1832.
 2017-05-24 14:24:29 -04:00
Mark Payne b12cf8a6d2 NIFI-3671: This closes #1852. Ensure that we use the existing ResourceClaim (if it exists) when swapping data in, instead of creating a new one. Otherwise, if the ResourceClaim is still writable, then we may archive the data and then write to it, which can cause a NullPointerException in FileSystemRepository 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-24 14:21:18 -04:00
Pierre Villard fb7d6d1150 NIFI-3799 Add Input Requirement Info to Docs 
Added input requirement info for processor documentation

This closes #1756.

Signed-off-by: James Wing <jvwing@gmail.com>
 2017-05-24 10:45:45 -07:00
Mark Payne 08b66b5b6a NIFI-3969: Prevent merging flowfiles prematurely when all bins fill but some are already full and can be processed 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1850.
 2017-05-24 19:36:18 +02:00
Pierre Villard bb96b0f464 NIFI-3816 - Added correct mime.type to S2S bulletin and provenance reporting tasks 
This closes #1758.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-05-25 00:33:50 +09:00
Scott Aslan 7a46238baf
[NIFI-3943] align combo option item toolips to hover closer to the icon. This closes #1849 2017-05-24 11:14:48 -04:00
Pierre Villard ba49b8427c
NIFI-3191 - HDFS Processors Should Allow Choosing LZO Compression 
This closes #1802.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-24 11:04:00 -04:00
Pierre Villard d63fa8a822 NIFI-3878 This closes #1790. AmbariReportingTask - Default run schedule set to 1 minute 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-24 00:09:17 -04:00
Andy LoPresto 6d07ebf50c NIFI-3954 This closes #1841. Upgraded version of httpclient library to handle TLS issues. 
Added explicit dependency on httpcore for @ThreadSafe annotation.

Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-23 23:42:28 -04:00
Mark Payne 2c751a8e5b NIFI-3962: This closes #1846. Updated ConsumerLease to better handle batching of messages into a single FlowFile in the same way that it is handled for demarcated data 2017-05-23 23:20:13 -04:00
Matt Burgess fb925fc182 NIFI-3867: Fixed issue with getConnectionURL in HiveConnectionPool using Expression Language 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1847.
 2017-05-23 21:28:59 +02:00
James Wing 9238fdb493 NIFI-3903 Unit Tests for AWS Processors 
* Added non-integration unit tests for Lambda, S3, SNS, and SQS processors
* Moved non-integration tests out of integration test files
* Moved SQS integration tests to IT* files for clarification

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1814.
 2017-05-23 19:25:55 +02:00
Joe Skora 0a7d149656 NIFI-3932 Symbols in API comments cause problems with Swagger Codegen 
* Update ApiModelProperty descriptions to avoid problematic characters.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1821.
 2017-05-23 19:04:54 +02:00
Matt Gilman 3ec0aa947f NIFI-3955: 
- Filtering out the EventTime searchable field for all implementation of ProvenanceRepository. Prefer user query using the startDate/endDate fields.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1844.
 2017-05-23 18:48:29 +02:00
James Wing b64232117f NIFI-3707 Sort Attributes in FlowFile Details UI 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1843.
 2017-05-23 18:06:18 +02:00
Andrew Lim 49270f8a8c NIFI-3944 Update docs and screenshots for Component Versioning 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1840
 2017-05-23 11:06:59 -04:00