Commit Graph

4099 Commits

Author SHA1 Message Date
Mark Payne 73e601bc55 NIFI-4102: If first line read does not match Grok expression, skip line
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1932
2017-06-21 15:10:22 -04:00
Pierre Villard ba3372a1dc NIFI-4079 Add concat in Record Path Guide. This closes #1920. 2017-06-21 14:56:07 -04:00
Joe Percivall 77e49b749e NIFI-4075 Updating 'addRemoteProcessGroup' in StandardFlowSerializer to properly use ScheduledStateLookup. This closes #1922. 2017-06-21 14:20:22 -04:00
Bryan Bende aabd4a25d2 NIFI-4043 Initial commit of nifi-redis-bundle
NIFI-4061 Initial version of RedisStateProvider
- Adding PropertyContext and updating existing contexts to extend it
- Added embedded Redis for unit testing
- Added wrapped StateProvider with NAR ClassLoader in StandardStateManagerProvider
- Updating state-management.xml with config for RedisStateProvider
- Renaming tests that use RedisServer to be IT tests so they don't run all the time

This closes #1918.
2017-06-21 12:47:19 -04:00
Matt Gilman 6bc6f955c0 NIFI-4059:
- Introducing the LdapUserGroupProvider.
- Updating documentation accordingly.
- Moving the IdentityMapping utilities so they were accessible.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1923.
2017-06-19 19:25:33 +02:00
Scott Aslan ad6af1d941 NIFI-3994 Add Create Template to the context menu
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1883.
2017-06-17 16:46:31 -07:00
Wesley-Lawrence 5a7e6c6ac1 NIFI-4064 Make sure that Funnels with queued incoming FlowFiles, but no outgoing connections yield rather than continually check to run.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1914.
2017-06-17 15:50:40 +02:00
Chris Herrera 2800df30d3 NIFI-2692
- Removing problematic timeout for SMTP Listen
- Converting anonymous method to lambda
- Adding debug and error logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1924.
2017-06-17 15:22:33 +02:00
Matt Gilman 490e1da5db NIFI-4019:
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
2017-06-15 14:17:35 -04:00
Mark Payne c0ad5bcc7b NIFI-1921: Fixed bug in how average lineage duration was calculated for cluster stat
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1912
2017-06-13 12:29:03 -04:00
Bryan Bende 2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure 2017-06-12 16:36:23 -04:00
Koji Kawamura de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient
To be used with cache engines that does not have revision number.

NIFI-4049: Refactor AtomicDistributedMapCacheClient

Removed old methods completely.

This closes #1904.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-12 10:34:48 -04:00
Yolanda M. Davis 8ef4fddddd
NIFI-3696 - ConfigMigration and FileManager tools
This closes #1889.

Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-06-12 09:50:02 -04:00
Koji Kawamura 7761903352 NIFI-4041: Add file.size attribute to ListFTP and ListSFTP
This closes #1899.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-12 10:53:09 +09:00
Mark Payne e7dcb6f6c5 NIFI-3921: Allow Record Writers to inherit schema from Record
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1902
2017-06-09 16:13:25 -04:00
Matt Gilman 4ed7511bee
NIFI-3653: - Introducing UserGroup and Policy provider interfaces.
- Introducing FileUserGroupProvider and FileAccessPolicyProvider.
- Refactoring FileAuthorizer to utilize the file based implementations.
- Introducing the StandardManagedAuthorizer.
- Decorating the configured ManagedAuthorizer to ensure integrity checks are still performed.
- Loading user groups if possible to use during access decisions.
- Merging responses for requests for AccessPolicies, Users, and UserGroups.
- Adding unit tests as appropriate.
- Adding methods to the User, Group, and AccessPolicy builder that more easily supports generating UUIDs.
- Fixing typo when seeding policies during startup.
- Fixing type in documentation and error messages.

This closes #1897.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-09 13:54:10 -04:00
Andrew Lim f447fc73fa NIFI-4048 Added nifi.cluster.node.protocol.max.threads to Cluster Node Properties section of Admin Guide
This closes #1908

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-06-09 12:59:22 -04:00
Mark Payne d8dc2bb00b NIFI-4047: Addressed issue with inconsistent Lexical policy between used cached schemas and non-cached schemas
This closes #1907

Signed-off-by: Joe Percivall <JPercivall@apache.org>
2017-06-09 12:05:11 -04:00
Matt Gilman cc741d2be6
NIFI-3997:
- Bumping to next minor version.
2017-06-08 15:22:51 -04:00
Matt Gilman 1bf0a1a849
Merge branch 'NIFI-3997-RC1' 2017-06-08 14:30:10 -04:00
Bryan Bende b0c9428776 NIFI-4030 Populating default values on GenericRecord from Avro schema if not present in RecordSchema
This closes #1896.
2017-06-07 13:59:40 -04:00
Steve Champagne 45e035686f
NIFI-4029: Allow null Avro default values in HortonworksSchemaRegistry
This closes #1894.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-07 12:03:53 -04:00
Matt Gilman c86190c513 NIFI-4027: - Fixing the positioning of the tooltips in the component toolbar.
This closes #1893

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-06-06 17:35:43 -04:00
Joe Gresock 3ef0fa48da NIFI-4014: Correcting Event Type text in S2S provenance reporting task
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1887.
2017-06-06 12:06:04 +02:00
Koji Kawamura e1880785d0
NIFI-4021: Fix StandardFlowSynchronizerSpec to pass independently.
This closes #1892.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-05 19:25:07 -07:00
Andy LoPresto f31f2a5f26
NIFI-3836 Added check for root user in test that depends on unreadable file.
This closes #1865.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-05 18:58:07 -07:00
Matt Gilman 6ee12e9b47
NIFI-3997-RC1prepare for next development iteration 2017-06-05 11:07:43 -04:00
Matt Gilman ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1 2017-06-05 11:07:28 -04:00
Andre F de Miranda 082b99640e NIFI-4001 - Bump ParCEFone version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1875.
2017-06-03 12:11:38 +02:00
Andre F de Miranda 4d78052dd4 NIFI-1709 - Introduce logic to probe Linux version using /etc/os-release to nifi.sh
Add explicit paths to support SLES 11 SP4 / OpenSUSE init.d layout

This closes #1794
2017-06-03 08:12:52 +10:00
Aldrin Piri 39ad7a369e
NIFI-4011 Updating Docker Hub image version information to accommodate next release.
This closes #1884.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-06-02 15:04:41 -04:00
Mark Payne 32314d70fd NIFI-4009: Added support for several key functions in RecordPath
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1881
2017-06-02 14:06:05 -04:00
Matt Burgess 0bddcfe730
NIFI-4002: Add PutElasticsearchHttpRecord processor
This closes #1878

Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-06-02 13:01:13 -04:00
Andrew Lim de6a98618a NIFI-479 Add UI Extension Section to Developer Guide
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1882
2017-06-02 12:05:20 -04:00
Mark Payne 239bbfbb9d NIFI-3989: This closes #1869. Avoid calling Long.parseLong, etc. in order to determine if a String is a valid number because we don't want the Exceptions that occur if it is not
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-02 10:09:38 -04:00
Mark Payne 37be0b9820 NIFI-3990: This closes #1870. Avoided creating garbage when we can avoid it in the JSON and csv readers and json writer
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-02 10:01:40 -04:00
Mark Payne 067e9dfeb0
NIFI-4003: Expose configuration option for cache size and duration NIFI-4003: Addressed remaining spots where client does not cache information
This closes #1879.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 15:31:35 -04:00
Mark Payne 2595d816c4 NIFI-3986: This closes #1868. When we encounted EOFException from sequential record reader event iterator, just treat it as not having any more events
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-01 15:08:12 -04:00
Mark Payne 7035694e37
NIFI-3995: Updated Hwx Encoded Schema Ref Writer to write 13 bytes for header instead of 14; added unit test to verify
This closes #1876.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 10:29:58 -04:00
Mark Payne a0b2311ff6 NIFI-3995: This closes #1873. No longer use the 14th byte in the header for hwx content-encoded schema reference
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-31 13:41:25 -04:00
Matt Gilman 7bcccb10f4 NIFI-3719:
- Removing the usage of SimpleDateFormat when formatting hours/minutes/seconds as the current timezone could cause unintended results.

This closes #1871.
2017-05-30 15:01:39 -04:00
Mark Payne 2b435cdfc6 NIFI-3985: This closes #1864. Added 'Starting Position' property to SiteToSiteReportingTask; also added additionalDetails.html that explains the schema and updated the reporting task to stop publishing when the user clicks 'stops' instead of running indefinitely until the reporting task has caught up
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-26 21:05:45 -05:00
Yolanda M. Davis dd50745a9f
NIFI-3984 - upgraded version of schema-registry client to 0.2.1
This closes #1866.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-26 17:59:53 -04:00
Pierre Villard 80dfe0257f ExtractGrok - Include exception message when compile fails
This closes: #1845

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-05-27 00:56:25 +10:00
Andrew Lim 3966f5ce86 NIFI-3959 Corrected Anatomy of Processor and Process group screenshots and text
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1862
2017-05-26 08:51:25 -04:00
Bryan Bende e85081ed20 NIFI-3979 Documenting how ListHDFS maintains state and performs listings
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1860.
2017-05-26 10:40:22 +02:00
Joey Frazee 118f4e8cca NIFI-3978 Increase threadpool size for S2S HTTP tests
This closes #1858.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-26 14:12:02 +09:00
Mark Payne 5cb928131c
NIFI-3981: When serializing flow to cluster, use the Scheduled State of ports as they are configured to be, not the current state, since the current state may change as soon as the FlowController has finished initializing
This closes #1861.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-25 16:45:20 -04:00
Koji Kawamura 13b59b5621 NIFI-3958: Decimal logical type with undefined precision and scale.
- Oracle NUMBER can return 0 precision and -127 or 0 scale with variable scale NUMBER such as ROWNUM or function result
- Added 'Default Decimal Precision' and 'Default Decimal Scale' property to ExecuteSQL and QueryDatabaseTable to apply default precision and scale if those are unknown
- Coerce BigDecimal scale to field schema logical type, so that BigDecimals having different scale can be written

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1851
2017-05-25 14:37:17 -04:00
Mark Payne 36911957dc NIFI-3972: This closes #1855. When enabling Controller Services on startup, wait until service is enabled (or until 30 seconds elapses, whichever comes first) before returning. This avoids having Service A depend on Service B and then attempting to start Service A before Service B is fully enabled
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-25 13:32:02 -04:00