Commit Graph

1110 Commits

Author SHA1 Message Date
Kevin Doran 81d3f6f326
NIFI-4740 Fix User Group Data Integrity Checks. This closes #2378
Removes user existence check from FileUserGroupProvider when
group is created or updated. Replaces it with check in the
Authorizer Decorator class created by Authorizer Factory, so
that all providers are used.

Also fixes bug when searching for group membership by user
that returns results across all providers.
2018-01-05 14:22:35 -05:00
yuri1969 41d9506a2b
NIFI-4402 - Add component location in Summary view
Implemented as described in the issue. Improvements are welcome.
Reworded the title according to feedback.
This closes #2195
2018-01-05 09:09:37 -05:00
Matt Gilman 7a8dbb8b15
NIFI-4733:
- Resolving logic issue in two phase commit when updating variable registry. This closes #2370
2018-01-04 13:03:11 -05:00
Matt Gilman a2a8fcb31c NIFI-4092: This closes #2365.
- Removing direct dependency on jaxb.

Signed-off-by: joewitt <joewitt@apache.org>
2018-01-04 09:38:35 -05:00
joewitt 6ee6b5e57c NIFI-4734 refactored couchbase bundle, jms bundle, removed jms test-lib usage, fixed broken SeeAlso and service links causing docs warns. Corrected L&N in each bundle. This closes #2369.
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-04 09:16:17 -05:00
Jeff Storck 42a1ee011b NIFI-4323 This closes #2360. Wrapped Get/ListHDFS hadoop operations in ugi.doAs calls
NIFI-3472 NIFI-4350 Removed explicit relogin code from HDFS/Hive/HBase components and updated SecurityUtils.loginKerberos to use UGI.loginUserFromKeytab. This brings those components in line with daemon-process-style usage, made possible by NiFi's InstanceClassloader isolation.  Relogin (on ticket expiry/connection failure) can now be properly handled by hadoop-client code implicitly.
NIFI-3472 Added default value (true) for javax.security.auth.useSubjectCredsOnly to bootstrap.conf
NIFI-3472 Added javadoc explaining the removal of explicit relogin threads and usage of UGI.loginUserFromKeytab
Readded Relogin Period property to AbstractHadoopProcessor, and updated its documentation to indicate that it is now a deprecated property
Additional cleanup of code that referenced relogin periods
Marked KerberosTicketRenewer is deprecated

NIFI-3472 Cleaned up imports in TestPutHiveStreaming
2018-01-03 11:31:47 -05:00
Matt Gilman b7c9c88f9f
NIFI-4444:
- Ensure the /nifi-api/controller redirection filter executes before matching.

This closes # 2358.

Signed-off-by: Andy LoPresto <alopresto.apache@gmail.com>
2018-01-02 10:01:03 -05:00
Kevin Doran 482f371958
NIFI-4701 Add authorizers.xml support to toolkit.
Adds authorizers.xml to the files understood by the encrypt-config
tool in the NiFi Toolkit. If enabled, then the sensitive properties
for LdapUserGroupProvider in authorizers.xml will be encrypted.
Also fixes a bug wherein encrypt-config replaces multiple XML nodes
in login-indentity-providers.xml when LdapProvider is not the first
provider listed in the file.
Enable properties in authorizers.xml to be encrypted by the master key.

This closes #2350.

Signed-off-by: Andy LoPresto <alopresto.apache@gmail.com>
2017-12-31 17:41:04 -05:00
Aldrin Piri 49285d325f NIFI-4719 - Incrementing Template encoding version to 1.2 to reflect changes incorporated in NIFI-3155
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2357.
2017-12-23 18:15:49 +01:00
Koji Kawamura e8f6ff440a NIFI-4714 - Use lowercase hostname for validation.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2355.
2017-12-21 14:38:36 +01:00
Matt Gilman 17718940d7 NIFI-4689 - Ensuring all provenance properties are represented in nifi.properties.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2352.
2017-12-19 09:44:25 +01:00
Joe Percivall 48ae4be015 NIFI-4475 Changing the get(batchSize) method in StandardProcessSession so that it checks all connections before returning nothing. This closes #2337. 2017-12-14 15:08:55 -05:00
Koji Kawamura b8375a681a NIFI-3377: NiFi RPG errors when switching between transport protocols. This closes #2340. 2017-12-14 15:02:40 -05:00
Kevin Doran 2608351113
NIFI-4667 Fix LDAP Sync Interval
Corrects time unit conversion for the Sync Interval config property
for LdapUserGroupProvider in authorizers.xml.

Also enforces a minimum value of 10 secs for the Sync Interval to help
catch unintentional misconfigurations, for example users upgrading
from previous versions, where tiny Sync Interval values could be set
as a workaround for NIFI-4667.

This closes #2341
2017-12-14 15:01:52 -05:00
Mark Payne 3b74d2ddad NIFI-4633: This closes #2327. Ensure that everywhere that a FlowFile is passed into ProcessSession that we used the most up-to-date version of it
Ensure that when ProcessSession.clone(FlowFile) is called, we obtain the most recent version of the FlowFile before attempting to obtain FlowFile size.

Signed-off-by: joewitt <joewitt@apache.org>
2017-12-08 15:30:01 -05:00
Mark Payne 8e6649ba15 NIFI-2776: This closes #2315. When joining a cluster, if a processor is stopping but cluster indicates that processor should be running, cause processor to start when its last thread finishes
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-07 15:45:18 -05:00
joewitt 7e61c6333c
NIFI-2375 updated to latest Tika across codebase. Fixed
tests and updated L&N for Tika parsers.  Turned unstable grpc test to IT
 test. Updated deps due to Tika testing findings. This closes #2320
2017-12-06 11:53:15 -05:00
joewitt 2c68d0e098
NIFI-4652 updating to latest apache version and updating key maven plugins, fixing versions for grpc to avoid extranous build dir, correcting checkstyle issues, resolving build problem with incorrect usage of activeByDefault in maven. Key change is now for the 'dir-only' profile it is now activated via a system property -Ddir-only instead of profile. No other activeByDefault profiles exist except to minifi the javascript but that usage is acceptible as-is. This closes #2313 2017-12-04 09:59:23 -05:00
Mark Payne 596a329dc7 NIFI-4653: Fixed bug where Process Group DTO was not containing variables when created with the #createConciseProcessGroup method. This closes #2314. 2017-12-04 09:31:54 -05:00
joewitt dd981e87dd NIFI-4642 updated tests to be more tolerant/variable to different system speeds. Many of these should be integration tests and not unit tests. This closes #2303. 2017-11-30 14:59:58 -05:00
Joey Frazee 73fa0429f0
NIFI-4640 Sub source w/ . in nifi.sh to be POSIX compliant
This closes #2302

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-11-28 20:02:58 -05:00
Mark Payne cec2764140
NIFI-4632: Add the local hostname to the list of validated host headers
This closes #2288.

Signed-off-by: Andy LoPresto <alopresto.apache@gmail.com>
2017-11-27 19:08:29 -08:00
Mark Payne 9766558cab
NIFI-4526: Allow Target URI's of Remote Process Groups to be changed. This closes #2298 2017-11-27 10:50:32 -05:00
Matt Gilman 439e13a8d5
NIFI-4567:
- Adding new properties to allow the referenced attribute of a user/group to be configurable when detecting group membership.
- Expanding on documentation regarding the new properties.

This closes #2274.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-20 10:09:53 -05:00
Matt Gilman 6b75921725 NIFI-4617:
- Ensuring a charset is specified when convert a string into bytes.
- Ensuring the aggregate snapshot is non null before attempting to promote the runStatus.

This closes #2278.
2017-11-20 09:39:23 -05:00
Andy LoPresto 5d643edfab
NIFI-4501
- Changed request header handling logic.
- Removed unnecessary Maven dependency.
- This closes #2279
2017-11-17 20:36:55 -05:00
sbouchex c89d793364
NIFI-4615
- processor status is set to the ProcessorStatusDTO object
- This closes #2276
2017-11-17 15:44:09 -05:00
Matthew Burgess 53de8c93ba NIFI-4603 - Externalize Max HTTP Header Size to nifi.properties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2271.
2017-11-15 10:12:39 +01:00
Andy LoPresto 7f8007f22a NIFI-4608 Removed unnecessary NiFiProperties mocking given enhancements to StringEncryptor.
Fixed checkstyle issues.
Fixed test failure in FingerprintFactoryTest.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2273.
2017-11-15 10:09:18 +01:00
Pierre Villard b9c53083c4 NIFI-4576 - rewording processors / cores
NIFI-4576: Rewording processor load average to core load average

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2267
2017-11-14 13:08:53 -05:00
Mark Payne af3a578711
NIFI-4598: When we retrieve the 'controller' from a remote NiFi instance in order to determine which ports are available, cache those results for up to some configurable amount of time (default 30 secs) so that we don't constantly issue HTTP Requests to the remote nifi
This closes #2270.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-13 14:46:38 -05:00
Mark Payne 2d3e5abf81
NIFI-3155, NIFI-4571: Fix issue of Remote Group Port having ID the same as on the remote system, by adding an additional targetId field RemoteGroupPort's; this also fixes issue of stats being mixed together for RPG's with the same URL. This closes #2253 2017-11-13 13:54:34 -05:00
Matt Gilman 387dce5ad0 NIFI-4591:
- Ensuring View Details button is visible if the user has read access and the service is defined in the current Process Group.

This closes #2262

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-11-09 16:41:45 -05:00
Matt Gilman 9ecb26a52b NIFI-4587 - Updating styles to allow for newlines in Process Group, Processor, Controller Service, and Reporting Task comments.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2261.
2017-11-09 20:25:13 +01:00
Mark Payne f4a1c9b547 NIFI-4454: Added Process Groups' variables to search capability
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2254
2017-11-06 11:27:05 -05:00
Koji Kawamura 2a69b35f12 NIFI-4548: Add REMOTE_INVOCATION provenance event type
This commit includes changes to DeleteHDFS to report REMOTE_INVOCATION
event. In order to do so, the processor had to be changed to create
output FlowFile because a provenance event needs a FlowFile it
associates with.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2234.
2017-11-02 19:32:22 +01:00
Koji Kawamura a73b5bda42 NIFI-4546: Make ReportingTask aware of node type in a cluster
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2235.
2017-10-30 11:22:03 +01:00
Jeff Storck d6744b9ee5
NIFI-4528 The ref attribute in the request to view content sent by the client will now be inspected for the proxy context path. If found, it will be removed so the request can be successfully made within the cluster.
This closes #2228.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-27 16:06:28 -04:00
Matt Gilman 1625f719e6 NIFI-4518:
- Ensuring the last selected variable id is reset when closing the dialog.

This closes #2227

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-26 20:53:37 -04:00
Matt Gilman f2bd9f87ba
NIFI-4518:
- Addressing issues when handling the done callback for controller service references.
2017-10-26 12:43:02 -04:00
Matt Gilman 32c0e2be3b
NIFI-4518:
- When the URI is too long, invoking the bulletin board multiple times for all specified component ids.
2017-10-26 10:27:57 -04:00
Mark Owens 10f27cd5f0 NIFI-2979 PriorityAttributePrioritizer violates Comparator contract. This closes #2220.
Modified the return value when both objects priority values are null to
zero to match the expected return value based upon the Comparator
contract.
2017-10-25 11:31:09 -04:00
Jeff Storck fb839fff56
NIFI-4499 Updated default content-viewer URL property to be relative rather than assuming it is deployed at the root context. This closes #2217 2017-10-19 15:34:39 -04:00
Matt Gilman 53e63eaf7c NIFI-4481:
- Adding support for visualizing if a component is scheduled for primary node only.
This closes #2210.
2017-10-18 15:25:23 -04:00
Matt Gilman b8a3862078 NIFI-4497:
- Fixing issue preventing separators in sub context menus.

This closes #2216

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-18 13:42:58 -04:00
Matt Gilman 6baea8ccff
NIFI-4444:
- Upgrading to Jersey 2.x.
- Updating NOTICE files where necessary.
- Fixing checkstyle issues.

This closes #2206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-10-12 10:27:02 -07:00
yuri1969 b5e1fa7ff6 NIFI-4470 - Variables Registry: Increase space...
...between Bulletin icon and Controller Service name

This closes #2200

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-10-09 10:10:17 -04:00
Andy LoPresto d4168f5ff1
NIFI-4297
- Upgraded immediately actionable dependency versions from Meterian report.
- Upgraded jackson-core test dependencies for HBase and Elasticsearch modules.
- Only 3 instances of jackson-core < 2.8.6 (Google Cloud Platform and Spark Receiver modules).
- Upgraded version of poi dependency in nifi-email-processors to 3.16.
- Resolving dependency issues after rebasing against 1.5.0-SNAPSHOT.
- Removed jackson-databind from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.version} in all referenced artifacts.
- Removed jackson-mapper-asl from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.old.version} in all referenced artifacts.
- Removed Jasypt from <dependencyManagement> and added explicit version in test dependency for legacy compatibility.
- This closes #2084
2017-10-05 15:23:52 -04:00
yuri1969 5e2fb8cff1
NIFI-4423 - Add a confirmation of a Counter reset action. This closes #2178 2017-10-05 13:55:59 -04:00
yuri1969 c29ee4a6fa
NIFI-3803 - Allow use of up/down arrow keys...
...during selection in Add Processor dialog

* Added navigation logic to both Add Processor and Add CS dialogs.
* No extending to the SlickGrid library done.
* Ported the new functionality to the Add Reporting Task dialog.
* Mimicked SlickGrid's PageUp/Down behavior.
* This closes #2170
2017-10-05 09:45:26 -04:00