Commit Graph

847 Commits

Author SHA1 Message Date
Matt Gilman 75bb4bfaa2 NIFI-1781:
- Listening for window resize events more selectively.
- Fixing malformed request when configuring remote process group ports.
- Fixing malformed request when starting/stopping a selected process group.
- Fixing default value for authorizers.xml.
- This closes #524
2016-06-13 16:55:01 -04:00
Mike Moser cc95e5d8c5 NIFI-1937 GetHTTP configurable redirect cookie policy
Reviewed by Tony Kurc (tkurc@apache.org). This closes #479
2016-06-11 11:22:33 -04:00
Koji Kawamura c120c4982d NIFI-1857: HTTPS Site-to-Site
- Enable HTTP(S) for Site-to-Site communication
- Support HTTP Proxy in the middle of local and remote NiFi
- Support BASIC and DIGEST auth with Proxy Server
- Provide 2-phase style commit same as existing socket version
- [WIP] Test with the latest cluster env (without NCM) hasn't tested yet

- Fixed Buffer handling issues at asyc http client POST
- Fixed JS error when applying Remote Process Group Port setting from UI
- Use compression setting from UI
- Removed already finished TODO comments

- Added additional buffer draining code after receiving EOF
- Added inspection and assert code to make sure Site-to-Site client has
  written data fully to output
stream
- Changed default nifi.remote.input.secure from true to false

This closes #497.
2016-06-09 15:09:57 -04:00
Bryan Rosander a5fecda5a2 NIFI-1975 - Processor for parsing evtx files
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #492
2016-06-09 12:07:00 -04:00
Pierre Villard 9e705a8468 NIFI-1866 ProcessException handling in StandardProcessSession 2016-06-08 15:58:27 -04:00
Mark Payne 8a447eec66 NIFI-1052: Added Ghost Processors, Ghost Reporting Tasks, Ghost Controller Services
This closes #499.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-06-08 15:23:29 -04:00
Mark Payne 18133988a0 NIFI-1984: Ensure that if an Exception is thrown by the 'Deletion Task' when calling NaiveRevisionManager.deleteRevision() that the locking is appropriately cleaned up
This closes #510
2016-06-08 10:31:36 -04:00
Matt Burgess 3b99e12352 NIFI-1973 Allow ExecuteSQL to use flow file content as SQL query
This closes #498.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-06-07 17:26:58 -04:00
Mark Payne 6de738fd04 NIFI-1660: Fix formatting; update to NOTICE files of nars that bring in EL. Closed Reader that was opened in TestQuery. 2016-06-07 15:34:37 -04:00
Scott Aslan 6710094bd7 create bower.options mvn property to support bower cli options...including --offline
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #505
2016-06-07 14:05:32 -04:00
Mark Bean 1ac44a0a4b NIFI-1118 adding SplitText features of size limit and header marker characters
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #444
2016-06-07 11:37:23 -04:00
Joey Frazee a490c29a4f Moved HL7 test file into TestExtractHL7Attributes, fixes NIFI-1979
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-06-07 11:20:21 -04:00
Joey Frazee d4395a8a08 Fixes NIFI-1968 so ExtractHL7Attributes keeps empty components
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-06-06 21:37:53 -04:00
Oleg Zhurakousky 91cdd78ebc NIFI-1668 modified TestProcessorLifecycle to ensure FlowController is always shut down
This closes #324
2016-06-06 13:55:49 -04:00
Oleg Zhurakousky cee2426df6 NIFI-1956 added 'keyboard-interactive' option to SFTPTransfer
This closes #487.
2016-06-06 19:32:16 +02:00
Simon Elliston Ball 55d32ae610 NIFI-1925 Fixed typo
This closes #468
2016-06-06 10:33:28 -04:00
Thad Guidry c090cdf29a Added details about data size in description.
added "in bytes" to further explain the Segment Size property.

This closes #494
2016-06-06 09:50:57 -04:00
Matt Burgess b32c70c419 NIFI-1929: Improvements for PutHDFS attribute handling
This closes #486.
2016-06-06 11:58:55 +02:00
Bryan Bende 8d8a9cba79 NIFI-1916 Updating FileAuthorizer to extend AbstractPolicyBasedAuthorizer and adding intial loading of data users, groups, and policies
- Implementing CRUD operations and unit tests for Users
- Implementing CRUD operations and unit tests for Groups
- Implementing CRUD operations and unit tests for AccessPolicies
- Adding support for seeding with an initial admin user
- Fixing delete for user and group so it removes references from policies
- Adding example to authorizations.xml
- Adding back the old users schema in preparation for auto-converting to the new format, and providing the AuthorizationConfigurationContext with access to the root process group id
- Refactoring some of the FileAuthorizer to ensure thread safety
- Adding /groups to policies created for initial admin
- This closes #473
2016-06-03 17:26:22 -04:00
Matt Gilman 806f4d549d NIFI-1951:
- Removing deprecated NiFiWebContext and related classes.
- Adding authorization to Custom UIs.
- Fixing issue when creating ControllerService inline.
- Addressing contentType issue when attempting to clear component state.
- This closes #489
2016-06-03 16:52:02 -04:00
Mark Payne df0e4e7960 NIFI-1897:
- Refactoring to allow requests to be replicated from a node to other nodes
- Renaming cluster node connection/read timeout properties.
- Renaming NCM DN to Cluster Coordinator DN.
- Fixing default values in properties.
- Starting to fix Spring context to load correctly in standalone mode.
- Using the cluster protocol to handle connection failures instead of heartbeats.
- Ensured replicate call is returned from ControllerResource.
- Ensure the appropriate classloader when serializing templates.
- Handling when the flow contents are null.
- This closes #488
2016-06-03 15:29:16 -04:00
Andre F de Miranda 5a8979150c NIFI-856 - Implements ListenLumberjack Processor
This closes #290.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-06-02 21:58:41 -04:00
jpercivall 54c5c28cbb NIFI-1943 added proper ReadsAttribute to PutFile
This closes #480
2016-06-02 13:04:14 -04:00
Matt Gilman f0f74fe404 NIFI-1928:
- Fixing UI action for bulk delete.
- Removing registration form.
- Fixing default visibility of the anonymous user warning.
2016-06-02 11:56:10 -04:00
Matt Gilman 950e0cfa58 NIFI-1265:
- Upgrading the jspc maven plugin.
2016-06-02 09:49:57 -04:00
jpercivall 4f101294eb NIFI-1265 Fixing InvokeHttp tests.
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-06-02 09:49:57 -04:00
Matt Gilman e587c99855 NIFI-1265:
- Upgrading to Jetty 9.3.
2016-06-02 09:49:57 -04:00
Jeff Storck 3e064101e9 NIFI-1948 Fixed encoding-version attribute not getting created in exported templates. This closes #485 2016-06-02 09:29:11 -04:00
Andre F de Miranda bcead3500d NIFI-1945 - Corrects minor issue in "<Hash Attribute Name>" description
This closes #481.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2016-06-01 21:13:59 +02:00
Oleg Zhurakousky 93795bc7ba NIFI-1915 Fixed '$' escape logic.
Fixed '$' escape logic (if not followed by number) to use Matcher.quoteReplacement(java.lang.String) to
suppress its special meaning so it could be treated as literal.

This closes #466.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2016-06-01 20:17:59 +02:00
Joe Skora c6af6be44c NIFI-1754 Rollback log messages should include the flowfile filename and UUID to assist in flow management. Incorporates debug logging into StandardProcessSession.rollback() to list Flowfile records retreived from the session.
Reviewed with slight style amendment (see Jira for details) by Tony Kurc (tkurc@apache.org). This closes #478.
2016-06-01 08:43:54 -07:00
jpercivall f47af1ce83 NIFI-1808 Adding proper license information to Nar and provenance reporting to PublishMQTT
NIFI-1808 changing ConsumeMQTT messageArrived() logging

This closes #484
2016-06-01 11:37:06 -04:00
Jeff Storck 893daf567d NIFI-1908 Added encoding-version attribute to TemplateDTO
added scaling of templates upon instantiation for placement on the canvas
added template-0.7.0.xml for live-testing the import of templates

Fixing issue with potentially uninitialized RemoteGroupPorts in copySnippet.

This closes #471
2016-05-30 14:40:52 -04:00
Matt Gilman b075f238a5 NIFI-1564:
- Addressing issue referencing the global jQuery variable in the content viewer.
- This closes #421
2016-05-26 15:23:29 -04:00
Matt Gilman a0ff2f7a9f NIFI-1554:
- Refactoring Cluster endpoints.
- Updating frontend to accomodate clustering endpoints.
- Remove the 'Make Primary' action.
- This closes #470
2016-05-26 14:28:24 -04:00
Matt Gilman 9152a9fdbb NIFI-1800:
- UI style updates to make the components stand out better.
- Reusing controller service table in different contexts (controller, process group, etc).
- This closes #469
2016-05-26 14:15:56 -04:00
Andy LoPresto ae3012a992 NIFI-1918 Ignored failing test because timing is not deterministic and should not be used in unit test.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #465
2016-05-24 22:43:17 -04:00
Jeff Storck 433db23567
NIFI-1799 Implements auto-scaling flow layout
added utility class to scale positions of components on the canvas,
extracted get/setPosition methods from ProcesGroup, RemoteProcessGroup, Label, and Connectable into new interface Positionable
added interface method for finding all Positionables in a ProcessGroup to the ProcessGroup interface and added implementation to StandardProcessGroup
added test flow for position rescaling
added Spock config to POM and a spec for testing the scaling of Positionables
forced Surefire to use JUnit (TestNG was on classpath and Surefire seems to prioritize that over JUnit),
added check in StandardFlowSynchronizer to scale positions only when flow encoding version is less than 1.0
added spec for StandardFlowfileSynchronizer
updated FlowConfiguration.xsd to allow encoding-version attribute
added new test flow used in StandardFlowSynchronizerSpec

This closes #442.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-05-24 14:26:28 -07:00
jpercivall 7923fd04c3 NIFI-1808 Refactored MQTT processors, and added proper unit and integration tests
This closes #392
2016-05-24 13:18:25 -04:00
info@richards-tech.com 7a4c71fec7 Added mqtt
Fixed attribute name in PutMQTT
2016-05-24 13:17:31 -04:00
jpercivall e1b654655a NIFI-1913 Properly removing flowfile in HandleHttpRequest when the Context Map fails to register the request
This closes #462
2016-05-24 10:54:46 -04:00
James Wing 9bb6dcb5e5 NIFI-786 AWS credential refactoring and enhancements
Signed-off-by: Joe Skora <jskora@gmail.com>
This closes #244.
2016-05-24 00:27:13 -04:00
Matt Gilman 4dd50c80a4 NIFI-1781:
- Including access policies in the breadcrumb's trail.
- Updating toolbox according to group access policies.
- Updating actions in palette based on selection access policies.
NIFI-1554:
- Introducing authorization during two phase commit.
- Introducing snippet authorization according to the encapsulated components and the action performed.
- This closes #461
2016-05-23 14:15:32 -04:00
Oleg Zhurakousky f40a090073 NIFI-1905 enabled ExecuteProcess to terminate process
NIFI-1905 polishing

NIFI-1905 changed WARN to INFO during shutdown
This closes #456
2016-05-22 10:36:03 -04:00
Mark Payne 4b74e4de74 NIFI-1745: Refactor how revisions are handled at NCM/Distributed to Node. This closes #454 2016-05-20 14:04:24 -04:00
DomenicPuzio afc8c645a1 NIFI-1498: putFile - Flowfiles routed to failure relationship produce INFO level log messages
This closes #445.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-19 16:21:45 -04:00
Oleg Zhurakousky d6674fbb8e NIFI-1898 Fixed Flume processor @OnScheduled methods to accept ProcessContext
This closes #455.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-19 16:07:57 -04:00
Aldrin Piri 1bd2cf0d09 NIFI-1811 Renaming MockProcessorLogger to MockComponentLogger for consistency. Removing unused imports from ExecuteScript causing checkstyle failures. 2016-05-19 14:38:41 -04:00
Pierre Villard 372ffb8aa0 NIFI-1811 Removed ProcessorLog and updated dependent interfaces
This closes #403.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-19 13:08:09 -04:00
Oleg Zhurakousky 2d03489ec5 NIFI-1296, NIFI-1680, NIFI-1764, NIFI-1837, NIFI-1827, NIFI-1699 implemented new Kafka processors that leverage Kafka 0.9 API
- Improved StreamScanner for better performance
- Renamed StreamScanner to StreamDemarcator as suggested by Joe
- Added failure handling logic to ensure both processors can be reset to their initial state (as if they were just started)
- Provided comprehensive test suite to validate various aspects of both Publish and Consume from Kafka
- Added relevant javadocs
- Added initial additionalDetails docs
- Addressed NPE reported by NIFI-1764
- Life-cycle refactoring for the existing PutKafka to ensure producer restart after errors
- Incorporated code changes contributed by Ralph Perko (see NIFI-1837)
- Addressed partition issue in RoundRobinPartitioner discussed in NIFI-1827
- Updated PropertyDescriptor descriptions to reflect their purpose

NIFI-1296 added @Ignore on some Kafka tests to improve test time

NIFI-1296 reworked tests to avoid dependency on embedded Kafka

NIFI-1296 fixed spelling error

NIFI-1296 fixed trailing whitespaces in non-java files

This closes #366
2016-05-19 07:33:03 -04:00