# Protocols and Interoperability ## Protocols ActiveMQ Artemis has a plugable protocol architecture. Protocol plugins come in the form of ActiveMQ Artemis protocol modules. Each protocol module should be added to the brokers class path and are loaded by the broker at boot time. ActiveMQ Artemis ships with 5 protocol modules out of the box. The 5 modules offer support for the following protocols: * AMQP * OpenWire * MQTT * STOMP * HornetQ In addition to the protocols above ActiveMQ Artemis also offers support for it's own highly performant native protocol "Core". ## Configuring protocols In order to make use of a particular protocol, a transport must be configured with the desired protocol enabled. There is a whole section on configuring transports that can be found [here](configuring-transports.md). The default configuration shipped with the ActiveMQ Artemis distribution comes with a number of acceptors already defined, one for each of the above protocols plus a generic acceptor that supports all protocols. To enable a protocol on a particular acceptor simply add a url parameter "protocol=AMQP,STOMP" to the acceptor url. Where the value of the parameter is a comma separated list of protocol names. If the protocol parameter is omitted from the url all protocols are enabled. tcp://localhost:1883?protocols=MQTT tcp://localhost:1883?protocols=MQTT,AMQP tcp://localhost:61616 ## AMQP Apache ActiveMQ Artemis supports the [AMQP 1.0](https://www.oasis-open.org/committees/tc_home.php?wg_abbrev=amqp) specification. To enable AMQP you must configure a Netty Acceptor to receive AMQP clients, like so: tcp://localhost:5672?protocols=AMQP Apache ActiveMQ Artemis will then accept AMQP 1.0 clients on port 5672 which is the default AMQP port. There are 2 AMQP examples available see proton-j and proton-ruby which use the qpid Java and Ruby clients respectively. ### AMQP and security The Apache ActiveMQ Artemis Server accepts AMQP SASL Authentication and will use this to map onto the underlying session created for the connection so you can use the normal Apache ActiveMQ Artemis security configuration. ### AMQP Links An AMQP Link is a uni directional transport for messages between a source and a target, i.e. a client and the Apache ActiveMQ Artemis Broker. A link will have an endpoint of which there are 2 kinds, a Sender and A Receiver. At the Broker a Sender will have its messages converted into an Apache ActiveMQ Artemis Message and forwarded to its destination or target. A Receiver will map onto an Apache ActiveMQ Artemis Server Consumer and convert Apache ActiveMQ Artemis messages back into AMQP messages before being delivered. ### AMQP and destinations If an AMQP Link is dynamic then a temporary queue will be created and either the remote source or remote target address will be set to the name of the temporary queue. If the Link is not dynamic then the the address of the remote target or source will used for the queue. If this does not exist then an exception will be sent > **Note** > > For the next version we will add a flag to aut create durable queue > but for now you will have to add them via the configuration ### AMQP and Topics Although amqp has no notion of topics it is still possible to treat amqp consumers or receivers as subscriptions rather than just consumers on a queue. By default any receiving link that attaches to an address with the prefix `jms.topic.` will be treated as a subscription and a subscription queue will be created. If the Terminus Durability is either UNSETTLED_STATE or CONFIGURATION then the queue will be made durable, similar to a JMS durable subscription and given a name made up from the container id and the link name, something like `my-container-id:my-link-name`. if the Terminus Durability is configured as NONE then a volatile queue will be created. The prefix can be changed by configuring the Acceptor and setting the `pubSubPrefix` like so > tcp://0.0.0.0:5672?protocols=AMQP;pubSubPrefix=foo.bar. Artemis also supports the qpid-jms client and will respect its use of topics regardless of the prefix used for the address. ### AMQP and Coordinations - Handling Transactions An AMQP links target can also be a Coordinator, the Coordinator is used to handle transactions. If a coordinator is used the the underlying HormetQ Server session will be transacted and will be either rolled back or committed via the coordinator. > **Note** > > AMQP allows the use of multiple transactions per session, > `amqp:multi-txns-per-ssn`, however in this version Apache ActiveMQ Artemis will only > support single transactions per session ## OpenWire Apache ActiveMQ Artemis now supports the [OpenWire](http://activemq.apache.org/openwire.html) protocol so that an Apache ActiveMQ Artemis JMS client can talk directly to an Apache ActiveMQ Artemis server. To enable OpenWire support you must configure a Netty Acceptor, like so: tcp://localhost:61616?protocols=OPENWIRE The Apache ActiveMQ Artemis server will then listens on port 61616 for incoming openwire commands. Please note the "protocols" is not mandatory here. The openwire configuration conforms to Apache ActiveMQ Artemis's "Single Port" feature. Please refer to [Configuring Single Port](#configuring-transports.single-port) for details. Please refer to the openwire example for more coding details. Currently we support Apache ActiveMQ Artemis clients that using standard JMS APIs. In the future we will get more supports for some advanced, Apache ActiveMQ Artemis specific features into Apache ActiveMQ Artemis. ## MQTT MQTT is a light weight, client to server, publish / subscribe messaging protocol. MQTT has been specifically designed to reduce transport overhead (and thus network traffic) and code footprint on client devices. For this reason MQTT is ideally suited to constrained devices such as sensors and actuators and is quickly becoming the defacto standard communication protocol for IoT. Apache ActiveMQ Artemis supports MQTT v3.1.1 (and also the older v3.1 code message format). To enable MQTT, simply add an appropriate acceptor with the MQTT protocol enabled. For example: tcp://localhost:1883?protocols=MQTT By default the configuration shipped with Apache ActiveMQ Artemis has the above acceptor already defined, MQTT is also active by default on the generic acceptor defined on port 61616 (where all protocols are enabled), in the out of the box configuration. The best source of information on the MQTT protocol is in the specification. The MQTT v3.1.1 specification can be downloaded from the OASIS website here: http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/os/mqtt-v3.1.1-os.html Some note worthy features of MQTT are explained below: ### MQTT Quality of Service MQTT offers 3 quality of service levels. Each message (or topic subscription) can define a quality of service that is associated with it. The quality of service level defined on a topic is the maximum level a client is willing to accept. The quality of service level on a message is the desired quality of service level for this message. The broker will attempt to deliver messages to subscribers at the highest quality of service level based on what is defined on the message and topic subscription. Each quality of service level offers a level of guarantee by which a message is sent or received: * QoS 0: AT MOST ONCE: Guarantees that a particular message is only ever received by the subscriber a maximum of one time. This does mean that the message may never arrive. The sender and the receiver will attempt to deliver the message, but if something fails and the message does not reach it's destination (say due to a network connection) the message may be lost. This QoS has the least network traffic overhead and the least burden on the client and the broker and is often useful for telemetry data where it doesn't matter if some of the data is lost. * QoS 1: AT LEAST ONCE: Guarantees that a message will reach it's intended recipient one or more times. The sender will continue to send the message until it receives an acknowledgment from the recipient, confirming it has received the message. The result of this QoS is that the recipient may receive the message multiple times, and also increases the network overhead than QoS 0, (due to acks). In addition more burden is placed on the sender as it needs to store the message and retry should it fail to receive an ack in a reasonable time. * QoS 2: EXACTLY ONCE: The most costly of the QoS (in terms of network traffic and burden on sender and receiver) this QoS will ensure that the message is received by a recipient exactly one time. This ensures that the receiver never gets any duplicate copies of the message and will eventually get it, but at the extra cost of network overhead and complexity required on the sender and receiver. ### MQTT Retain Messages MQTT has an interesting feature in which messages can be "retained" for a particular address. This means that once a retain message has been sent to an address, any new subscribers to that address will receive the last sent retain message before any others messages, this happens even if the retained message was sent before a client has connected or subscribed. An example of where this feature might be useful is in environments such as IoT where devices need to quickly get the current state of a system when they are on boarded into a system. ### Will Messages A will message can be sent when a client initially connects to a broker. Clients are able to set a "will message" as part of the connect packet. If the client abnormally disconnects, say due to a device or network failure the broker will proceed to publish the will message to the specified address (as defined also in the connect packet). Other subscribers to the will topic will receive the will message and can react accordingly. This feature can be useful in an IoT style scenario to detect errors across a potentially large scale deployment of devices. ### Wild card subscriptions MQTT addresses are hierarchical much like a file system, and use "/" character to separate hierarchical levels. Subscribers are able to subscribe to specific topics or to whole branches of a hierarchy. To subscribe to branches of an address hierarchy a subscriber can use wild cards. There are 2 types of wild card in MQTT: * "#" Multi level wild card. Adding this wild card to an address would match all branches of the address hierarchy under a specified node. For example: /uk/# Would match /uk/cities, /uk/cities/newcastle and also /uk/rivers/tyne. Subscribing to an address "#" would result in subscribing to all topics in the broker. This can be useful, but should be done so with care since it has significant performance implications. * "+" Single level wild card. Matches a single level in the address hierarchy. For example /uk/+/stores would match /uk/newcastle/stores but not /uk/cities/newcastle/stores. ## Stomp [Stomp](http://stomp.github.com/) is a text-orientated wire protocol that allows Stomp clients to communicate with Stomp Brokers. Apache ActiveMQ Artemis now supports Stomp 1.0, 1.1 and 1.2. Stomp clients are available for several languages and platforms making it a good choice for interoperability. ## Native Stomp support Apache ActiveMQ Artemis provides native support for Stomp. To be able to send and receive Stomp messages, you must configure a `NettyAcceptor` with a `protocols` parameter set to have `stomp`: tcp://localhost:61613?protocols=STOMP With this configuration, Apache ActiveMQ Artemis will accept Stomp connections on the port `61613` (which is the default port of the Stomp brokers). See the `stomp` example which shows how to configure an Apache ActiveMQ Artemis server with Stomp. ### Limitations Message acknowledgements are not transactional. The ACK frame can not be part of a transaction (it will be ignored if its `transaction` header is set). ### Stomp 1.1/1.2 Notes #### Virtual Hosting Apache ActiveMQ Artemis currently doesn't support virtual hosting, which means the 'host' header in CONNECT fram will be ignored. #### Heart-beating Apache ActiveMQ Artemis specifies a minimum value for both client and server heart-beat intervals. The minimum interval for both client and server heartbeats is 500 milliseconds. That means if a client sends a CONNECT frame with heartbeat values lower than 500, the server will defaults the value to 500 milliseconds regardless the values of the 'heart-beat' header in the frame. ### Mapping Stomp destinations to Apache ActiveMQ Artemis addresses and queues Stomp clients deals with *destinations* when sending messages and subscribing. Destination names are simply strings which are mapped to some form of destination on the server - how the server translates these is left to the server implementation. In Apache ActiveMQ Artemis, these destinations are mapped to *addresses* and *queues*. When a Stomp client sends a message (using a `SEND` frame), the specified destination is mapped to an address. When a Stomp client subscribes (or unsubscribes) for a destination (using a `SUBSCRIBE` or `UNSUBSCRIBE` frame), the destination is mapped to an Apache ActiveMQ Artemis queue. ### STOMP and connection-ttl Well behaved STOMP clients will always send a DISCONNECT frame before closing their connections. In this case the server will clear up any server side resources such as sessions and consumers synchronously. However if STOMP clients exit without sending a DISCONNECT frame or if they crash the server will have no way of knowing immediately whether the client is still alive or not. STOMP connections therefore default to a connection-ttl value of 1 minute (see chapter on [connection-ttl](#connection-ttl) for more information. This value can be overridden using connection-ttl-override. If you need a specific connectionTtl for your stomp connections without affecting the connectionTtlOverride setting, you can configure your stomp acceptor with the "connectionTtl" property, which is used to set the ttl for connections that are created from that acceptor. For example: tcp://localhost:61613?protocols=STOMP;connectionTtl=20000 The above configuration will make sure that any stomp connection that is created from that acceptor will have its connection-ttl set to 20 seconds. > **Note** > > Please note that the STOMP protocol version 1.0 does not contain any > heartbeat frame. It is therefore the user's responsibility to make > sure data is sent within connection-ttl or the server will assume the > client is dead and clean up server side resources. With `Stomp 1.1` > users can use heart-beats to maintain the life cycle of stomp > connections. ### Stomp and JMS interoperability #### Using JMS destinations As explained in [Mapping JMS Concepts to the Core API](jms-core-mapping.md), JMS destinations are also mapped to Apache ActiveMQ Artemis addresses and queues. If you want to use Stomp to send messages to JMS destinations, the Stomp destinations must follow the same convention: - send or subscribe to a JMS *Queue* by prepending the queue name by `jms.queue.`. For example, to send a message to the `orders` JMS Queue, the Stomp client must send the frame: SEND destination:jms.queue.orders hello queue orders ^@ - send or subscribe to a JMS *Topic* by prepending the topic name by `jms.topic.`. For example to subscribe to the `stocks` JMS Topic, the Stomp client must send the frame: SUBSCRIBE destination:jms.topic.stocks ^@ #### Sending and consuming Stomp message from JMS or Apache ActiveMQ Artemis Core API Stomp is mainly a text-orientated protocol. To make it simpler to interoperate with JMS and Apache ActiveMQ Artemis Core API, our Stomp implementation checks for presence of the `content-length` header to decide how to map a Stomp message to a JMS Message or a Core message. If the Stomp message does *not* have a `content-length` header, it will be mapped to a JMS *TextMessage* or a Core message with a *single nullable SimpleString in the body buffer*. Alternatively, if the Stomp message *has* a `content-length` header, it will be mapped to a JMS *BytesMessage* or a Core message with a *byte[] in the body buffer*. The same logic applies when mapping a JMS message or a Core message to Stomp. A Stomp client can check the presence of the `content-length` header to determine the type of the message body (String or bytes). #### Message IDs for Stomp messages When receiving Stomp messages via a JMS consumer or a QueueBrowser, the messages have no properties like JMSMessageID by default. However this may bring some inconvenience to clients who wants an ID for their purpose. Apache ActiveMQ Artemis Stomp provides a parameter to enable message ID on each incoming Stomp message. If you want each Stomp message to have a unique ID, just set the `stompEnableMessageId` to true. For example: tcp://localhost:61613?protocols=STOMP;stompEnableMessageId=true When the server starts with the above setting, each stomp message sent through this acceptor will have an extra property added. The property key is ` amq-message-id` and the value is a String representation of a long type internal message id prefixed with "`STOMP`", like: amq-message-id : STOMP12345 If `stomp-enable-message-id` is not specified in the configuration, default is `false`. #### Handling of Large Messages with Stomp Stomp clients may send very large bodys of frames which can exceed the size of Apache ActiveMQ Artemis server's internal buffer, causing unexpected errors. To prevent this situation from happening, Apache ActiveMQ Artemis provides a stomp configuration attribute `stompMinLargeMessageSize`. This attribute can be configured inside a stomp acceptor, as a parameter. For example: tcp://localhost:61613?protocols=STOMP;stompMinLargeMessageSize=10240 The type of this attribute is integer. When this attributed is configured, Apache ActiveMQ Artemis server will check the size of the body of each Stomp frame arrived from connections established with this acceptor. If the size of the body is equal or greater than the value of `stompMinLargeMessageSize`, the message will be persisted as a large message. When a large message is delievered to a stomp consumer, the HorentQ server will automatically handle the conversion from a large message to a normal message, before sending it to the client. If a large message is compressed, the server will uncompressed it before sending it to stomp clients. The default value of `stompMinLargeMessageSize` is the same as the default value of [min-large-message-size](#large-messages.core.config). ### Stomp Over Web Sockets Apache ActiveMQ Artemis also support Stomp over [Web Sockets](http://dev.w3.org/html5/websockets/). Modern web browser which support Web Sockets can send and receive Stomp messages from Apache ActiveMQ Artemis. To enable Stomp over Web Sockets, you must configure a `NettyAcceptor` with a `protocol` parameter set to `stomp_ws`: tcp://localhost:61614?protocols=STOMP_WS With this configuration, Apache ActiveMQ Artemis will accept Stomp connections over Web Sockets on the port `61614` with the URL path `/stomp`. Web browser can then connect to `ws://:61614/stomp` using a Web Socket to send and receive Stomp messages. A companion JavaScript library to ease client-side development is available from [GitHub](http://github.com/jmesnil/stomp-websocket) (please see its [documentation](http://jmesnil.net/stomp-websocket/doc/) for a complete description). The `stomp-websockets` example shows how to configure Apache ActiveMQ Artemis server to have web browsers and Java applications exchanges messages on a JMS topic. ## REST Please see [Rest Interface](rest.md)