Running Maven 2 Performance Test

This Maven 2 plugin allows you to run performance tests easily using the Maven command line or run tests automatically in Continuum

Prerequisites

Currently we have not released the plugin so you could well have to build it yourself first. Start with a complete build of Apache ActiveMQ and then do

cd tooling/maven-activemq-perf-plugin
mvn clean install

To run the following Maven goals make sure you are inside a Maven2 project directory where its POM is enabled with the Maven2 plugin such as the activemq-perftest module.

Getting started

To get started try typing the following commands into separate shells from the activemq-perftest directory

mvn activemq-perf:broker -Durl=broker:tcp://localhost:61616
mvn activemq-perf:consumer
mvn activemq-perf:producer

If you run the broker on a different machine then change the producer and consumer commands to

mvn activemq-perf:consumer -Dfactory.brokerUrl=tcp://host:port
mvn activemq-perf:producer -Dfactory.brokerUrl=tcp://host:port

where you switch host:port with the actual values.

When you run the producer & consumer, it generates an XML performance report in the current directory, so that you can graph and chart the results etc. See the sample report

Maven goals

Goal Description
activemq-perf:broker Starts broker using the activemq configuration file located in "src\main\resources\broker-conf" where the default config is activemq.xml.
Parameters:
 1. -DconfigType - specifies the type of configuration to use. Its value must be one of the filename in the "..\broker-config" directory (e.g. -DconfigType=kaha).
 2. -DconfigFile - path to config file other than those in "src\..\broker-config".e.g -DconfigFile=c:\dir\activemq.xml)
activemq-perf:consumer Starts the consumer's performance testing. The generated report file can be found in the directory specified in the parameter "sysTest.reportDir".
activemq-perf:producer Starts the producer's performance testing. The generated report file can be found in the directory specified in the parameter "sysTest.reportDir".

1 Note:The parameters for both consumer and producers are described in the next section. (sample report)

Configuration for running a system of JMS Clients (Producer/Consumer)

Configuration Key Default Value
Description
sysTest.clientPrefix JmsConsumer or JmsProducer Specifies the client name prefix that will be use for each system. By default it will use JmsConsumer for consumer systems, and JmsProducer for producer systems.
sysTest.numClients 1 Specifies the number of JMS Clients to start.
sysTest.totalDests 1 Specifies the total number of destinations to use for the whole system test.
sysTest.destDistro all Specifies how to distribute the destinations to the clients. Available values are (Invalid value will result to using the default value 'all')1:
  • 'all' - All clients will send/receive to all destinations. i.e. if there are 2 producers and 5 destinations, each producer will send a message to each individual destination.
  • 'equal' - Clients will equally divide the destinations among themselves. i.e. if there are 2 producers and 5 destinations, each producer will send messages to 2 destinations. The fifth destination will not be used.
  • 'divide' - Clients will divide the destinations among themselves regardless of equality. i.e. if there are 2 producers and 5 destinations, producer 1 will send to 3 destinations, while producer 2 will send to 2 destinations.
sysTest.reportDirectory ./ The directory where the sampler report will be saved.
sysTest.reportName null The default filename the sampler report will be saved us. There is usually no need to set this setting as the default value will create either JmsProducer_numClients#numDests#<Dest Distro>.xml and JmsConsumer_numClients#_numDests#_<Dest Distro>.xml, where # represents the number of clients and destinations set for that system, and <Dest Distro> specifies the destination distribution for the system.
sysTest.reportType xml Specifies the manner of generating the performance report. Available values are:
  • 'xml' - Write the performance report into an xml file. Specified by reportDirectory and reportName. A verbose summary will also be displayed at the end of the test.
  • 'verbose' - All information will be written to the standard output, which includes settings, sampler data, and performance summary.
sysTest.samplers tp,cpu Specifies the samplers that will be started. To use enable more than one sampler, separate the values by commas without spaces. Available values are:
  • 'tp' - Throughput sampler
  • 'cpu' - CPU Usage sampler
sysTest.spiClass org.apache.activemq.tool.spi.ActiveMQClassLoaderSPI The service provider interface class that allows the client to create a generic connection factory. Current available SPI classes include:
  1. 'org.apache.activemq.tool.ActiveMQPojoSPI'
  2. 'org.apache.activemq.tool.ActiveMQClassLoaderSPI'

1 Note: If the number of destinations is less than the number of clients and the distribution type is either 'equal' or 'divide', each client will send/receive from only one destination, distributing the destinations among the clients. i.e. if there are 5 producers and 2 destinations, 3 producers will send to destination 1, and 2 producers will send to destination 2. Also, a consumer can only receive from a single destination, unless composite destination is supported and specified.

Configuration for running a JMS Producer

Configuration Key Default Value Description
producer.sessTransacted false Specifies if the session created will be transacted or not. See the JMS Specifications for more details.
producer.sessAckMode autoAck Specified the acknowledge mode of the session. See the JMS Specifications for more details. Available values are:
  1. 'autoAck' - Session.AUTO_ACKNOWLEDGE
  2. 'clientAck' - Session.CLIENT_ACKNOWLEDGE
  3. 'dupsAck' - Session.DUPS_OK_ACKNOWLEDGE
  4. 'transacted' - Session.TRANSACTED
producer.destName TEST.FOO The prefix of the destination name to use. To specify a queue, prefix the destination name with 'queue://', for topics, prefix the destination with 'topic://'. If no prefix is specified, a topic will be created.
producer.destComposite false If there are more than one destination, and destComposite=true, the destinations will be merged into one. This assumes that the provider supports composite destinations.
producer.deliveryMode nonpersistent The message delivery mode that will be used for each producer. Available values are:
  1. 'nonpersistent' - use non-persistent delivery mode. javax.jms.DeliveryMode.NON_PERSISTENT.
  2. 'persistent' - use persistent delivery mode. javax.jms.DeliveryMode.PERSISTENT.
producer.messageSize 1024 bytes The size of each text message to send.
producer.createNewMsg false If true, each send will create a new JMS Message with the specified message size with incrementing text messages (i.e. Text Message 1, Text Message 2, ...). If false, only one message will be created before the send loop, and this message will be sent over and over again.
producer.sendType time Send either time-based or message-count-based. Available values are:
  1. 'time' - keep sending messages until a specific interval of time elapses.
  2. 'count' - keep sending messages until N messages has been sent.
producer.sendCount 1000000 msgs
(1 million) 		If sendType=count, send this number of messages.
producer.sendDuration 300000 ms
(5 mins) 		If sendType=time, send messages for this number of milliseconds.

Configuration for running a JMS Consumer

Configuration Key Default Value Description
consumer.sessTransacted false Specifies if the session created will be transacted or not. See the JMS Specifications for more details.
consumer.sessAckMode autoAck Specified the acknowledge mode of the session. See the JMS Specifications for more details. Available values are:
  1. 'autoAck' - Session.AUTO_ACKNOWLEDGE
  2. 'clientAck' - Session.CLIENT_ACKNOWLEDGE
  3. 'dupsAck' - Session.DUPS_OK_ACKNOWLEDGE
  4. 'transacted' - Session.TRANSACTED
consumer.destName TEST.FOO The prefix of the destination name to use. To specify a queue, prefix the destination name with 'queue://', for topics, prefix the destination with 'topic://'. If no prefix is specified, a topic will be created.
consumer.destComposite false If there are more than one destination, and destComposite=true, the destinations will be merged into one. This assumes that the provider supports composite destinations.
consumer.durable false If true, create a durable subscriber, otherwise create a message consumer. See the JMS Specifications for more details.
consumer.asyncRecv true If true, asynchronously receive messages using the onMessage() method, otherwise use the receive() method.
consumer.recvType time Receive either time-based or message-count-based. Available values are:
  1. 'time' - keep receiving messages until a specific time interval has elapsed.
  2. 'count' - keep receiving until N messages has been received.
consumer.recvCount 1000000 msgs
(1 million) 		If recvType=count, receive this much messages.
consumer.recvType 300000 ms
(5 mins) 		If recvType=time, receive messages for this specific time duration.

Note: If you have more than one consumer receiving from multiple destinations, it is a good idea to change the sysTest.destDistro to 'equal', since by default it uses 'all' and a consumer can only receive from a single destination, hence all consumers will receive from the first destination in the list only.

Configuration for SPI Connection Factory: org.apache.activemq.tool.spi.ActiveMQPojoSPI

Description: This provides details in configuring the JMS Connection Factory created by ActiveMQPojoSPI. Default values are based from the default values of the service provider org.apache.activemq.ActiveMQConnectionFactory.

Configuration Key Default Value Description
factory.brokerUrl tcp://localhost:61616 The url of the broker the client will connect to.
factory.username null Username on the connection to use.
factory.password null Password on the connection to use.
factory.clientID null Client ID the connection will use. If none is specified, it will be automatically generated.
factory.asyncSend false If true, asynchronously send messages.
factory.asyncDispatch false If true, asynchronously dispatch messages.
factory.asyncSession true If true, session will dispatch messages asynchronously.
factory.closeTimeout 15000 ms
factory.copyMsgOnSend true If true, creates a copy of the message to be sent.
factory.disableTimestamp false If true, disable the setting of the JMSTimestamp.
factory.deferObjSerial false If true, defer the serialization of message objects.
factory.optimAck true If true, optimizes the acknowledgement of messages.
factory.optimDispatch true If true, optimizes the dispatching of messages.
factory.prefetchQueue 1000 messages Number of messages a queue consumer will cache in RAM before processing it.
factory.prefetchTopic 32766 messages Number of messages a topic consumer will cache in RAM before processing it.
factory.useCompression false If true, compress message data.
factory.useRetroactive false If true, make consumers retroactive.

Configuration for SPI Connection Factory: org.apache.activemq.tool.spi.ActiveMQClassLoaderSPI

Description: This provides details in configuring the JMS Connection Factory created by ActiveMQClassLoaderSPI. Default values are based from the default values of the service provider org.apache.activemq.ActiveMQConnectionFactory.

ActiveMQClassLoaderSPI loads from the classpath "org.apache.activemq.ActiveMQConnectionFactory" and configures it using reflection. Configuration is generally based on the API of the class loaded. General format is factory.YYY or factory.XXX.YYY, where the last variable (YYY) is the property to set and everything in between is the getter of the class to use to set (YYY). For example:

  1. To set the value for asyncSend in ActiveMQConnectionFactory, use:
    factory.useAsyncSend=true, which is equivalent to calling factory.setUseAsyncSend(true)
  1. To set the queue prefetch for ActiveMQConnectionFactory, use:
    factory.prefetchPolicy.queuePrefetch=1, which is equivalent to calling factory.getPrefetchPolicy().setQueuePrefetch(1)

It should be noted that the loaded class should implement the appropriate getter and setter methods. Nested objects should also be properly instantiated. For more information on configuring this SPI, refer to the specific provider API manual.

As of ActiveMQ 4.0.1, these are the available fields and default values:

Configuration Key Default Value
factory.prefetchPolicy.optimizeDurableTopicPrefetch 1000
factory.prefetchPolicy.durableTopicPrefetch 100
factory.password null
factory.prefetchPolicy.queueBrowserPrefetch 500
factory.useCompression false
factory.disableTimeStampsByDefault false
factory.optimizedMessageDispatch true
factory.useRetroactiveConsumer false
factory.alwaysSessionAsync true
factory.copyMessageOnSend true
factory.prefetchPolicy.topicPrefetch 32766
factory.useAsyncSend false
factory.redeliveryPolicy.backOffMultiplier 5
factory.prefetchPolicy.inputStreamPrefetch 100
factory.closeTimeout 15000
factory.userName null
factory.optimizeAcknowledge false
factory.clientID null
factory.objectMessageSerializationDefered false
factory.asyncDispatch false
factory.redeliveryPolicy.initialRedeliveryDelay 1000
factory.prefetchPolicy.queuePrefetch 1000
factory.redeliveryPolicy.maximumRedeliveries 5
factory.redeliveryPolicy.useCollisionAvoidance false
factory.prefetchPolicy.maximumPendingMessageLimit 0
factory.redeliveryPolicy.useExponentialBackOff false

Configuration for the throughput sampler

Configuration Key Default Value Description
tpSampler.duration 300000 The total duration (in ms) the sampler will run, including ramp up and ramp down time.
tpSampler.rampUpTime 30000 The ramp up time of the sampler, sampling will only start after the ramp up time.
tpSampler.rampDownTime 30000 The ramp down time of the sampler, sampling will stop when the sampler has executed for (duration - rampUpTime - rampDownTime) ms.
tpSampler.interval 1000 The interval (in ms), the sampler will sample for data.

Configuration for the cpu sampler

Configuration Key Default Value Description
cpuSampler.duration 300000 The total duration (in ms) the sampler will run, including ramp up and ramp down time.
cpuSampler.rampUpTime 30000 The ramp up time of the sampler, sampling will only start after the ramp up time.
cpuSampler.rampDownTime 30000 The ramp down time of the sampler, sampling will stop when the sampler has executed for (duration - rampUpTime - rampDownTime) ms.
cpuSampler.interval 1000 The interval (in ms), the sampler will sample for data.