Commit Graph

248 Commits

Author SHA1 Message Date
Christopher L. Shannon (cshannon) b9f9f03829 https://issues.apache.org/jira/browse/AMQ-6256
Calling beforeMarshall on messages when they async stored before the
store task is run and before consumer dispatch to prevent two threads
from trying to mutate the message state at the same time.
2016-04-15 13:01:21 +00:00
gtully 13ec994939 Revert "https://issues.apache.org/jira/browse/AMQ-4495 - revisit. Reinstate check for space on pagein, so that highWaterMark is respected and full state is not reached, hense pfc is not triggered in error"
This reverts commit d8cf54b0a9.
2016-03-07 16:26:25 +00:00
gtully d8cf54b0a9 https://issues.apache.org/jira/browse/AMQ-4495 - revisit. Reinstate check for space on pagein, so that highWaterMark is respected and full state is not reached, hense pfc is not triggered in error 2016-03-01 11:44:41 +00:00
gtully 499e39e52c https://issues.apache.org/jira/browse/AMQ-6164 - allow journal write batching on a single destination 2016-02-09 12:50:27 +00:00
Timothy Bish 4ecff14030 NO-JIRA Update master version to 5.14.0-SNAPSHOT to match the eventual
release version.
2016-01-20 12:40:20 -05:00
Hiram Chirino 9de3fff1f5 Fixes AMQ-5404: LevelDB files not being released after deletion 2015-12-21 11:18:08 -05:00
Christopher L. Shannon (cshannon) cfb4ca9f54 [maven-release-plugin] prepare for next development iteration 2015-11-30 13:48:58 +00:00
Christopher L. Shannon (cshannon) abfe038ddf [maven-release-plugin] prepare release activemq-5.13.0 2015-11-30 13:48:11 +00:00
Christopher L. Shannon (cshannon) 130455c925 https://issues.apache.org/jira/browse/AMQ-5968
Fixing a potential null pointer exception when attempting to use
scheduler support with replicated levelDB, which is currently not
supported.
2015-09-21 17:37:02 +00:00
Christopher L. Shannon (cshannon) 734fb7dda3 https://issues.apache.org/jira/browse/AMQ-5923
Adding metrics to track the pending message size for a queue and for
subscribers.  This is useful so that not only the pending count is
known but also the total message size left to consume. Also improving
the message size store tests as well.
2015-09-09 18:12:15 +00:00
Christopher L. Shannon (cshannon) f8060a7b38 removing inadvertant check in of temp files 2015-08-13 15:52:00 +00:00
Christopher L. Shannon (cshannon) 3c358b32fd AMQ-5889 - refactoring and cleanup 2015-08-13 15:49:50 +00:00
Christopher L. Shannon (cshannon) 04ee70a161 https://issues.apache.org/jira/browse/AMQ-5889
Adding support for auto detection of wire protocols over a transport.
OpenWire, AMQP, STOMP, and MQTT can all be detected and the broker
will properly handle each one over a given Transport.  Currently
auto TCP, NIO, SSL, and NIO+SSL transports can handle auto-detection
of the wire format and client but support could be added in the
future for other transports like websockets.
2015-08-11 19:39:29 +00:00
Timothy Bish 6cdd750ddc [maven-release-plugin] prepare for next development iteration 2015-08-10 11:04:26 -04:00
Timothy Bish a9eeb03520 [maven-release-plugin] prepare release activemq-5.12.0 2015-08-10 11:04:17 -04:00
gtully a05a9a2129 https://issues.apache.org/jira/browse/AMQ-5552 - added profile for activemq.tests=smoke to run a fast subset of tests that gives a fast verification of a full build 2015-07-09 14:10:38 +01:00
Christopher L. Shannon (cshannon) 785b16bf9e https://issues.apache.org/jira/browse/AMQ-5748
Added a getMessageSize method to MessageStore to support retrieving the
total message size of all stored messages for a destination.  Added a
new storeMessageSize statistic to DestinationStatistics.
2015-07-07 18:03:27 +00:00
gtully 610ff0634f remove trace logging to speed up test duration in leveldb replication 2015-04-23 15:51:16 +01:00
James A. Robinson a6243225c5 fix the inconsistency with ElectingLevelDBStore.isMaster() under AMQ-5082 unit test conditions 2015-04-01 07:36:52 -07:00
Christian Posta a39e51e051 Fix for https://issues.apache.org/jira/browse/AMQ-5082 ActiveMQ replicatedLevelDB cluster breaks, all nodes stop listening.
Many thanks to Jim Robinson (jim.robinson@gmail.com) for the patch!
2015-03-30 17:07:42 -07:00
gtully ae595c95b1 [maven-release-plugin] prepare for next development iteration 2015-01-30 12:46:19 +00:00
gtully 4ba1a1689f [maven-release-plugin] prepare release activemq-5.11.0 2015-01-30 12:46:08 +00:00
gtully bf5a2997c7 [maven-release-plugin] prepare for next development iteration 2015-01-26 16:48:46 +00:00
gtully eec2955bde [maven-release-plugin] prepare release activemq-5.11.0 2015-01-26 16:48:37 +00:00
gtully 64fa706d54 Revert "[maven-release-plugin] prepare release activemq-5.11.0"
This reverts commit f47fbe4b89.
2015-01-26 16:39:35 +00:00
gtully f47fbe4b89 [maven-release-plugin] prepare release activemq-5.11.0 2015-01-26 16:17:43 +00:00
gtully cf62d58ae7 https://issues.apache.org/jira/browse/AMQ-5515 - tidy up jetty deps - fix jetty maven coords 2015-01-12 22:58:07 +00:00
gtully 05f6cd6cfc ignore intermittent failures for 5.11 - leveldb can be a focus for 5.12 - https://issues.apache.org/jira/browse/AMQ-5512 2015-01-09 13:30:59 +00:00
gtully f303f85ce3 remove inadvertent test mods 2015-01-08 15:58:28 +00:00
gtully 6588aea8e1 avoid npe causing hang on shutdown, sync shutdown of log 2015-01-08 15:21:31 +00:00
gtully 726bc97bae more logging for leveldb tests 2015-01-08 15:06:40 +00:00
gtully b54606b124 https://issues.apache.org/jira/browse/AMQ-5300 - fix and test that verifies recovery in the absense of an index 2015-01-07 17:11:09 +00:00
gtully f1df9f8b82 ignore errors on dir cleanup 2015-01-07 17:11:09 +00:00
gtully a52bfe62a4 track first missing message - to see if there is some consistency to the ubuntu ci failures 2015-01-06 15:57:50 +00:00
gtully 5616d39d82 see if a stronger sync will sort the ubuntu ci test failures of leveldb - i cannot reproduce 2015-01-06 15:40:45 +00:00
gtully 6c2e2f5446 using a more sensible session timeout sorts org.apache.activemq.leveldb.test.ElectingLevelDBStoreTest#testElection also 2015-01-05 21:05:34 +00:00
gtully 4d8489ba38 https://issues.apache.org/jira/browse/AMQ-5506 - fix typo in leveldb attribute ZkSessionTmeout - now with the i, store.setZkSessionTimeout 2015-01-05 21:00:45 +00:00
gtully 5ebe71cec9 improve reliability of leveldb replication test org.apache.activemq.leveldb.test.ReplicatedLevelDBBrokerTest - ZOOKEEPER-1751 fixed in 3.4.6 is releated, also the default 2s session expiry with a 500ms tick seems to be problematic with porpotional ping intervals. With 3.4.6 random client session expiry due to ping timeouts are avoided but unexpected server side expiry still ocurrs due to missing pings. Upping the session expiry to 15s avoids the client - server mismatch in session connection cleanup 2015-01-05 21:00:45 +00:00
Hadrian Zbarcea aedcae139b Revert "[maven-release-plugin] prepare release activemq-5.11.0"
This reverts commit 48b0cf396c.
2015-01-05 12:25:58 -05:00
Hadrian Zbarcea 89995f4723 Revert "[maven-release-plugin] prepare for next development iteration"
This reverts commit 7b285c6f52.
2015-01-05 12:25:47 -05:00
Dejan Bosanac 7b285c6f52 [maven-release-plugin] prepare for next development iteration 2014-12-29 12:44:32 +01:00
Dejan Bosanac 48b0cf396c [maven-release-plugin] prepare release activemq-5.11.0 2014-12-29 12:44:20 +01:00
Dejan Bosanac 9752e1dc93 more levedb test cleaning and turning on debug logging to try to figure CI failures 2014-12-25 14:08:54 +01:00
Dejan Bosanac 5315389080 replicated leveldb test improvements 2014-12-24 16:25:04 +01:00
Hiram Chirino 4e3499e41b Implements https://issues.apache.org/jira/browse/AMQ-5458 - Lets make sure we register the Test mbean when in slave mode. 2014-11-26 10:57:13 -05:00
Hiram Chirino f4149c0a46 Implements https://issues.apache.org/jira/browse/AMQ-5458 - Also needed to update the slave since it does writes slightly differently. 2014-11-26 08:36:43 -05:00
Hiram Chirino ebafd5c193 Implements https://issues.apache.org/jira/browse/AMQ-5458 2014-11-25 11:41:00 -05:00
gtully 350889c1eb https://issues.apache.org/jira/browse/AMQ-5266 - fix regression in levedlb xa recovery and durable sub scan - org.apache.activemq.broker.mLevelDBXARecoveryBrokerTest and org.apache.activemq.bugs.AMQ2149LevelDBTest 2014-10-24 14:28:00 +01:00
gtully 3042797b41 https://issues.apache.org/jira/browse/AMQ-5266 tidy up leveldb impl with additional scenario tests 2014-10-23 16:29:57 +01:00
gtully 1a0bd45a4e https://issues.apache.org/jira/browse/AMQ-4485 - leveldb version - shows the need to flag async adds so they can get suppressed as duplicates \(and not go to the dlq\) when the cursor order is out of sync on cache full 2014-10-17 13:35:31 +01:00
gtully 51a2596c52 run leveldb tests on osx 2014-10-16 23:53:44 +01:00
gtully 8a37f97315 AMQ4677Test.testSendAndReceiveAllMessages - demoed the lack of reference increment for transacted send and the non completion of transacted futures in leveldb 2014-08-30 23:36:05 +01:00
gtully 54e2e3bef2 rework cursor store sync w.r.t to index order. resolve issues with skipped dispatch and duplicate dispatch. https://issues.apache.org/jira/browse/AMQ-4485 https://issues.apache.org/jira/browse/AMQ-5266 2014-08-30 00:51:21 +01:00
Hiram Chirino b76d8318d7 Support configuring a connectUrl on the leveldb store in case your running in a system like OpenShift where clients connect to a different ip:port from the one that the sever binds. 2014-08-27 13:08:01 -04:00
gtully 66a689df0e fix up karaf-itests , related commits https://issues.apache.org/jira/browse/AMQ-5224 https://issues.apache.org/jira/browse/AMQ-5105 Update poms to fully load into M2E - 06bb7a2716 2014-07-28 15:30:12 +01:00
Dejan Bosanac 3c69127524 https://issues.apache.org/jira/browse/AMQ-4349 - stopping leveldb throws NPE 2014-07-18 15:12:02 +02:00
Dejan Bosanac 4da588d4fc https://issues.apache.org/jira/browse/AMQ-5105 - problem starting broker with leveldb store 2014-07-17 17:12:52 +02:00
Daniel Kulp 06bb7a2716 Update poms to fully load into M2E 2014-07-10 13:47:55 -04:00
Kevin Earls 13581c9aac Exclude leveldb tests on AIX, Solaris, HP-UX, and Windows as they cause problems with CI 2014-07-10 11:10:11 +02:00
Timothy Bish e62e90abaf https://issues.apache.org/jira/browse/AMQ-5125
Fix for potential deadlock when external classes synchronize on the
LevelDBStore instance which can deadlock the hawtDispatch runner thread
if a task also attempts to take the lock to protect some mutable state
values.
2014-07-07 17:53:46 -04:00
Timothy Bish 74846bb2b4 https://issues.apache.org/jira/browse/AMQ-3758
Refactor the scheduler store into a more KahaDB style store that can
recover from various problems like missing journal files or corruption
as well as rebuild its index when needed.  Move the scheduler store into
a more configurable style that allows for users to plug in their own
implementations.  Store update from legacy versions is automatic.
2014-07-07 12:28:11 -04:00
Kevin Earls bbd61084e0 Change logging from TRACE to WARN to save space on CI nodes 2014-06-24 11:21:34 +02:00
Dejan Bosanac fa086396a7 [maven-release-plugin] prepare for next development iteration 2014-06-05 11:59:29 +02:00
Dejan Bosanac 58dd93e42e [maven-release-plugin] prepare release activemq-5.10.0 2014-06-05 11:59:17 +02:00
Dejan Bosanac c2cf78542f [maven-release-plugin] prepare for next development iteration 2014-06-04 11:33:17 +02:00
Dejan Bosanac 5bc741f227 [maven-release-plugin] prepare release activemq-5.10.0 2014-06-04 11:33:03 +02:00
Hiram Chirino bdb24ee7c7 Fixes AMQ-5176: Support building ActiveMQ using Java 8 JDK 2014-05-07 10:53:51 -04:00
gtully ad1f751a41 https://issues.apache.org/jira/browse/AMQ-5077 - reduce reader thread work when client uses async send; async store updates can now queue up to the destination memory limit b/c they don't block the send thread. Pending store writes are now tracked in memory usage. This allows a client to quickly provide a burst of messages to fill the destination cache bounded only by network bandwidth 2014-04-30 16:13:18 +01:00
gtully 266d23ef79 revisit https://issues.apache.org/jira/browse/AMQ-3519 with more durable solution https://issues.apache.org/jira/browse/AMQ-5068 - JMSRedelivered header now persisted before dispatch so that it is a reliable indication of a possible duplicate delivery. The option is enabled via destination policy persistJMSRedelivered 2014-03-26 11:16:42 +00:00
Hiram Chirino db321727c9 Fixes AMQ-5115: LevelDB sync=true is not being honored. 2014-03-21 12:54:55 -04:00
gtully cb6941ee0b https://issues.apache.org/jira/browse/AMQ-4886 - think the sync on shutdown issue is resolved and the test will no longer hang 2014-03-20 14:14:31 +00:00
Kevin Earls 4ca5519e9b Reduced timeouts from 60 to 10 minutes to avoid long CI hangs 2014-02-20 14:21:02 +01:00
Daniel Kulp 43a88a9367 Get mvn eclipse:eclipse work for the leveldb stuff 2014-02-05 11:41:22 -05:00
Hadrian Zbarcea d36e3c0e95 AMQ-5005. Fix for scala plugin 2014-01-30 15:43:45 -05:00
Kevin Earls c027552035 Upgraded surefire plugin to 2.16. AMQ-5006 2014-01-30 14:22:44 +01:00
gtully 0f0c0d676a fix leveldb version of org.apache.activemq.bugs.AMQ2870Test#testSize 2014-01-07 16:54:18 +00:00
Hiram Chirino 30f3a9b7f3 Default flushDelay on the replicated leveldb store did not have the correct default. 2013-12-05 13:38:52 -05:00
Hiram Chirino ed8e4eae8f Fixes https://issues.apache.org/jira/browse/AMQ-4923: Replicated LevelDB: Loss of broker Quorum fails to fully stop the master 2013-12-05 13:38:52 -05:00
Hiram Chirino 3b5fa4bf89 Implementing a dirty stop method for the leveldb store that might come in handy for testing. 2013-12-05 09:24:10 -05:00
Hiram Chirino 8378cb1ffc Fixing https://issues.apache.org/jira/browse/AMQ-4917 : LevelDB store can fail when using durable subs.
We were browsing durable sub entries which had been concurrently GCed causing leveldb store failures which then caused the broker to restart.
2013-12-04 12:09:47 -05:00
Hiram Chirino 5fa462a08a Adding assertions to make sure that we only append to the log from the write thread. Found a code path that was appending to the log from a different thread. This might have been affecting https://issues.apache.org/jira/browse/AMQ-4882 2013-12-03 12:05:16 -05:00
Hiram Chirino 61e13fa6ce Fixing regression caused by changes to SuppressRelyException in commit b0e91d47f5. 2013-12-02 12:29:21 -05:00
Hiram Chirino b0e91d47f5 Have the leveldb store thorw SuppressReplyExceptions instead of IOExceptions so that the clients retry try the operations instead of giving up. Also retry the problemantic getMessage() call which seems to fail at times. 2013-11-25 13:17:58 -05:00
Claus Ibsen 00cb9a5668 AMQ-4858: Moved scala source file from java to scala dir. Thanks to Jaromir Hamala for patch. 2013-11-22 11:25:08 +01:00
Claus Ibsen c0090f6f0c AMQ-4885: Renamed some API methods in MessageStore due typos. 2013-11-22 11:21:42 +01:00
Timothy Bish 38ab4b10a4 https://issues.apache.org/jira/browse/AMQ-4855
Deprecate the misspelled subcription named getters and use the correctly
spelled versions where the older ones are in use.
2013-11-11 11:40:07 -05:00
Hiram Chirino 42e1c463d4 Replicated leveldb slaves index snapshots were being labeled with higher journal positions than what they really contained. 2013-11-08 10:34:21 -05:00
Hiram Chirino 4367ec1b82 If a replicated leveldb slave's connection gets slow, lets merge together journal write events to avoid them queuing up on the master side. 2013-11-05 11:53:37 -05:00
Hiram Chirino a907fc9e94 leveldb store: Add more log traces for when we need to get more details on what's going on. 2013-11-04 09:26:01 -05:00
Hiram Chirino b1d8cbe4cd Fixes for leveldb replication: make sure we only apply index updates when we encounter a UOW_END_RECORD so that we don't end up with an inconsistent index if a partial UOW is replicated. 2013-11-04 09:26:01 -05:00
Hiram Chirino dea38e62f8 leveldb replication: Lets always download the current append log just to be safe 2013-11-04 09:26:01 -05:00
Hiram Chirino 2824a94af4 Continue to append to the last leveldb log file on a store restart. 2013-11-04 09:26:01 -05:00
Hiram Chirino 190da29691 Fix for: https://issues.apache.org/jira/browse/AMQ-4837 : LevelDB corrupted in AMQ cluster.
- The tracked flushed offset was not getting initialized to match the initial size of the log file.  This invalid flushed offset was being used to do the initial sync /w the slave and then things went downhill.
2013-11-01 12:13:33 -04:00
Hiram Chirino 24d5490e57 Fix for: https://issues.apache.org/jira/browse/AMQ-4837 : LevelDB corrupted in AMQ cluster.
- Log rotation was causing a pre-mature index snapshot to be taken on the slave (snapshot while the slave was still synchronizing).
- Also fix issue with the append position displayed in JMX for the master not being correct.
2013-10-31 12:52:50 -04:00
Hiram Chirino 3ed52ef8a2 Working on a test case for https://issues.apache.org/jira/browse/AMQ-4837 : LevelDB corrupted in AMQ cluster. 2013-10-30 15:44:06 -04:00
Hiram Chirino 17415ceecd Only register the leveldb store MBeans in JMX if jmx is enabled on the broker. 2013-10-30 15:34:29 -04:00
Hiram Chirino aaa1a74dfb Add a toString() method to the replicated leveldb store so that it displays a nicer message when the broker starts it up. 2013-10-30 12:22:28 -04:00
Hiram Chirino 1896d27409 Update to the latest leveldbjni release. 2013-10-17 09:30:07 -04:00
Hiram Chirino ef45a5f8ff Avoid NullPointerExceptions that can occur during leveldb replication M/S state transitions. 2013-10-15 12:43:00 -04:00
gtully 864aa6798f [maven-release-plugin] prepare for next development iteration 2013-10-14 23:38:35 +01:00