13581c9aac
Exclude leveldb tests on AIX, Solaris, HP-UX, and Windows as they cause problems with CI
2014-07-10 11:10:11 +02:00
e62e90abaf
https://issues.apache.org/jira/browse/AMQ-5125
...
Fix for potential deadlock when external classes synchronize on the
LevelDBStore instance which can deadlock the hawtDispatch runner thread
if a task also attempts to take the lock to protect some mutable state
values.
2014-07-07 17:53:46 -04:00
74846bb2b4
https://issues.apache.org/jira/browse/AMQ-3758
...
Refactor the scheduler store into a more KahaDB style store that can
recover from various problems like missing journal files or corruption
as well as rebuild its index when needed. Move the scheduler store into
a more configurable style that allows for users to plug in their own
implementations. Store update from legacy versions is automatic.
2014-07-07 12:28:11 -04:00
bbd61084e0
Change logging from TRACE to WARN to save space on CI nodes
2014-06-24 11:21:34 +02:00
fa086396a7
[maven-release-plugin] prepare for next development iteration
2014-06-05 11:59:29 +02:00
58dd93e42e
[maven-release-plugin] prepare release activemq-5.10.0
2014-06-05 11:59:17 +02:00
c2cf78542f
[maven-release-plugin] prepare for next development iteration
2014-06-04 11:33:17 +02:00
5bc741f227
[maven-release-plugin] prepare release activemq-5.10.0
2014-06-04 11:33:03 +02:00
bdb24ee7c7
Fixes AMQ-5176: Support building ActiveMQ using Java 8 JDK
2014-05-07 10:53:51 -04:00
ad1f751a41
https://issues.apache.org/jira/browse/AMQ-5077 - reduce reader thread work when client uses async send; async store updates can now queue up to the destination memory limit b/c they don't block the send thread. Pending store writes are now tracked in memory usage. This allows a client to quickly provide a burst of messages to fill the destination cache bounded only by network bandwidth
2014-04-30 16:13:18 +01:00
266d23ef79
revisit https://issues.apache.org/jira/browse/AMQ-3519 with more durable solution https://issues.apache.org/jira/browse/AMQ-5068 - JMSRedelivered header now persisted before dispatch so that it is a reliable indication of a possible duplicate delivery. The option is enabled via destination policy persistJMSRedelivered
2014-03-26 11:16:42 +00:00
db321727c9
Fixes AMQ-5115: LevelDB sync=true is not being honored.
2014-03-21 12:54:55 -04:00
cb6941ee0b
https://issues.apache.org/jira/browse/AMQ-4886 - think the sync on shutdown issue is resolved and the test will no longer hang
2014-03-20 14:14:31 +00:00
4ca5519e9b
Reduced timeouts from 60 to 10 minutes to avoid long CI hangs
2014-02-20 14:21:02 +01:00
43a88a9367
Get mvn eclipse:eclipse work for the leveldb stuff
2014-02-05 11:41:22 -05:00
d36e3c0e95
AMQ-5005. Fix for scala plugin
2014-01-30 15:43:45 -05:00
c027552035
Upgraded surefire plugin to 2.16. AMQ-5006
2014-01-30 14:22:44 +01:00
0f0c0d676a
fix leveldb version of org.apache.activemq.bugs.AMQ2870Test#testSize
2014-01-07 16:54:18 +00:00
30f3a9b7f3
Default flushDelay on the replicated leveldb store did not have the correct default.
2013-12-05 13:38:52 -05:00
ed8e4eae8f
Fixes https://issues.apache.org/jira/browse/AMQ-4923 : Replicated LevelDB: Loss of broker Quorum fails to fully stop the master
2013-12-05 13:38:52 -05:00
3b5fa4bf89
Implementing a dirty stop method for the leveldb store that might come in handy for testing.
2013-12-05 09:24:10 -05:00
8378cb1ffc
Fixing https://issues.apache.org/jira/browse/AMQ-4917 : LevelDB store can fail when using durable subs.
...
We were browsing durable sub entries which had been concurrently GCed causing leveldb store failures which then caused the broker to restart.
2013-12-04 12:09:47 -05:00
5fa462a08a
Adding assertions to make sure that we only append to the log from the write thread. Found a code path that was appending to the log from a different thread. This might have been affecting https://issues.apache.org/jira/browse/AMQ-4882
2013-12-03 12:05:16 -05:00
61e13fa6ce
Fixing regression caused by changes to SuppressRelyException in commit b0e91d47f5.
2013-12-02 12:29:21 -05:00
b0e91d47f5
Have the leveldb store thorw SuppressReplyExceptions instead of IOExceptions so that the clients retry try the operations instead of giving up. Also retry the problemantic getMessage() call which seems to fail at times.
2013-11-25 13:17:58 -05:00
00cb9a5668
AMQ-4858: Moved scala source file from java to scala dir. Thanks to Jaromir Hamala for patch.
2013-11-22 11:25:08 +01:00
c0090f6f0c
AMQ-4885: Renamed some API methods in MessageStore due typos.
2013-11-22 11:21:42 +01:00
38ab4b10a4
https://issues.apache.org/jira/browse/AMQ-4855
...
Deprecate the misspelled subcription named getters and use the correctly
spelled versions where the older ones are in use.
2013-11-11 11:40:07 -05:00
42e1c463d4
Replicated leveldb slaves index snapshots were being labeled with higher journal positions than what they really contained.
2013-11-08 10:34:21 -05:00
4367ec1b82
If a replicated leveldb slave's connection gets slow, lets merge together journal write events to avoid them queuing up on the master side.
2013-11-05 11:53:37 -05:00
a907fc9e94
leveldb store: Add more log traces for when we need to get more details on what's going on.
2013-11-04 09:26:01 -05:00
b1d8cbe4cd
Fixes for leveldb replication: make sure we only apply index updates when we encounter a UOW_END_RECORD so that we don't end up with an inconsistent index if a partial UOW is replicated.
2013-11-04 09:26:01 -05:00
dea38e62f8
leveldb replication: Lets always download the current append log just to be safe
2013-11-04 09:26:01 -05:00
2824a94af4
Continue to append to the last leveldb log file on a store restart.
2013-11-04 09:26:01 -05:00
190da29691
Fix for: https://issues.apache.org/jira/browse/AMQ-4837 : LevelDB corrupted in AMQ cluster.
...
- The tracked flushed offset was not getting initialized to match the initial size of the log file. This invalid flushed offset was being used to do the initial sync /w the slave and then things went downhill.
2013-11-01 12:13:33 -04:00
24d5490e57
Fix for: https://issues.apache.org/jira/browse/AMQ-4837 : LevelDB corrupted in AMQ cluster.
...
- Log rotation was causing a pre-mature index snapshot to be taken on the slave (snapshot while the slave was still synchronizing).
- Also fix issue with the append position displayed in JMX for the master not being correct.
2013-10-31 12:52:50 -04:00
3ed52ef8a2
Working on a test case for https://issues.apache.org/jira/browse/AMQ-4837 : LevelDB corrupted in AMQ cluster.
2013-10-30 15:44:06 -04:00
17415ceecd
Only register the leveldb store MBeans in JMX if jmx is enabled on the broker.
2013-10-30 15:34:29 -04:00
aaa1a74dfb
Add a toString() method to the replicated leveldb store so that it displays a nicer message when the broker starts it up.
2013-10-30 12:22:28 -04:00
1896d27409
Update to the latest leveldbjni release.
2013-10-17 09:30:07 -04:00
ef45a5f8ff
Avoid NullPointerExceptions that can occur during leveldb replication M/S state transitions.
2013-10-15 12:43:00 -04:00
864aa6798f
[maven-release-plugin] prepare for next development iteration
2013-10-14 23:38:35 +01:00
87c9bbebac
[maven-release-plugin] prepare release activemq-5.9.0
2013-10-14 23:38:22 +01:00
d44c8968c4
Expose a JMX attribute to show when the last leveldb replication log entry was recorded.
...
This can be used to get a time estimate of far behind a master a slave is.
2013-10-14 08:45:54 -04:00
ee0933c71e
[maven-release-plugin] prepare for next development iteration
2013-10-11 14:51:36 +01:00
b276006911
[maven-release-plugin] prepare release activemq-5.9.0
2013-10-11 14:51:24 +01:00
59af7479b2
Polished the logging
2013-10-11 11:20:22 +02:00
0214bfbfcd
Support weighting the leveldb store replication nodes so that some have a better chance of becoming the master than others.
2013-10-10 15:42:02 -04:00
e90ce1aabb
Don't display leveldb replication recovery progress on slave nodes.
2013-10-10 14:52:07 -04:00
4f108cead5
fix up missing license headers - keep mr. rat happy :-)
2013-10-10 11:41:58 +01:00
d609d2ae38
Make sure the leveldb append log file is flushed to disk before it's closed to avoid data loss.
2013-10-09 11:49:11 -04:00
5e63ddd337
Fixing bug which caused replicated leveldb nodes to not recover from a ZooKeeper failure.
2013-10-09 10:56:34 -04:00
119fdab1d0
Fixes leveldb replication bug that can cause read errors: make sure that log is flushed for records that are being read.
2013-10-09 09:15:48 -04:00
a5ac1a3630
Avoid logging ZooKeeper related exceptions during a replicated leveldb store shutdown.
2013-10-03 10:42:45 -04:00
b720b264e3
The the hostname on the replicated leveldb store test so that the test works better on machines with weird DNS settings.
2013-10-02 12:15:36 -04:00
0b66abcbfb
Fixing leveldb replication bug where loosing quorum did not properly restart the master in a clean way.
2013-10-02 12:15:36 -04:00
8804341c19
Adding more debug info to help trouble shoot election issues with leveldb replication elections.
2013-10-02 10:45:58 -04:00
f75520fc8b
Implementing AMQ-4744: Support using LevelDB as a nested store in mKahaDB
2013-09-27 09:19:48 -04:00
efaa351db7
https://issues.apache.org/jira/browse/AMQ-4365 - allow lease locker to be used by kahadb - remove deps on jdbc pa. LockableService now passes a reference to a locker so it can pull the brokerService, extracted some of the jdbc lock common stuff, additional test kahadb with jdbc lease
2013-09-20 15:33:24 +01:00
d771ebb97e
Fixes bug in replicated leveldb where log files on slaves were not getting GCed.
2013-09-16 11:58:03 -04:00
1eca031356
leveldb replication Master was failing to give up being master after it's process is suspended by using ctrl-z.
2013-09-03 10:41:33 -04:00
f4d51e092b
Adding a LevelDB version of the RedeliveryRestartTest. Implemented redelivery tracking in the leveldb store.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1518289 13f79535-47bb-0310-9956-ffa450edef68
2013-08-28 17:20:25 +00:00
45e1462609
Persist the latest producer position across restarts in the leveldb store.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1515799 13f79535-47bb-0310-9956-ffa450edef68
2013-08-20 12:38:32 +00:00
7c50c1c736
fix up failure - still leveldb variant problem that needs work - testQueueTransactionalOrderWithRestart - org.apache.activemq.bugs.AMQ2149LevelDBTest
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1512332 13f79535-47bb-0310-9956-ffa450edef68
2013-08-09 15:11:11 +00:00
563cc1bc6a
Warn when there are too many replication nodes attached.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1506965 13f79535-47bb-0310-9956-ffa450edef68
2013-07-25 13:40:59 +00:00
194c6535cd
[LevelDB]
...
https://issues.apache.org/jira/browse/AMQ-4296
Fixes remainder of failing unit tests. The LevelDB wasn't incrementing or decrementing reference counts on messages added to the store which causes the expectations of certain memory limit based tests to fail as the memory usage was being updates after the store add instead of during so a message could get placed into the batch list of a cursor when we did not expect that it would. This could also cause a browse to return fewer message than we want as the in memory messages would top out the usage limit so we'd never page in one batch of messages.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1505805 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 20:53:27 +00:00
11ed6b0e18
{LevelDB] fix for StoreQueueCursorLevelDBNoDuplicateTest failure. When the cursor calls setBatch and then recovering the next batch its expecting the batch to start at lastMsgId + 1 so we were seeing a single duplicate message and since audit was disabled it was delivered.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1504668 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 21:21:38 +00:00
ae5abf143b
Adding a container property to the zk node data used by the leveldb replication.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1504626 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 20:04:45 +00:00
86e2426d1b
Improve the replicated leveldb bits: Avoid dependencies on fabric-group stuff. Makes it easier to embed in different versions of a fabric osgi env.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1501877 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:49:03 +00:00
5f0dd8ab53
Fix for failing LveelDB unit tests where only non-persistent messages are sent in a TX. The preCommit wasn't being run so the Queue's orderIndexUpdates structure wasn't getting updated with the TX to process in the postCommit phase.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1501420 13f79535-47bb-0310-9956-ffa450edef68
2013-07-09 18:15:26 +00:00
2019a21d96
Simplify and improve the leveldb replication MBean
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1499754 13f79535-47bb-0310-9956-ffa450edef68
2013-07-04 13:47:27 +00:00
34f3329370
When the leveldb replicated master was shutting down the client would get notified of a failure and it would not be hidden from the client app. We now suppress sending failure messages to clients when a broker is shutting down so that the client failover logic can kick in an reconnect the client to another server gracefully.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1498978 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 15:28:42 +00:00
b98067732b
Improve the replicated leveldb behavior when the number of nodes in the cluster falls below the required minimum. The master node will switch to electing mode. The master store startup will now also block until it syncs up with slaves so that we don't accept connections the master is fully online.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1498601 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 17:38:13 +00:00
16cd8c3954
Expose the replicated store status via JMX.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1497843 13f79535-47bb-0310-9956-ffa450edef68
2013-06-28 16:57:29 +00:00
baf8c499b3
Fixes AMQ-4599: Only package the pure java LevelDB driver by default
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1496514 13f79535-47bb-0310-9956-ffa450edef68
2013-06-25 15:12:23 +00:00
06dae40d94
https://issues.apache.org/jira/browse/AMQ-4593 - upgrade snappy java
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1495392 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 11:31:23 +00:00
7ef79f2d2a
Display who the slave leveldb store thinks is the master.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1494218 13f79535-47bb-0310-9956-ffa450edef68
2013-06-18 17:25:09 +00:00
6ee4c66fc3
m2e updates
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1492832 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 19:46:00 +00:00
7db8987ca6
Fixup the assembly packaging so that the replicated leveldb store can be used.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1491287 13f79535-47bb-0310-9956-ffa450edef68
2013-06-09 20:41:24 +00:00
5f301c40fa
Help the xbean generate the proper xsd for the leveldb store.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1491278 13f79535-47bb-0310-9956-ffa450edef68
2013-06-09 20:16:22 +00:00
c161033abb
Make the fabric dependencies of the leveldb store needed for replication as provided.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1490271 13f79535-47bb-0310-9956-ffa450edef68
2013-06-06 13:20:28 +00:00
50e8795464
Fixes a ghost messages issue where the queue cursor goes out of sync /w the leveldb store when transactions are being used.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1490065 13f79535-47bb-0310-9956-ffa450edef68
2013-06-05 23:01:13 +00:00
bb30abf774
Try to avoid the 'short record at position' LevelDB error reported at: http://activemq.2283324.n4.nabble.com/Activemq-5-9-leveldb-replication-issue-tp4667495p4667674.html
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1489019 13f79535-47bb-0310-9956-ffa450edef68
2013-06-03 14:55:57 +00:00
ec9975c36e
Additional fixes related to AMQ-4563: You can now configure the storeOpenWireVersion property of a broker to control which version of openwire is used by the persistence stores. This needs to be set to version 10 to preserve the original AMQP message ids.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1488375 13f79535-47bb-0310-9956-ffa450edef68
2013-05-31 19:56:03 +00:00
300a26d350
No need for the uber jar anymore since we are part of the distro.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1486243 13f79535-47bb-0310-9956-ffa450edef68
2013-05-24 22:33:38 +00:00
b41121e359
This should fixed the problem with the delayed leveldb index updates.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1486242 13f79535-47bb-0310-9956-ffa450edef68
2013-05-24 22:33:32 +00:00
75245da626
Seems like on some machines leveldb index updates are delayed.. looping seems to fix it.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1485897 13f79535-47bb-0310-9956-ffa450edef68
2013-05-23 23:17:26 +00:00
148909357f
related to AMQ-4296 : Fixes leveldb store cursoring. It was recovering too many messages and sometimes not the right messages.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1485810 13f79535-47bb-0310-9956-ffa450edef68
2013-05-23 18:33:06 +00:00
49a2d9656e
Convert some tests to junit 4 style and add test timeouts.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1484496 13f79535-47bb-0310-9956-ffa450edef68
2013-05-20 15:02:09 +00:00
3e2dcc1202
No need to sync to the remote machines if a remote sync option is not enabled.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1484480 13f79535-47bb-0310-9956-ffa450edef68
2013-05-20 13:38:56 +00:00
57617b862f
Try initializing the replicated leveldb response_callbacks early on to avoid potential NPE.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1484049 13f79535-47bb-0310-9956-ffa450edef68
2013-05-18 03:07:35 +00:00
b6703d6bd7
Fixes failing ThreeBrokerVirtualTopicNetwork test associated /w AMQ-4296
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1483878 13f79535-47bb-0310-9956-ffa450edef68
2013-05-17 15:47:04 +00:00
1558cbbb55
Support multiple local/remote syncing styles.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1483810 13f79535-47bb-0310-9956-ffa450edef68
2013-05-17 14:04:12 +00:00
ef6df68831
Fixes issue in AMQ-4296: Implement a pure LevelDB test for the StoreQueueCursorNoDuplicateTest and fix the bug that was causing it to fail.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1483582 13f79535-47bb-0310-9956-ffa450edef68
2013-05-16 21:50:25 +00:00
b5505d462d
Fix for AMQ-4296: Don't GC past LevelDB records pointed to by prepared XA transactions.
...
Also avoid double logging a LOG_ADD_ENTRY.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1483530 13f79535-47bb-0310-9956-ffa450edef68
2013-05-16 19:34:48 +00:00
e40d280115
Reduce how often forced leveldb compactions occur.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1483395 13f79535-47bb-0310-9956-ffa450edef68
2013-05-16 14:49:51 +00:00
086e9de9ac
Additional fix for AMQ-4535: Seems store was getting out of sync /w cursor due to thread unsafe access in the leveldb store.
...
Switched to a concurrent HashMap to track the transaction since that will be getting accessed by multiple threads.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1483369 13f79535-47bb-0310-9956-ffa450edef68
2013-05-16 13:50:35 +00:00
2ecb5eaa1b
Don't delay flushes for now. Seems to cause more harm than good.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1482845 13f79535-47bb-0310-9956-ffa450edef68
2013-05-15 13:58:25 +00:00
8461158178
Fixes AMQ-4535: Activemq configured with leveldb commit fail when accessed by PutGet from IBM Perf Harness
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1482789 13f79535-47bb-0310-9956-ffa450edef68
2013-05-15 12:30:45 +00:00
842630c8c7
Implement some tracking of producer positions in the LevelDB store to help the broker to filter out dups.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1482788 13f79535-47bb-0310-9956-ffa450edef68
2013-05-15 12:30:34 +00:00
Kevin Earls
Timothy Bish
Dejan Bosanac
Hiram Chirino
gtully
Daniel Kulp
Hadrian Zbarcea
Claus Ibsen
Timothy Bish
Hiram R. Chirino
Gary Tully
Timothy A. Bish
Bosanac Dejan