Commit Graph

338 Commits

Author SHA1 Message Date
gtully 135226533f https://issues.apache.org/jira/browse/AMQ-5394 - applied patch for kahadb lastUpdate tracking from Jesse Fugitt with thanks 2014-10-24 14:42:25 +01:00
gtully 67ead201e1 https://issues.apache.org/jira/browse/AMQ-5266 https://issues.apache.org/jira/browse/AMQ-4485 - single dest test with low limit exposed ignored setbatch in kahadb when sequence was not found in the index due to acking - resolved and validated with test that verifies dlq is empty 2014-10-21 16:05:46 +01:00
gtully 1d39f08c12 https://issues.apache.org/jira/browse/AMQ-5266 https://issues.apache.org/jira/browse/AMQ-4485 - fix warn logging from kahadb on set batch when message already consumed using seq from messageId, additional single dest test that hammers this case 2014-10-17 16:55:23 +01:00
gtully 9c2b1d2572 https://issues.apache.org/jira/browse/AMQ-5266 https://issues.apache.org/jira/browse/AMQ-4485 - store has messages must be aware of pending also kahadb setBatch for async sends. additional tests and tidy up of cusror sync with store to reflect async/sync additions 2014-10-16 23:35:18 +01:00
gtully 97c127d2d4 https://issues.apache.org/jira/browse/AMQ-4485 - fix test regression with browse test - AMQ4595Test - reduce replay window when sync and asnyc cursor updates flip message order - concurrentStoreAndDispatch=true - https://issues.apache.org/jira/browse/AMQ-5266 - increse default audit depth to match async jobs for concurrent store 2014-10-09 13:47:31 +01:00
gtully 140ce1bc8f https://issues.apache.org/jira/browse/AMQ-4485 - reenable test. concurrentStoreandDispatch case cannot be reconciled via setBatch, best we can do is trap duplicates from inflight messages as they occur. tagged async stores to support this. the revert of serialization with tx and non aysnc send brings perf back to where it was. https://issues.apache.org/jira/browse/AMQ-5266 2014-10-07 14:50:41 +01:00
gtully a0c42a61dd https://issues.apache.org/jira/browse/AMQ-5354 - patch applied with thanks 2014-09-15 15:59:00 +01:00
gtully 8cdb5c2c1d https://issues.apache.org/jira/browse/AMQ-5266 - remove err message print on iterator limit 2014-09-11 17:07:35 +01:00
gtully 54e2e3bef2 rework cursor store sync w.r.t to index order. resolve issues with skipped dispatch and duplicate dispatch. https://issues.apache.org/jira/browse/AMQ-4485 https://issues.apache.org/jira/browse/AMQ-5266 2014-08-30 00:51:21 +01:00
Timothy Bish 582fc08019 https://issues.apache.org/jira/browse/AMQ-5072
Add accessors to the persitence adapter class and a test to validate.
2014-08-14 11:14:59 -04:00
Daniel Kulp 06bb7a2716 Update poms to fully load into M2E 2014-07-10 13:47:55 -04:00
Timothy Bish 74846bb2b4 https://issues.apache.org/jira/browse/AMQ-3758
Refactor the scheduler store into a more KahaDB style store that can
recover from various problems like missing journal files or corruption
as well as rebuild its index when needed.  Move the scheduler store into
a more configurable style that allows for users to plug in their own
implementations.  Store update from legacy versions is automatic.
2014-07-07 12:28:11 -04:00
gtully 27b3a7c344 https://issues.apache.org/jira/browse/AMQ-5212 - ensure uncontented access to concurrent destination map avoides deadlock, rerework https://issues.apache.org/jira/browse/AMQ-4952 to differenciate duplicates from send and recovered messages from the store. https://issues.apache.org/jira/browse/AMQ-3454 benefits from getDestinationMap(destination) to get direct access to the map to determine existance. Additional test 2014-06-09 12:32:33 +01:00
Dejan Bosanac fa086396a7 [maven-release-plugin] prepare for next development iteration 2014-06-05 11:59:29 +02:00
Dejan Bosanac 58dd93e42e [maven-release-plugin] prepare release activemq-5.10.0 2014-06-05 11:59:17 +02:00
Dejan Bosanac c2cf78542f [maven-release-plugin] prepare for next development iteration 2014-06-04 11:33:17 +02:00
Dejan Bosanac 5bc741f227 [maven-release-plugin] prepare release activemq-5.10.0 2014-06-04 11:33:03 +02:00
Timothy Bish bfb1778211 https://issues.apache.org/jira/browse/AMQ-5166
Apply fix for tracker settings.
2014-05-06 16:31:27 -04:00
gtully ad1f751a41 https://issues.apache.org/jira/browse/AMQ-5077 - reduce reader thread work when client uses async send; async store updates can now queue up to the destination memory limit b/c they don't block the send thread. Pending store writes are now tracked in memory usage. This allows a client to quickly provide a burst of messages to fill the destination cache bounded only by network bandwidth 2014-04-30 16:13:18 +01:00
Hadrian Zbarcea 3f32507f78 Use autocrlf consistently for line endings 2014-04-29 14:18:37 -04:00
gtully 79ba2a79c1 have kahadb journal transaction commands respect enableJournalDiskSyncs - so consistent with leveldbstore - syncs off breaks the jms durability guarantee across the board - no good reason to distinguish transactional from non transaction ops; the server qos can override the client 2014-03-26 16:37:23 +00:00
gtully 266d23ef79 revisit https://issues.apache.org/jira/browse/AMQ-3519 with more durable solution https://issues.apache.org/jira/browse/AMQ-5068 - JMSRedelivered header now persisted before dispatch so that it is a reliable indication of a possible duplicate delivery. The option is enabled via destination policy persistJMSRedelivered 2014-03-26 11:16:42 +00:00
gtully cfe099d1cc rework https://issues.apache.org/jira/browse/AMQ-3305 in the context of https://issues.apache.org/jira/browse/AMQ-4952 dlq processing of duplicates, also possible missed dispatch with interleaved xa completion and new messages - recovered transactions are now individually tracked by the store and replayed in the next batch, which negates the need to flush the cursor and avoids duplicates 2014-03-05 14:51:05 +00:00
gtully ab01ae3818 fix build revert extras in MessageDatabase from https://git-wip-us.apache.org/repos/asf?p=activemq.git;a=commit;h=69c0d399 - sorry 2014-03-03 16:20:21 +00:00
gtully 69c0d399fb make perpared xa transactions visible in kahadb persistenceadapter view mbean 2014-03-03 13:55:27 +00:00
Hiram Chirino 232b8c51e9 Implements AMQ-5072: Support configuring a different directory for the KahaDB index files. 2014-02-21 11:08:27 -05:00
Hadrian Zbarcea 7b555c2898 AMQ-5047. Fix packaging issues related to maven version 2014-02-15 16:15:04 -05:00
Kevin Earls c027552035 Upgraded surefire plugin to 2.16. AMQ-5006 2014-01-30 14:22:44 +01:00
Timothy Bish dd0c9c4144 https://issues.apache.org/jira/browse/AMQ-4988 2014-01-22 10:09:38 -05:00
Timothy Bish 11ae61f539 https://issues.apache.org/jira/browse/AMQ-4969 2014-01-14 18:48:40 -05:00
Timothy Bish ef619b6a9b https://issues.apache.org/jira/browse/AMQ-4947
Updated fix for this issue allows for enabling non-forced metadata
updates to the file channel via FileChannel#force(false)

enable this by defining
"org.apache.activemq.kahaDB.files.skipMetadataUpdate=true"
2014-01-09 17:21:56 -05:00
gtully f92d45bec1 https://issues.apache.org/jira/browse/AMQ-4952 - deal with duplicates by redirecting to dlq when they are detected by the cursors such that they don't linger for redispatch after a restart. Networks are the main culprit for such duplicates b/c the producer audit traps regular failover resends 2014-01-07 16:52:39 +00:00
Timothy Bish 97b12c7245 Revert "Fix for: https://issues.apache.org/jira/browse/AMQ-4947"
This reverts commit c50b6c39ba.
2014-01-06 09:32:46 -05:00
Timothy Bish 7db0fe6a38 https://issues.apache.org/jira/browse/AMQ-4819 2013-12-20 17:29:31 -05:00
Timothy Bish 44b25cb7a1 https://issues.apache.org/jira/browse/AMQ-4819
Slightly modified version of the patch since it was not against latest
code.  Trimmed down the changes by breaking out the logging checks into
a separate method.
2013-12-20 15:56:24 -05:00
Timothy Bish c50b6c39ba Fix for: https://issues.apache.org/jira/browse/AMQ-4947 2013-12-19 18:36:05 -05:00
gtully 06f24e2e0b https://issues.apache.org/jira/browse/AMQ-4907 - sanity check on the index when checkForCorruptJournalFiles - test and check that validates the orderindex makes sense 2013-11-28 21:14:24 +00:00
Claus Ibsen c0090f6f0c AMQ-4885: Renamed some API methods in MessageStore due typos. 2013-11-22 11:21:42 +01:00
gtully ff593bf3dd add debug logging for mkaha destination to persistence adapter mapping 2013-11-15 11:29:15 +00:00
Dejan Bosanac 5dacae368b https://issues.apache.org/jira/browse/AMQ-3725 - close delegated file only if not null 2013-11-01 14:03:20 +01:00
Dejan Bosanac 582af3e74a https://issues.apache.org/jira/browse/AMQ-3725 - allow kahadb to recover from failed file system 2013-10-31 17:58:52 +01:00
gtully 864aa6798f [maven-release-plugin] prepare for next development iteration 2013-10-14 23:38:35 +01:00
gtully 87c9bbebac [maven-release-plugin] prepare release activemq-5.9.0 2013-10-14 23:38:22 +01:00
gtully ee0933c71e [maven-release-plugin] prepare for next development iteration 2013-10-11 14:51:36 +01:00
gtully b276006911 [maven-release-plugin] prepare release activemq-5.9.0 2013-10-11 14:51:24 +01:00
Hiram Chirino 28163a4065 Don't assume all persistence store use the same default directory. 2013-09-27 05:10:30 -04:00
Hiram Chirino 70c698f988 Fixes NPE that was occurring. 2013-09-27 04:51:11 -04:00
Hiram Chirino 21fe8cac7d Make the mKahaDB store agnostic to the nested persistence adapter type. 2013-09-27 04:26:17 -04:00
gtully 0f90695db7 https://issues.apache.org/jira/browse/AMQ-4729 - add lockableSupport to mKahaDb to isolate it from dynamically created filtered kahadb locks, nested locks are disabled when top level lock is in place. default to a sharedfile locker 2013-09-19 21:58:43 +01:00
Timothy Bish d1446c3bca fix and tests for: https://issues.apache.org/jira/browse/AMQ-4073 2013-09-05 15:59:01 -04:00
Timothy A. Bish 2d861dae65 fix for: https://issues.apache.org/jira/browse/AMQ-4683
Make scheduler job dispatching start more deterministic

git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1516912 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 16:01:12 +00:00
Timothy A. Bish 85bb229aa7 fix for: https://issues.apache.org/jira/browse/AMQ-4683
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1516561 13f79535-47bb-0310-9956-ffa450edef68
2013-08-22 19:45:22 +00:00
Gary Tully 90d6c2042d https://issues.apache.org/jira/browse/AMQ-4212 - fix auto upgrade from ver 1 and 2 to 5 - regression in KahaDBVersionTest
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1511711 13f79535-47bb-0310-9956-ffa450edef68
2013-08-08 11:51:29 +00:00
Gary Tully 0061f6f755 https://issues.apache.org/jira/browse/AMQ-4000 - tracking subscription commands causes a problem with replay outside of activate - can reset a sub ack locations - regression in AMQ2149Test. Fixed by ignoring sub add during recovery replay
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1511306 13f79535-47bb-0310-9956-ffa450edef68
2013-08-07 13:38:53 +00:00
Gary Tully 5cadb04ad3 https://issues.apache.org/jira/browse/AMQ-4662 - kahadb default checksumJournalFiles = true - validate no migration impact as we currently store default checksum value of 0
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1509178 13f79535-47bb-0310-9956-ffa450edef68
2013-08-01 11:44:30 +00:00
Timothy A. Bish bc4392bdde Additional AMQ-4563: Since the version of the OpenWire marshalers is configured, lets persist what it was when the store was created and log a warning should we start a broker with an old store configured to use a higher openwire version than originally set.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1489062 13f79535-47bb-0310-9956-ffa450edef68
2013-06-03 17:00:38 +00:00
Hiram R. Chirino ec9975c36e Additional fixes related to AMQ-4563: You can now configure the storeOpenWireVersion property of a broker to control which version of openwire is used by the persistence stores. This needs to be set to version 10 to preserve the original AMQP message ids.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1488375 13f79535-47bb-0310-9956-ffa450edef68
2013-05-31 19:56:03 +00:00
Hiram R. Chirino b2b4fc81f7 Fix for AMQ-4563: Changes the KahaDB store to use a more consistent key for message ids. MessageId.toString can change depending on how the message was encoded.
Support storing the externally generated message id of a message in the MessageID class so that Selectors can operate against that external message id.

git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1488353 13f79535-47bb-0310-9956-ffa450edef68
2013-05-31 18:53:48 +00:00
Timothy A. Bish d9b54d6ae8 fix for: https://issues.apache.org/jira/browse/AMQ-4548
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1484999 13f79535-47bb-0310-9956-ffa450edef68
2013-05-21 22:18:36 +00:00
Bosanac Dejan 7450a32ae7 https://issues.apache.org/jira/browse/AMQ-4495 - always get a max batch of messages from the store
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1478823 13f79535-47bb-0310-9956-ffa450edef68
2013-05-03 14:50:56 +00:00
Timothy A. Bish 7057e819eb Fix for: https://issues.apache.org/jira/browse/AMQ-4488
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1475842 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 16:25:51 +00:00
Gary Tully 66e8011e9e https://issues.apache.org/jira/browse/AMQ-4485 - ensure cursor updates in same order as store orderindex via beforeCompletion with index lock. The before completion tracks ordered work that first thread completes as a unit. All updates to a destination are combined to a single sync, such that there is no cursor contention between transactions
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1475734 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 12:47:20 +00:00
Timothy A. Bish 3bf9d0cceb fix for: https://issues.apache.org/jira/browse/AMQ-4212
fix for: https://issues.apache.org/jira/browse/AMQ-2832

git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1468171 13f79535-47bb-0310-9956-ffa450edef68
2013-04-15 18:08:15 +00:00
Gary Tully ed6c472601 https://issues.apache.org/jira/browse/AMQ-4407 - thanks for the test, to fix we need to ensure a persistence adapter is started, b/c it is stopped when the last dest is removed
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1461528 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 11:22:58 +00:00
Hiram R. Chirino 4c5197711a Fixes AMQ4368. Make sure we don't try to GC the database midway through a store operation.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1455661 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 18:22:59 +00:00
Timothy A. Bish 4e624b0393 Apply patch for: https://issues.apache.org/jira/browse/AMQ-4306
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1454501 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 19:18:35 +00:00
Gary Tully 65bc9f3eaf https://issues.apache.org/jira/browse/AMQ-4323 - fix nd test
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1446577 13f79535-47bb-0310-9956-ffa450edef68
2013-02-15 13:33:01 +00:00
Timothy A. Bish 94b9d551b7 apply patch for: https://issues.apache.org/jira/browse/AMQ-4306
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1444193 13f79535-47bb-0310-9956-ffa450edef68
2013-02-08 19:03:28 +00:00
Gary Tully 56174e770d [maven-release-plugin] prepare for next development iteration
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1443026 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 15:45:26 +00:00
Gary Tully 5e257808f3 [maven-release-plugin] prepare release activemq-5.8.0
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1443024 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 15:43:41 +00:00
Gary Tully fc519e186a fix up missing license files - our rat check friend
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1442984 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 14:27:03 +00:00
Timothy A. Bish a55aae00e7 Scrub the pom files and remove old cruft and leftovers from the recent refactoring
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1439680 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 22:44:25 +00:00
Timothy A. Bish 144be7c277 Apply patch with updates for: https://issues.apache.org/jira/browse/AMQ-4265
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1437038 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 16:40:46 +00:00
Gary Tully 0dcdab784b https://issues.apache.org/jira/browse/AMQ-4172 - resolve with test. inflight transactions need to just protect a data file range rather than all subsequent data files. so gc can reclaim what is valid
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1436291 13f79535-47bb-0310-9956-ffa450edef68
2013-01-21 11:37:23 +00:00
Gary Tully 3bffaf7e4c rudimentary generic persistence adapter mbean view - help show data and transaction info - usefull when blocked on usage
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1434903 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 20:40:23 +00:00
Gary Tully 20d3bdb4eb https://issues.apache.org/jira/browse/AMQ-4157 - test case and fix. when an ack is in a tx we need to wait for the store sync as it may be a rollback
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1431463 13f79535-47bb-0310-9956-ffa450edef68
2013-01-10 16:11:40 +00:00
Timothy A. Bish f21992ef41 apply fix for: https://issues.apache.org/jira/browse/AMQ-4068
Updated patch for new layout and fixed size returned to only include the dynamic journal size and not the total disk usage since that accounts for the full log file size and not just the used portion. 

git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1421557 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 21:43:50 +00:00
Gary Tully c73027da1a https://issues.apache.org/jira/browse/AMQ-4221 - fix dangling reference to free page
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1421373 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 16:39:30 +00:00
Timothy A. Bish a1a973ca34 fix for: https://issues.apache.org/jira/browse/AMQ-4220
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1421059 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 01:27:30 +00:00
Timothy A. Bish 05fb2bbcc9 Add warning about long destination names and mKahaDB for:
https://issues.apache.org/jira/browse/AMQ-4183 

git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1420778 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 15:41:03 +00:00
Hiram R. Chirino 32e63dce28 Fixes AMQ-4215: Simplify PList interface and provide a LevelDB store implementation.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1418686 13f79535-47bb-0310-9956-ffa450edef68
2012-12-08 15:21:14 +00:00
Timothy A. Bish 54d56df705 fix for: https://issues.apache.org/jira/browse/AMQ-3833
Allows the store to detect changes in the Audit and only write if its dirty.

git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1416989 13f79535-47bb-0310-9956-ffa450edef68
2012-12-04 15:25:54 +00:00
Timothy A. Bish 81c167b205 apply patch for: https://issues.apache.org/jira/browse/AMQ-4158
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1415870 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 22:02:51 +00:00
Timothy A. Bish 1288df5ad4 fix for: https://issues.apache.org/jira/browse/AMQ-4171
use the getCanonicalPath() value to ensure valid pathnames being used on the platform. 

git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1415725 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 16:15:57 +00:00
Gary Tully c6cf88b836 https://issues.apache.org/jira/browse/AMQ-3894 - remove requirement for destination property enforced by spring - for a default entry there is no need for a destination - fix dependants
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1415661 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 14:48:08 +00:00
Gary Tully fb62989e5e https://issues.apache.org/jira/browse/AMQ-4108 - fix unit test regression, QueueMasterSlaveTest, related to https://issues.apache.org/jira/browse/AMQ-4005 and the dual impl of broker service aware. the auto created locker was not getting its broker service init. flakyness in test related to exponential backoff tool long for reconnect
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1409871 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 16:34:02 +00:00
Timothy A. Bish 6010bd3d97 Move some of the KahaDB tests from core into the KahaDB store module
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1409554 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 23:31:34 +00:00
Hiram R. Chirino c5cf03806d Refactored out the remaining plugins in the activemq-core module into their own modules.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@1406686 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 16:00:07 +00:00