Gary Tully
958038e0ca
remove duplicate sync, order is now down to the enqueueMutex only which is still consistent as it is only accessed from this place
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@962516 13f79535-47bb-0310-9956-ffa450edef68
2010-07-09 13:21:16 +00:00
Gary Tully
5763561d60
resolve PerDestinationStoreLimitTest - have store size reflect stored messages rather than disk usage (so now it reports used rather than allocated disk soace excluding the index) such that 100MB messages gives store size ~100MB while disk utilisation may be bigger. getDiskSize still exsits to get totall allocated space on disk. This allows configured limits to be more accuratly enforced and fixes this test regression. Also calculation is accumulative rather than on demand so it much faster
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@962468 13f79535-47bb-0310-9956-ffa450edef68
2010-07-09 09:52:43 +00:00
Gary Tully
76f842d371
improve async task concurrency, contention over indexMutex for transactions and taskMap, not per destination. Added some metrics enabled by system properties to help further diagnosis of journal usage
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@960060 13f79535-47bb-0310-9956-ffa450edef68
2010-07-02 17:11:00 +00:00
Hiram R. Chirino
9ae41192a9
Fix for AMQ-2757 - leaf nodes were not properly getting linked together in some cases.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@956741 13f79535-47bb-0310-9956-ffa450edef68
2010-06-21 23:56:35 +00:00
Hiram R. Chirino
d8440f8610
fixing contains method so that recovery is quicker
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@956732 13f79535-47bb-0310-9956-ffa450edef68
2010-06-21 23:26:49 +00:00
Gary Tully
e85dda9c64
have KahaDB lock work in vm, so master slave tests can work ok. preserver kaha behaiour in this regard as it makes testing simpler. fix npe on shutdown if start fails
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@955973 13f79535-47bb-0310-9956-ffa450edef68
2010-06-18 12:27:51 +00:00
Gary Tully
e1389a6acc
allow journal write batching, resolve global transaction lock and journal lock, let writes accumulate on the datafileappender rather than at the store, also tie transaction completion and after commit processing together with a callback rather than with a global lock so that concurrent commits can batch their writes - rework of fix for https://issues.apache.org/activemq/browse/AMQ-2594
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@947657 13f79535-47bb-0310-9956-ffa450edef68
2010-05-24 14:48:55 +00:00
Robert Davies
54a00fe5fe
removing static schedulers - so ActiveMQ will shutdown cleanly - see https://issues.apache.org/activemq/browse/AMQ-2568
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@945524 13f79535-47bb-0310-9956-ffa450edef68
2010-05-18 07:23:20 +00:00
Hiram R. Chirino
10e57c9e05
related to https://issues.apache.org/activemq/browse/AMQ-2687
...
was using the wrong file var when reading some values from the recovery log. Net effect is that recovery log was always considered inconsistent.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@932537 13f79535-47bb-0310-9956-ffa450edef68
2010-04-09 18:23:04 +00:00
Guillaume Nodet
3ce41d42c5
AMQ-2602: avoid activemq osgi bundles to import their own packages
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@908905 13f79535-47bb-0310-9956-ffa450edef68
2010-02-11 09:57:46 +00:00
Gary Tully
4b49834ef6
hang on linux seems to point to the possibilit of more than one thread waiting on the enque mutex so this change to notifyAll should help
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@903330 13f79535-47bb-0310-9956-ffa450edef68
2010-01-26 17:29:00 +00:00
Hiram R. Chirino
a33d6684eb
Adding a isEmpty() method to the btree indexes.. related to the fix created for AMQ-2512
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@901763 13f79535-47bb-0310-9956-ffa450edef68
2010-01-21 16:37:37 +00:00
Bosanac Dejan
5cf4d83556
https://issues.apache.org/activemq/browse/AMQ-2042 - kahadb cleaning up after io exception
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@881221 13f79535-47bb-0310-9956-ffa450edef68
2009-11-17 09:53:49 +00:00
Bosanac Dejan
a19e27a9fc
https://issues.apache.org/activemq/browse/AMQ-2042 - enable kahadb to recover from 'no space available'
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@880792 13f79535-47bb-0310-9956-ffa450edef68
2009-11-16 15:22:19 +00:00
Bosanac Dejan
6a4e25c737
http://issues.apache.org/activemq/browse/AMQ-2042 - additional fix for kahaDB store
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@835833 13f79535-47bb-0310-9956-ffa450edef68
2009-11-13 12:56:38 +00:00
Bosanac Dejan
b1a9130149
http://issues.apache.org/activemq/browse/AMQ-2042 - shutdown if kahadb cannot access disk
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@834922 13f79535-47bb-0310-9956-ffa450edef68
2009-11-11 15:50:45 +00:00
Bosanac Dejan
7172be35bc
[maven-release-plugin] prepare for next development iteration
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@816197 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 14:02:19 +00:00
Bosanac Dejan
05a2c0773e
[maven-release-plugin] prepare release activemq-5.3.0
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@816195 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 14:01:35 +00:00
Gary Tully
039a15fc13
allow embedded broker with kahaDB to exit without stop - make writer threads Daemon
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@814649 13f79535-47bb-0310-9956-ffa450edef68
2009-09-14 14:04:19 +00:00
Gary Tully
561cda1e45
expose journal writeBatchSize
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@813467 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 15:00:13 +00:00
Gary Tully
868965997c
resolve https://issues.apache.org/activemq/browse/AMQ-2366 - new File needed on each lock attempt or master restart will see old lock history
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@808378 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 11:46:21 +00:00
Gary Tully
589f9241fe
resolve fd leak in locking logic, cause slave to exhaust fds and fail
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@808041 13f79535-47bb-0310-9956-ffa450edef68
2009-08-26 15:09:02 +00:00
Hiram R. Chirino
76d3b4665c
- Journal will now check the data files for data corruption if checkForCorruptionOnStartup option is enabled.
...
- The corrupted journal records can be inspected via DataFile.getCorruptedBlocks()
- An OR and AND BTreeVisitor is now supported to support running more complex queries against the BTree
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@805550 13f79535-47bb-0310-9956-ffa450edef68
2009-08-18 19:44:22 +00:00
Gary Tully
c42d980db8
revert change of max file size to long as it will impact index size and 2gb is a reasonable max atm
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@802781 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 13:13:33 +00:00
Gary Tully
747a2383f4
reflect preferredSize change to long
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@802766 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 12:41:36 +00:00
Gary Tully
880f3d6811
file size limit should be a long
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@802709 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 09:51:08 +00:00
Hiram R. Chirino
fbc5eb5eb0
Implemented:
...
https://issues.apache.org/activemq/browse/AMQ-2338
https://issues.apache.org/activemq/browse/AMQ-2337
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@799733 13f79535-47bb-0310-9956-ffa450edef68
2009-07-31 20:10:05 +00:00
Gary Tully
a88a513e3c
fix file lock usage in kahadb store, so shared file system master slave can work
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@783364 13f79535-47bb-0310-9956-ffa450edef68
2009-06-10 14:06:59 +00:00
Hiram R. Chirino
c442ebcc7d
Forgot this one in last commit
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@777216 13f79535-47bb-0310-9956-ffa450edef68
2009-05-21 18:43:21 +00:00
Hiram R. Chirino
e22a37a70e
Extended the Marshaller interface so that users can determin if uses fixed size records. Kahadb should be able to make some optimizations
...
on fixed sized objects.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@777209 13f79535-47bb-0310-9956-ffa450edef68
2009-05-21 18:34:45 +00:00
Hiram R. Chirino
3d64397cbf
Added support for creating BTreeIndex objects with a default constructor.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@758732 13f79535-47bb-0310-9956-ffa450edef68
2009-03-26 16:42:52 +00:00
Gary Tully
d458a5d17f
fix org.apache.kahadb.journal.JournalTest.testBatchWriteCompleteAfterClose() after changes for AMQ-2143, the file and offset in a location are set after an enqueue to a write batch, so doing the inflight add just overwrote the same entry, -1:-1. Which fixed the leak but broke inflights, proper fix is to do the inflight addition in enqueue, just after the location details are known and with a lock on appender enqueue
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@748475 13f79535-47bb-0310-9956-ffa450edef68
2009-02-27 10:22:50 +00:00
Gary Tully
d98ea376ba
resolve mem leak in kahadb - AMQ-2143
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@748218 13f79535-47bb-0310-9956-ffa450edef68
2009-02-26 17:32:37 +00:00
Hiram R. Chirino
f73b622a60
Change the way journal records are validated on recovery to be consistent. We now use a checksum to provide better consistency.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741741 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 21:35:39 +00:00
Hiram R. Chirino
d761e80ae4
- added some handy generic visitors to the BTreeVisitor class.
...
- Updated the recovery process so it now rollsback changes applied to the index which did not get synced to the journal.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741659 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 18:19:31 +00:00
Hiram R. Chirino
789ea7cab9
Making the removeDataFile a little smarter to avoid removing data files that are still being worked on
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741600 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 15:54:19 +00:00
Gary Tully
deea2d11a8
expose relevant index attributes for configuration from kahadb
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741528 13f79535-47bb-0310-9956-ffa450edef68
2009-02-06 10:59:47 +00:00
Hiram R. Chirino
180b0ec4ab
- Implemented the setBatch API call in KahaDBStore.
...
- fixed bug: When a async thread was used for writing in KahaDBStore you could run in a Memory leak due to an unbound enqueue buffer type problem.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741327 13f79535-47bb-0310-9956-ffa450edef68
2009-02-05 22:41:01 +00:00
Gary Tully
f0af62f64d
add a little more info to flush
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741293 13f79535-47bb-0310-9956-ffa450edef68
2009-02-05 21:15:13 +00:00
Hiram R. Chirino
8262ef7903
Changed the cleanup algorithm used in the KahaDB.. It should now be much faster.
...
Fixed bug in the BTreeNode.visit() which was making us load most of the pages instead of letting us filter down to just a few.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741212 13f79535-47bb-0310-9956-ffa450edef68
2009-02-05 18:07:57 +00:00
Hiram R. Chirino
c0594251e2
Bettter property names.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741169 13f79535-47bb-0310-9956-ffa450edef68
2009-02-05 16:33:23 +00:00
Hiram R. Chirino
19c4316a1c
Added the ability to customize thw write batch size in the PageFile.
...
Added some diagnostic logging to see when store updates take too long and why.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@741137 13f79535-47bb-0310-9956-ffa450edef68
2009-02-05 15:29:48 +00:00
Hiram R. Chirino
ba706d134d
Added a handy little rotateTo method to be able to quickly rotate to a specific node.
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@740329 13f79535-47bb-0310-9956-ffa450edef68
2009-02-03 16:02:01 +00:00
Hiram R. Chirino
c01e182cfd
Avoid NPE
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@740087 13f79535-47bb-0310-9956-ffa450edef68
2009-02-02 19:38:04 +00:00
Hiram R. Chirino
42824ffc55
Adding a handy getList() method to the LinkedNode impl
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@738946 13f79535-47bb-0310-9956-ffa450edef68
2009-01-29 18:10:03 +00:00
Gary Tully
2deea18cc2
applied patch from https://issues.apache.org/activemq/browse/AMQ-2068 with thanks
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@734981 13f79535-47bb-0310-9956-ffa450edef68
2009-01-16 11:47:02 +00:00
Hiram R. Chirino
47e6d0482b
Fixing 2 bugs and adding a nice to have toArrayList() method
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@733888 13f79535-47bb-0310-9956-ffa450edef68
2009-01-12 20:17:48 +00:00
Hiram R. Chirino
050436d72c
Fixing rotate() method
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@733849 13f79535-47bb-0310-9956-ffa450edef68
2009-01-12 17:51:08 +00:00
Bosanac Dejan
3967b81cc7
name and description for kaha db module
...
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@732985 13f79535-47bb-0310-9956-ffa450edef68
2009-01-09 09:48:35 +00:00
Hiram R. Chirino
f62737be7c
Moving stuff around so that activemq-core can depend on kahadb instead of kahadb depending on activemq-core. This step allows kahadb to be used as the default
...
store implementation if desired. Will do that next.
git-svn-id: https://svn.apache.org/repos/asf/activemq/trunk@731704 13f79535-47bb-0310-9956-ffa450edef68
2009-01-05 20:48:38 +00:00