Commit Graph

4366 Commits

Author SHA1 Message Date
Doug Meil 37cbd5a38e hbase-5036 book.xml architecture chapter minor mods regarding region-RS assignment
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214614 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 03:56:03 +00:00
Zhihong Yu 6b60585fef HBASE-5030 Some tests do not close the HFile.Reader they use, leaving some file descriptors open (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214519 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 22:52:45 +00:00
Zhihong Yu e85d2d45d3 HBASE-5026 Add coprocessor hook to HRegionServer.ScannerListener.leaseExpired()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214431 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:57:42 +00:00
Michael Stack bade2361c9 HBASE-4993 Performance regression in minicluster creation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214419 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:39:23 +00:00
Doug Meil 685284c604 hbase-5028 book.xml - adding info on region assignment and file locality
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214412 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:14:10 +00:00
Zhihong Yu 9ed28b472c HBASE-5022 Optimize HBaseConfiguration#create (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214366 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 17:30:44 +00:00
larsh cd0c4cffa9 HBASE-5001 Improve the performance of block cache keys (Lars H and J-D)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213995 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 00:05:04 +00:00
Jean-Daniel Cryans 69b7530f60 HBASE-5017 Bump the default hfile.block.cache.size because of HFileV2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213950 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 21:55:36 +00:00
Michael Stack 4de54f3552 HBASE-5006 Move hbase 0.92RC1 on to hadoop 1.0.0RC2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213928 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 21:01:44 +00:00
Zhihong Yu 1b1725188e HBASE-5015 Remove some leaks in tests due to lack of HTable.close()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213823 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 18:21:33 +00:00
karthik 34dc2a4b66 [jira] [HBASE-4661] get list of store files.
Summary:
1. Ported getStoreFileList API to trunk.
2. Also ported flushRegion API to trunk (with option of flushing if
lastFlushTime < TS).

Test Plan: Tested on 89.

Reviewers: Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: Karthik

CC: HBase Diffs Facebook Group, Karthik, Kannan, stack, madhuvaidya

Differential Revision: 729

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213487 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:58:51 +00:00
Michael Stack 4b8eb16ea9 HBASE-4997 SplitLogManager can have a race on batch.installed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213479 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:46:33 +00:00
Michael Stack fba66ac5f2 HBASE-5011 Move test-util.sh from src/test/bin to dev-tools
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213477 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:43:55 +00:00
Michael Stack d7f1fb414c HBASE-5011 Move test-util.sh from src/test/bin to dev-tools
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213476 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:41:42 +00:00
Michael Stack f4f2d4cf01 HBASE-4965 Monitor the open file descriptors and the threads counters during the unit tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213466 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:14:27 +00:00
Michael Stack 6eb38cfbae HBASE-4965 Monitor the open file descriptors and the threads counters during the unit tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213453 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 21:48:29 +00:00
Michael Stack 677467df67 HBASE-4922 [packaging] Assembly tars up hbase in a subdir; i.e. after untar hbase-0.92.0 has a subdir named 0.92.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213429 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 20:37:21 +00:00
Michael Stack 747b5cb124 HBASE-4881 Unhealthy region is on service caused by rollback of region splitting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213383 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 19:24:28 +00:00
Michael Stack c7c688679a HBASE-5008 The clusters can't provide services because Region can't flush.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213358 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:43:49 +00:00
Michael Stack fe60d5dce8 HBASE-5000 Speed up simultaneous reads of a block when block caching is turned off; bit of doc and why its a bad idea disabling block cache completely
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213354 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:34:17 +00:00
Michael Stack 28ee3bf9ba HBASE-4989 Metrics to measure sequential reads and random reads separately
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213345 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:21:37 +00:00
Michael Stack 54c3a0a530 HBASE-4923 [packaging] Assembly should make only executables executable (docs should not be executable)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213108 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 23:38:42 +00:00
Michael Stack ac1657ba59 HBASE-4971 Useless sleeps in TestTimestampsFilter and TestMultipleTimestamps
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213103 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 23:17:09 +00:00
Michael Stack 756aa7ff16 HBASE-5007 HBaseAdmin.stopRegionServer do not stop the region server
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213102 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 23:05:14 +00:00
larsh a443b9f338 HBASE-5005 Add DEFAULT_MIN_VERSIONS to HColumnDescriptor.DEFAULT_VALUES
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212737 13f79535-47bb-0310-9956-ffa450edef68
2011-12-10 06:21:19 +00:00
Michael Stack c3110b3436 HBASE-4922 [packaging] Assembly tars up hbase in a subdir; i.e. after untar hbase-0.92.0 has a subdir named 0.92.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212732 13f79535-47bb-0310-9956-ffa450edef68
2011-12-10 05:33:39 +00:00
Michael Stack 2261fc23c9 HBASE-4859 Correctly PreWarm HBCK ThreadPool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212701 13f79535-47bb-0310-9956-ffa450edef68
2011-12-10 00:40:01 +00:00
Michael Stack d855d71ba8 HBASE-4974 Remove some resources leaks on the tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212688 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 23:33:36 +00:00
larsh 3e608b3979 HBASE-4998 Support deleted rows in CopyTable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212671 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 22:39:02 +00:00
Michael Stack 1bed70fd99 HBASE-4992 Use a UUID for HFileOutputFormat partition path name
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212581 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 19:08:11 +00:00
Michael Stack 8ef75773c8 HBASE-4996 hadoopqa not running long category tests, just short and medium
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212575 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 18:55:38 +00:00
Michael Stack 69b505b4da HBASE-4995 Increase zk maxClientCnxns to give us some head room
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212570 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 18:44:03 +00:00
Michael Stack 844819717c HBASE-4994 TestHeapSize broke in trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212549 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 17:56:12 +00:00
Michael Stack 0b0fa97084 HBASE-4969 tautology in HRegionInfo.readFields
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212259 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 06:44:51 +00:00
Michael Stack 2704cd8a57 HBASE-4987 wrong use of incarnation var in SplitLogManager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212256 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 06:16:03 +00:00
Michael Stack 307ca7c68b HBASE-4880 Region is on service before openRegionHandler completes, may cause data loss
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212251 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 05:59:34 +00:00
Zhihong Yu abf897ad42 HBASE-4946 HTable.coprocessorExec (and possibly coprocessorProxy) does not work with
dynamically loaded coprocessors (Andrei Dragomir)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212250 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 05:58:05 +00:00
larsh e167c8ab28 HBASE-4682 Support deleted rows using Import/Export (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212181 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:16:55 +00:00
larsh 14a266fb6c HBASE-4981 add raw scan support to shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212178 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:01:08 +00:00
Michael Stack c1ae21cc93 HBASE-4980 Null pointer exception in HBaseClient receiveResponse
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212167 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:17:37 +00:00
Michael Stack 1f12fbf6d3 HBASE-4973 On failure, HBaseAdmin sleeps one time too many
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212165 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:14:04 +00:00
Doug Meil c5cf90b09d hbase-4986 index.html - fixed a nit grammatical error in describing BigTable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212142 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 21:49:03 +00:00
Doug Meil 7d57025877 hbase-4985 pom.xml - changing docbook section depth to 2 for chapters.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212134 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 21:29:34 +00:00
Michael Stack 685762a691 HBASE-4982 graceful_stop.sh does not pass on the --config its passed to its internal invocations of other hbase scripts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212050 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 19:19:45 +00:00
Doug Meil badf636b13 hbase-4984 index.html. adding link to arch overview in More Info section.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212005 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 17:55:42 +00:00
Doug Meil e87af46b02 hbase-4983. index.html: one correction, one change, one addition.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211942 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 16:12:39 +00:00
larsh 0418f67d37 HBASE-4979 Setting KEEP_DELETE_CELLS fails in shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211768 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 06:43:41 +00:00
Michael Stack 34df21c7a4 Added troubleshooting section on running hbase on other than the hadoop it ships with
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211758 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 05:11:36 +00:00
Nicolas Spiegelberg 09d0aff149 [jira] [HBASE-4908] HBase cluster test tool (port from 0.89-fb)
Summary:
Porting one of our HBase cluster test tools (a single-process multi-threaded
load generator and verifier) from 0.89-fb to trunk.
I cleaned up the code a bit compared to what's in 0.89-fb, and discovered that
it has some features that I have not tried yet (some kind of a kill test, and
some way to run HBase as multiple processes on one machine).
The main utility of this piece of code for us has been the HBaseClusterTest
command-line tool (called HBaseTest in 0.89-fb), which we usually invoke as a
load test in our five-node dev cluster testing, e.g.:

hbase org.apache.hadoop.hbase.util.LoadTestTool -write 50💯20 -tn loadtest4
-read 100:10 -zk <zk_quorum_node> -bloom ROWCOL -compression LZO -key_window 5
-max_read_errors 10000 -num_keys 10000000000 -start_key 0

Test Plan:
Run this on a dev cluster. Run all unit tests.

Reviewers: stack, Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: stack, nspiegelberg, mbautin, Karthik

Differential Revision: 549

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211746 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:38:27 +00:00
Michael Stack 77dae7ccb7 HBASE-4976 Add compaction/flush queue size metrics mistakenly removed by HFile v2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211719 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 00:11:26 +00:00