Commit Graph

4480 Commits

Author SHA1 Message Date
Zhihong Yu abf897ad42 HBASE-4946 HTable.coprocessorExec (and possibly coprocessorProxy) does not work with
dynamically loaded coprocessors (Andrei Dragomir)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212250 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 05:58:05 +00:00
larsh e167c8ab28 HBASE-4682 Support deleted rows using Import/Export (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212181 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:16:55 +00:00
larsh 14a266fb6c HBASE-4981 add raw scan support to shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212178 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:01:08 +00:00
Michael Stack c1ae21cc93 HBASE-4980 Null pointer exception in HBaseClient receiveResponse
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212167 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:17:37 +00:00
Michael Stack 1f12fbf6d3 HBASE-4973 On failure, HBaseAdmin sleeps one time too many
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212165 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:14:04 +00:00
Doug Meil c5cf90b09d hbase-4986 index.html - fixed a nit grammatical error in describing BigTable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212142 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 21:49:03 +00:00
Doug Meil 7d57025877 hbase-4985 pom.xml - changing docbook section depth to 2 for chapters.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212134 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 21:29:34 +00:00
Michael Stack 685762a691 HBASE-4982 graceful_stop.sh does not pass on the --config its passed to its internal invocations of other hbase scripts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212050 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 19:19:45 +00:00
Doug Meil badf636b13 hbase-4984 index.html. adding link to arch overview in More Info section.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212005 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 17:55:42 +00:00
Doug Meil e87af46b02 hbase-4983. index.html: one correction, one change, one addition.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211942 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 16:12:39 +00:00
larsh 0418f67d37 HBASE-4979 Setting KEEP_DELETE_CELLS fails in shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211768 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 06:43:41 +00:00
Michael Stack 34df21c7a4 Added troubleshooting section on running hbase on other than the hadoop it ships with
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211758 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 05:11:36 +00:00
Nicolas Spiegelberg 09d0aff149 [jira] [HBASE-4908] HBase cluster test tool (port from 0.89-fb)
Summary:
Porting one of our HBase cluster test tools (a single-process multi-threaded
load generator and verifier) from 0.89-fb to trunk.
I cleaned up the code a bit compared to what's in 0.89-fb, and discovered that
it has some features that I have not tried yet (some kind of a kill test, and
some way to run HBase as multiple processes on one machine).
The main utility of this piece of code for us has been the HBaseClusterTest
command-line tool (called HBaseTest in 0.89-fb), which we usually invoke as a
load test in our five-node dev cluster testing, e.g.:

hbase org.apache.hadoop.hbase.util.LoadTestTool -write 50💯20 -tn loadtest4
-read 100:10 -zk <zk_quorum_node> -bloom ROWCOL -compression LZO -key_window 5
-max_read_errors 10000 -num_keys 10000000000 -start_key 0

Test Plan:
Run this on a dev cluster. Run all unit tests.

Reviewers: stack, Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: stack, nspiegelberg, mbautin, Karthik

Differential Revision: 549

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211746 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:38:27 +00:00
Michael Stack 77dae7ccb7 HBASE-4976 Add compaction/flush queue size metrics mistakenly removed by HFile v2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211719 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 00:11:26 +00:00
Zhihong Yu f4ef4485a7 HBASE-4610 Addendum removes break statement
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211706 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 23:38:06 +00:00
Zhihong Yu 7a36cab817 HBASE-4610 Port HBASE-3380 (Master failover can split logs of live servers) to 92/trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211695 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 22:59:06 +00:00
Michael Stack 7af49fc56d HBASE-4712 Document rules for writing tests; Addendum via Jesse Yates
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211652 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 21:48:30 +00:00
Zhihong Yu bb7f82ac71 HBASE-4927 Addendum fixes case where start key is empty and end key is empty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211632 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 21:05:59 +00:00
Michael Stack 888fad5f0d HBASE-4968 Add to troubleshooting workaround for direct buffer oome's.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211254 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 01:18:24 +00:00
Michael Stack f349a155af Add how to build against hadoop 0.22/0.23
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211246 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 00:36:18 +00:00
Michael Stack dc104e7669 HBASE-4936 Cached HRegionInterface connections crash when getting UnknownHost exceptions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211232 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 23:48:13 +00:00
Michael Stack 83107d86d5 HBASE-4937 Error in Quick Start Shell Exercises
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211227 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 23:26:14 +00:00
Michael Stack bfa4e138c7 HBASE-4376 Document mutual authentication between HBase and Zookeeper using SASL
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211224 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 23:13:37 +00:00
Michael Stack 1f176022fe HBASE-4927 CatalogJanior:SplitParentFirstComparator doesn't sort as expected, for the last region when the endkey is empty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211204 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:15:11 +00:00
Michael Stack cb4320232d HBASE-4729 Clash between region unassign and splitting kills the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211197 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:02:10 +00:00
Michael Stack ff8e1a53c5 HBASE-4712 Document rules for writing tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211187 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 21:48:56 +00:00
Michael Stack 1f8162e80c HBASE-4964 Add builddate, make less sections in toc, and add header and footer customizations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210795 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 06:43:54 +00:00
Nicolas Spiegelberg e1bfdf16a4 HBASE-4440 add an option to presplit table to PerformanceEvaluation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210752 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 02:34:00 +00:00
Nicolas Spiegelberg 9498f9baf3 HBASE-4860 RegionSplitter Should Allow NSFRE during logical split verification
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210699 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 23:14:31 +00:00
Nicolas Spiegelberg 806ccf03dd HBASE-4932 Block cache can be mistakenly instantiated by tools
Summary: disable block cache for HFile writers created for tools

Test Plan:
ran the following tests that call getWriterFactory

test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFilePerformance.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileSeek.java
test/java/org/apache/hadoop/hbase/io/hfile/TestReseekTo.java
test/java/org/apache/hadoop/hbase/io/hfile/TestSeekTo.java
test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java
test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java
test/java/org/apache/hadoop/hbase/regionserver/TestHRegionServerBulkLoad.java
test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALReplay.java

Reviewers: dhruba, jgray, nspiegelberg, JIRA, mbautin

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, mbautin, khemani, nspiegelberg

Differential Revision: 573

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210697 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 23:01:48 +00:00
Doug Meil 2e4ae76616 hbase-4959. site.xml, adding left-hand nav for videos/pres. book.xml, nit capitalization fix.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210645 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:20:40 +00:00
Michael Stack 7ba1306e5b HBASE-4847 Activate single jvm for small tests on jenkins
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210643 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:20:04 +00:00
Nicolas Spiegelberg b955fa6c32 Ability to calculate the blockcache hit ratio for the last few minutes
Summary:
The metric blockcacheHitRatio is since the beginning of time. It would be nice
to calculate the block cache hit ratio for the past few minutes.

This patch remembers the blockcacheHitRatio for the last 5 periods by default.

Test Plan: unit test attached.

Reviewers: jgray, khemani, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, dhruba

Differential Revision: 585

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210640 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:17:47 +00:00
Doug Meil c1ac1f4d80 hbase-4958 book.xml, troubleshooting.xml, external_apis.xml several cleanup items.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210608 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 20:24:18 +00:00
Andrew Kyle Purtell d9f39151c5 HBASE-4944. Optionally verify bulk loaded HFiles
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210311 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 02:20:55 +00:00
Zhihong Yu 5021d29ef4 HBASE-4942 HMaster is unable to start of HFile V1 is used (Honghua Zhu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210303 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 01:11:10 +00:00
Doug Meil 1a2ea74705 hbase-4950. book.xml, corrected BigTable link throughout paper (it was actually producing 404 from Google Labs)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210290 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 00:13:12 +00:00
Doug Meil c7d0ae2692 hbase-4949. book.xml, more links for "more information about hbase"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210216 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:56:20 +00:00
larsh 8fe805ce29 HBASE-4945 NPE in HRegion.bulkLoadHFiles (Andrew P and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210212 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:54:37 +00:00
Doug Meil f547de07c8 hbase-4948. book.xml, adding more links to resources in appendix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210189 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 19:57:09 +00:00
Doug Meil ca79114d4c hbase-4943. book updates (more FAQ, add to appendix for other resources)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210010 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 21:28:58 +00:00
Doug Meil 73b59715e9 hbase-4941. Fixed mis-spelling of 'configuration' in 2 places (configuration.xml and hbase-default.xml)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209912 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 13:53:48 +00:00
Doug Meil 7df968e09a hbase-4939 book.xml (architecture/faq), troubleshooting.xml (created resources section)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209688 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 20:57:35 +00:00
Doug Meil b3d87416d2 hbase-4930. home page (index.html) reformat.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209684 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 20:40:51 +00:00
Michael Stack 5a0f0313b9 HBASE-4899 Region would be assigned twice easily with continually killing server and moving region in testing environment
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209367 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 05:55:25 +00:00
larsh 31468fa7ac HBASE-4903 addendum for security build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209365 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 05:41:55 +00:00
Doug Meil dbb016a527 hbase-4928. overhauled FAQ in book.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209233 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 20:46:53 +00:00
Michael Stack 1e2757e33b HBASE-4918 HTablePool Constructor may cause unintended behavior
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209210 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 19:44:53 +00:00
larsh 9581eea546 HBASE-4903 Return a result from RegionObserver.preIncrement (Daniel Gómez Ferro)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208952 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 05:06:24 +00:00
karthik 50de126b79 HBASE-4463 [jira] Run more aggressive compactions during off peak hours
Summary:
HBASE-4463 Run more aggressive compactions during off peak hours

Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at any
point.

The number of iops on the disk and the top of the rack bandwidth utilization at
off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.

Test Plan: Started running the unit tests.

Reviewers: JIRA, Kannan, nspiegelberg, mbautin, stack

Reviewed By: nspiegelberg

CC: nspiegelberg, tedyu, lhofhansl, Karthik

Differential Revision: 471

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208885 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 23:42:21 +00:00