Commit Graph

4253 Commits

Author SHA1 Message Date
Michael Stack c176d41582 HBASE-5481 Uncaught UnknownHostException prevents HBase from starting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294217 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:26 +00:00
Michael Stack 5b61755b0f HBASE-5473 Metrics does not push pread time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293532 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 04:22:55 +00:00
Michael Stack e540751766 HBASE-5350 Fix jamon generated package names
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:59:37 +00:00
Michael Stack 3544e1c5f7 HBASE-5351 hbase completebulkload to a new table fails in a race
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293479 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:40:27 +00:00
larsh d229b63a28 HBASE-5455 Add test to avoid unintentional reordering of items in HbaseObjectWritable (Michael Drzal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293455 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:29:40 +00:00
Michael Stack d7050d3541 HBASE-5325 Expose basic information about the master-status through jmx beans
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293416 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:06:12 +00:00
larsh a54ec1b7cc HBASE-5440 Allow Import to optionally use HFileOutputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293101 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:47:29 +00:00
Michael Stack e531e2595c HBASE-4365 Add a decent heuristic for region size
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293099 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:41:37 +00:00
Michael Stack ce71b8a1bc HBASE-5166 MultiThreaded Table Mapper analogous to MultiThreaded Mapper in hadoop
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293098 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:38:18 +00:00
mbautin a01166ec92 [jira] [HBASE-5442] Use builder pattern in StoreFile and HFile
Summary: Cleaning up the factory method explosion in HFile writer and StoreFile.
Now, adding a new parameter to HFile/StoreFile writer initialization will not
require modifying factory method invocations all over the codebase.

Test Plan:
Run unit tests
Deploy to dev cluster and run a load test

Reviewers: JIRA, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: stack

Differential Revision: https://reviews.facebook.net/D1893

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293095 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:06:53 +00:00
Michael Stack bbf0a0074e HBASE-5464 Log warning message when thrift calls throw exceptions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293093 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 05:48:13 +00:00
mbautin 85c90d9274 [jira] [HBASE-5470] Make DataBlockEncodingTool work correctly with no native
compression codecs loaded

Summary:
DataBlockEncodingTool was fixed as part of porting data block encoding
(HBASE-4218) to 89-fb
(https://reviews.facebook.net/rHBASEEIGHTNINEFBBRANCH1245291,
https://reviews.facebook.net/D1659). The bug being fixed here appeared when
using GZ as baseline compression codec but not loading native Hadoop libraries,
in which case the compressor instance would be null.

Test Plan:
Run DataBlockEncoding tool with GZ (no native codecs) and LZO (with native
codecs) as baseline (Hadoop-level) compression codecs

Reviewers: JIRA, Kannan, mcorgan, lhofhansl, todd, stack, tedyu

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D1917

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293057 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:03:37 +00:00
Zhihong Yu 398289ce6e HBASE-5317 Fix TestHFileOutputFormat to work against hadoop 0.23 (Gregory Chanan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293049 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 01:07:03 +00:00
Zhihong Yu 49904bcf1d HBASE-5466 Opening a table also opens the metatable and never closes it
(Ashley Taylor)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293047 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:55:58 +00:00
Jean-Daniel Cryans a4a4e97338 HBASE-5415 FSTableDescriptors should handle random folders in
hbase.root.dir better


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293042 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:41:31 +00:00
mbautin b77dca0c7f [jira] [HBASE-5357] Refactoring: use the builder pattern for HColumnDescriptor
Summary: Deprecate three ugly HColumnDescriptor constructors and use a "builder"
pattern instead, e.g. new
HColumnDescriptor(cfName).setMaxVersions(5).setBlockSize(8192), etc. Setters
have now become "builder" methods.

Test Plan: Run unit tests

Reviewers: JIRA, todd, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D1851

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293026 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 23:18:27 +00:00
Zhihong Yu b0d4403059 HBASE-5437 HRegionThriftServer does not start because of a bug in HbaseHandlerMetricsProxy (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293013 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:58:42 +00:00
Doug Meil 2b41fc22b4 hbase-5468 book.xml - updating copyright to 2012
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292998 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:31:57 +00:00
Doug Meil 16014f0448 hbase-5467 - change homepage to refer to 'reference guide'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292958 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 21:12:07 +00:00
Doug Meil bea5f9e592 hbase-5465 book.xml, preface.xml - changing "book" to "reference guide"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292921 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 19:43:37 +00:00
larsh 375d81ab29 HBASE-5460 Add protobuf as M/R dependency jar
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292656 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:44:56 +00:00
Michael Stack 30f21c3ef4 HBASE-5423 Regionserver may block forever on waitOnAllRegionsToClose when aborting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292647 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:05:30 +00:00
Michael Stack 240d6bc52b HBASE-5424 HTable meet NPE when call getRegionInfo() -- REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292646 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:01:29 +00:00
Michael Stack 6a80cf5bf9 HBASE-5424 HTable meet NPE when call getRegionInfo()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 04:43:29 +00:00
Nicolas Spiegelberg c3575d2eb5 [jira] [HBASE-5332] Deterministic Compaction Jitter
Summary:
Changing the jitter in major compactions to be deterministic,
so reboots don't cause a time-based compaction storm.  This
implementation seeds a random number generator with HDFS data for
persistence.

Test Plan: - mvn test -Dtest=TestCompaction,TestCompactSelection,TestHeapSize

Reviewers: JIRA, Kannan, aaiyer, stack

Reviewed By: Kannan

Differential Revision: https://reviews.facebook.net/D1785

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292495 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 20:36:39 +00:00
Michael Stack 7b5ec59eda HBASE-5422 StartupBulkAssigner would cause a lot of timeout on RIT when assigning large numbers of regions (timeout = 3 mins)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292409 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:29:26 +00:00
larsh 0f708f7370 HBASE-5439 Fix some performance findbugs issues (Gregory Chanan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292141 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 07:00:44 +00:00
Michael Stack 953d89e3a9 HBASE-5189 Add metrics to keep track of region-splits in RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292139 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 06:51:02 +00:00
Michael Stack 6da328e0fb HBASE-5436 Right-size the map when reading attributes.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1291463 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 21:46:04 +00:00
larsh ad14643d55 HBASE-5431 Improve delete marker handling in Import M/R jobs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290955 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 05:51:56 +00:00
Michael Stack 145d25dfc2 HBASE-5209 HConnection/HMasterInterface should allow for way to get hostname of currently active master in multi-master HBase setup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290942 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 04:10:46 +00:00
Michael Stack d69299dfdc HBASE-5003 If the master is started with a wrong root dir, it gets stuck and can't be killed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290882 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 21:32:42 +00:00
Michael Stack 588206f411 HBASE-5200 AM.ProcessRegionInTransition() and AM.handleRegion() race thus leaving the region assignment inconsistent
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290854 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 20:13:54 +00:00
larsh 0e54a5f331 HBASE-3584 Addendum, remove RowMutation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245876 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 07:25:41 +00:00
Michael Stack 9a7f01e293 HBASE-5294 Make sure javadoc is included in tarball bundle when we release
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245827 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:07:13 +00:00
Michael Stack f1815cf544 HBASE-5420 TestImportTsv does not shut down MR Cluster correctly (fails against 0.23 hadoop)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245795 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 23:02:37 +00:00
Michael Stack 0d17817fde HBASE-3584 Rename RowMutation to RowMutations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245792 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 22:58:01 +00:00
Michael Stack 9684065bec HBASE-5428 Allow for custom filters to be registered within the Thrift interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245774 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:39:30 +00:00
Michael Stack 0dd3c22706 HBASE-5195 [Coprocessors] preGet hook does not allow overriding or wrapping filter on incoming Get -- SECOND HALF OF THIS COMMIT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245773 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:34:46 +00:00
Michael Stack 0caad4616e HBASE-5279 NPE in Master after upgrading to 0.92.0 -- REVERT OVERCOMMIT TO HREGION
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245768 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:26:23 +00:00
Michael Stack 5994c50143 HBASE-5279 NPE in Master after upgrading to 0.92.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245767 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:24:21 +00:00
Michael Stack aa7a5b2926 HBASE-5120 Timeout monitor races with table disable handler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245731 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 20:03:57 +00:00
Jean-Daniel Cryans 6fa8f6a042 HBASE-4640 Catch ClosedChannelException and document it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245730 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:56:54 +00:00
Jean-Daniel Cryans 5b542b7921 HBASE-5393 Consider splitting after flushing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245727 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:45:45 +00:00
Michael Stack f45b59aa4d HBASE-5425 Punt on the timeout doesn't work in BulkEnabler#waitUntilDone (master's EnableTableHandler)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245674 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 17:28:46 +00:00
Michael Stack 0a9ab79730 HBASE-5346 Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245280 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 01:07:01 +00:00
Doug Meil b45071a8d0 hbase-5397. performance.xml, configuration.xml - correction to ZK config.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245199 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 21:56:57 +00:00
Zhihong Yu 628e5cd9f2 HBASE-5411 Add more metrics for ThriftMetrics (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244977 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 13:56:40 +00:00
Zhihong Yu fe2a3d022b HBASE-5400 Some tests does not have annotations for (Small|Medium|Large)Tests (Enis)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244726 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 21:06:15 +00:00
Doug Meil 49ea0d8484 hbase-5409 book.xml - adding section on sort-order in Data Model chapter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244706 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 20:47:30 +00:00
Doug Meil b4b62e6d97 hbase-5408. book.xml, moved "column metadata" section to top-level in Data Model chapter.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244681 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:59:28 +00:00
Doug Meil db6992f96c hbase-5406 book.xml - adding section to Data Model chapter about column metadata.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244676 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:46:06 +00:00
Doug Meil 87d4ad6980 hbase-5405. index.xml - correcting bigtable link description
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244659 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:20:21 +00:00
Doug Meil 421c120f4a hbase-5404. book.xml, performance.xml - more info on compression and schema design
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244649 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:08:05 +00:00
Michael Stack 71682997f3 HBASE-5394 Add ability to include Protobufs in HbaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244641 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:45:06 +00:00
Michael Stack caf2c0c67a HBASE-5398 HBase shell disable_all/enable_all/drop_all promp wrong tables for confirmation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244169 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:02:13 +00:00
Zhihong Yu ac0fb8d5ae HBASE-5388 Tune HConnectionManager#getCachedLocation method (Ronghai Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243994 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 15:28:59 +00:00
Jean-Daniel Cryans 37735435ec HBASE-5395 CopyTable needs to use GenericOptionsParser
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243759 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 01:13:33 +00:00
Jean-Daniel Cryans ce3bae0334 HBASE-5197 [replication] Handle socket timeouts in ReplicationSource
to prevent DDOS


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243733 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 23:12:55 +00:00
mbautin b50714c043 [jira] [HBASE-5387] Reuse compression streams in HFileBlock.Writer
Summary: We need to to reuse compression streams in HFileBlock.Writer instead of
allocating them every time. The motivation is that when using Java's built-in
implementation of Gzip, we allocate a new GZIPOutputStream object and an
associated native data structure any time. This is one suspected cause of recent
TestHFileBlock failures on Hadoop QA:
https://builds.apache.org/job/HBase-TRUNK/2658/testReport/org.apache.hadoop.hbase.io.hfile/TestHFileBlock/testPreviousOffset_1_/.

Test Plan:
* Run unit tests
* Create a GZIP-compressed CF with new code, load some data, shut down HBase,
deploy old code, restart HBase, and scan the table

Reviewers: tedyu, Liyin, dhruba, JIRA, lhofhansl

Reviewed By: lhofhansl

CC: tedyu, lhofhansl, mbautin

Differential Revision: https://reviews.facebook.net/D1719

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243667 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 19:41:58 +00:00
Zhihong Yu f2bb12c6bb HBASE-5327 Print a message when an invalid hbase.rootdir is passed (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243650 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 18:47:04 +00:00
Doug Meil 2c2310c0db hbase-5392. adding 2 releases to 'news'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243561 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 15:31:35 +00:00
Doug Meil d6c736e628 hbase-5391. index.html - adding 'year' to news items
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243552 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 15:05:50 +00:00
Doug Meil 8e35106b38 hbase-5390. book.xml - adding section in Arch/Master about what happens if master dies.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243550 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 15:00:51 +00:00
Doug Meil 0553fbc25b hbase-5389. book.xml - minor correction of compaction selection example #1
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243532 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 14:24:58 +00:00
Zhihong Yu 0e0394bc35 HBASE-5199 Differential revision 1311 Delete out of TTL store files before compaction selection (Liyin)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243086 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 16:29:36 +00:00
larsh 23b135965f HBASE-5368 Move PrefixSplitKeyPolicy out of the src/test into src, so it is accessible in HBase installs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242981 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:32:52 +00:00
Jonathan Hsieh 8bb23aef17 HBASE-5364 Fix source files missing license in 0.92 and trunk (Elliott Clark)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242906 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 20:07:36 +00:00
mbautin af0612f886 [jira] [HBASE-5382] Test that we always cache index and bloom blocks
Summary: This is a unit test that should have been part of HBASE-4683 but was
not committed. The original test was reviewed as part of
https://reviews.facebook.net/D807. Submitting unit test as a separate JIRA and
patch, and extending the scope of the test to also handle the case when block
cache is enabled for the column family.

Test Plan: Run unit tests

Reviewers: JIRA, jdcryans, lhofhansl, Liyin

Reviewed By: jdcryans

CC: jdcryans

Differential Revision: https://reviews.facebook.net/D1695

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242894 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:27:29 +00:00
Doug Meil 9d7d022ec6 hbase-5380. book.xml, comment about KeyValue instances not being split across blocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242878 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:27:42 +00:00
Doug Meil ac8ccdf477 hbase-5378 book.xml - adding new section for coprocessors in Arch/RegionServer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242870 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 17:48:16 +00:00
Zhihong Yu c6519ca4c7 HBASE-5358 HBaseObjectWritable should be able to serialize/deserialize generic arrays
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242649 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 03:37:32 +00:00
Doug Meil 4aebaffe43 hbase-5367 book.xml - this time, really fixing the default compaction.min.size
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242494 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:56:40 +00:00
Doug Meil 25e0f67da7 hbase-5367. book.xml - minor formatting in Arch/Region/Store compaction description
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:45:06 +00:00
Jonathan Hsieh e0fc9e1382 HBASE-5288 Security source code dirs missing from 0.92.0 release tarballs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242457 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:56:26 +00:00
Doug Meil 34b24a2ab7 hbase-5330. Update to TestCompactSelection unit test for selection SF assertions.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:13:29 +00:00
Doug Meil f49e4780dc hbase-5365. book - Arch/Region/Store adding description of compaction file selection
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242427 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:09:45 +00:00
larsh ff1f0decc4 HBASE-5229 Provide basic building blocks for 'multi-row' local transactions.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242037 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 18:30:37 +00:00
Zhihong Yu 7ef8f6e307 HBASE-5298 Add thrift metrics to thrift2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241974 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 17:03:11 +00:00
Zhihong Yu 10f108630f HBASE-5345 CheckAndPut doesn't work when value is empty byte[] (Evert Arckens)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241972 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 16:55:16 +00:00
Michael Stack 38d28bccc6 HBASE-5348 Constraint configuration loaded with bloat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241704 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:49:37 +00:00
Zhihong Yu 802d7c8674 HBASE-3850 Log more details when a scanner lease expires (Darren Haas)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241667 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:23:45 +00:00
Zhihong Yu b4f585e6a3 HBASE-5267 Add a configuration to disable the slab cache by default (Li Pi)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241644 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 21:41:45 +00:00
Michael Stack e8b6a99539 Added a sponsors page linked from front page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 19:57:58 +00:00
Zhihong Yu a2887a9bb7 HBASE-4658 Put attributes are not exposed via the ThriftServer (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1240294 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 19:02:13 +00:00
larsh df4a9d4ad3 HBASE-5304 Pluggable split key policy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239909 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 23:00:06 +00:00
Zhihong Yu 4b4904a77c HBASE-5186 Add metrics to ThriftServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239737 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 17:30:13 +00:00
larsh be722211fd HBASE-5266 Add documentation for ColumnRangeFilter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239399 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:27:43 +00:00
Zhihong Yu 8a6d0fbca1 HBASE-5212 Fix test TestTableMapReduce against 0.23 (Ted and Gregory)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:56:34 +00:00
Zhihong Yu 6bed2d07da HBASE-5295 Improve the Thrift API to switch on/off writing to wal for Mutations (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239241 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:04:06 +00:00
Zhihong Yu 457d51bec5 HBASE-5310 HConnectionManager server cache key enhancement (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239220 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:34:04 +00:00
Zhihong Yu 4b698e776d HBASE-5283 Request counters may become negative for heavily loaded regions (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239157 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 14:56:20 +00:00
Zhihong Yu e5a38bed76 HBASE-5256 Use WritableUtils.readVInt() in RegionLoad.readFields() (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238873 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:12:36 +00:00
Michael Stack 11446b1bd6 HBASE-5286 Added pointer to Lars Hofhansl's blog describing his attempt at adding a '...column prefix delete marker'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238843 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 22:44:20 +00:00
Zhihong Yu b246e68435 HBASE-5259 Normalize the RegionLocation in TableInputFormat by the reverse DNS lookup (Liyin Tang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238774 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 19:52:58 +00:00
Zhihong Yu 650b321396 HBASE-5290 [FindBugs] Synchronization on boxed primitive (Ben West)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238693 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 16:52:51 +00:00
Zhihong Yu 093c7203e8 HBASE-5297 Update metrics numOpenConnections and callQueueLen directly in HBaseServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238114 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 00:37:29 +00:00
Doug Meil fa1fe609a5 ops_mgt.xml - updating metrics descriptions (block cache, fs latency)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1237994 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 20:46:05 +00:00
mbautin e06a31d62b [jira] [HBASE-5274] Filter out expired scanners on compaction as well
Summary: This is a followup for D1017 to make it similar to D909 (89-fb). The
fix for 89-fb used the TTL-based scanner filtering logic on both normal scanners
and compactions, while the trunk fix D1017 did not. This is just the delta
between the two diffs that brings filtering expired store files on compaction to
trunk.

Test Plan: Unit tests

Reviewers: Liyin, JIRA, lhofhansl, Kannan

Reviewed By: Liyin

CC: Liyin, tedyu, Kannan, mbautin, lhofhansl

Differential Revision: https://reviews.facebook.net/D1473

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236483 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 01:23:37 +00:00
Jonathan Hsieh 36788d1cc2 HBASE-5282 Possible file handle leak with truncated HLog file
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236445 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:30:47 +00:00
Zhihong Yu da1443d90a HBASE-5271 Result.getValue and Result.getColumnLatest return the wrong column (Ghais Issa)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:51:33 +00:00
mbautin ec1c804fc1 [jira] [HBASE-4218] HFile data block encoding framework and delta encoding
implementation (Jacek Midgal, Mikhail Bautin)

Summary:

Adding a framework that allows to "encode" keys in an HFile data block. We
support two modes of encoding: (1) both on disk and in cache, and (2) in cache
only. This is distinct from compression that is already being done in HBase,
e.g. GZ or LZO. When data block encoding is enabled, we store blocks in cache
in an uncompressed but encoded form. This allows to fit more blocks in cache
and reduce the number of disk reads.

The most common example of data block encoding is delta encoding, where we take
advantage of the fact that HFile keys are sorted and share a lot of common
prefixes, and only store the delta between each pair of consecutive keys.
Initial encoding algorithms implemented are DIFF, FAST_DIFF, and PREFIX.

This is based on the delta encoding patch developed by Jacek Midgal during his
2011 summer internship at Facebook. The original patch is available here:
https://reviews.apache.org/r/2308/diff/.

Test Plan: Unit tests. Distributed load test on a five-node cluster.

Reviewers: JIRA, tedyu, stack, nspiegelberg, Kannan

Reviewed By: Kannan

CC: tedyu, todd, mbautin, stack, Kannan, mcorgan, gqchen

Differential Revision: https://reviews.facebook.net/D447



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236031 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 02:58:57 +00:00
mbautin 07dbe903de HBASE-5230 : ensure that compactions do not cache-on-write data blocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235882 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 19:41:07 +00:00
Michael Stack 6bcf607630 More home page edits and ref to favicon.ico
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235539 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 22:54:05 +00:00
Zhihong Yu f20083b193 HBASE-4720 revert until agreement is reached on solution
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235388 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:17:23 +00:00
Zhihong Yu f4872ddd1f HBASE-4720 Implement atomic update operations (checkAndPut, checkAndDelete) for REST client/server (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235362 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:19:59 +00:00
Michael Stack 5095b451e4 HBASE-5264 Add 0.92.0 upgrade guide
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235062 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 23:27:05 +00:00
Michael Stack a56613fd71 Add Riley's slow query doc from hbase-4117
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235023 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:06:03 +00:00
Zhihong Yu 59b1b68d12 HBASE-5255 Use singletons for OperationStatus to save memory (Benoit)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235016 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:56:45 +00:00
Doug Meil de42b015a4 hbase-5260. troubleshooting.xml - fixed incorrect XML tag
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 19:04:10 +00:00
Zhihong Yu 35a60f187d HBASE-5139 Addendum handles startRow being null for the case where median is in the first region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234903 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 17:07:45 +00:00
Michael Stack e453c3c46d Add hbasecon2012 to news on front page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234681 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 05:00:28 +00:00
Doug Meil 5e0bc5edb5 hbase-5254 book.xml. Arch/Regions, added link to troubleshooting section on hbase objects on HDFS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234679 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 03:12:52 +00:00
Doug Meil 927e1eec6d hbase-5253 book.xml - adding chart of object heirarchy in Arch/Regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234677 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 03:03:39 +00:00
Doug Meil 8f90bbef96 hbase-5252. book.xml, added section in Data Model about joins
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234674 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 02:27:54 +00:00
Michael Stack d8610080d2 Edit of the mailing list/search archive section
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234636 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 22:25:50 +00:00
Michael Stack 3724f4859b Formatting fix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234620 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 21:34:56 +00:00
ramkrishna 3331341429 HBASE-5243 LogSyncerThread not getting shutdown waiting for the interrupted flag (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234559 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:43:16 +00:00
ramkrishna fbf165d347 HBASE-5235 HLogSplitter writer thread's streams not getting closed when any of the writer threads has exceptions.(Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234509 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 13:20:15 +00:00
Zhihong Yu da0f65de98 HBASE-5246 Regenerate code with thrift 0.8.0 (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234445 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 01:52:49 +00:00
ramkrishna fc8d2fe645 HBASE-5237 Addendum for HBASE-5160 and HBASE-4397 (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234377 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 17:47:08 +00:00
Andrew Kyle Purtell 7436e93ee9 HBASE-5228. [REST] Rip out transform feature
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 18:06:34 +00:00
Doug Meil c06edb6808 performance.xml - added another paragraph in "One Hot Region" section.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233610 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:31:16 +00:00
Doug Meil 7e363179c3 hbase-5233. [book] configuration.xml - adding example of /etc/hosts for loopback ip config
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233602 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:15:55 +00:00
Zhihong Yu 8ebcadd679 HBASE-5223 TestMetaReaderEditor is missing call to CatalogTracker.stop()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233101 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 22:43:55 +00:00
Zhihong Yu 1c8829e0ad HBASE-5208 Allow setting Scan start/stop row individually in TableInputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233071 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 21:22:49 +00:00
Doug Meil c5cea96fbd hbase-5227. [book] book.xml, troubleshooting.xml - added caution about rowlocks.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 16:55:38 +00:00
Doug Meil 22bc7c8231 hbase-5226. troubleshooting.xml, client section: adding reference to client slowdown due to admin API calls.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232947 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 16:22:02 +00:00
Zhihong Yu 9b1e9d3c29 HBASE-5176 AssignmentManager#getRegion: logging nit adds a redundant '+' (Karthik K)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232567 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 20:40:26 +00:00
Doug Meil ef4eb46d9f hbase-5220 troubleshooting.xml - zkcli info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232559 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 20:07:35 +00:00
larsh 01246cdc99 HBASE-5203 Group atomic put/delete operation into a single WALEdit to handle region server failures. (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232551 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 19:38:13 +00:00
Doug Meil 25dc6b2530 hbase-5218 book.xml - Arch/HFile, added link to HFile v2 info in appendix from this section.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232547 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 19:29:53 +00:00
Doug Meil 51b31b05da hbase-5216 book.xml - added detail on Arch "when to use hbase" section
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232524 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 18:29:00 +00:00
Zhihong Yu c0d127fcb2 HBASE-5201 Add new files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232506 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:49:34 +00:00
Zhihong Yu 916b3a166c HBASE-5201 Utilize TThreadedSelectorServer and remove redundant code in ThriftServer and HRegionThriftServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232504 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:38:58 +00:00
Zhihong Yu 174248a26f HBASE-5153 revert due to failed Jenkins builds
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232490 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:15:23 +00:00
Doug Meil 27bf216d9c [book] book.xml, ops_mgt.xml additional clarification that compaction does not do region merging
also, added link to script in HBASE-1621 in Ops Mgt chapter.

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232408 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 13:32:33 +00:00
Michael Stack e04919de09 Update version on hadoop versions to include note on hadoop 1.0.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232308 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 05:15:44 +00:00
Zhihong Yu 5ce4d352de HBASE-5153 Add retry logic in HConnectionImplementation#resetZooKeeperTrackers (Jieshan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232292 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 04:06:30 +00:00
Michael Stack e20aa2b3a6 HBASE-5204 Backward compatibility fixes for 0.92
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231985 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 13:08:54 +00:00
larsh 323d17d3ae HBASE-3584 Allow atomic put/delete in one call (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231441 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 04:59:44 +00:00
Zhihong Yu a9c183ff98 HBASE-5150 Failure in a thread may not fail a test, clean up log splitting test (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231364 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:44:03 +00:00
Michael Stack 0876497eb9 HBASE-5193 Use TBoundedThreadPoolServer in HRegionThriftServer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:23:52 +00:00
Zhihong Yu ee03d1626d HBASE-5196 Failure in region split after PONR could cause region hole (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231302 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:17:30 +00:00
Zhihong Yu 8d07130c67 HBASE-5143 Fix config typo in pluggable load balancer factory (Harsh J)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231281 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 20:07:40 +00:00
Michael Stack 240e30c4ab Meetup at ebay
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231193 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 17:16:09 +00:00
Michael Stack 1962888156 HBASE-5115 Change HBase color from purple to 'International Orange (Engineering)'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230854 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 01:21:52 +00:00
Doug Meil 31044826da hbase-5188 - ops_mgt.xml added comments about configuring Scan caching for builtin utilities
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230760 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 20:28:11 +00:00
Doug Meil 67b8b3356d hbase-5187. [book] configuration.xml, troubleshooting.xml loopback IP config info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230739 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 20:02:26 +00:00
Zhihong Yu 1df784d11a HBASE-5177 Differential Revision: 1197 HTable needs a non cached version of getRegionLocation (Pritam Damania)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230725 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:46:32 +00:00
Doug Meil dfe54a9c92 hbase-5185 book.xml - trivial rename of section heading "Client Filters" to "Client Request Filters"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230649 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 17:19:53 +00:00
Zhihong Yu f90f4971bd HBASE-5033 Differential Revision: 933 Opening/Closing store in parallel to reduce region open/close time (Liyin)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 01:19:26 +00:00
Michael Stack 06ca87ae87 HBASE-5182 TBoundedThreadPoolServer threadKeepAliveTimeSec is not configured properly
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230306 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:52:57 +00:00
Doug Meil d44d06f48e hbase-5129 [BOOK] configuration.xml - changed the major compaction disable instruction from Long.MAX_VALUE to 0.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230277 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:06:01 +00:00
Doug Meil ce09411591 hbase-5180 book.xml - the scanner example wasn't closing the ResultScanner. That's not good practice.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230271 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 21:54:23 +00:00
Zhihong Yu 5ad571ab6c HBASE-5139 Compute (weighted) median using AggregateProtocol
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230200 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:24:48 +00:00
Zhihong Yu 39a1e07ce4 HBASE-3565 Add metrics to keep track of slow HLog appends (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230188 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:02:28 +00:00
Zhihong Yu 97579d4019 HBASE-5163 TestLogRolling#testLogRollOnDatanodeDeath fails sometimes on Jenkins or hadoop QA ("The directory is already locked.") (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230077 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 14:58:46 +00:00
larsh 15c62ed21a HBASE-5121 MajorCompaction may affect scan's correctness (chunhui shen and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229806 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:39:57 +00:00
Michael Stack 9cbf9e9f4e HBASE-5172 HTableInterface should extend java.io.Closeable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 19:21:40 +00:00
Michael Stack 94342eea88 HBASE-5134 Remove getRegionServerWithoutRetries and getRegionServerWithRetries from HConnection Interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229683 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 18:52:43 +00:00
ramkrishna e06aaf4ecc HBASE-5137 MasterFileSystem.splitLog() should abort even if waitOnSafeMode() throws IOException(Ram & Ted)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229649 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 17:33:49 +00:00
Zhihong Yu 296cf139aa HBASE-5152 Region is on service before completing initialization when doing rollback of split,
it will affect read correctness (Chunhui)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229418 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 23:22:37 +00:00
Michael Stack 5b4f692019 add link to cloudera post that describes how hadoop versions relate
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229270 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 17:31:59 +00:00
Todd Lipcon 8c2a573d48 HBASE-3949. Add "Master" link to RegionServer pages. Contributed by Gregory Chanan.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229035 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 05:43:40 +00:00
larsh dd604d3136 HBASE-5088 addendum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228761 13f79535-47bb-0310-9956-ffa450edef68
2012-01-08 01:18:53 +00:00
Michael Stack d821f6fcfc HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REDO
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228749 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:47:56 +00:00
Michael Stack 45b7b8955b HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REVERT. OVER-COMMITTED. REVERTING ALL SO CAN REDO COMMIT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228747 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:46:31 +00:00
Michael Stack 25d465426a HBASE-5052 The path where a dynamically loaded coprocessor jar is copied on the local file system depends on the region name (and implicitly, the start key)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228742 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:20:45 +00:00
Michael Stack 492feb2a53 HBASE-5141 Memory leak in MonitoredRPCHandlerImpl
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228740 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:16:11 +00:00
larsh 7624bcba26 HBASE-5088 A concurrency issue on SoftValueSortedMap (Jieshan Bean and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228539 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 01:40:07 +00:00
Zhihong Yu 28bbeb76c2 HBASE-5041 Major compaction on non existing table does not throw error (Shrijeet)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228507 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 00:10:41 +00:00
Zhihong Yu 30a0a2c6d6 HBASE-4357 Region stayed in transition - in closing state (Ming Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228489 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 22:55:36 +00:00
Zhihong Yu ff3cf1aeda HBASE-5081 Distributed log splitting deleteNode races against splitLog retry (Prakash)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227951 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 03:53:58 +00:00
Zhihong Yu c3d7b8ec19 HBASE-3373 Allow regions to be load-balanced by table
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227873 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 22:22:19 +00:00
Jean-Daniel Cryans d619a545e0 HBASE-5127 [ref manual] Better block cache documentation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227425 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:35:37 +00:00
larsh 771022eed9 HBASE-5118 Fix Scan documentation (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227419 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:17:28 +00:00
larsh 49f35a7756 HBASE-2947 MultiIncrement/MultiAppend (JGray and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227382 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 23:16:54 +00:00
Zhihong Yu b549283c78 HBASE-5114 TestMetaReaderEditor can timeout during test execution
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226269 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 17:46:53 +00:00
Zhihong Yu c0c6500436 HBASE-4822 disabling testAggregation for now
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226262 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 16:51:07 +00:00
Zhihong Yu 41e3540ab2 HBASE-5064 utilize surefire tests parallelization, second attempt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226255 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 15:22:43 +00:00
ramkrishna ebc3945450 HBASE-5094 The META can hold an entry for a region with a different server name from the one actually in the AssignmentManager thus making the region inaccessible. (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226165 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 18:37:08 +00:00
Zhihong Yu 453de3a66c HBASE-4397 -ROOT-, .META. tables stay offline for too long in recovery phase after all RSs
are shutdown at the same time (Ming Ma)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226110 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 15:43:19 +00:00
Zhihong Yu ceafb4aab8 HBASE-5105 TestImportTsv failed with hadoop 0.22 (Ming Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226103 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 15:36:14 +00:00
Zhihong Yu 50d332606d HBASE-5064 revert - need to figure out which test caused surefire to report timeout
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226101 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 15:25:58 +00:00
Zhihong Yu 497b4e781d HBASE-5113 TestDrainingServer expects round robin region assignment but misses a
config parameter


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226087 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 13:41:55 +00:00
Zhihong Yu d499eedb3c HBASE-5064 utilize surefire tests parallelization (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226083 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 13:35:28 +00:00
Zhihong Yu 10e6defda5 HBASE-5112 TestReplication#queueFailover flaky due to potentially
uninitialized Scan (Jimmy Xiang)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226039 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 05:03:49 +00:00
Zhihong Yu ddd384369f HBASE-5100 Rollback of split could cause closed region to be opened again (Chunhui)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226029 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 02:45:18 +00:00
Zhihong Yu a2471aa255 HBASE-5099 ZK event thread waiting for root region assignment may block server
shutdown handler for the region sever the root region was on (Jimmy)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225765 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 06:39:07 +00:00
Zhihong Yu 315c91901f HBASE-5103 Fix improper master znode deserialization (Jonathan Hsieh)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225622 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 19:08:38 +00:00
Zhihong Yu 270122168b HBASE-5009 Failure of creating split dir if it already exists prevents splits from happening further
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225153 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 10:07:31 +00:00
larsh 2dcc010d36 HBASE-5096 Replication does not handle deletes correctly. (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224851 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 01:44:14 +00:00
Zhihong Yu c8ddab6962 HBASE-5010 Filter HFiles based on TTL - add TestScannerSelectionUsingTTL
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224793 13f79535-47bb-0310-9956-ffa450edef68
2011-12-26 19:35:10 +00:00
Zhihong Yu 2fe6ab663c HBASE-5010 Filter HFiles based on TTL (Mikhail)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224792 13f79535-47bb-0310-9956-ffa450edef68
2011-12-26 19:33:51 +00:00
Zhihong Yu 300f900354 HBASE-4218 Data Block Encoding of KeyValues - revert, problems were uncovered during cluster testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223042 13f79535-47bb-0310-9956-ffa450edef68
2011-12-25 02:49:46 +00:00
Zhihong Yu 499d11b741 HBASE-5070 Constraints implementation and javadoc changes (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223024 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:42:31 +00:00
Zhihong Yu 73e8383359 HBASE-4218 Data Block Encoding of KeyValues (aka delta encoding / prefix compression) - files used for testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223021 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:24:38 +00:00
Zhihong Yu cd47ea0562 HBASE-4218 Data Block Encoding of KeyValues (aka delta encoding / prefix compression) (Jacek, Mikhail)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223020 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:20:39 +00:00
Zhihong Yu 0c9fad8f6b HBASE-4938 Create a HRegion.getScanner public method that allows reading from a specified readPoint (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222890 13f79535-47bb-0310-9956-ffa450edef68
2011-12-23 23:57:55 +00:00
larsh 8b4c4f094e HBASE-4439 Move ClientScanner out of HTable (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222551 13f79535-47bb-0310-9956-ffa450edef68
2011-12-23 04:16:26 +00:00
Michael Stack 6313293e51 HBASE-5091 [replication] Update replication doc to reflect current znode structure
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222481 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 22:04:09 +00:00
Michael Stack 7569cea558 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED -- AGAINpatch -p0 -R < x.txt patch -p0 -R < x.txt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222046 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 05:44:29 +00:00
Michael Stack 6c97552ee1 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REAPPLY
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222045 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 05:42:05 +00:00
Michael Stack fa979ebab2 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221978 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 01:09:03 +00:00
Michael Stack 72c1f6c8c7 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221977 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 01:04:00 +00:00
Michael Stack 30f5a95a6a HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row; REMOVE OVER-COMMIT, STUFF NOT IN 4698 PATCH
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221621 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 06:01:26 +00:00
Michael Stack df77a4b0b3 HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221620 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 06:00:05 +00:00
Michael Stack c5b874fff0 HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS -- fix compile error
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221604 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:12:17 +00:00
Michael Stack 04dd71214a HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221601 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:06:03 +00:00
Michael Stack f000c951c6 HBASE-5078 DistributedLogSplitter failing to split file because it has edits for lots of regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221596 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:00:47 +00:00
Michael Stack cd508de041 HBASE-5021 Enforce upper bound on timestamp
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221592 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 03:51:42 +00:00
Nicolas Spiegelberg 82e376b3ea [jira] [HBase-5021] Enforce upper bound on timestamp
Summary:
We have been getting hit with performance problems on the ODS
side due to invalid timestamps being inserted by the timestamp.  ODS is
working on adding proper checks to app server, but production
performance could be severely impacted with significant recovery time if
something slips past.  Therefore, we should also allow the option to
check the upper bound in HBase.

This is the first draft.  Probably should allow per-CF customization.

Test Plan:  - mvn test -Dtest=TestHRegion#testPutWithTsTooNew

Reviewers: Kannan, Liyin, JIRA

CC: stack, nspiegelberg, tedyu, Kannan, mbautin

Differential Revision: 849

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221532 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 00:02:55 +00:00
Jean-Daniel Cryans a952738257 Fixing the link for ZK session expiration
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221527 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 23:40:10 +00:00
Nicolas Spiegelberg 9a0eb6f0c2 [jira] [HBASE-5072] Support Max Value for Per-Store Metrics
Summary:
We were bit in our multi-tenant cluster because one of our Stores
encountered a bug and grew its StoreFile count. We didn't notice this because
the StoreFile count currently reported by the RegionServer is an average of all
Stores in the region. For the per-Store metrics, we should also record the max
so we can notice outliers.

Test Plan: - mvn test -Dtest=TestRegionServerMetrics

Reviewers: JIRA, mbautin, Kannan

Reviewed By: Kannan

CC: stack, nspiegelberg, mbautin, Kannan

Differential Revision: 945

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221419 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 18:42:11 +00:00
Michael Stack 8fe40ce0e9 HBASE-5063 RegionServers fail to report to backup HMaster after primary goes down
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221121 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 06:46:17 +00:00
Michael Stack 77e16e8027 HBASE-4935 hbase 0.92.0 doesn't work going against 0.20.205.0, its packaged hadoop
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221033 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 00:10:02 +00:00
Michael Stack 1222383f1d HBASE-5029 TestDistributedLogSplitting fails on occasion; Added catch of NPE and reenabled ignored test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220991 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 23:04:15 +00:00
larsh 2062ea1d00 HBASE-5058 Allow HBaseAmin to use an existing connection (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220989 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 23:01:26 +00:00
Michael Stack 48ccb28e81 HBASE-5029 TestDistributedLogSplitting fails on occasion; disabling failing test -- redo -- forgot to import @Ignore
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220904 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 19:19:17 +00:00
Michael Stack 86a3830175 HBASE-5029 TestDistributedLogSplitting fails on occasion; disabling failing test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220894 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 18:51:10 +00:00
Michael Stack 1f8021eca9 HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220864 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 17:24:33 +00:00
Zhihong Yu 4e09ea6be8 HBASE-5060 HBase client is blocked forever (Jinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220863 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 17:24:21 +00:00
Michael Stack a46959a370 HBASE-5062 Missing logons if security is enabled
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220829 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 16:26:22 +00:00
larsh 818adb795b HBASE-4970 Add a parameter so that keepAliveTime of Htable thread pool can be changed (gaojinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220626 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 06:57:08 +00:00
Michael Stack d9c8e9954a HBASE-4934 Display Master server and Regionserver start time on respective info servers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220304 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 00:04:23 +00:00
Michael Stack 46eef1e255 HBASE-5049 TestHLogSplit.testLogRollAfterSplitStart not working due to HBASE-5006
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215371 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:48:34 +00:00
Michael Stack 3cad85bc77 HBASE-5029 TestDistributedLogSplitting fails on occasion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215370 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:40:53 +00:00
Michael Stack 324eec9a44 HBASE-5055 Build against hadoop 0.22 broken
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215356 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:13:28 +00:00
Michael Stack 175ef436b6 HBASE-4935 hbase 0.92.0 doesn't work going against 0.20.205.0, its packaged hadoop -- revert from TRUNK though this change was added as part of HBASE-4908
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215353 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:09:02 +00:00
Zhihong Yu 0c5abfccd7 HBASE-5053 HCM Tests leak connections (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215314 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 22:05:02 +00:00
Zhihong Yu 3f016b62fd HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call - revert
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215307 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 21:55:16 +00:00
Zhihong Yu 15d9af3d42 HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215236 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 18:17:32 +00:00
Kannan Muthukkaruppan 3772951b9d HBASE-5014 PutSortReducer should adhere to memory limits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214968 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 22:09:44 +00:00
Jean-Daniel Cryans 7e095fa615 HBASE-4683 Always cache index and bloom blocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214902 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:26:35 +00:00
Michael Stack e77df774eb Add note on how to do all tests w/ security profile enabled
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214901 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:22:27 +00:00
Michael Stack 82a4dedeee Add note on how to do single test w/ security profile enabled
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214900 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:20:48 +00:00
Zhihong Yu 063fa64fd5 HBASE-4605 Constraints, remove .orig files accidentally added in previous commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214892 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:52:04 +00:00
Zhihong Yu 5166afddc5 HBASE-4605 Constraints (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214889 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:44:59 +00:00
Michael Stack 52dbd69707 HBASE-5027 HConnection.create(final Connection conf) does not clone, it creates a new Configuration reading *.xmls and then does a merge.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214871 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:13:34 +00:00
Michael Stack 32490bddce HBASE-5038 Some tests leak connections
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214839 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 16:20:41 +00:00
Doug Meil 5543c548c4 hbase-5039 book.xml arch chapter fixup for regions, adding FAQ entry for architecture
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214806 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 15:17:20 +00:00
Doug Meil 37cbd5a38e hbase-5036 book.xml architecture chapter minor mods regarding region-RS assignment
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214614 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 03:56:03 +00:00
Zhihong Yu 6b60585fef HBASE-5030 Some tests do not close the HFile.Reader they use, leaving some file descriptors open (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214519 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 22:52:45 +00:00
Zhihong Yu e85d2d45d3 HBASE-5026 Add coprocessor hook to HRegionServer.ScannerListener.leaseExpired()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214431 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:57:42 +00:00
Michael Stack bade2361c9 HBASE-4993 Performance regression in minicluster creation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214419 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:39:23 +00:00
Doug Meil 685284c604 hbase-5028 book.xml - adding info on region assignment and file locality
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214412 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:14:10 +00:00
Zhihong Yu 9ed28b472c HBASE-5022 Optimize HBaseConfiguration#create (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214366 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 17:30:44 +00:00
larsh cd0c4cffa9 HBASE-5001 Improve the performance of block cache keys (Lars H and J-D)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213995 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 00:05:04 +00:00
Jean-Daniel Cryans 69b7530f60 HBASE-5017 Bump the default hfile.block.cache.size because of HFileV2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213950 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 21:55:36 +00:00
Michael Stack 4de54f3552 HBASE-5006 Move hbase 0.92RC1 on to hadoop 1.0.0RC2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213928 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 21:01:44 +00:00
Zhihong Yu 1b1725188e HBASE-5015 Remove some leaks in tests due to lack of HTable.close()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213823 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 18:21:33 +00:00
karthik 34dc2a4b66 [jira] [HBASE-4661] get list of store files.
Summary:
1. Ported getStoreFileList API to trunk.
2. Also ported flushRegion API to trunk (with option of flushing if
lastFlushTime < TS).

Test Plan: Tested on 89.

Reviewers: Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: Karthik

CC: HBase Diffs Facebook Group, Karthik, Kannan, stack, madhuvaidya

Differential Revision: 729

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213487 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:58:51 +00:00
Michael Stack 4b8eb16ea9 HBASE-4997 SplitLogManager can have a race on batch.installed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213479 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:46:33 +00:00
Michael Stack d7f1fb414c HBASE-5011 Move test-util.sh from src/test/bin to dev-tools
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213476 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:41:42 +00:00
Michael Stack f4f2d4cf01 HBASE-4965 Monitor the open file descriptors and the threads counters during the unit tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213466 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:14:27 +00:00
Michael Stack 6eb38cfbae HBASE-4965 Monitor the open file descriptors and the threads counters during the unit tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213453 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 21:48:29 +00:00
Michael Stack 747b5cb124 HBASE-4881 Unhealthy region is on service caused by rollback of region splitting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213383 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 19:24:28 +00:00
Michael Stack c7c688679a HBASE-5008 The clusters can't provide services because Region can't flush.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213358 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:43:49 +00:00
Michael Stack fe60d5dce8 HBASE-5000 Speed up simultaneous reads of a block when block caching is turned off; bit of doc and why its a bad idea disabling block cache completely
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213354 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:34:17 +00:00
Michael Stack 28ee3bf9ba HBASE-4989 Metrics to measure sequential reads and random reads separately
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213345 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:21:37 +00:00
Michael Stack 54c3a0a530 HBASE-4923 [packaging] Assembly should make only executables executable (docs should not be executable)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213108 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 23:38:42 +00:00
Michael Stack ac1657ba59 HBASE-4971 Useless sleeps in TestTimestampsFilter and TestMultipleTimestamps
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213103 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 23:17:09 +00:00
Michael Stack 756aa7ff16 HBASE-5007 HBaseAdmin.stopRegionServer do not stop the region server
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213102 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 23:05:14 +00:00
larsh a443b9f338 HBASE-5005 Add DEFAULT_MIN_VERSIONS to HColumnDescriptor.DEFAULT_VALUES
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212737 13f79535-47bb-0310-9956-ffa450edef68
2011-12-10 06:21:19 +00:00
Michael Stack 2261fc23c9 HBASE-4859 Correctly PreWarm HBCK ThreadPool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212701 13f79535-47bb-0310-9956-ffa450edef68
2011-12-10 00:40:01 +00:00
Michael Stack d855d71ba8 HBASE-4974 Remove some resources leaks on the tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212688 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 23:33:36 +00:00
larsh 3e608b3979 HBASE-4998 Support deleted rows in CopyTable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212671 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 22:39:02 +00:00
Michael Stack 1bed70fd99 HBASE-4992 Use a UUID for HFileOutputFormat partition path name
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212581 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 19:08:11 +00:00
Michael Stack 69b505b4da HBASE-4995 Increase zk maxClientCnxns to give us some head room
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212570 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 18:44:03 +00:00
Michael Stack 844819717c HBASE-4994 TestHeapSize broke in trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212549 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 17:56:12 +00:00
Michael Stack 0b0fa97084 HBASE-4969 tautology in HRegionInfo.readFields
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212259 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 06:44:51 +00:00
Michael Stack 2704cd8a57 HBASE-4987 wrong use of incarnation var in SplitLogManager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212256 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 06:16:03 +00:00
Michael Stack 307ca7c68b HBASE-4880 Region is on service before openRegionHandler completes, may cause data loss
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212251 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 05:59:34 +00:00
Zhihong Yu abf897ad42 HBASE-4946 HTable.coprocessorExec (and possibly coprocessorProxy) does not work with
dynamically loaded coprocessors (Andrei Dragomir)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212250 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 05:58:05 +00:00
larsh e167c8ab28 HBASE-4682 Support deleted rows using Import/Export (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212181 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:16:55 +00:00
larsh 14a266fb6c HBASE-4981 add raw scan support to shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212178 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:01:08 +00:00
Michael Stack c1ae21cc93 HBASE-4980 Null pointer exception in HBaseClient receiveResponse
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212167 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:17:37 +00:00
Michael Stack 1f12fbf6d3 HBASE-4973 On failure, HBaseAdmin sleeps one time too many
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212165 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:14:04 +00:00
Doug Meil c5cf90b09d hbase-4986 index.html - fixed a nit grammatical error in describing BigTable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212142 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 21:49:03 +00:00
Doug Meil badf636b13 hbase-4984 index.html. adding link to arch overview in More Info section.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212005 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 17:55:42 +00:00
Doug Meil e87af46b02 hbase-4983. index.html: one correction, one change, one addition.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211942 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 16:12:39 +00:00
larsh 0418f67d37 HBASE-4979 Setting KEEP_DELETE_CELLS fails in shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211768 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 06:43:41 +00:00
Michael Stack 34df21c7a4 Added troubleshooting section on running hbase on other than the hadoop it ships with
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211758 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 05:11:36 +00:00
Nicolas Spiegelberg 09d0aff149 [jira] [HBASE-4908] HBase cluster test tool (port from 0.89-fb)
Summary:
Porting one of our HBase cluster test tools (a single-process multi-threaded
load generator and verifier) from 0.89-fb to trunk.
I cleaned up the code a bit compared to what's in 0.89-fb, and discovered that
it has some features that I have not tried yet (some kind of a kill test, and
some way to run HBase as multiple processes on one machine).
The main utility of this piece of code for us has been the HBaseClusterTest
command-line tool (called HBaseTest in 0.89-fb), which we usually invoke as a
load test in our five-node dev cluster testing, e.g.:

hbase org.apache.hadoop.hbase.util.LoadTestTool -write 50💯20 -tn loadtest4
-read 100:10 -zk <zk_quorum_node> -bloom ROWCOL -compression LZO -key_window 5
-max_read_errors 10000 -num_keys 10000000000 -start_key 0

Test Plan:
Run this on a dev cluster. Run all unit tests.

Reviewers: stack, Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: stack, nspiegelberg, mbautin, Karthik

Differential Revision: 549

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211746 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:38:27 +00:00
Michael Stack 77dae7ccb7 HBASE-4976 Add compaction/flush queue size metrics mistakenly removed by HFile v2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211719 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 00:11:26 +00:00
Zhihong Yu f4ef4485a7 HBASE-4610 Addendum removes break statement
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211706 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 23:38:06 +00:00
Zhihong Yu 7a36cab817 HBASE-4610 Port HBASE-3380 (Master failover can split logs of live servers) to 92/trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211695 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 22:59:06 +00:00
Michael Stack 7af49fc56d HBASE-4712 Document rules for writing tests; Addendum via Jesse Yates
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211652 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 21:48:30 +00:00
Zhihong Yu bb7f82ac71 HBASE-4927 Addendum fixes case where start key is empty and end key is empty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211632 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 21:05:59 +00:00
Michael Stack 888fad5f0d HBASE-4968 Add to troubleshooting workaround for direct buffer oome's.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211254 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 01:18:24 +00:00
Michael Stack f349a155af Add how to build against hadoop 0.22/0.23
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211246 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 00:36:18 +00:00
Michael Stack dc104e7669 HBASE-4936 Cached HRegionInterface connections crash when getting UnknownHost exceptions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211232 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 23:48:13 +00:00
Michael Stack 83107d86d5 HBASE-4937 Error in Quick Start Shell Exercises
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211227 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 23:26:14 +00:00
Michael Stack bfa4e138c7 HBASE-4376 Document mutual authentication between HBase and Zookeeper using SASL
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211224 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 23:13:37 +00:00
Michael Stack 1f176022fe HBASE-4927 CatalogJanior:SplitParentFirstComparator doesn't sort as expected, for the last region when the endkey is empty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211204 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:15:11 +00:00
Michael Stack cb4320232d HBASE-4729 Clash between region unassign and splitting kills the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211197 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:02:10 +00:00
Michael Stack ff8e1a53c5 HBASE-4712 Document rules for writing tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211187 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 21:48:56 +00:00
Michael Stack 1f8162e80c HBASE-4964 Add builddate, make less sections in toc, and add header and footer customizations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210795 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 06:43:54 +00:00
Nicolas Spiegelberg e1bfdf16a4 HBASE-4440 add an option to presplit table to PerformanceEvaluation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210752 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 02:34:00 +00:00
Nicolas Spiegelberg 9498f9baf3 HBASE-4860 RegionSplitter Should Allow NSFRE during logical split verification
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210699 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 23:14:31 +00:00
Nicolas Spiegelberg 806ccf03dd HBASE-4932 Block cache can be mistakenly instantiated by tools
Summary: disable block cache for HFile writers created for tools

Test Plan:
ran the following tests that call getWriterFactory

test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFilePerformance.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileSeek.java
test/java/org/apache/hadoop/hbase/io/hfile/TestReseekTo.java
test/java/org/apache/hadoop/hbase/io/hfile/TestSeekTo.java
test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java
test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java
test/java/org/apache/hadoop/hbase/regionserver/TestHRegionServerBulkLoad.java
test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALReplay.java

Reviewers: dhruba, jgray, nspiegelberg, JIRA, mbautin

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, mbautin, khemani, nspiegelberg

Differential Revision: 573

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210697 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 23:01:48 +00:00
Doug Meil 2e4ae76616 hbase-4959. site.xml, adding left-hand nav for videos/pres. book.xml, nit capitalization fix.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210645 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:20:40 +00:00
Michael Stack 7ba1306e5b HBASE-4847 Activate single jvm for small tests on jenkins
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210643 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:20:04 +00:00
Nicolas Spiegelberg b955fa6c32 Ability to calculate the blockcache hit ratio for the last few minutes
Summary:
The metric blockcacheHitRatio is since the beginning of time. It would be nice
to calculate the block cache hit ratio for the past few minutes.

This patch remembers the blockcacheHitRatio for the last 5 periods by default.

Test Plan: unit test attached.

Reviewers: jgray, khemani, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, dhruba

Differential Revision: 585

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210640 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:17:47 +00:00
Doug Meil c1ac1f4d80 hbase-4958 book.xml, troubleshooting.xml, external_apis.xml several cleanup items.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210608 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 20:24:18 +00:00
Andrew Kyle Purtell d9f39151c5 HBASE-4944. Optionally verify bulk loaded HFiles
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210311 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 02:20:55 +00:00
Zhihong Yu 5021d29ef4 HBASE-4942 HMaster is unable to start of HFile V1 is used (Honghua Zhu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210303 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 01:11:10 +00:00
Doug Meil 1a2ea74705 hbase-4950. book.xml, corrected BigTable link throughout paper (it was actually producing 404 from Google Labs)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210290 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 00:13:12 +00:00
Doug Meil c7d0ae2692 hbase-4949. book.xml, more links for "more information about hbase"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210216 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:56:20 +00:00
larsh 8fe805ce29 HBASE-4945 NPE in HRegion.bulkLoadHFiles (Andrew P and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210212 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:54:37 +00:00
Doug Meil f547de07c8 hbase-4948. book.xml, adding more links to resources in appendix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210189 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 19:57:09 +00:00
Doug Meil ca79114d4c hbase-4943. book updates (more FAQ, add to appendix for other resources)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210010 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 21:28:58 +00:00
Doug Meil 73b59715e9 hbase-4941. Fixed mis-spelling of 'configuration' in 2 places (configuration.xml and hbase-default.xml)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209912 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 13:53:48 +00:00
Doug Meil 7df968e09a hbase-4939 book.xml (architecture/faq), troubleshooting.xml (created resources section)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209688 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 20:57:35 +00:00
Doug Meil b3d87416d2 hbase-4930. home page (index.html) reformat.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209684 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 20:40:51 +00:00
Michael Stack 5a0f0313b9 HBASE-4899 Region would be assigned twice easily with continually killing server and moving region in testing environment
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209367 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 05:55:25 +00:00
Doug Meil dbb016a527 hbase-4928. overhauled FAQ in book.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209233 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 20:46:53 +00:00
Michael Stack 1e2757e33b HBASE-4918 HTablePool Constructor may cause unintended behavior
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209210 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 19:44:53 +00:00
larsh 9581eea546 HBASE-4903 Return a result from RegionObserver.preIncrement (Daniel Gómez Ferro)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208952 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 05:06:24 +00:00
karthik 50de126b79 HBASE-4463 [jira] Run more aggressive compactions during off peak hours
Summary:
HBASE-4463 Run more aggressive compactions during off peak hours

Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at any
point.

The number of iops on the disk and the top of the rack bandwidth utilization at
off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.

Test Plan: Started running the unit tests.

Reviewers: JIRA, Kannan, nspiegelberg, mbautin, stack

Reviewed By: nspiegelberg

CC: nspiegelberg, tedyu, lhofhansl, Karthik

Differential Revision: 471

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208885 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 23:42:21 +00:00
karthik a9ca67a2c5 [jira] [HBASE-4867] A tool to merge configuration files
Summary: With our cluster configuration setup it would be good to have a tool
that would merge HBase configuration files so that files appearing later in the
list would override properties specified in earlier files. This way we could
merge an application-specific configuration file with a cluster-specific
configuration file (with the latter overriding the former) and produce a single
HBase configuration file to install on the cluster.

Test Plan: Run the tool on two configuration files (common and
cluster-specific). Use the resulting configuration on a dev cluster.

Reviewers: todd, Karthik, tedyu, stack, JIRA

Reviewed By: Karthik

CC: Karthik, mbautin, todd

Differential Revision: 537

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208832 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 22:12:22 +00:00
Todd Lipcon 54e463f519 HBASE-4820. Distributed log splitting coding enhancement to make it easier to understand, no semantics change. Contributed by Jimmy Xiang.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208801 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 21:28:36 +00:00
Doug Meil b290b43264 hbase-4906 book.xml - repatch of MR to RDBMS example. fixed typo missed in first patch.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208671 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 18:34:58 +00:00
Doug Meil c4078275ea hbase-4906. book.xml. added MR summary to RDBMS section in MR chapter.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208654 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 18:30:10 +00:00
Doug Meil 338e4d602c hbase-4905. book.xml (keyvalue types), ops_mgt.xml (metrics corrections)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208495 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 16:32:58 +00:00
Doug Meil d11ddc0622 hbase-4898. book.xml (1 correction in no-reducer summary)
troubleshooting.xml 1 addition for MapReduce related documentation.

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208230 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 03:08:14 +00:00
Doug Meil a0cce57e46 hbase-4897 book.xml (clarified scan example), troubleshooting.xml (mr example)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208225 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 02:48:58 +00:00
karthik 99263fecfc HBASE-4721 Retain Delete Markers after Major Compaction
Summary: major compactions *try* to retain delete markers for the configured
time interval

Test Plan:
added a new test testDeleteMarkerLongevity() in TestStoreScanner

following tests passed
TestMemStore
TestStoreScanner
TestQueryMatcher
TestCompaction

Reviewers: jgray, dhruba, lhofhansl, Karthik, nspiegelberg

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, lhofhansl, khemani, nspiegelberg

Differential Revision: 321

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208055 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 20:31:57 +00:00
Doug Meil a10fb0ccad hbase-4892 book.xml, ops_mgt.xml book changes.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208028 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 19:08:17 +00:00
Michael Stack 8db322ebdd HBASE-4889 HRegionInfo.isMetaTable() should be true for -ROOT- regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208006 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 18:29:31 +00:00
Michael Stack e0a283fa3c HBASE-4885 Building against Hadoop 0.23 uses out-of-date MapReduce artifacts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207763 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 06:04:17 +00:00
larsh 01652cecb9 HBASE-4886 - truncate fails in HBase shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207651 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 22:12:25 +00:00
Michael Stack 01c389c879 HBASE-4883 TestCatalogTracker failing for me on ubuntu
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207639 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 21:49:58 +00:00
Zhihong Yu bdc28714e1 HBASE-4878 Master crash when splitting hlog may cause data loss (Chunhui Shen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207560 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 20:10:58 +00:00
Michael Stack 228ebc64d8 HBASE-4877 TestHCM failing sporadically on jenkins and always for me on an ubuntu machine
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207491 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 18:22:18 +00:00
Zhihong Yu d88f53bced HBASE-4773 HBaseAdmin may leak ZooKeeper connections (Xufeng)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207297 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 15:30:55 +00:00
Zhihong Yu b1159115a4 HBASE-4862 Splitting hlog and opening region concurrently may cause data loss
(Chunhui Shen)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206965 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 02:35:35 +00:00
Zhihong Yu 26a4ab4a15 HBASE-4868 TestOfflineMetaRebuildBase#testMetaRebuild occasionally fails
(Gao Jinchao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206755 13f79535-47bb-0310-9956-ffa450edef68
2011-11-27 16:21:10 +00:00
Zhihong Yu f584f12260 HBASE-4833 HRegionServer stops could be 0.5s faster (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206490 13f79535-47bb-0310-9956-ffa450edef68
2011-11-26 16:50:35 +00:00
Zhihong Yu 6ce8bf9130 HBASE-4832 TestRegionServerCoprocessorExceptionWithAbort fails if the region server stops too fast
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206462 13f79535-47bb-0310-9956-ffa450edef68
2011-11-26 15:46:18 +00:00
Zhihong Yu 7dd0694984 HBASE-4863 Addendum to add category for TestThreads
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206369 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 23:05:27 +00:00
Doug Meil ec4ebc7ee3 HBASE-4871 hbase book. docs cleanup.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206362 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 22:20:48 +00:00
Doug Meil 66e47a99f9 HBASE-4870 developer.xml, integration test info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206318 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 20:58:01 +00:00
Zhihong Yu 91a19bf59a HBASE-4863 Phabricator D531 Make Thrift server thread pool bounded and add a command-line UI test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206267 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 17:26:40 +00:00
Zhihong Yu 3ba5e7b318 HBASE-4855 SplitLogManager hangs on cluster restart due to batch.installed doubly counted
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205959 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 19:03:46 +00:00
Zhihong Yu 5392c55cf6 HBASE-4864 TestMasterObserver#testRegionTransitionOperations occasionally
fails (Gao Jinchao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205872 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 15:17:38 +00:00
Michael Stack 8d056194e1 HBASE-4861 Fix some misspells and extraneous characters in logs; set some to TRACE
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205732 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 06:13:10 +00:00
Michael Stack fc20e56a0f HBASE-4853 HBASE-4789 does overzealous pruning of seqids
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205722 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 04:24:56 +00:00
Michael Stack aaabb3e8a5 HBASE-4853 HBASE-4789 does overzealous pruning of seqids; REVERT TEMPORARILY TO GET TED COMMENT IN
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205721 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 04:22:05 +00:00
Michael Stack 054c0a2418 HBASE-4853 HBASE-4789 does overzealous pruning of seqids
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205719 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 04:13:09 +00:00
Zhihong Yu 2c1c5223f4 HBASE-4739 Master dying while going to close a region can leave it in transition
forever (Gao Jinchao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205706 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 02:09:09 +00:00
Nicolas Spiegelberg 2fb8275da0 HBASE-4787 Rename HTable thread pool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205684 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 00:46:05 +00:00
karthik a01617ba90 HBASE-4772 Utility to Create StoreFiles
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205661 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 23:34:09 +00:00
Nicolas Spiegelberg 0d73a879b3 HBASE-4785 Improve recovery time of HBase client when a region server dies.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205656 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 23:21:47 +00:00
ramkrishna 42104d08f2 HBASE-4308 Race between RegionOpenedHandler and AssignmentManager(Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205513 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:03:10 +00:00
Nicolas Spiegelberg 10407c9a16 HBASE-4783 Improve RowCounter to count rows in a specific key range.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205510 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 17:48:26 +00:00
Zhihong Yu 351e75629f HBASE-4797 [availability] Skip recovered.edits files with edits we know older than what region currently has (Jimmy Jiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205290 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 05:23:45 +00:00
Michael Stack a5c87acadd HBASE-4842 [hbck] Fix intermittent failures on TestHBaseFsck.testHBaseFsck
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205101 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 17:41:19 +00:00
Michael Stack 2229f7e016 HBASE-4849 TestCatalogTracker can fail if an existing zookeeper running
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205093 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 17:31:05 +00:00
Michael Stack 8cc1870f6f HBASE-4825 TestRegionServersMetrics and TestZKLeaderManager are not categorized (small/medium/large); ADDENDUM; PARTIAL REVERT; MISTAKENLY COMMITTED TestCatalogTracker change
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205091 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 17:28:06 +00:00
Michael Stack 986a2f553c HBASE-4825 TestRegionServersMetrics and TestZKLeaderManager are not categorized (small/medium/large)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205090 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 17:26:00 +00:00
Michael Stack d6d1ee0a45 HBASE-4848 TestScanner failing because hostname can't be null
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205084 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 17:08:27 +00:00
Nicolas Spiegelberg 9f7557729c HBASE-4808 Test to Ensure Expired Deletes Don't Override Puts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204802 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 03:56:59 +00:00
Nicolas Spiegelberg 4a2bea25be [jira] [HBASE-4809] Per-CF set RPC metrics
Summary: Porting RPC metrics incremented for each column family set touched by a
request from 0.89-fb.

Test Plan:
Unit tests, 5-node cluster. Observe metrics through JMX.
The current version of patch compiles but no testing done yet.

Reviewers: nspiegelberg, JIRA, Kannan, Karthik

Reviewed By: nspiegelberg

CC: nspiegelberg, mbautin

Differential Revision: 483

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204799 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 03:48:58 +00:00
Michael Stack 23532b3538 HBASE-4798 Sleeps and synchronisation improvements for tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204769 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 01:04:40 +00:00
Zhihong Yu bba38d9a5f HBASE-4213 Addendum disables testInstantSchemaOperationsInZKForMasterFailover which didn't fail on PreCommit but failed on Jenkins
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204667 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:45:24 +00:00
Doug Meil 211553dd35 HBASE-4837 book.xml, schema design
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204627 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 18:11:49 +00:00
Zhihong Yu 7a8c36be23 HBASE-4213 Support for fault tolerant, instant schema updates with out master's intervention through ZK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204611 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 17:29:32 +00:00
Andrew Kyle Purtell 46b1b65cc7 HBASE-2418 Support for ZooKeeper authentication
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204227 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 19:46:21 +00:00
Andrew Kyle Purtell 35981f50f9 HBASE-4827 TestAdmin should clean up resources after tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204097 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 22:16:47 +00:00
Michael Stack 72c3a34146 HBASE-4829 Fix javadoc warnings in 0.92 branch
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204094 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 22:11:17 +00:00
Michael Stack d47fd50da1 HBASE-4828 Fix failing TestShell, needs same addendum as HBASE-4815 got
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204083 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 21:48:25 +00:00
Michael Stack d7d32fa80e Added link to meetup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204038 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 18:42:59 +00:00
Michael Stack b4c79fc418 Edit of our hadoop versions section
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204037 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 18:41:22 +00:00
Michael Stack 39d7828814 HBASE-4789 On split, parent region is sticking around in oldest sequenceid to region map though not online; we don't cleanup WALs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204034 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 18:27:51 +00:00
Zhihong Yu ef6ba2db03 HBASE-4815 Addendum sets "hbase.online.schema.update.enable" to true
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203965 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 11:29:12 +00:00
Michael Stack eba8dab3ec HBASE-4436 Remove @deprecated Scan methods in 0.90 from TRUNK and 0.92
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203959 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 04:45:14 +00:00
Michael Stack 95d22b9dc5 HBASE-4256 Intra-row scanning (part deux)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203957 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 04:40:29 +00:00
Michael Stack c42e7e1028 HBASE-4815 Disable online altering by default, create a config for it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203916 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 00:26:59 +00:00
Gary Helmling cc7e469310 HBASE-3025 Security: coprocessor based access control
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203909 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 00:15:27 +00:00
Gary Helmling a2de91f85b Amend HBASE-2742 Fix intermittent TestZKLeaderManager failure
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203841 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 21:08:38 +00:00
Michael Stack b5f5e2aeeb HBASE-4816 Regionserver wouldn't go down because split happened exactly at same time we issued bulk user region close call on our way out
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203814 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 20:01:30 +00:00
Michael Stack 8df0e84cf7 HBASE-4819 TestShell broke in trunk; typo
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203788 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 18:45:51 +00:00
Gary Helmling e0e0d94f97 HBASE-2742 Provide strong authentication with a secure RPC engine
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203515 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 07:34:43 +00:00
Nicolas Spiegelberg e7fb30c371 HBASE-4544 change RWCC to MVCC
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203468 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:37 +00:00
Nicolas Spiegelberg 1e68440431 HBASE-4594 Fix maxVersions when scanning a file with a TS > read point
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203467 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:33 +00:00
Nicolas Spiegelberg 619d1a327e HBASE-4485 Eliminate window of missing Data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203466 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:28 +00:00
Nicolas Spiegelberg d116edef93 HBASE-2856 Cross Column Family Read Atomicity
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203465 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:24 +00:00
larsh a9253a7104 HBASE-4805 Allow better control of resource consumption in HTable (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203428 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 23:58:57 +00:00
Kannan Muthukkaruppan 3039d61014 HBASE-4628 [jira] Enhance Table Create Presplit Functionality within the HBase
Shell

Summary:
HBase shell can algorithmically split a new table at creation

This change adds optional arguments to the HBase shell's create command
to split a table into a specified number of regions using a specified
splitting algorithm as defined by RegionSplitter.

Currently, we allow the user to presplit in the HBase shell by explicitly
listing the startkey of all the region shards that they want.  Instead, we
should provide the RegionSplitter functionality of choosing a split algorithm,
followed by the number of splits that they want.

Test Plan:
Created tables with and without splits using the shell; also attampted
to give incorrect arguments to shell create command.

Reviewers: nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, lhofhansl

Differential Revision: 429

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203413 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 23:01:59 +00:00
Michael Stack c9d5a838d0 HBASE-4799 Catalog Janitor logic bug causes region leackage
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203308 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 18:16:30 +00:00
Todd Lipcon 9c6b3b375d HBASE-4806 Fix logging message in HbaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203284 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 17:18:03 +00:00
Zhihong Yu ac6e9a1125 HBASE-4796 Race between SplitRegionHandlers for the same region kills the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202935 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 23:40:29 +00:00
Michael Stack e84b62cbb0 HBASE-4801 alter_status shell prints sensible message at completion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202914 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 22:46:14 +00:00
larsh 99724ae460 HBASE-4800 Result.compareResults is incorrect (James Taylor and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202827 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 18:38:12 +00:00
Michael Stack 207ca9895f HBASE-4795 Fix TestHFileBlock when running on a 32-bit JVM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202518 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 03:04:10 +00:00
Zhihong Yu 1ae05e5dd3 HBASE-4793 HBase shell still using deprecated methods removed in HBASE-4436
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202493 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 01:04:45 +00:00
Jean-Daniel Cryans eb5e28e4e1 HBASE-4792 SplitRegionHandler doesn't care if it deletes the znode or not,
leaves the parent region stuck offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202487 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 00:42:52 +00:00
Zhihong Yu 0ab2272833 HBASE-4768 Addendum removes unnecessary assertion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202419 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 20:57:35 +00:00
Gary Helmling 3f423daca0 HBASE-4784 Handle void return types in CoprocessorProtocol methods
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202336 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 17:55:48 +00:00
Zhihong Yu 48c16d1d66 HBASE-4790 Occasional TestDistributedLogSplitting failure (Jinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202312 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 17:15:04 +00:00
Zhihong Yu ed36c7cbda HBASE-4764 Addendum add HLogUtilsForTests.java
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202124 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 11:00:38 +00:00
Michael Stack dd9c07f1c9 HBASE-4764 naming errors for TestHLogUtils and SoftValueSortedMapTest
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202046 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 05:18:19 +00:00
Doug Meil eaada4b531 HBASE-4788. Adding MR to file example.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202031 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 04:10:38 +00:00
Nicolas Spiegelberg 548a74e9b4 HBASE-4768 Per-(table, columnFamily) metrics with configurable table name inclusion
Summary: This is an initial version of an HBase trunk diff for per-table/CF
metrics (see JIRA for details). Unit tests mostly pass -- need to look into
TestDistributedLogSplitting. Also still doing cluster testing.

Test Plan: Unit tests, single-node cluster, dev cluster. Need to try bulk-load
map-reduce jobs as well. Observe metrics through JMX.

Reviewers: jgray, nspiegelberg, stack, tedyu, todd, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, Liyin, mbautin, tedyu

Differential Revision: 363

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201994 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:26:05 +00:00
Doug Meil dab526e492 HBASE-4786 book.xml,performance.xml adding and reorg of schema info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201992 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:14:10 +00:00
Michael Stack 1c9f356fca HBASE-4780 Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201954 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:50:10 +00:00
Nicolas Spiegelberg 6ebf318735 HBASE-4778 Don't ignore corrupt StoreFiles when opening a region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201940 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:29:03 +00:00
Zhihong Yu 7d23c9afb1 HBASE-4752 Don't create an unnecessary LinkedList when evicting from the BlockCache
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201516 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 21:17:35 +00:00
Zhihong Yu 9cdde5ab68 HBASE-4779 TestHTablePool, TestScanWithBloomError, TestRegionSplitCalculator are
not tagged and TestPoolMap should not use TestSuite (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201442 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 15:46:44 +00:00
Michael Stack 94a06fb391 HBASE-4777 Write back to client 'incompatible' if we show up with wrong version
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201400 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 04:56:26 +00:00
Zhihong Yu 62b5c04786 HBASE-4478 Improve AssignmentManager.handleRegion so that it can process certain ZK state
in the case of RS offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201186 13f79535-47bb-0310-9956-ffa450edef68
2011-11-12 04:40:41 +00:00
Michael Stack 3e37baa9f3 HBASE-4577 Region server reports storefileSizeMB bigger than storefileUncompressedSizeMB
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201106 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:40:29 +00:00
Michael Stack 902cd7e192 HBASE-4511 There is data loss when master failovers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201104 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:36:47 +00:00
Michael Stack 7671b5d49d HBASE-4723 Loads of NotAllMetaRegionsOnlineException traces when starting the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201097 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:21:07 +00:00
larsh 571e8f8520 HBASE-3433 Remove the KV copy of every KV in Scan; introduced by HBASE-3232
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201094 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:19:28 +00:00
Michael Stack a51931de2d HBASE-4734 [bulk load] Warn if bulk load directory contained no files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200958 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 17:09:12 +00:00
Nicolas Spiegelberg 4206b1e860 [debug] Have NSFRE messages also display the row associated with the region request.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200691 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 02:11:03 +00:00
Nicolas Spiegelberg b45fd73378 HBASE-4769 Abort RegionServer Immediately on OOME
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200662 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:33:46 +00:00
Michael Stack 45a629cd76 HBASE-4741 Online schema change doesn't return errors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200660 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:24:04 +00:00
Michael Stack 274e7c2743 HBASE-4288 "Server not running" exception during meta verification causes RS abort
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200648 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:58:06 +00:00
Nicolas Spiegelberg 04afdf9633 HBASE-3690 Option to Exclude Bulk Import Files from Minor Compaction
Summary:
We ran an incremental scrape with HFileOutputFormat and
encountered major compaction storms. This is caused by the bug in
HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We
realized that a quicker solution for avoiding these compaction storms is
to simply exclude bulk import files from minor compactions and let them
only be handled by time-based major compactions. Add with functionality
along with a config option to enable it.

Rewrote this feature to be done on a per-bulkload basis.

Test Plan:
 - mvn test -Dtest=TestHFileOutputFormat

DiffCamp Revision:

Reviewers: stack, Kannan, JIRA, dhruba

Reviewed By: stack

CC: dhruba, lhofhansl, nspiegelberg, stack

Differential Revision: 357

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200621 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:31:13 +00:00
Nicolas Spiegelberg 6c57076f7e HBASE-4765 Enhance HLog Metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200619 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:29:16 +00:00
Andrew Kyle Purtell 373c98b0df HBASE-4554 Allow set/unset coprocessor table attributes from shell (Mingjie Lai)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200436 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 17:15:20 +00:00
Zhihong Yu 076030550f HBASE-4737 Addendum removes unnecessary print
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200138 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 04:18:42 +00:00
Zhihong Yu f5944d1a72 HBASE-4737 Addendum tags SmallTests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200012 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 22:37:32 +00:00
Nicolas Spiegelberg e896f6d400 Upgrade nextKeyValue() error message from debug to info to highlight MR generation failures
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199605 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 03:48:11 +00:00
Zhihong Yu 1f2aadb80d HBASE-4737 Categorize the tests into small/medium/large; allow small tests to be run
in parallel within a single JVM (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199604 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 03:38:10 +00:00
Zhihong Yu 78ebe94d05 HBASE-4740 [bulk load] the HBASE-4552 API can't tell if errors on region server are recoverable
(Jonathan Hsieh)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199017 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 23:51:56 +00:00
Zhihong Yu d54b1fdee7 HBASE-4754 FSTableDescriptors.getTableInfoPath() should handle FileNotFoundException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198953 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 21:40:28 +00:00
Zhihong Yu f7e925c8d3 HBASE-4746 Use a random ZK client port in unit tests so we can run them in parallel
(Mikhail Bautin)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198856 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 18:22:57 +00:00
Michael Stack 02f6104dc2 HBASE-4753 org.apache.hadoop.hbase.regionserver.TestHRegionInfo#testGetSetOfHTD throws NPE on trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198581 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 22:47:17 +00:00
Michael Stack 7d8d42d01b HBASE-3939 Some crossports of Hadoop IPC fixes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198573 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 21:48:31 +00:00
Michael Stack b508f52998 HBASE-4751 Make TestAdmin#testEnableTableRoundRobinAssignment friendly to concurrent tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198013 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 18:53:49 +00:00
Michael Stack 7052e59b38 HBASE-4749 TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS occasionally fails
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198007 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 18:45:24 +00:00
Andrew Kyle Purtell c775d60de6 HBASE-4745 LRU statistics thread should be a daemon
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197864 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 01:48:45 +00:00
Michael Stack 56e19a72dc HBASE-4725 NPE in AM#updateTimers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197815 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 23:10:08 +00:00
Michael Stack bb0c9a11d8 HBASE-4553 The update of .tableinfo is not atomic; we remove then rename
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197812 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 23:03:29 +00:00
Michael Stack 2ce1d7c97c HBASE-4722 TestGlobalMemStoreSize has started failing; ADDENDUM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197349 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 23:39:48 +00:00
Doug Meil ae6af9e630 HBASE-4743 book.xml, performance.xml, troubleshooting.xml scan info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197315 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 21:22:57 +00:00
Michael Stack 92b57170e9 HBASE-4298 Support to drain RS nodes through ZK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197256 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 18:34:41 +00:00
Gary Helmling a9992a53c4 HBASE-4518 TestServerCustomProtocol fails intermittently
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196952 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 05:57:36 +00:00
Michael Stack 09225cf9b6 HBASE-4480 Testing script to simplify local testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196939 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 04:11:46 +00:00
Doug Meil 5eaea899e3 HBASE-4736 troubleshooting.xml, xrefs to Arch chapter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196925 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 03:05:37 +00:00
Zhihong Yu 76060691bb HBASE-4609 ThriftServer.getRegionInfo() is expecting old ServerName format, need to
use new Addressing class instead (Jonathan Gray)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196873 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 23:48:22 +00:00
Doug Meil c61f0f296f HBASE-4735 book.xml, schema design keysize code example
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196860 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 23:26:30 +00:00
Doug Meil 88643f7220 HBASE-4732 book.xml, added link to MR tutorial in MR chapter (trivial change)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196805 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 21:19:13 +00:00
Doug Meil b08f746cd2 HBASE-4731 book.xml, schema design - rowkey numeric example
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196801 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 21:09:47 +00:00
Doug Meil f0444014b8 HBASE-4730 book.xml, ops_mgt.xml, performance.xml - handful of changes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 20:40:14 +00:00