Commit Graph

2513 Commits

Author SHA1 Message Date
larsh ef65dde6b3 HBASE-5641 decayingSampleTick1 prevents HBase from shutting down.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305722 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 03:34:51 +00:00
Jonathan Hsieh 3fd6997380 HBASE-5596 Few minor bugs from HBASE-5209 (David S. Wang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 23:06:02 +00:00
larsh 080206de01 HBASE-5623 Race condition when rolling the HLog and hlogFlush (Enis Soztutar and LarsH)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305556 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 20:42:46 +00:00
Michael Stack 8ea1c8ddd6 HBASE-5533 Add more metrics to HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305499 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 19:21:42 +00:00
Zhihong Yu 3c234f13ba HBASE-5615 the master never does balance because of balancing the parent region (Xufeng)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305171 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 23:22:00 +00:00
larsh 82670f81b8 HBASE-4957 Clean up some log messages, code in RecoverableZooKeeper (Todd)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304940 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 22:02:41 +00:00
Michael Stack 9cfe7cfa3c HBASE-5633 NPE reading ZK config in HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304924 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:15:40 +00:00
larsh accf8ee862 HBASE-5434 [REST] Include more metrics in cluster status request (Mubarak Seyed)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304919 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:04:45 +00:00
Zhihong Yu 53712ce495 HBASE-5128 Addendum adds two new files Jon forgot to add
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304702 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 03:58:22 +00:00
Jonathan Hsieh f2d637ffa5 HBASE-5128 [uber hbck] Online automated repair of table integrity and region consistency problems
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 23:53:55 +00:00
Jean-Daniel Cryans 560173f756 HBASE-5190 Limit the IPC queue size based on calls' payload size
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304634 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:32:31 +00:00
mbautin 86962028dd [jira] [HBASE-5469] Add baseline compression efficiency to DataBlockEncodingTool
Summary:
DataBlockEncodingTool currently does not provide baseline compression
efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if
we are using LZO to compress blocks, we would like to have the following
columns in the report (possibly as percentages of raw data size).

Baseline K+V in blockcache | Baseline K + V on disk (LZO compressed) | K + V
DataBlockEncoded in block cache | K + V DataBlockEncoded + LZOCompressed (on
disk)

Background: we never store compressed blocks in cache, but we always store
encoded data blocks in cache if data block encoding is enabled for the column
family.

This patch also has multiple bugfixes and improvements to DataBlockEncodingTool,
including presentation format, memory requirements (reduced 3x) and fixing the
handling of compression.

Test Plan:
* Run unit tests.
* Run DataBlockEncodingTool on a variety of real-world HFiles.

Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2409

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:02:53 +00:00
Michael Stack 1e6c227883 HBASE-5616 Make compaction code standalone; ADDENDUM -- ADD LICENSES
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304624 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:52:55 +00:00
Michael Stack 5a9f595e7d HBASE-5616 Make compaction code standalone
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304616 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:37:01 +00:00
Michael Stack 358dc6e6e6 HBASE-5624 Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:18:41 +00:00
Zhihong Yu 26b2950bc7 HBASE-5613 ThriftServer getTableRegions does not return serverName and port (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:15:50 +00:00
larsh 929113dfab HBASE-4657 Improve the efficiency of our MR jobs with a few configurations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304110 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:34:35 +00:00
Zhihong Yu a379a41e3d HBASE-5591 ThiftServerRunner.HBaseHandler.toBytes() is identical to Bytes.getBytes() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 20:43:55 +00:00
Jean-Daniel Cryans fa98df639e HBASE-5586 [replication] NPE in ReplicationSource when creating a stream
to an inexistent cluster


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303945 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 18:13:12 +00:00
larsh 536ff21825 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) part 2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303920 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:51:37 +00:00
larsh 6fb055da00 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303915 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:49:32 +00:00
Michael Stack 772ecdd236 HBASE-5328 Small changes to Master to make it more testable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303648 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 03:40:46 +00:00
Michael Stack 327e2d1f74 HBASE-5328 Small changes to Master to make it more testable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:02:36 +00:00
larsh 4ba5a9d29e HBASE-5433 [REST] Add metrics to keep track of success/failure count (Mubarak Seyed)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303536 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:48:11 +00:00
Jonathan Hsieh 865b14133b HBASE-5589 Add of the offline call to the Master Interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303519 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:30:54 +00:00
Zhihong Yu 5b2d6ebfc5 HBASE-5542 revert due to broken trunk build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303517 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:28:33 +00:00
Michael Stack 250252f400 HBASE-5560 Avoid RegionServer GC caused by timed-out calls
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303512 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:17:59 +00:00
Zhihong Yu ce36877d30 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303490 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:25:18 +00:00
larsh 41f31490ff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303220 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 23:57:53 +00:00
mbautin b4dccf9198 HBASE-5605 [jira] compression does not work in Store.java
Author: Yongqiang He

Summary: need to pass compression parameter to WriterBuilder

Test Plan: one simple and straightforward change

Reviewers: mbautin

Reviewed By: mbautin

CC: tedyu

Differential Revision: https://reviews.facebook.net/D2391

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303150 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 21:04:38 +00:00
ramkrishna 2f58da0489 HBASE-5520 Support reseek() at RegionScanner (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303005 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 17:10:50 +00:00
mbautin 6be64072e8 HBASE-5521 [jira] Move compression/decompression to an encoder specific encoding
context

Author: Yongqiang He

Summary:
https://issues.apache.org/jira/browse/HBASE-5521

As part of working on HBASE-5313, we want to add a new columnar encoder/decoder.
It makes sense to move compression to be part of encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer.

If there is no encoder specified for a writer, the HBlock.Writer will use a
default compression-context to do something very similar to today's code.

Test Plan: existing unit tests verified by mbautin and tedyu. And no new test
added here since this code is just a preparation for columnar encoder. Will add
testcase later in that diff.

Reviewers: dhruba, tedyu, sc, mbautin

Reviewed By: mbautin

Differential Revision: https://reviews.facebook.net/D2097

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 19:12:19 +00:00
Michael Stack 047d209cee HBASE-5955 Fix NoSuchMethodException in 0.92 when running on local filesystem
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302207 13f79535-47bb-0310-9956-ffa450edef68
2012-03-18 19:40:24 +00:00
Jonathan Hsieh 37da60f92f HBASE-5588 Deprecate/remove AssignmentManager#clearRegionFromTransition
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301885 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 07:34:22 +00:00
larsh fda76c71cb Revert HBASE-5569
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301872 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 06:59:31 +00:00
Jonathan Hsieh f34edd6378 HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301779 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 21:50:05 +00:00
Zhihong Yu 1d24d71821 HBASE-5549 HBASE-5572 Master can fail if ZooKeeper session expires (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301775 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 21:30:47 +00:00
Michael Stack 8a4c928de0 HBASE-5592 Make it easier to get a table from shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301715 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 19:45:06 +00:00
Zhihong Yu 458a3ff092 HBASE-5206 Port HBASE-5155 to trunk (Ashutosh Jindal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301709 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 19:14:11 +00:00
Michael Stack a388bae569 HBASE-5581 Creating a table with invalid syntax does not give an error message when it fails
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301688 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 18:46:53 +00:00
Zhihong Yu 8e84390b37 HBASE-5568 Multi concurrent flushcache() for one region could cause data loss (Chunhui)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301639 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 16:39:44 +00:00
Zhihong Yu 4a5a27eac2 HBASE-5579 A Delete Version could mask other values (Daniel Ferro)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301173 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 20:03:47 +00:00
Michael Stack 273804e658 HBASE-4608 HLog Compression
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301165 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 19:32:01 +00:00
larsh 5055d4cfff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301135 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 18:46:31 +00:00
Zhihong Yu d73aee4f66 HBASE-5206 revert because of test failues in trunk build.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300725 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 21:25:51 +00:00
Zhihong Yu 2ec60a022e HBASE-5206 port HBASE-5155 to TRUNK (Ashutosh Jindal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300711 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 20:29:54 +00:00
Michael Stack eebdfb5d65 HBASE-5574 DEFAULT_MAX_FILE_SIZE defaults to a negative value
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300288 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 19:04:41 +00:00
Michael Stack 05423b150b HBASE-5179 Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300194 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 15:35:54 +00:00
Michael Stack e4fefa0073 HBASE-5399 Cut the link between the client and the zookeeper ensemble
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299872 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 21:20:33 +00:00
mbautin be78e3c4ee [jira] [HBASE-5292] Prevent counting getSize on compactions
Author: Zhiqiu Kong

Summary:
Added two separate metrics for both get() and next(). This is done by
refactoring on internal next() API. To be more specific, only Get.get()
and ResultScanner.next() passes the metric name ("getsize" and
"nextsize" repectively) to
  HRegion::RegionScanner::next(List<KeyValue>, String)

This will eventually hit StoreScanner()::next((List<KeyValue>,
int, String) where the metrics are counted.

And their call paths are:

1) Get

HTable::get(final Get get)
=> HRegionServer::get(byte [] regionName, Get get)
=> HRegion::get(final Get get, final Integer lockid)
=> HRegion::get(final Get get)      [pass METRIC_GETSIZE to the
callee]

=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)

2) Next

HTable::ClientScanner::next()
=> ScannerCallable::call()
=> HRegionServer::next(long scannerId)
=> HRegionServer::next(final long scannerId, int nbRows)  [pass
METRIC_NEXTSIZE to the callee]

=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)

Test Plan:
1. Passed unit tests.
2. Created a testcase TestRegionServerMetrics::testGetNextSize to
guarantee:
 * Get/Next contributes to getsize/nextsize metrics
 * Both getsize/nextsize are per Column Family
 * Flush/compaction won't affect these two metrics

Reviewed By: mbautin

Reviewers: Kannan, mbautin, Liyin, JIRA

CC: Kannan, mbautin, Liyin, zhiqiu

Differential Revision: https://reviews.facebook.net/D1617

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299147 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 02:27:05 +00:00
Michael Stack e4c43d72bf HBASE-5535 Make the functions in task monitor synchronized
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299088 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 22:47:54 +00:00
Michael Stack 7d34da889e HBASE-5538 A metric to measure the size of the response queue in the hbase rpc server
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299084 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 22:40:12 +00:00
mbautin fc08d20ebd [jira] [HBASE-4542] Add filter info to slow query logging
Author: Zhiqiu Kong

Summary:
The original 89-fb diff is: https://reviews.facebook.net/D1263

Slow opertaion log does not provide enough information when a filter is
present. The followings are done to add the filter info:

1) Added toString() method for filters inheriting FilterBase, this
affect 22 filters and their subclasses. The info added includes the
filter's name and its members. For example, for TimestampsFilter, we'll
output its class name as well as the defined timestamps.

2) Added a field 'filter' in Get::toMap() and Scan::toMap() to enable
the logging of filter info.

Task ID: #750975

Blame Rev:

Test Plan:
1. Run and passed unit-tests to make sure it does not break things

2. Run kannan's script to trigger the slow operation logging, checked
for each filter to make sure the filter info was logged. To be more
detailed, the output log are as following (only 'filter' filed is put
here for ease of reading):

"filter":"TimestampsFilter (3/3): [2, 3, 5]"
"filter":"TimestampsFilter (5/6): [2, 3, 5, 7, 11]"
"filter":"ColumnPrefixFilter col2"
"filter":"ColumnRangeFilter [col2a, col2b]"
"filter":"ColumnCountGetFilter 8"
"filter":"ColumnPaginationFilter (4, 4)"
"filter":"InclusiveStopFilter row"
"filter":"PrefixFilter row"
"filter":"PageFilter 1"
"filter":"SkipFilter TimestampsFilter (1/1): [1000]"
"filter":"WhileMatchFilter TimestampsFilter (3/3): [2, 3, 5]"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"MultipleColumnPrefixFilter (3/3): [a, b, c]"
"filter":"DependentColumnFilter (family, qualifier, true, LESS, value)"
"filter":"FamilyFilter (LESS, value)"
"filter":"QualifierFilter (LESS, value)"
"filter":"RowFilter (LESS, value)"
"filter":"ValueFilter (LESS, value)"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"SingleColumnValueFilter (family, qualifier, EQUAL, value)"
"filter":"SingleColumnValueExcludeFilter (family, qualifier, EQUAL,
value)"
"filter":"FilterList AND (2/2): [KeyOnlyFilter, FirstKeyOnlyFilter]"
Please check ~zhiqiu/Codes/scripts/testFilter.rb for the testing script.

3. Added unit test cases to TestOperation to verify the filters'
toString() method works well.

Reviewed By: mbautin

Reviewers: Kannan, madhuvaidya, mbautin, JIRA

CC: Kannan, madhuvaidya, mbautin, zhiqiu, stack

Differential Revision: https://reviews.facebook.net/D1539

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299019 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 20:14:26 +00:00
Michael Stack cbdf0ca007 HBASE-5552 Clean up our jmx view; its a bit of a mess
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298923 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 16:54:13 +00:00
Zhihong Yu 35a36c2c66 HBASE-5213 "hbase master stop" does not bring down backup masters (Gregory)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298859 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 14:47:16 +00:00
larsh 5d9f98e09d HBASE-5541 Avoid holding the rowlock during HLog sync in HRegion.mutateRowWithLocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298678 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 00:52:25 +00:00
larsh 7ce77fc5d3 HBASE-5526 ^Cnfigurable file and directory based umask (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298657 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 23:58:17 +00:00
mbautin 961455cd9d [jira] [HBASE-5074] Support checksums in HBase block cache
Author: Dhruba

Summary:
HFile is enhanced to store a checksum for each block. HDFS checksum verification
is avoided while reading data into the block cache. On a checksum verification
failure, we retry the file system read request with hdfs checksums switched on
(thanks Todd).

I have a benchmark that shows that it reduces iops on the disk by about 40%. In
this experiment, the entire memory on the regionserver is allocated to the
regionserver's jvm and the OS buffer cache size is negligible. I also measured
negligible (<5%) additional cpu usage while using hbase-level checksums.

The salient points of this patch:

1. Each hfile's trailer used to have a 4 byte version number. I enhanced this so
that these 4 bytes can be interpreted as a (major version number, minor
version). Pre-existing hfiles have a minor version of 0. The new hfile format
has a minor version of 1 (thanks Mikhail). The hfile major version remains
unchanged at 2. The reason I did not introduce a new major version number is
because the code changes needed to store/read checksums do not differ much from
existing V2 writers/readers.

2. Introduced a HFileSystem object which is a encapsulates the FileSystem
objects needed to access data from hfiles and hlogs.  HDFS FileSystem objects
already had the ability to switch off checksum verifications for reads.

3. The majority of the code changes are located in hbase.io.hfie package. The
retry of a read on an initial checksum failure occurs inside the hbase.io.hfile
package itself.  The code changes to hbase.regionserver package are minor.

4. The format of a hfileblock is the header followed by the data followed by the
checksum(s). Each 16 K (configurable) size of data has a 4 byte checksum.  The
hfileblock header has two additional fields: a 4 byte value to store the
bytesPerChecksum and a 4 byte value to store the size of the user data
(excluding the checksum data). This is well explained in the associated
javadocs.

5. I added a test to test backward compatibility. I will be writing more unit
tests that triggers checksum verification failures aggressively. I have left a
few redundant log messages in the code (just for easier debugging) and will
remove them in later stage of this patch. I will also be adding metrics on
number of checksum verification failures/success in a later version of this
diff.

6. By default, hbase-level checksums are switched on and hdfs level checksums
are switched off for hfile-reads. No changes to Hlog code path here.

Test Plan: The default setting is to switch on hbase checksums for hfile-reads,
thus all existing tests actually validate the new code pieces. I will be writing
more unit tests for triggering checksum verification failures.

Reviewers: mbautin

Reviewed By: mbautin

CC: JIRA, tedyu, mbautin, dhruba, todd, stack

Differential Revision: https://reviews.facebook.net/D1521

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298641 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 22:55:49 +00:00
Zhihong Yu c4426b5b79 HBASE-5515 Add a processRow API that supports atomic multiple reads and writes on a row (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298533 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 19:40:27 +00:00
Michael Stack 0f7285a81a HBASE-4890 fix possible NPE in HConnectionManager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298272 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 05:00:01 +00:00
Andrew Kyle Purtell edc6696bc5 HBASE-5480. Fixups to MultithreadedTableMapper for Hadoop 0.23
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298259 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 02:28:39 +00:00
Michael Stack e4f4022493 HBASE-5519 Incorrect warning in splitlogmanager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297707 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 20:46:02 +00:00
larsh 723e8559e3 HBASE-5523 Fix Delete Timerange logic for KEEP_DELETED_CELLS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 06:17:11 +00:00
Zhihong Yu 88115f3d8b HBASE-5507 ThriftServerRunner.HbaseHandler.getRegionInfo() and getTableRegions() do not use ByteBuffer correctly (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297300 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:00:36 +00:00
Zhihong Yu 44e348ea1b HBASE-5010 Pass region info in LoadBalancer.randomAssignment(List<ServerName> servers) (Anoop Sam John)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297155 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:41:03 +00:00
Michael Stack 0132176084 HBASE-5286 bin/hbase's logic of adding Hadoop jar files to the classpath is fragile when presented with split packaged Hadoop 0.23 installation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296663 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 16:46:57 +00:00
Michael Stack 4343a0a00d HBASE-5486 Warn message in HTable: Stringify the byte[]
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296478 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 21:16:03 +00:00
Zhihong Yu a2392c913e HBASE-5506 Add unit test for ThriftServerRunner.HbaseHandler.getRegionInfo() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296365 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 18:30:27 +00:00
larsh 9ffc748589 HBASE-5489 Addendum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296011 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 00:26:25 +00:00
Michael Stack 7147bc5424 HBASE-5489 Add HTable accessor to get regions for a key range
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295729 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 18:43:29 +00:00
Michael Stack dace419238 HBASE-4403 Adopt interface stability/audience classifications from Hadoop AND HBASE-5502 region_mover.rb fails to load regions back to original server for regions only containing empty tables
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295710 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 17:53:03 +00:00
Michael Stack 324a2cfeb4 HBASE-5454 Refuse operations from Admin before master is initialized
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295433 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 06:59:51 +00:00
Michael Stack 8eab15acf5 HBASE-5491 Remove HBaseConfiguration.create() call from coprocessor.Exec class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295429 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 06:49:59 +00:00
larsh 6e612849dc HBASE-5497 Add protobuf as M/R dependency jar (mapred)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295329 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:42:37 +00:00
Zhihong Yu ba56d88d60 HBASE-5441 HRegionThriftServer may not start because of a race-condition (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295192 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 17:58:35 +00:00
Michael Stack 09eaaba6b4 HBASE-5485 LogCleaner refers to non-existant SnapshotLogCleaner
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294799 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 19:39:33 +00:00
Michael Stack 09a8719814 HBASE-5484 Spelling mistake in error message in HMasterCommandLine
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294790 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 19:01:46 +00:00
Michael Stack 4ef6cb8bc9 HBASE-5483 Allow configurable host to bind to for starting REST server from commandline
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294229 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 17:01:04 +00:00
Michael Stack c176d41582 HBASE-5481 Uncaught UnknownHostException prevents HBase from starting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294217 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:26 +00:00
Michael Stack 5b61755b0f HBASE-5473 Metrics does not push pread time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293532 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 04:22:55 +00:00
Michael Stack e540751766 HBASE-5350 Fix jamon generated package names
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:59:37 +00:00
Michael Stack 3544e1c5f7 HBASE-5351 hbase completebulkload to a new table fails in a race
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293479 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:40:27 +00:00
larsh d229b63a28 HBASE-5455 Add test to avoid unintentional reordering of items in HbaseObjectWritable (Michael Drzal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293455 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:29:40 +00:00
Michael Stack d7050d3541 HBASE-5325 Expose basic information about the master-status through jmx beans
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293416 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:06:12 +00:00
larsh a54ec1b7cc HBASE-5440 Allow Import to optionally use HFileOutputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293101 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:47:29 +00:00
Michael Stack e531e2595c HBASE-4365 Add a decent heuristic for region size
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293099 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:41:37 +00:00
Michael Stack ce71b8a1bc HBASE-5166 MultiThreaded Table Mapper analogous to MultiThreaded Mapper in hadoop
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293098 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:38:18 +00:00
mbautin a01166ec92 [jira] [HBASE-5442] Use builder pattern in StoreFile and HFile
Summary: Cleaning up the factory method explosion in HFile writer and StoreFile.
Now, adding a new parameter to HFile/StoreFile writer initialization will not
require modifying factory method invocations all over the codebase.

Test Plan:
Run unit tests
Deploy to dev cluster and run a load test

Reviewers: JIRA, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: stack

Differential Revision: https://reviews.facebook.net/D1893

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293095 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:06:53 +00:00
Michael Stack bbf0a0074e HBASE-5464 Log warning message when thrift calls throw exceptions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293093 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 05:48:13 +00:00
Zhihong Yu 398289ce6e HBASE-5317 Fix TestHFileOutputFormat to work against hadoop 0.23 (Gregory Chanan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293049 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 01:07:03 +00:00
Zhihong Yu 49904bcf1d HBASE-5466 Opening a table also opens the metatable and never closes it
(Ashley Taylor)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293047 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:55:58 +00:00
Jean-Daniel Cryans a4a4e97338 HBASE-5415 FSTableDescriptors should handle random folders in
hbase.root.dir better


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293042 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:41:31 +00:00
mbautin b77dca0c7f [jira] [HBASE-5357] Refactoring: use the builder pattern for HColumnDescriptor
Summary: Deprecate three ugly HColumnDescriptor constructors and use a "builder"
pattern instead, e.g. new
HColumnDescriptor(cfName).setMaxVersions(5).setBlockSize(8192), etc. Setters
have now become "builder" methods.

Test Plan: Run unit tests

Reviewers: JIRA, todd, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D1851

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293026 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 23:18:27 +00:00
Zhihong Yu b0d4403059 HBASE-5437 HRegionThriftServer does not start because of a bug in HbaseHandlerMetricsProxy (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293013 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:58:42 +00:00
larsh 375d81ab29 HBASE-5460 Add protobuf as M/R dependency jar
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292656 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:44:56 +00:00
Michael Stack 30f21c3ef4 HBASE-5423 Regionserver may block forever on waitOnAllRegionsToClose when aborting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292647 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:05:30 +00:00
Michael Stack 240d6bc52b HBASE-5424 HTable meet NPE when call getRegionInfo() -- REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292646 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:01:29 +00:00
Michael Stack 6a80cf5bf9 HBASE-5424 HTable meet NPE when call getRegionInfo()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 04:43:29 +00:00
Nicolas Spiegelberg c3575d2eb5 [jira] [HBASE-5332] Deterministic Compaction Jitter
Summary:
Changing the jitter in major compactions to be deterministic,
so reboots don't cause a time-based compaction storm.  This
implementation seeds a random number generator with HDFS data for
persistence.

Test Plan: - mvn test -Dtest=TestCompaction,TestCompactSelection,TestHeapSize

Reviewers: JIRA, Kannan, aaiyer, stack

Reviewed By: Kannan

Differential Revision: https://reviews.facebook.net/D1785

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292495 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 20:36:39 +00:00
Michael Stack 7b5ec59eda HBASE-5422 StartupBulkAssigner would cause a lot of timeout on RIT when assigning large numbers of regions (timeout = 3 mins)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292409 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:29:26 +00:00
larsh 0f708f7370 HBASE-5439 Fix some performance findbugs issues (Gregory Chanan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292141 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 07:00:44 +00:00
Michael Stack 953d89e3a9 HBASE-5189 Add metrics to keep track of region-splits in RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292139 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 06:51:02 +00:00
Michael Stack 6da328e0fb HBASE-5436 Right-size the map when reading attributes.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1291463 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 21:46:04 +00:00
larsh ad14643d55 HBASE-5431 Improve delete marker handling in Import M/R jobs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290955 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 05:51:56 +00:00
Michael Stack 145d25dfc2 HBASE-5209 HConnection/HMasterInterface should allow for way to get hostname of currently active master in multi-master HBase setup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290942 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 04:10:46 +00:00
Michael Stack d69299dfdc HBASE-5003 If the master is started with a wrong root dir, it gets stuck and can't be killed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290882 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 21:32:42 +00:00
Michael Stack 588206f411 HBASE-5200 AM.ProcessRegionInTransition() and AM.handleRegion() race thus leaving the region assignment inconsistent
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290854 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 20:13:54 +00:00
larsh 0e54a5f331 HBASE-3584 Addendum, remove RowMutation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245876 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 07:25:41 +00:00
Michael Stack 0d17817fde HBASE-3584 Rename RowMutation to RowMutations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245792 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 22:58:01 +00:00
Michael Stack 9684065bec HBASE-5428 Allow for custom filters to be registered within the Thrift interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245774 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:39:30 +00:00
Michael Stack 0dd3c22706 HBASE-5195 [Coprocessors] preGet hook does not allow overriding or wrapping filter on incoming Get -- SECOND HALF OF THIS COMMIT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245773 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:34:46 +00:00
Michael Stack 0caad4616e HBASE-5279 NPE in Master after upgrading to 0.92.0 -- REVERT OVERCOMMIT TO HREGION
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245768 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:26:23 +00:00
Michael Stack 5994c50143 HBASE-5279 NPE in Master after upgrading to 0.92.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245767 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:24:21 +00:00
Michael Stack aa7a5b2926 HBASE-5120 Timeout monitor races with table disable handler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245731 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 20:03:57 +00:00
Jean-Daniel Cryans 6fa8f6a042 HBASE-4640 Catch ClosedChannelException and document it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245730 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:56:54 +00:00
Jean-Daniel Cryans 5b542b7921 HBASE-5393 Consider splitting after flushing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245727 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:45:45 +00:00
Michael Stack f45b59aa4d HBASE-5425 Punt on the timeout doesn't work in BulkEnabler#waitUntilDone (master's EnableTableHandler)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245674 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 17:28:46 +00:00
Zhihong Yu 628e5cd9f2 HBASE-5411 Add more metrics for ThriftMetrics (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244977 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 13:56:40 +00:00
Michael Stack 71682997f3 HBASE-5394 Add ability to include Protobufs in HbaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244641 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:45:06 +00:00
Michael Stack caf2c0c67a HBASE-5398 HBase shell disable_all/enable_all/drop_all promp wrong tables for confirmation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244169 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:02:13 +00:00
Zhihong Yu ac0fb8d5ae HBASE-5388 Tune HConnectionManager#getCachedLocation method (Ronghai Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243994 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 15:28:59 +00:00
Jean-Daniel Cryans 37735435ec HBASE-5395 CopyTable needs to use GenericOptionsParser
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243759 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 01:13:33 +00:00
Jean-Daniel Cryans ce3bae0334 HBASE-5197 [replication] Handle socket timeouts in ReplicationSource
to prevent DDOS


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243733 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 23:12:55 +00:00
mbautin b50714c043 [jira] [HBASE-5387] Reuse compression streams in HFileBlock.Writer
Summary: We need to to reuse compression streams in HFileBlock.Writer instead of
allocating them every time. The motivation is that when using Java's built-in
implementation of Gzip, we allocate a new GZIPOutputStream object and an
associated native data structure any time. This is one suspected cause of recent
TestHFileBlock failures on Hadoop QA:
https://builds.apache.org/job/HBase-TRUNK/2658/testReport/org.apache.hadoop.hbase.io.hfile/TestHFileBlock/testPreviousOffset_1_/.

Test Plan:
* Run unit tests
* Create a GZIP-compressed CF with new code, load some data, shut down HBase,
deploy old code, restart HBase, and scan the table

Reviewers: tedyu, Liyin, dhruba, JIRA, lhofhansl

Reviewed By: lhofhansl

CC: tedyu, lhofhansl, mbautin

Differential Revision: https://reviews.facebook.net/D1719

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243667 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 19:41:58 +00:00
Zhihong Yu f2bb12c6bb HBASE-5327 Print a message when an invalid hbase.rootdir is passed (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243650 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 18:47:04 +00:00
Zhihong Yu 0e0394bc35 HBASE-5199 Differential revision 1311 Delete out of TTL store files before compaction selection (Liyin)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243086 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 16:29:36 +00:00
larsh 23b135965f HBASE-5368 Move PrefixSplitKeyPolicy out of the src/test into src, so it is accessible in HBase installs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242981 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:32:52 +00:00
Jonathan Hsieh 8bb23aef17 HBASE-5364 Fix source files missing license in 0.92 and trunk (Elliott Clark)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242906 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 20:07:36 +00:00
Zhihong Yu c6519ca4c7 HBASE-5358 HBaseObjectWritable should be able to serialize/deserialize generic arrays
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242649 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 03:37:32 +00:00
larsh ff1f0decc4 HBASE-5229 Provide basic building blocks for 'multi-row' local transactions.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242037 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 18:30:37 +00:00
Zhihong Yu 7ef8f6e307 HBASE-5298 Add thrift metrics to thrift2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241974 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 17:03:11 +00:00
Zhihong Yu 10f108630f HBASE-5345 CheckAndPut doesn't work when value is empty byte[] (Evert Arckens)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241972 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 16:55:16 +00:00
Michael Stack 38d28bccc6 HBASE-5348 Constraint configuration loaded with bloat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241704 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:49:37 +00:00
Zhihong Yu 802d7c8674 HBASE-3850 Log more details when a scanner lease expires (Darren Haas)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241667 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:23:45 +00:00
Zhihong Yu b4f585e6a3 HBASE-5267 Add a configuration to disable the slab cache by default (Li Pi)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241644 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 21:41:45 +00:00
Zhihong Yu a2887a9bb7 HBASE-4658 Put attributes are not exposed via the ThriftServer (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1240294 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 19:02:13 +00:00
larsh df4a9d4ad3 HBASE-5304 Pluggable split key policy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239909 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 23:00:06 +00:00
Zhihong Yu 4b4904a77c HBASE-5186 Add metrics to ThriftServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239737 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 17:30:13 +00:00
Zhihong Yu 8a6d0fbca1 HBASE-5212 Fix test TestTableMapReduce against 0.23 (Ted and Gregory)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:56:34 +00:00
Zhihong Yu 6bed2d07da HBASE-5295 Improve the Thrift API to switch on/off writing to wal for Mutations (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239241 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:04:06 +00:00
Zhihong Yu 457d51bec5 HBASE-5310 HConnectionManager server cache key enhancement (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239220 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:34:04 +00:00
Zhihong Yu 4b698e776d HBASE-5283 Request counters may become negative for heavily loaded regions (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239157 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 14:56:20 +00:00
Zhihong Yu e5a38bed76 HBASE-5256 Use WritableUtils.readVInt() in RegionLoad.readFields() (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238873 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:12:36 +00:00
Zhihong Yu b246e68435 HBASE-5259 Normalize the RegionLocation in TableInputFormat by the reverse DNS lookup (Liyin Tang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238774 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 19:52:58 +00:00
Zhihong Yu 650b321396 HBASE-5290 [FindBugs] Synchronization on boxed primitive (Ben West)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238693 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 16:52:51 +00:00
Zhihong Yu 093c7203e8 HBASE-5297 Update metrics numOpenConnections and callQueueLen directly in HBaseServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238114 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 00:37:29 +00:00
mbautin e06a31d62b [jira] [HBASE-5274] Filter out expired scanners on compaction as well
Summary: This is a followup for D1017 to make it similar to D909 (89-fb). The
fix for 89-fb used the TTL-based scanner filtering logic on both normal scanners
and compactions, while the trunk fix D1017 did not. This is just the delta
between the two diffs that brings filtering expired store files on compaction to
trunk.

Test Plan: Unit tests

Reviewers: Liyin, JIRA, lhofhansl, Kannan

Reviewed By: Liyin

CC: Liyin, tedyu, Kannan, mbautin, lhofhansl

Differential Revision: https://reviews.facebook.net/D1473

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236483 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 01:23:37 +00:00
Jonathan Hsieh 36788d1cc2 HBASE-5282 Possible file handle leak with truncated HLog file
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236445 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:30:47 +00:00
Zhihong Yu da1443d90a HBASE-5271 Result.getValue and Result.getColumnLatest return the wrong column (Ghais Issa)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:51:33 +00:00
mbautin ec1c804fc1 [jira] [HBASE-4218] HFile data block encoding framework and delta encoding
implementation (Jacek Midgal, Mikhail Bautin)

Summary:

Adding a framework that allows to "encode" keys in an HFile data block. We
support two modes of encoding: (1) both on disk and in cache, and (2) in cache
only. This is distinct from compression that is already being done in HBase,
e.g. GZ or LZO. When data block encoding is enabled, we store blocks in cache
in an uncompressed but encoded form. This allows to fit more blocks in cache
and reduce the number of disk reads.

The most common example of data block encoding is delta encoding, where we take
advantage of the fact that HFile keys are sorted and share a lot of common
prefixes, and only store the delta between each pair of consecutive keys.
Initial encoding algorithms implemented are DIFF, FAST_DIFF, and PREFIX.

This is based on the delta encoding patch developed by Jacek Midgal during his
2011 summer internship at Facebook. The original patch is available here:
https://reviews.apache.org/r/2308/diff/.

Test Plan: Unit tests. Distributed load test on a five-node cluster.

Reviewers: JIRA, tedyu, stack, nspiegelberg, Kannan

Reviewed By: Kannan

CC: tedyu, todd, mbautin, stack, Kannan, mcorgan, gqchen

Differential Revision: https://reviews.facebook.net/D447



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236031 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 02:58:57 +00:00
mbautin 07dbe903de HBASE-5230 : ensure that compactions do not cache-on-write data blocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235882 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 19:41:07 +00:00
Zhihong Yu f20083b193 HBASE-4720 revert until agreement is reached on solution
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235388 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:17:23 +00:00
Zhihong Yu f4872ddd1f HBASE-4720 Implement atomic update operations (checkAndPut, checkAndDelete) for REST client/server (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235362 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:19:59 +00:00
Michael Stack 5095b451e4 HBASE-5264 Add 0.92.0 upgrade guide
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235062 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 23:27:05 +00:00
Zhihong Yu 59b1b68d12 HBASE-5255 Use singletons for OperationStatus to save memory (Benoit)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235016 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:56:45 +00:00
Zhihong Yu 35a60f187d HBASE-5139 Addendum handles startRow being null for the case where median is in the first region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234903 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 17:07:45 +00:00
ramkrishna 3331341429 HBASE-5243 LogSyncerThread not getting shutdown waiting for the interrupted flag (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234559 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:43:16 +00:00
ramkrishna fbf165d347 HBASE-5235 HLogSplitter writer thread's streams not getting closed when any of the writer threads has exceptions.(Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234509 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 13:20:15 +00:00
Zhihong Yu da0f65de98 HBASE-5246 Regenerate code with thrift 0.8.0 (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234445 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 01:52:49 +00:00
ramkrishna fc8d2fe645 HBASE-5237 Addendum for HBASE-5160 and HBASE-4397 (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234377 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 17:47:08 +00:00
Andrew Kyle Purtell 7436e93ee9 HBASE-5228. [REST] Rip out transform feature
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 18:06:34 +00:00
Zhihong Yu 1c8829e0ad HBASE-5208 Allow setting Scan start/stop row individually in TableInputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233071 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 21:22:49 +00:00
Zhihong Yu 9b1e9d3c29 HBASE-5176 AssignmentManager#getRegion: logging nit adds a redundant '+' (Karthik K)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232567 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 20:40:26 +00:00
larsh 01246cdc99 HBASE-5203 Group atomic put/delete operation into a single WALEdit to handle region server failures. (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232551 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 19:38:13 +00:00
Zhihong Yu c0d127fcb2 HBASE-5201 Add new files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232506 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:49:34 +00:00
Zhihong Yu 916b3a166c HBASE-5201 Utilize TThreadedSelectorServer and remove redundant code in ThriftServer and HRegionThriftServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232504 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:38:58 +00:00
Zhihong Yu 174248a26f HBASE-5153 revert due to failed Jenkins builds
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232490 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:15:23 +00:00
Zhihong Yu 5ce4d352de HBASE-5153 Add retry logic in HConnectionImplementation#resetZooKeeperTrackers (Jieshan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232292 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 04:06:30 +00:00
Michael Stack e20aa2b3a6 HBASE-5204 Backward compatibility fixes for 0.92
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231985 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 13:08:54 +00:00
larsh 323d17d3ae HBASE-3584 Allow atomic put/delete in one call (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231441 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 04:59:44 +00:00
Zhihong Yu a9c183ff98 HBASE-5150 Failure in a thread may not fail a test, clean up log splitting test (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231364 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:44:03 +00:00
Michael Stack 0876497eb9 HBASE-5193 Use TBoundedThreadPoolServer in HRegionThriftServer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:23:52 +00:00
Zhihong Yu ee03d1626d HBASE-5196 Failure in region split after PONR could cause region hole (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231302 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:17:30 +00:00
Zhihong Yu 8d07130c67 HBASE-5143 Fix config typo in pluggable load balancer factory (Harsh J)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231281 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 20:07:40 +00:00
Michael Stack 1962888156 HBASE-5115 Change HBase color from purple to 'International Orange (Engineering)'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230854 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 01:21:52 +00:00
Zhihong Yu 1df784d11a HBASE-5177 Differential Revision: 1197 HTable needs a non cached version of getRegionLocation (Pritam Damania)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230725 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:46:32 +00:00
Zhihong Yu f90f4971bd HBASE-5033 Differential Revision: 933 Opening/Closing store in parallel to reduce region open/close time (Liyin)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 01:19:26 +00:00
Michael Stack 06ca87ae87 HBASE-5182 TBoundedThreadPoolServer threadKeepAliveTimeSec is not configured properly
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230306 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:52:57 +00:00
Zhihong Yu 5ad571ab6c HBASE-5139 Compute (weighted) median using AggregateProtocol
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230200 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:24:48 +00:00
Zhihong Yu 39a1e07ce4 HBASE-3565 Add metrics to keep track of slow HLog appends (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230188 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:02:28 +00:00
larsh 15c62ed21a HBASE-5121 MajorCompaction may affect scan's correctness (chunhui shen and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229806 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:39:57 +00:00
Michael Stack 9cbf9e9f4e HBASE-5172 HTableInterface should extend java.io.Closeable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 19:21:40 +00:00
Michael Stack 94342eea88 HBASE-5134 Remove getRegionServerWithoutRetries and getRegionServerWithRetries from HConnection Interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229683 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 18:52:43 +00:00
ramkrishna e06aaf4ecc HBASE-5137 MasterFileSystem.splitLog() should abort even if waitOnSafeMode() throws IOException(Ram & Ted)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229649 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 17:33:49 +00:00
Zhihong Yu 296cf139aa HBASE-5152 Region is on service before completing initialization when doing rollback of split,
it will affect read correctness (Chunhui)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229418 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 23:22:37 +00:00
Todd Lipcon 8c2a573d48 HBASE-3949. Add "Master" link to RegionServer pages. Contributed by Gregory Chanan.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229035 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 05:43:40 +00:00
larsh dd604d3136 HBASE-5088 addendum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228761 13f79535-47bb-0310-9956-ffa450edef68
2012-01-08 01:18:53 +00:00
Michael Stack d821f6fcfc HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REDO
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228749 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:47:56 +00:00
Michael Stack 45b7b8955b HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REVERT. OVER-COMMITTED. REVERTING ALL SO CAN REDO COMMIT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228747 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:46:31 +00:00
Michael Stack 25d465426a HBASE-5052 The path where a dynamically loaded coprocessor jar is copied on the local file system depends on the region name (and implicitly, the start key)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228742 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:20:45 +00:00
Michael Stack 492feb2a53 HBASE-5141 Memory leak in MonitoredRPCHandlerImpl
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228740 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:16:11 +00:00
larsh 7624bcba26 HBASE-5088 A concurrency issue on SoftValueSortedMap (Jieshan Bean and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228539 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 01:40:07 +00:00
Zhihong Yu 28bbeb76c2 HBASE-5041 Major compaction on non existing table does not throw error (Shrijeet)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228507 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 00:10:41 +00:00
Zhihong Yu 30a0a2c6d6 HBASE-4357 Region stayed in transition - in closing state (Ming Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228489 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 22:55:36 +00:00
Zhihong Yu ff3cf1aeda HBASE-5081 Distributed log splitting deleteNode races against splitLog retry (Prakash)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227951 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 03:53:58 +00:00
Zhihong Yu c3d7b8ec19 HBASE-3373 Allow regions to be load-balanced by table
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227873 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 22:22:19 +00:00
larsh 771022eed9 HBASE-5118 Fix Scan documentation (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227419 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:17:28 +00:00
larsh 49f35a7756 HBASE-2947 MultiIncrement/MultiAppend (JGray and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227382 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 23:16:54 +00:00
ramkrishna ebc3945450 HBASE-5094 The META can hold an entry for a region with a different server name from the one actually in the AssignmentManager thus making the region inaccessible. (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226165 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 18:37:08 +00:00
Zhihong Yu 453de3a66c HBASE-4397 -ROOT-, .META. tables stay offline for too long in recovery phase after all RSs
are shutdown at the same time (Ming Ma)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226110 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 15:43:19 +00:00
Zhihong Yu ddd384369f HBASE-5100 Rollback of split could cause closed region to be opened again (Chunhui)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226029 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 02:45:18 +00:00
Zhihong Yu a2471aa255 HBASE-5099 ZK event thread waiting for root region assignment may block server
shutdown handler for the region sever the root region was on (Jimmy)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225765 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 06:39:07 +00:00
Zhihong Yu 315c91901f HBASE-5103 Fix improper master znode deserialization (Jonathan Hsieh)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225622 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 19:08:38 +00:00
Zhihong Yu 270122168b HBASE-5009 Failure of creating split dir if it already exists prevents splits from happening further
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225153 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 10:07:31 +00:00
larsh 2dcc010d36 HBASE-5096 Replication does not handle deletes correctly. (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224851 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 01:44:14 +00:00
Zhihong Yu 2fe6ab663c HBASE-5010 Filter HFiles based on TTL (Mikhail)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224792 13f79535-47bb-0310-9956-ffa450edef68
2011-12-26 19:33:51 +00:00
Zhihong Yu 300f900354 HBASE-4218 Data Block Encoding of KeyValues - revert, problems were uncovered during cluster testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223042 13f79535-47bb-0310-9956-ffa450edef68
2011-12-25 02:49:46 +00:00
Zhihong Yu 499d11b741 HBASE-5070 Constraints implementation and javadoc changes (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223024 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:42:31 +00:00
Zhihong Yu cd47ea0562 HBASE-4218 Data Block Encoding of KeyValues (aka delta encoding / prefix compression) (Jacek, Mikhail)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223020 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:20:39 +00:00
Zhihong Yu 0c9fad8f6b HBASE-4938 Create a HRegion.getScanner public method that allows reading from a specified readPoint (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222890 13f79535-47bb-0310-9956-ffa450edef68
2011-12-23 23:57:55 +00:00
larsh 8b4c4f094e HBASE-4439 Move ClientScanner out of HTable (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222551 13f79535-47bb-0310-9956-ffa450edef68
2011-12-23 04:16:26 +00:00
Michael Stack 7569cea558 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED -- AGAINpatch -p0 -R < x.txt patch -p0 -R < x.txt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222046 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 05:44:29 +00:00
Michael Stack 6c97552ee1 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REAPPLY
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222045 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 05:42:05 +00:00
Michael Stack fa979ebab2 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221978 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 01:09:03 +00:00
Michael Stack 72c1f6c8c7 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221977 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 01:04:00 +00:00
Michael Stack 30f5a95a6a HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row; REMOVE OVER-COMMIT, STUFF NOT IN 4698 PATCH
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221621 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 06:01:26 +00:00
Michael Stack df77a4b0b3 HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221620 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 06:00:05 +00:00
Michael Stack c5b874fff0 HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS -- fix compile error
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221604 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:12:17 +00:00
Michael Stack 04dd71214a HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221601 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:06:03 +00:00
Michael Stack f000c951c6 HBASE-5078 DistributedLogSplitter failing to split file because it has edits for lots of regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221596 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:00:47 +00:00
Michael Stack cd508de041 HBASE-5021 Enforce upper bound on timestamp
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221592 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 03:51:42 +00:00
Nicolas Spiegelberg 82e376b3ea [jira] [HBase-5021] Enforce upper bound on timestamp
Summary:
We have been getting hit with performance problems on the ODS
side due to invalid timestamps being inserted by the timestamp.  ODS is
working on adding proper checks to app server, but production
performance could be severely impacted with significant recovery time if
something slips past.  Therefore, we should also allow the option to
check the upper bound in HBase.

This is the first draft.  Probably should allow per-CF customization.

Test Plan:  - mvn test -Dtest=TestHRegion#testPutWithTsTooNew

Reviewers: Kannan, Liyin, JIRA

CC: stack, nspiegelberg, tedyu, Kannan, mbautin

Differential Revision: 849

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221532 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 00:02:55 +00:00
Jean-Daniel Cryans a952738257 Fixing the link for ZK session expiration
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221527 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 23:40:10 +00:00
Nicolas Spiegelberg 9a0eb6f0c2 [jira] [HBASE-5072] Support Max Value for Per-Store Metrics
Summary:
We were bit in our multi-tenant cluster because one of our Stores
encountered a bug and grew its StoreFile count. We didn't notice this because
the StoreFile count currently reported by the RegionServer is an average of all
Stores in the region. For the per-Store metrics, we should also record the max
so we can notice outliers.

Test Plan: - mvn test -Dtest=TestRegionServerMetrics

Reviewers: JIRA, mbautin, Kannan

Reviewed By: Kannan

CC: stack, nspiegelberg, mbautin, Kannan

Differential Revision: 945

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221419 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 18:42:11 +00:00
Michael Stack 8fe40ce0e9 HBASE-5063 RegionServers fail to report to backup HMaster after primary goes down
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221121 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 06:46:17 +00:00
Michael Stack 77e16e8027 HBASE-4935 hbase 0.92.0 doesn't work going against 0.20.205.0, its packaged hadoop
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221033 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 00:10:02 +00:00
Michael Stack 1222383f1d HBASE-5029 TestDistributedLogSplitting fails on occasion; Added catch of NPE and reenabled ignored test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220991 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 23:04:15 +00:00
larsh 2062ea1d00 HBASE-5058 Allow HBaseAmin to use an existing connection (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220989 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 23:01:26 +00:00
Michael Stack 1f8021eca9 HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220864 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 17:24:33 +00:00
Zhihong Yu 4e09ea6be8 HBASE-5060 HBase client is blocked forever (Jinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220863 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 17:24:21 +00:00
Michael Stack a46959a370 HBASE-5062 Missing logons if security is enabled
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220829 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 16:26:22 +00:00
larsh 818adb795b HBASE-4970 Add a parameter so that keepAliveTime of Htable thread pool can be changed (gaojinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220626 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 06:57:08 +00:00
Michael Stack d9c8e9954a HBASE-4934 Display Master server and Regionserver start time on respective info servers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220304 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 00:04:23 +00:00
Michael Stack 46eef1e255 HBASE-5049 TestHLogSplit.testLogRollAfterSplitStart not working due to HBASE-5006
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215371 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:48:34 +00:00
Michael Stack 175ef436b6 HBASE-4935 hbase 0.92.0 doesn't work going against 0.20.205.0, its packaged hadoop -- revert from TRUNK though this change was added as part of HBASE-4908
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215353 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:09:02 +00:00
Zhihong Yu 0c5abfccd7 HBASE-5053 HCM Tests leak connections (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215314 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 22:05:02 +00:00
Zhihong Yu 3f016b62fd HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call - revert
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215307 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 21:55:16 +00:00
Zhihong Yu 15d9af3d42 HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215236 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 18:17:32 +00:00
Kannan Muthukkaruppan 3772951b9d HBASE-5014 PutSortReducer should adhere to memory limits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214968 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 22:09:44 +00:00
Jean-Daniel Cryans 7e095fa615 HBASE-4683 Always cache index and bloom blocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214902 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:26:35 +00:00
Zhihong Yu 063fa64fd5 HBASE-4605 Constraints, remove .orig files accidentally added in previous commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214892 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:52:04 +00:00
Zhihong Yu 5166afddc5 HBASE-4605 Constraints (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214889 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:44:59 +00:00
Michael Stack 32490bddce HBASE-5038 Some tests leak connections
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214839 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 16:20:41 +00:00
Zhihong Yu e85d2d45d3 HBASE-5026 Add coprocessor hook to HRegionServer.ScannerListener.leaseExpired()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214431 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:57:42 +00:00
Michael Stack bade2361c9 HBASE-4993 Performance regression in minicluster creation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214419 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:39:23 +00:00
Zhihong Yu 9ed28b472c HBASE-5022 Optimize HBaseConfiguration#create (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214366 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 17:30:44 +00:00
larsh cd0c4cffa9 HBASE-5001 Improve the performance of block cache keys (Lars H and J-D)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213995 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 00:05:04 +00:00
Jean-Daniel Cryans 69b7530f60 HBASE-5017 Bump the default hfile.block.cache.size because of HFileV2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213950 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 21:55:36 +00:00
Michael Stack 4de54f3552 HBASE-5006 Move hbase 0.92RC1 on to hadoop 1.0.0RC2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213928 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 21:01:44 +00:00
karthik 34dc2a4b66 [jira] [HBASE-4661] get list of store files.
Summary:
1. Ported getStoreFileList API to trunk.
2. Also ported flushRegion API to trunk (with option of flushing if
lastFlushTime < TS).

Test Plan: Tested on 89.

Reviewers: Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: Karthik

CC: HBase Diffs Facebook Group, Karthik, Kannan, stack, madhuvaidya

Differential Revision: 729

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213487 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:58:51 +00:00
Michael Stack 4b8eb16ea9 HBASE-4997 SplitLogManager can have a race on batch.installed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213479 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 22:46:33 +00:00
Michael Stack 747b5cb124 HBASE-4881 Unhealthy region is on service caused by rollback of region splitting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213383 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 19:24:28 +00:00
Michael Stack c7c688679a HBASE-5008 The clusters can't provide services because Region can't flush.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213358 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:43:49 +00:00
Michael Stack 28ee3bf9ba HBASE-4989 Metrics to measure sequential reads and random reads separately
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213345 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 18:21:37 +00:00
Michael Stack 756aa7ff16 HBASE-5007 HBaseAdmin.stopRegionServer do not stop the region server
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213102 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 23:05:14 +00:00
larsh a443b9f338 HBASE-5005 Add DEFAULT_MIN_VERSIONS to HColumnDescriptor.DEFAULT_VALUES
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212737 13f79535-47bb-0310-9956-ffa450edef68
2011-12-10 06:21:19 +00:00
Michael Stack 2261fc23c9 HBASE-4859 Correctly PreWarm HBCK ThreadPool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212701 13f79535-47bb-0310-9956-ffa450edef68
2011-12-10 00:40:01 +00:00
larsh 3e608b3979 HBASE-4998 Support deleted rows in CopyTable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212671 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 22:39:02 +00:00
Michael Stack 1bed70fd99 HBASE-4992 Use a UUID for HFileOutputFormat partition path name
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212581 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 19:08:11 +00:00
Michael Stack 69b505b4da HBASE-4995 Increase zk maxClientCnxns to give us some head room
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212570 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 18:44:03 +00:00
Michael Stack 844819717c HBASE-4994 TestHeapSize broke in trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212549 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 17:56:12 +00:00
Michael Stack 0b0fa97084 HBASE-4969 tautology in HRegionInfo.readFields
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212259 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 06:44:51 +00:00
Michael Stack 2704cd8a57 HBASE-4987 wrong use of incarnation var in SplitLogManager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212256 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 06:16:03 +00:00
Michael Stack 307ca7c68b HBASE-4880 Region is on service before openRegionHandler completes, may cause data loss
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212251 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 05:59:34 +00:00
Zhihong Yu abf897ad42 HBASE-4946 HTable.coprocessorExec (and possibly coprocessorProxy) does not work with
dynamically loaded coprocessors (Andrei Dragomir)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212250 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 05:58:05 +00:00
larsh e167c8ab28 HBASE-4682 Support deleted rows using Import/Export (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212181 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:16:55 +00:00
larsh 14a266fb6c HBASE-4981 add raw scan support to shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212178 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:01:08 +00:00
Michael Stack c1ae21cc93 HBASE-4980 Null pointer exception in HBaseClient receiveResponse
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212167 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:17:37 +00:00
Michael Stack 1f12fbf6d3 HBASE-4973 On failure, HBaseAdmin sleeps one time too many
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1212165 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 22:14:04 +00:00
larsh 0418f67d37 HBASE-4979 Setting KEEP_DELETE_CELLS fails in shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211768 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 06:43:41 +00:00
Nicolas Spiegelberg 09d0aff149 [jira] [HBASE-4908] HBase cluster test tool (port from 0.89-fb)
Summary:
Porting one of our HBase cluster test tools (a single-process multi-threaded
load generator and verifier) from 0.89-fb to trunk.
I cleaned up the code a bit compared to what's in 0.89-fb, and discovered that
it has some features that I have not tried yet (some kind of a kill test, and
some way to run HBase as multiple processes on one machine).
The main utility of this piece of code for us has been the HBaseClusterTest
command-line tool (called HBaseTest in 0.89-fb), which we usually invoke as a
load test in our five-node dev cluster testing, e.g.:

hbase org.apache.hadoop.hbase.util.LoadTestTool -write 50💯20 -tn loadtest4
-read 100:10 -zk <zk_quorum_node> -bloom ROWCOL -compression LZO -key_window 5
-max_read_errors 10000 -num_keys 10000000000 -start_key 0

Test Plan:
Run this on a dev cluster. Run all unit tests.

Reviewers: stack, Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: stack, nspiegelberg, mbautin, Karthik

Differential Revision: 549

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211746 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:38:27 +00:00
Michael Stack 77dae7ccb7 HBASE-4976 Add compaction/flush queue size metrics mistakenly removed by HFile v2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211719 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 00:11:26 +00:00
Zhihong Yu f4ef4485a7 HBASE-4610 Addendum removes break statement
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211706 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 23:38:06 +00:00
Zhihong Yu 7a36cab817 HBASE-4610 Port HBASE-3380 (Master failover can split logs of live servers) to 92/trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211695 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 22:59:06 +00:00
Zhihong Yu bb7f82ac71 HBASE-4927 Addendum fixes case where start key is empty and end key is empty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211632 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 21:05:59 +00:00
Michael Stack dc104e7669 HBASE-4936 Cached HRegionInterface connections crash when getting UnknownHost exceptions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211232 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 23:48:13 +00:00
Michael Stack 1f176022fe HBASE-4927 CatalogJanior:SplitParentFirstComparator doesn't sort as expected, for the last region when the endkey is empty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211204 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:15:11 +00:00
Michael Stack cb4320232d HBASE-4729 Clash between region unassign and splitting kills the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211197 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:02:10 +00:00
Nicolas Spiegelberg 9498f9baf3 HBASE-4860 RegionSplitter Should Allow NSFRE during logical split verification
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210699 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 23:14:31 +00:00
Nicolas Spiegelberg 806ccf03dd HBASE-4932 Block cache can be mistakenly instantiated by tools
Summary: disable block cache for HFile writers created for tools

Test Plan:
ran the following tests that call getWriterFactory

test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFilePerformance.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileSeek.java
test/java/org/apache/hadoop/hbase/io/hfile/TestReseekTo.java
test/java/org/apache/hadoop/hbase/io/hfile/TestSeekTo.java
test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java
test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java
test/java/org/apache/hadoop/hbase/regionserver/TestHRegionServerBulkLoad.java
test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALReplay.java

Reviewers: dhruba, jgray, nspiegelberg, JIRA, mbautin

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, mbautin, khemani, nspiegelberg

Differential Revision: 573

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210697 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 23:01:48 +00:00
Nicolas Spiegelberg b955fa6c32 Ability to calculate the blockcache hit ratio for the last few minutes
Summary:
The metric blockcacheHitRatio is since the beginning of time. It would be nice
to calculate the block cache hit ratio for the past few minutes.

This patch remembers the blockcacheHitRatio for the last 5 periods by default.

Test Plan: unit test attached.

Reviewers: jgray, khemani, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, dhruba

Differential Revision: 585

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210640 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:17:47 +00:00
Andrew Kyle Purtell d9f39151c5 HBASE-4944. Optionally verify bulk loaded HFiles
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210311 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 02:20:55 +00:00
Zhihong Yu 5021d29ef4 HBASE-4942 HMaster is unable to start of HFile V1 is used (Honghua Zhu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210303 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 01:11:10 +00:00
larsh 8fe805ce29 HBASE-4945 NPE in HRegion.bulkLoadHFiles (Andrew P and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210212 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:54:37 +00:00
Doug Meil 73b59715e9 hbase-4941. Fixed mis-spelling of 'configuration' in 2 places (configuration.xml and hbase-default.xml)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209912 13f79535-47bb-0310-9956-ffa450edef68
2011-12-03 13:53:48 +00:00
Michael Stack 5a0f0313b9 HBASE-4899 Region would be assigned twice easily with continually killing server and moving region in testing environment
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209367 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 05:55:25 +00:00
Michael Stack 1e2757e33b HBASE-4918 HTablePool Constructor may cause unintended behavior
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209210 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 19:44:53 +00:00
larsh 9581eea546 HBASE-4903 Return a result from RegionObserver.preIncrement (Daniel Gómez Ferro)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208952 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 05:06:24 +00:00
karthik 50de126b79 HBASE-4463 [jira] Run more aggressive compactions during off peak hours
Summary:
HBASE-4463 Run more aggressive compactions during off peak hours

Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at any
point.

The number of iops on the disk and the top of the rack bandwidth utilization at
off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.

Test Plan: Started running the unit tests.

Reviewers: JIRA, Kannan, nspiegelberg, mbautin, stack

Reviewed By: nspiegelberg

CC: nspiegelberg, tedyu, lhofhansl, Karthik

Differential Revision: 471

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208885 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 23:42:21 +00:00
karthik a9ca67a2c5 [jira] [HBASE-4867] A tool to merge configuration files
Summary: With our cluster configuration setup it would be good to have a tool
that would merge HBase configuration files so that files appearing later in the
list would override properties specified in earlier files. This way we could
merge an application-specific configuration file with a cluster-specific
configuration file (with the latter overriding the former) and produce a single
HBase configuration file to install on the cluster.

Test Plan: Run the tool on two configuration files (common and
cluster-specific). Use the resulting configuration on a dev cluster.

Reviewers: todd, Karthik, tedyu, stack, JIRA

Reviewed By: Karthik

CC: Karthik, mbautin, todd

Differential Revision: 537

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208832 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 22:12:22 +00:00
Todd Lipcon 54e463f519 HBASE-4820. Distributed log splitting coding enhancement to make it easier to understand, no semantics change. Contributed by Jimmy Xiang.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208801 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 21:28:36 +00:00
karthik 99263fecfc HBASE-4721 Retain Delete Markers after Major Compaction
Summary: major compactions *try* to retain delete markers for the configured
time interval

Test Plan:
added a new test testDeleteMarkerLongevity() in TestStoreScanner

following tests passed
TestMemStore
TestStoreScanner
TestQueryMatcher
TestCompaction

Reviewers: jgray, dhruba, lhofhansl, Karthik, nspiegelberg

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, lhofhansl, khemani, nspiegelberg

Differential Revision: 321

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208055 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 20:31:57 +00:00
Michael Stack 8db322ebdd HBASE-4889 HRegionInfo.isMetaTable() should be true for -ROOT- regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208006 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 18:29:31 +00:00
larsh 01652cecb9 HBASE-4886 - truncate fails in HBase shell (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207651 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 22:12:25 +00:00
Zhihong Yu bdc28714e1 HBASE-4878 Master crash when splitting hlog may cause data loss (Chunhui Shen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207560 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 20:10:58 +00:00
Zhihong Yu d88f53bced HBASE-4773 HBaseAdmin may leak ZooKeeper connections (Xufeng)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207297 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 15:30:55 +00:00
Zhihong Yu b1159115a4 HBASE-4862 Splitting hlog and opening region concurrently may cause data loss
(Chunhui Shen)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206965 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 02:35:35 +00:00
Zhihong Yu f584f12260 HBASE-4833 HRegionServer stops could be 0.5s faster (N Keywal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206490 13f79535-47bb-0310-9956-ffa450edef68
2011-11-26 16:50:35 +00:00
Zhihong Yu 91a19bf59a HBASE-4863 Phabricator D531 Make Thrift server thread pool bounded and add a command-line UI test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206267 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 17:26:40 +00:00
Zhihong Yu 3ba5e7b318 HBASE-4855 SplitLogManager hangs on cluster restart due to batch.installed doubly counted
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205959 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 19:03:46 +00:00
Michael Stack 8d056194e1 HBASE-4861 Fix some misspells and extraneous characters in logs; set some to TRACE
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205732 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 06:13:10 +00:00
Michael Stack fc20e56a0f HBASE-4853 HBASE-4789 does overzealous pruning of seqids
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205722 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 04:24:56 +00:00
Michael Stack aaabb3e8a5 HBASE-4853 HBASE-4789 does overzealous pruning of seqids; REVERT TEMPORARILY TO GET TED COMMENT IN
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205721 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 04:22:05 +00:00
Michael Stack 054c0a2418 HBASE-4853 HBASE-4789 does overzealous pruning of seqids
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205719 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 04:13:09 +00:00
Zhihong Yu 2c1c5223f4 HBASE-4739 Master dying while going to close a region can leave it in transition
forever (Gao Jinchao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205706 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 02:09:09 +00:00
Nicolas Spiegelberg 2fb8275da0 HBASE-4787 Rename HTable thread pool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205684 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 00:46:05 +00:00
karthik a01617ba90 HBASE-4772 Utility to Create StoreFiles
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205661 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 23:34:09 +00:00
Nicolas Spiegelberg 0d73a879b3 HBASE-4785 Improve recovery time of HBase client when a region server dies.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205656 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 23:21:47 +00:00
ramkrishna 42104d08f2 HBASE-4308 Race between RegionOpenedHandler and AssignmentManager(Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205513 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:03:10 +00:00
Nicolas Spiegelberg 10407c9a16 HBASE-4783 Improve RowCounter to count rows in a specific key range.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205510 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 17:48:26 +00:00
Zhihong Yu 351e75629f HBASE-4797 [availability] Skip recovered.edits files with edits we know older than what region currently has (Jimmy Jiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205290 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 05:23:45 +00:00
Nicolas Spiegelberg 4a2bea25be [jira] [HBASE-4809] Per-CF set RPC metrics
Summary: Porting RPC metrics incremented for each column family set touched by a
request from 0.89-fb.

Test Plan:
Unit tests, 5-node cluster. Observe metrics through JMX.
The current version of patch compiles but no testing done yet.

Reviewers: nspiegelberg, JIRA, Kannan, Karthik

Reviewed By: nspiegelberg

CC: nspiegelberg, mbautin

Differential Revision: 483

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204799 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 03:48:58 +00:00
Michael Stack 23532b3538 HBASE-4798 Sleeps and synchronisation improvements for tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204769 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 01:04:40 +00:00
Zhihong Yu 7a8c36be23 HBASE-4213 Support for fault tolerant, instant schema updates with out master's intervention through ZK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204611 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 17:29:32 +00:00
Andrew Kyle Purtell 46b1b65cc7 HBASE-2418 Support for ZooKeeper authentication
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204227 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 19:46:21 +00:00
Michael Stack 72c3a34146 HBASE-4829 Fix javadoc warnings in 0.92 branch
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204094 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 22:11:17 +00:00
Michael Stack 39d7828814 HBASE-4789 On split, parent region is sticking around in oldest sequenceid to region map though not online; we don't cleanup WALs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204034 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 18:27:51 +00:00
Michael Stack eba8dab3ec HBASE-4436 Remove @deprecated Scan methods in 0.90 from TRUNK and 0.92
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203959 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 04:45:14 +00:00
Michael Stack c42e7e1028 HBASE-4815 Disable online altering by default, create a config for it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203916 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 00:26:59 +00:00
Gary Helmling cc7e469310 HBASE-3025 Security: coprocessor based access control
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203909 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 00:15:27 +00:00
Michael Stack b5f5e2aeeb HBASE-4816 Regionserver wouldn't go down because split happened exactly at same time we issued bulk user region close call on our way out
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203814 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 20:01:30 +00:00
Michael Stack 8df0e84cf7 HBASE-4819 TestShell broke in trunk; typo
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203788 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 18:45:51 +00:00
Gary Helmling e0e0d94f97 HBASE-2742 Provide strong authentication with a secure RPC engine
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203515 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 07:34:43 +00:00
Nicolas Spiegelberg e7fb30c371 HBASE-4544 change RWCC to MVCC
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203468 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:37 +00:00
Nicolas Spiegelberg 1e68440431 HBASE-4594 Fix maxVersions when scanning a file with a TS > read point
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203467 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:33 +00:00
Nicolas Spiegelberg 619d1a327e HBASE-4485 Eliminate window of missing Data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203466 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:28 +00:00
Nicolas Spiegelberg d116edef93 HBASE-2856 Cross Column Family Read Atomicity
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203465 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:24 +00:00
larsh a9253a7104 HBASE-4805 Allow better control of resource consumption in HTable (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203428 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 23:58:57 +00:00
Kannan Muthukkaruppan 3039d61014 HBASE-4628 [jira] Enhance Table Create Presplit Functionality within the HBase
Shell

Summary:
HBase shell can algorithmically split a new table at creation

This change adds optional arguments to the HBase shell's create command
to split a table into a specified number of regions using a specified
splitting algorithm as defined by RegionSplitter.

Currently, we allow the user to presplit in the HBase shell by explicitly
listing the startkey of all the region shards that they want.  Instead, we
should provide the RegionSplitter functionality of choosing a split algorithm,
followed by the number of splits that they want.

Test Plan:
Created tables with and without splits using the shell; also attampted
to give incorrect arguments to shell create command.

Reviewers: nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, lhofhansl

Differential Revision: 429

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203413 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 23:01:59 +00:00
Michael Stack c9d5a838d0 HBASE-4799 Catalog Janitor logic bug causes region leackage
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203308 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 18:16:30 +00:00
Todd Lipcon 9c6b3b375d HBASE-4806 Fix logging message in HbaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203284 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 17:18:03 +00:00
Zhihong Yu ac6e9a1125 HBASE-4796 Race between SplitRegionHandlers for the same region kills the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202935 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 23:40:29 +00:00
Michael Stack e84b62cbb0 HBASE-4801 alter_status shell prints sensible message at completion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202914 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 22:46:14 +00:00
larsh 99724ae460 HBASE-4800 Result.compareResults is incorrect (James Taylor and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202827 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 18:38:12 +00:00
Michael Stack 207ca9895f HBASE-4795 Fix TestHFileBlock when running on a 32-bit JVM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202518 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 03:04:10 +00:00
Zhihong Yu 1ae05e5dd3 HBASE-4793 HBase shell still using deprecated methods removed in HBASE-4436
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202493 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 01:04:45 +00:00
Jean-Daniel Cryans eb5e28e4e1 HBASE-4792 SplitRegionHandler doesn't care if it deletes the znode or not,
leaves the parent region stuck offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202487 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 00:42:52 +00:00
Gary Helmling 3f423daca0 HBASE-4784 Handle void return types in CoprocessorProtocol methods
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202336 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 17:55:48 +00:00
Nicolas Spiegelberg 548a74e9b4 HBASE-4768 Per-(table, columnFamily) metrics with configurable table name inclusion
Summary: This is an initial version of an HBase trunk diff for per-table/CF
metrics (see JIRA for details). Unit tests mostly pass -- need to look into
TestDistributedLogSplitting. Also still doing cluster testing.

Test Plan: Unit tests, single-node cluster, dev cluster. Need to try bulk-load
map-reduce jobs as well. Observe metrics through JMX.

Reviewers: jgray, nspiegelberg, stack, tedyu, todd, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, Liyin, mbautin, tedyu

Differential Revision: 363

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201994 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:26:05 +00:00
Michael Stack 1c9f356fca HBASE-4780 Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201954 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:50:10 +00:00
Nicolas Spiegelberg 6ebf318735 HBASE-4778 Don't ignore corrupt StoreFiles when opening a region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201940 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:29:03 +00:00
Zhihong Yu 7d23c9afb1 HBASE-4752 Don't create an unnecessary LinkedList when evicting from the BlockCache
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201516 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 21:17:35 +00:00
Michael Stack 94a06fb391 HBASE-4777 Write back to client 'incompatible' if we show up with wrong version
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201400 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 04:56:26 +00:00
Zhihong Yu 62b5c04786 HBASE-4478 Improve AssignmentManager.handleRegion so that it can process certain ZK state
in the case of RS offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201186 13f79535-47bb-0310-9956-ffa450edef68
2011-11-12 04:40:41 +00:00
Michael Stack 3e37baa9f3 HBASE-4577 Region server reports storefileSizeMB bigger than storefileUncompressedSizeMB
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201106 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:40:29 +00:00
Michael Stack 902cd7e192 HBASE-4511 There is data loss when master failovers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201104 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:36:47 +00:00
Michael Stack 7671b5d49d HBASE-4723 Loads of NotAllMetaRegionsOnlineException traces when starting the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201097 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:21:07 +00:00
larsh 571e8f8520 HBASE-3433 Remove the KV copy of every KV in Scan; introduced by HBASE-3232
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201094 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:19:28 +00:00
Michael Stack a51931de2d HBASE-4734 [bulk load] Warn if bulk load directory contained no files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200958 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 17:09:12 +00:00
Nicolas Spiegelberg 4206b1e860 [debug] Have NSFRE messages also display the row associated with the region request.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200691 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 02:11:03 +00:00
Nicolas Spiegelberg b45fd73378 HBASE-4769 Abort RegionServer Immediately on OOME
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200662 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:33:46 +00:00
Michael Stack 45a629cd76 HBASE-4741 Online schema change doesn't return errors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200660 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:24:04 +00:00
Michael Stack 274e7c2743 HBASE-4288 "Server not running" exception during meta verification causes RS abort
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200648 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:58:06 +00:00
Nicolas Spiegelberg 04afdf9633 HBASE-3690 Option to Exclude Bulk Import Files from Minor Compaction
Summary:
We ran an incremental scrape with HFileOutputFormat and
encountered major compaction storms. This is caused by the bug in
HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We
realized that a quicker solution for avoiding these compaction storms is
to simply exclude bulk import files from minor compactions and let them
only be handled by time-based major compactions. Add with functionality
along with a config option to enable it.

Rewrote this feature to be done on a per-bulkload basis.

Test Plan:
 - mvn test -Dtest=TestHFileOutputFormat

DiffCamp Revision:

Reviewers: stack, Kannan, JIRA, dhruba

Reviewed By: stack

CC: dhruba, lhofhansl, nspiegelberg, stack

Differential Revision: 357

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200621 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:31:13 +00:00
Nicolas Spiegelberg 6c57076f7e HBASE-4765 Enhance HLog Metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200619 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:29:16 +00:00
Andrew Kyle Purtell 373c98b0df HBASE-4554 Allow set/unset coprocessor table attributes from shell (Mingjie Lai)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200436 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 17:15:20 +00:00
Nicolas Spiegelberg e896f6d400 Upgrade nextKeyValue() error message from debug to info to highlight MR generation failures
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199605 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 03:48:11 +00:00
Zhihong Yu 78ebe94d05 HBASE-4740 [bulk load] the HBASE-4552 API can't tell if errors on region server are recoverable
(Jonathan Hsieh)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199017 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 23:51:56 +00:00
Zhihong Yu d54b1fdee7 HBASE-4754 FSTableDescriptors.getTableInfoPath() should handle FileNotFoundException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198953 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 21:40:28 +00:00
Zhihong Yu f7e925c8d3 HBASE-4746 Use a random ZK client port in unit tests so we can run them in parallel
(Mikhail Bautin)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198856 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 18:22:57 +00:00
Michael Stack 02f6104dc2 HBASE-4753 org.apache.hadoop.hbase.regionserver.TestHRegionInfo#testGetSetOfHTD throws NPE on trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198581 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 22:47:17 +00:00
Michael Stack 7d8d42d01b HBASE-3939 Some crossports of Hadoop IPC fixes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198573 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 21:48:31 +00:00
Michael Stack 7052e59b38 HBASE-4749 TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS occasionally fails
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198007 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 18:45:24 +00:00
Andrew Kyle Purtell c775d60de6 HBASE-4745 LRU statistics thread should be a daemon
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197864 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 01:48:45 +00:00
Michael Stack 56e19a72dc HBASE-4725 NPE in AM#updateTimers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197815 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 23:10:08 +00:00
Michael Stack bb0c9a11d8 HBASE-4553 The update of .tableinfo is not atomic; we remove then rename
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197812 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 23:03:29 +00:00
Michael Stack 2ce1d7c97c HBASE-4722 TestGlobalMemStoreSize has started failing; ADDENDUM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197349 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 23:39:48 +00:00
Michael Stack 92b57170e9 HBASE-4298 Support to drain RS nodes through ZK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197256 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 18:34:41 +00:00
Zhihong Yu 76060691bb HBASE-4609 ThriftServer.getRegionInfo() is expecting old ServerName format, need to
use new Addressing class instead (Jonathan Gray)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196873 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 23:48:22 +00:00
Nicolas Spiegelberg b44e09085c HBASE-2312 [jira] Possible data loss when RS goes into GC pause while rolling
HLog

Summary:
There is a very corner case when bad things could happen(ie data loss):

1)	RS #1 is going to roll its HLog - not yet created the new one, old one will
get no more writes
2)	RS #1 enters GC Pause of Death
3)	Master lists HLog files of RS#1 that is has to split as RS#1 is dead, starts
splitting
4)	RS #1 wakes up, created the new HLog (previous one was rolled) and appends an
edit - which is lost

The following seems like a possible solution:

1)	Master detects RS#1 is dead
2)	The master renames the /hbase/.logs/<regionserver name>  directory to
something else (say /hbase/.logs/<regionserver name>-dead)
3)	Add mkdir support (as opposed to mkdirs) to HDFS - so that a file create
fails if the directory doesn't exist. Dhruba tells me this is very doable.
4)	RS#1 comes back up and is not able create the new hlog. It restarts itself.

Test Plan: EMPTY
Reviewers: JIRA, stack, khemani
Reviewed By: khemani
CC: tedyu, nspiegelberg, stack, Kannan, khemani, jgray
Differential Revision: 99

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196773 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 19:24:23 +00:00
Nicolas Spiegelberg 119ae0c4ac [jira] [HBASE-4627] Ability to specify a custom start/end to RegionSplitter
Summary:
[HBASE-4627]

added a custom start/end row to RegionSplitter.  Also solved
an off-by-one error because the end row is prefix-inclusive and not
exclusive.

<a href="https://issues.apache.org/jira/browse/HBASE-4489" title="Better key splitting in RegionSplitter"><del>HBASE-4489</del></a> changed the default endKey on HexStringSplit from 7FFF... to FFFF...  While this is correct, existing users of 0.90 RegionSplitter have 7FFF as the end key in their schema and the last region will not split properly under this new code.  We need to let the user specify a custom start/end key range for when situations like this arise.  Optimally, we should also write the start/end key in META so we could figure this out implicitly instead of requiring the user to explicitly specify it.

Test Plan:
 - mvn test -Dtest=TestRegionSplitter

CC: JIRA

Reviewers: DUMMY_REVIEWER

Differential Revision: 39

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196772 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 19:24:18 +00:00
Zhihong Yu 5721a5ac53 HBASE-4716 Addendum Use Preconditions and remove enum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196749 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 18:35:52 +00:00
Zhihong Yu 0e32567cdd HBASE-4716 Improve locking for single column family bulk load
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196674 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 16:28:09 +00:00
Michael Stack d6601d1d17 HBASE-4713 Raise debug level to warn on ExecutionException in HConnectionManager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196592 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 14:15:54 +00:00
Zhihong Yu 061c22b302 SE-4377 [hbck] Offline rebuild .META. from fs data only
(Jonathan Hsieh)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196527 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 09:51:19 +00:00
Zhihong Yu 1b63b76e69 HBASE-1744 Thrift server to match the new java api (Tim Sell)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196451 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 04:26:26 +00:00
Jean-Daniel Cryans 930eb49759 HBASE-3515 [replication] ReplicationSource can miss a log after RS comes out of GC
(fixing a missing handling of IOE in Replication)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196402 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:05:55 +00:00
Jean-Daniel Cryans 08a9170236 HBASE-3515 [replication] ReplicationSource can miss a log after RS comes out of GC
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196398 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:44:02 +00:00
Michael Stack 850bb134a6 HBASE-3680 Publish more metrics about mslab; REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196389 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:19:59 +00:00
Michael Stack e44d373842 HBASE-4708 Revert safemode related pieces of hbase-4510
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196321 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 22:10:10 +00:00
Nicolas Spiegelberg 8742f64536 Revert "HBASE-4627 Ability to specify a custom start/end to RegionSplitter"
This reverts commit r1196256.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196258 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 20:25:08 +00:00
Nicolas Spiegelberg 1b70625b81 HBASE-4627 Ability to specify a custom start/end to RegionSplitter (unintended commit)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196256 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 20:23:47 +00:00
Jonathan Gray 8e2dea1eb4 HBASE-4696 HRegionThriftServer' might have to indefinitely do redirtects (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196254 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 20:14:42 +00:00
Michael Stack d8516489ff HBASE-3680 Publish more metrics about mslab; REVERTED
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196236 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 19:39:20 +00:00
Michael Stack 61735778e9 HBASE-3680 Publish more metrics about mslab
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196232 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 19:32:53 +00:00
Michael Stack d5364c2bfd HBASE-4695 WAL logs get deleted before region server can fully flush
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196220 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 19:12:11 +00:00
Gary Helmling e34c773792 HBASE-4710 UnknownProtocolException should abort client retries as a DoNotRetryIOException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196185 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 18:15:11 +00:00
Michael Stack df053660bf HBASE-4714 Don't ship w/ icms enabled by default; REVERT -- I overcommitted by mistake
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196117 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:45:31 +00:00
Michael Stack a47b0b3293 HBASE-4714 Don't ship w/ icms enabled by default
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196114 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:44:38 +00:00
Michael Stack 9018d028e1 HBASE-4703 Improvements in tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1195833 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:36:12 +00:00
Zhihong Yu e29a6c1b3b HBASE-4669 Add an option of using round-robin assignment for enabling table
(Jieshan Bean)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1195670 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 21:00:48 +00:00
Michael Stack f6ad8d2647 HBASE-4680 FSUtils.isInSafeMode() checks should operate on HBase root dir, where we have permissions; REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1195588 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 18:09:17 +00:00
Zhihong Yu e32b161c8f HBASE-4552 multi-CF bulk load is not atomic across column families (Jonathan Hsieh)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1195574 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:26:42 +00:00
Michael Stack b625995326 HBASE-4613 hbase.util.Threads#threadDumpingIsAlive sleeps 1 second, slowing down the shutdown by 0.5s
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1195056 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 22:01:59 +00:00
Michael Stack f686732973 HBASE-4701 TestMasterObserver fails up on jenkins
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1194900 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 15:03:30 +00:00
Zhihong Yu 2b021bce11 HBASE-4694 Addendum, revert non-logging statements in DefaultLoadBalancer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190747 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 03:35:05 +00:00
Michael Stack 9586812380 HBASE-4436 Remove trivial 0.90 deprecated code from 0.92 and trunk.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190675 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 23:40:32 +00:00
Michael Stack 8c6f8b4b96 HBASE-4694 Some cleanup of log messages in RS and M
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190669 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 23:20:14 +00:00
Michael Stack bdd4b8d012 HBASE-4699 Cleanup the UIs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190662 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 23:05:57 +00:00
larsh 45f44dc9ea HBASE-4691 Remove more unnecessary byte[] copies from KeyValues
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190640 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 22:29:49 +00:00
Jonathan Gray 94d1cc12ab HBASE-4687 regionserver may miss zk-heartbeats to master when replaying edits at region open (prakash via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190610 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:54:30 +00:00
Zhihong Yu e99dc7fa83 HBASE-4532 remove system.out.println (Jonathan Hsieh)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190607 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:49:46 +00:00
Jonathan Gray 804e99e4d0 HBASE-4528 The put operation can release the rowlock before sync-ing the Hlog (dhruba via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190606 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:49:38 +00:00
Jonathan Gray 9d172f9b96 HBASE-4641 Block cache can be mistakenly instantiated on Master (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190604 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:43:58 +00:00
Gary Helmling b5929431a5 HBASE-4680 FSUtils.isInSafeMode() checks should operate on HBase root dir, where we have permissions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190428 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 16:25:34 +00:00
Michael Stack 86f20b257f HBASE-4692 HBASE-4300 broke the build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190176 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:59:47 +00:00
Michael Stack 91090148f7 HBASE-4304 requestsPerSecond counter stuck at 0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190167 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:09:32 +00:00
Nicolas Spiegelberg 0e83d7445d HBASE-4679 Thrift null mutation error
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190143 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 03:29:52 +00:00
Michael Stack bf0f06c569 HBASE-4300 Start of new-version master fails if old master's znode is hanging around
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190068 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:20:02 +00:00
Michael Stack 421ae8504c HBASE-4388 Second start after migration from 90 to trunk crashes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1190027 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 21:05:55 +00:00
larsh 9f2204fbe3 HBASE-4673 NPE in HFileReaderV2.close during major compaction when hfile.block.cache.size is set to 0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1189481 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 21:32:43 +00:00
larsh 9efd27b733 HBASE-4648 Bytes.toBigDecimal() doesn't use offset
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1189351 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:05:02 +00:00
Nicolas Spiegelberg 770cc7d5d2 HBASE-4645 Edits Log recovery losing data across column families
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1189285 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 16:11:11 +00:00
Michael Stack 9570f3c907 HBASE-4367 Deadlock in MemStore flusher due to JDK internally synchronizing on current thread
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188555 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 07:40:25 +00:00
Michael Stack 3c764b1e05 HBASE-4670 Fix javadoc warnings
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188537 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:51:28 +00:00
Michael Stack 0b4c5efe75 HBASE-4374 Up default regions size from 256M to 1G
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188505 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 03:34:22 +00:00
Andrew Kyle Purtell 998539d05d HBASE-3512 Shell support for listing currently loaded coprocessors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188444 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 23:22:20 +00:00
Andrew Kyle Purtell ed76ba8de3 HBASE-4070 Improve region server metrics to report loaded coprocessors to master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188442 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 23:18:04 +00:00
Michael Stack 95a8d2bfc4 HBASE-4578 NPE when altering a table that has moving regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188439 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 23:13:01 +00:00
Michael Stack b31527ee35 HBASE-4656 Note how dfs.support.append has to be enabled in 0.20.205.0 clusters
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188434 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 22:56:56 +00:00
Michael Stack d3927860a8 HBASE-4437 Update hadoop in 0.92 (0.20.205?)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188403 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:55:38 +00:00
Nicolas Spiegelberg a165e6cd59 HBASE-4591 TTL for old HLogs should be calculated from last modification time.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188390 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:24:00 +00:00
Nicolas Spiegelberg 9431c3b55c HBASE-4532 Avoid top row seek by dedicated bloom filter for delete family bloom filter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1188268 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 18:10:37 +00:00
Michael Stack b3266f1f62 HBASE-4647 RAT finds about 40 files missing licenses
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 21:19:23 +00:00
Jonathan Gray bd7ff8ece3 HBASE-4588 The floating point arithmetic to validate memory allocation configurations need to be done as integers (dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187551 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 21:27:12 +00:00
larsh f9f3a148d9 HBASE-4536 Allow CF to retain deleted rows
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187531 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 19:57:07 +00:00
Todd Lipcon 53c69f2e9f HBASE-3929 Add option to HFile tool to produce basic stats
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187494 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:45:31 +00:00
ramkrishna 4e27946157 HBASE-4219 Addendum for TestHFileBlock failure
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187278 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 10:11:13 +00:00
larsh c00dbf8139 HBASE-4626 Filters unnecessarily copy byte arrays
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187175 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 03:15:28 +00:00
Michael Stack 25385fe1e2 HBASE-4580 Some invalid zk nodes were created when a clean cluster restarts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187010 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 19:40:00 +00:00
Michael Stack 0d9185a60d HBASE-4595 HFilePrettyPrinter Scanned kv count always 0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1187004 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 19:25:38 +00:00
Michael Stack 94e4322937 HBASE-4510 Check and workaround usage of internal HDFS APIs in HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186992 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 19:03:56 +00:00
Michael Stack de797e9237 HBASE-4430 Disable TestSlabCache and TestSingleSizedCache temporarily to see if these are cause of build box failure though all tests pass
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186977 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 18:21:59 +00:00
ramkrishna 8a0699e585 HBASE-4459 HbaseObjectWritable code is a byte, we will eventually run out of codes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 18:19:44 +00:00
Michael Stack dd6460d183 HBASE-4378 [hbck] Does not complain about regions with startkey==endkey.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186953 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 17:36:09 +00:00
Jonathan Gray a141ff2a79 HBASE-4460 Support running an embedded ThriftServer within a RegionServer (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186586 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 00:42:57 +00:00
Nicolas Spiegelberg 8182ddaaef HBASE-4489 Better key splitting in RegionSplitter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 00:09:57 +00:00
Michael Stack e6c422defe HBASE-4486 Improve Javadoc for HTableDescriptor
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186559 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 23:13:20 +00:00
Michael Stack 5b809d7f7c HBASE-4620 I broke the build when I submitted HBASE-3581 (Send length of the rpc response)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1186347 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 17:13:21 +00:00
Nicolas Spiegelberg dcb718d0c5 HBASE-4418 Show all the hbase configuration in the web ui
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185859 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 21:05:14 +00:00
Nicolas Spiegelberg a1a1b1b781 HBASE-4219 Per Column Family Metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185835 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 20:23:28 +00:00
ramkrishna 9e071332b2 HBASE-4585 Avoid seek operation when current kv is deleted(Liyin Tang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185771 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 17:52:06 +00:00
Michael Stack 712bf529b8 HBASE-3581 hbase rpc should send size of response
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185618 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 12:20:19 +00:00
Michael Stack 54acda49f9 HBASE-3581 hbase rpc should send size of response
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185617 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 12:20:01 +00:00
larsh 6217443231 HBASE-4562 When split doing offlineParentInMeta encounters error, it'll cause data loss
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185414 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 22:37:33 +00:00
Jean-Daniel Cryans 03351581d0 HBASE-4606 Remove spam in HCM and fix a list.size == 0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185326 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 19:01:49 +00:00
Jean-Daniel Cryans 8fa3959795 HBASE-4579 CST.requestCompaction semantics changed, logs are now
spammed when too many store files


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185316 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 18:19:18 +00:00
Todd Lipcon ef6532498b HBASE-4570. Fix a race condition that could cause inconsistent results from scans during concurrent writes.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185301 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 17:37:03 +00:00
larsh ef6a0f9db3 HBASE-4563 When error occurs in this.parent.close(false) of split, the split region cannot write or read
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1185005 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 05:08:49 +00:00
Jonathan Gray 4d776c28b9 HBASE-4589 CacheOnWrite broken in some cases because it can conflict with evictOnClose (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183541 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:41:45 +00:00
Gary Helmling 8313263677 HBASE-4282 RegionServer should abort when WAL close fails with unflushed edits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183180 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 00:40:41 +00:00
Nicolas Spiegelberg fc5c533c59 HBASE-4568 Make zk dump jsp response faster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183166 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 23:49:15 +00:00
Michael Stack 8d8dc87d0d HBASE-3446 ProcessServerShutdown fails if META moves, orphaning lots of regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183158 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 23:12:30 +00:00
Jonathan Gray 69761be2c2 HBASE-4469 Avoid top row seek by looking up bloomfilter (liyin via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183155 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 22:56:18 +00:00
Jonathan Gray ef5476f5ca HBASE-3417 CacheOnWrite is using the temporary output path for block names, need to use a more consistent block naming scheme (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183137 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 22:21:00 +00:00
Nicolas Spiegelberg df9b82c082 HBASE-4078 Validate store files after flush/compaction
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 20:25:03 +00:00
larsh 9814ffbaf0 HBASE-4556 Fix all incorrect uses of InternalScanner.next(...)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1183016 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 18:07:04 +00:00
larsh 202118d3b5 HBASE-4102 atomicAppend: A put that appends to the latest version of a cell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1182588 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 21:42:20 +00:00
Jonathan Gray c2681355b5 HBASE-4582 Store.java cleanup (failing TestHeapSize and has warnings) (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1182530 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 19:08:50 +00:00
Jonathan Gray 52c4ce5cdd HBASE-4422 Move block cache parameters and references into single CacheConf class (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1182194 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 04:15:30 +00:00
larsh ed7605b892 Integrating HBASE-4335
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1182096 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 21:20:39 +00:00
ramkrishna 3d50077db1 HBASE-4540 OpenedRegionHandler is not enforcing atomicity of the operation it is performing . Also fixes HBASE-4539 (ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1180553 13f79535-47bb-0310-9956-ffa450edef68
2011-10-09 06:35:46 +00:00
Michael Stack 72449b2bf4 HBASE-4547 TestAdmin failing in 0.92 because .tableinfo not found
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1180085 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 16:04:30 +00:00
Michael Stack e95a7409af HBASE-4547 TestAdmin failing in 0.92 because .tableinfo not found
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179881 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 22:02:00 +00:00
Michael Stack 82dd6f5235 HBASE-4482 Race Condition Concerning Eviction in SlabCache
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179868 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:39:47 +00:00
Michael Stack c15feb5fbf HBASE-4402 Retaining locality after restart broken
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179809 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 20:10:08 +00:00
Todd Lipcon 3d156a5a24 HBASE-4386 Fix a potential NPE in TaskMonitor
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179479 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 00:16:45 +00:00
Jonathan Gray ead9159ecd HBASE-4465 Lazy-seek optimization for StoreFile scanners (mikhail/liyin)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179442 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 21:14:50 +00:00
Doug Meil 435fea6d79 HBASE-4505 fixed javadoc for SubstringComparator.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179421 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 20:29:05 +00:00
Jean-Daniel Cryans 1edf8b65e4 HBASE-4501 [replication] Shutting down a stream leaves recovered
sources running


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179345 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 17:36:58 +00:00
ramkrishna 456e7fbb60 HBASE-4479 TestMasterFailover failure in Hbase-0.92#17(Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179052 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 04:43:05 +00:00
Michael Stack 2b981abcbb HBASE-4494 AvroServer:: get fails with NPE on a non-existent row
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1179014 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 00:06:48 +00:00
Jonathan Gray 6529cf3660 HBASE-4534 A new unit test for lazy seek and StoreScanner in general (mikhail via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1178920 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 19:26:25 +00:00
Michael Stack ea5ddc5ff7 HBASE-4520 Better handling of Bloom filter type discrepancy between HFile and CF config
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1178893 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 18:27:54 +00:00
Zhihong Yu d4a8c48add HBASE-4334 HRegion.get never validates row (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1178623 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 22:34:52 +00:00
Jean-Daniel Cryans 4ecbf3c8c0 HBASE-4473 NPE when executors are down but events are still coming in
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1178520 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 19:08:23 +00:00
Zhihong Yu c5f80ebc53 HBASE-4496 HFile V2 does not honor setCacheBlocks when scanning (Lars and Mikhail)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1178258 13f79535-47bb-0310-9956-ffa450edef68
2011-10-02 21:30:06 +00:00
Michael Stack 15e66a3ab5 HBASE-4509 [hbck] Improve region map output
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177900 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 04:24:44 +00:00
Michael Stack 5bbed78d73 HBASE-4506 [hbck] Allow HBaseFsck to be instantiated without connecting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177896 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 04:18:13 +00:00
Gary Helmling 39c0909e3e HBASE-4515 User.getCurrent() can fail to initialize the current user
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177881 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 01:44:39 +00:00
Michael Stack dd224a594b HBASE-4517 Document new replication features in 0.92
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177867 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:29:19 +00:00
Michael Stack c80eaecce1 HBASE-4209 The HBase hbase-daemon.sh SIGKILLs master when stopping it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177849 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 21:45:20 +00:00
Michael Stack ba809c3b29 HBASE-4476 Compactions must fail if column tracker gets columns out of order
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177839 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 21:20:24 +00:00
Zhihong Yu 43f173cf44 HBASE-4487 The increment operation can release the rowlock before sync-ing
the Hlog (dhruba borthakur)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177815 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 20:22:22 +00:00
Zhihong Yu 1d621be994 HBASE-2794 Utilize ROWCOL bloom filter if multiple columns within same family
are requested in a Get (Mikhail Bautin)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177768 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 18:35:27 +00:00
Zhihong Yu e960eab790 HBASE-4145 Provide metrics for hbase client, add ScanMetrics.java
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177506 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 04:26:48 +00:00
Zhihong Yu 2ce873e3d1 HBASE-4145 Provide metrics for hbase client (Ming Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177501 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 04:20:34 +00:00
Zhihong Yu 93a104a018 HBASE-4412 No need to retry scan operation on the same server in case of
RegionServerStoppedException (Ming Ma)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177498 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 04:03:33 +00:00
Zhihong Yu 3a7bda2cd1 HBASE-4212 TestMasterFailover fails occasionally (Gao Jinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177488 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 03:08:38 +00:00
Jean-Daniel Cryans b2f6235668 HBASE-3130 [replication] ReplicationSource can't recover from session
expired on remote clusters (Chris Trezzo via JD)
   HBASE-4499  [replication] Source shouldn't update ZK if it didn't progress
               (Chris Trezzo via JD)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177461 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 23:33:39 +00:00
Jonathan Gray e2da35f666 HBASE-4477 Ability for an application to store metadata into the transaction log (dhruba via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177426 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 21:00:24 +00:00
ramkrishna 8585691fcd HBASE-4512 JVMClusterUtil throwing wrong exception when master thread cannot be created (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177370 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 17:14:13 +00:00
ramkrishna aaa8c0e38e HBASE-4492 TestRollingRestart Fails Intermittently(Ted yu and Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1177175 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 06:29:16 +00:00
Jonathan Gray 2c988abf35 HBASE-4131 Make the Replication Service pluggable via a standard interface definition (dhruba via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1176935 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 15:56:22 +00:00
Jonathan Gray 29ecdaa84e HBASE-4488 Store could miss rows during flush (Lars H via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1176931 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 15:50:46 +00:00
Zhihong Yu 7416d6015b HBASE-4455 Rolling restart RSs scenario, -ROOT-, .META. regions are lost in
AssignmentManager (Ming Ma)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1176613 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 20:49:04 +00:00
Jonathan Gray 9bfdd1d91c HBASE-4433 avoid extra next (potentially a seek) if done with column/row (kannan via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1176202 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 05:29:57 +00:00
Zhihong Yu 581421a6b2 HBASE-4014 Coprocessors: Flag the presence of coprocessors in logged
exceptions (Eugene Koontz)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1175292 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 03:46:53 +00:00
Jonathan Gray 62e8b5d61d HBASE-4461 Expose getRowOrBefore via Thrift (jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1175220 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 18:53:04 +00:00
Zhihong Yu d607687eb1 HBASE-4014 revert due to a failed test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1175172 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 14:46:29 +00:00
Zhihong Yu 74e7091ab3 HBASE-4014 Coprocessors: Flag the presence of coprocessors in logged exceptions(Eugene Koontz)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1175170 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 14:11:05 +00:00
Jean-Daniel Cryans 06484db575 HBASE-4280 [replication] ReplicationSink can deadlock itself via handlers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1175060 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 22:44:00 +00:00
Zhihong Yu 8c94f9f825 HBASE-4472 MiniHBaseCluster.shutdown() doesn't work if no active master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1175050 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 22:13:43 +00:00
Michael Stack 97e337f330 HBASE-4131 Make the Replication Service pluggable via a standard interface definition; BACKED IT OUT -- WAS CAUSING TestReplication failures
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1175048 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 22:09:01 +00:00
Michael Stack 2345d9298e HBASE-4434 seek optimization: don't do eager HFile Scanner next() unless the next KV is needed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174982 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 19:54:25 +00:00
Nicolas Spiegelberg 0f38c6df8a Added comment for clarity while reading code to review HBASE-4449
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174974 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 19:41:39 +00:00
Michael Stack e086041801 HBASE-4468 Wrong resource name in an error massage: webapps instead of hbase-webapps
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174969 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 19:36:12 +00:00
Michael Stack a170f9ee4e HBASE-4131 Make the Replication Service pluggable via a standard interface definition
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174963 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 19:18:41 +00:00
Michael Stack abed8ff130 HBASE-4132 Extend the WALActionsListener API to accomodate log archival
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174942 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 18:35:17 +00:00
Michael Stack 9c41ffc734 HBASE-4295 rowcounter does not return the correct number of rows in certain circumstances
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174919 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 17:50:46 +00:00
Michael Stack da5f1baa39 HBASE-4387 Error while syncing: DFSOutputStream is closed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174906 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 17:37:59 +00:00
Michael Stack d4c706f1b4 HBASE-4446 Rolling restart RSs scenario, regions could stay in OPENING state
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174878 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 16:46:34 +00:00
Zhihong Yu 1bd5e4032c HBASE-4452 Possibility of RS opening a region though tickleOpening fails due to
znode version mismatch (Ramkrishna)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174447 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 23:08:17 +00:00
Zhihong Yu 083d104243 HBASE-4153 Ramkrishna's fix for TestZKBasedOpenCloseRegion#testRSAlreadyProcessingRegion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1174105 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 13:03:27 +00:00
Zhihong Yu 76ba002ef7 HBASE-4153 apply the correct patch - v4
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1173811 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 19:48:38 +00:00
Zhihong Yu 7e6a6538b4 HBASE-4153 Handle RegionAlreadyInTransitionException in AssignmentManager
(Ramkrishna)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1173768 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 17:14:32 +00:00
Zhihong Yu bcaecda371 HBASE-3421 Very wide rows -- 30M plus -- cause us OOME (Nate Putnam)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1173335 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 20:21:27 +00:00
Zhihong Yu 7f0c31e55f HBASE-4432 Enable/Disable off heap cache with config (Li Pi)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1172802 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 20:29:40 +00:00
Zhihong Yu e1244033bf HBASE-4429 Provide synchronous balanceSwitch()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1172718 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 17:21:32 +00:00
Michael Stack ddb6a6870d HBASE-4375 [hbck] Add region coverage visualization to hbck
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1172310 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 18:00:30 +00:00
Zhihong Yu 3cc7e62571 HBASE-4400 .META. getting stuck if RS hosting it is dead and znode state is in
RS_ZK_REGION_OPENED (Ramkrishna)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1172063 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 20:27:00 +00:00
Michael Stack f70dd57e1e HBASE-4247 Add isAborted method to the Abortable interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1172039 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 18:26:03 +00:00
Michael Stack b86f8dff19 HBASE-4369 Deprecate HConnection#getZookeeperWatcher in prep for HBASE-1762
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1172025 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 17:42:15 +00:00
Gary Helmling 9da4ab25b7 HBASE-4424 Provide coprocessors access to createTable() via MasterServices
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171882 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 01:17:39 +00:00
Michael Stack 6a7e3c3b8b HBASE-4411 When copying tables/CFs, allow CF names to be changed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171880 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 00:38:21 +00:00
Gary Helmling d70a6ec716 HBASE-4425 Provide access to RpcServer in RegionServerServices
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171865 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 23:59:56 +00:00
Gary Helmling 900a9124c4 HBASE-4420 MasterObserver preMove() and postMove() should throw IOException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171785 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 21:10:56 +00:00
Michael Stack 6571376717 HBASE-4195 Possible inconsistency in a memstore read after a reseek, possible performance improvement
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171746 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 19:37:39 +00:00
Zhihong Yu 879ab1b8fb HBASE-4417 HBaseAdmin.checkHBaseAvailable() doesn't close ZooKeeper connections
(Stefan Seelmann)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171734 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 19:04:12 +00:00
Zhihong Yu db102ed307 HBASE-4373 HBaseAdmin.assign() does not use force flag (Ramkrishna)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171697 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 17:59:02 +00:00
Michael Stack 8948204c47 HBASE-4322 [hbck] Update checkIntegrity/checkRegionChain to present more accurate region split problem
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171648 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 16:25:26 +00:00
Michael Stack 18926f9fed HBASE-4322 [hbck] Update checkIntegrity/checkRegionChain to present more accurate region split problem
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171642 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 16:16:34 +00:00
Michael Stack 7901848a9a HBASE-4322 [hbck] Update checkIntegrity/checkRegionChain to present more accurate region split problem
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171640 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 16:10:17 +00:00
Gary Helmling eca8e0a8f6 HBASE-4414 Region splits by size not being triggered
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171366 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 03:06:58 +00:00
Jean-Daniel Cryans 848748b1ae HBASE-4395 EnableTableHandler races with itself
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171331 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 23:51:00 +00:00
Jean-Daniel Cryans ee4df4fba8 HBASE-4390 [replication] ReplicationSource's UncaughtExceptionHandler
shouldn't join



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171305 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 22:41:25 +00:00
Jean-Daniel Cryans 419490d69b HBASE-4363 [replication] ReplicationSource won't close if failing
to contact the sink (JD and Lars Hofhansl)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171286 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 21:48:59 +00:00
Zhihong Yu 067b987b3c HBASE-2196 Addendum 2 from Lars which uses an anonymous Stoppable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171198 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 17:56:48 +00:00
Zhihong Yu f23110b987 HBASE-2196 Addendum fix TestReplicationAdmin where multi-slave is supported
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1171036 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 10:34:36 +00:00
Zhihong Yu 692207c368 HBASE-2196 Support more than one slave cluster (Lars Hofhansl)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170950 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 04:16:53 +00:00
Zhihong Yu cb3db2f74e HBASE-4351 If from Admin we try to unassign a region forcefully, though a valid region name is given the master is not able to identify the region to unassign.(Ramkrishna)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170933 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 02:46:38 +00:00
Zhihong Yu ad95acf852 HBASE-4383 SlabCache reports negative heap sizes (Li Pi)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170930 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 02:25:04 +00:00
Zhihong Yu a76a708a20 HBASE-4330 Fix races in slab cache (Li Pi & Todd)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170902 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 23:47:21 +00:00
Todd Lipcon 0b83bf1d7a Amend HBASE-4381 Refactor split decisions into a split policy class
Adjusts heap size estimates for HRegion and Store to fix failing TestHeapSize.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170804 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 19:34:26 +00:00
Todd Lipcon 4a448e4d74 HBASE-4381 Refactor split decisions into a split policy class.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170468 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 08:07:33 +00:00
Todd Lipcon 1df9e04262 HBASE-4287 If region opening fails, change region in transition into a FAILED_OPEN state so that it can be retried quickly.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170449 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 06:45:34 +00:00
Michael Stack a902f9ab1c HBASE-4394 Add support for seeking hints to FilterList
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170422 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 03:18:56 +00:00
Michael Stack bf5a6641bf HBASE-4359 Show dead RegionServer names in the HMaster info page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170421 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 02:54:15 +00:00
Michael Stack 12cc83fd03 HBASE-4384 Hard to tell what causes failure in CloseRegionHandler#getCurrentVersion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170353 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 21:10:41 +00:00
Michael Stack 3bda78ec61 HBASE-4238 CatalogJanitor can clear a daughter that split before processing its parent
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170291 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:36:54 +00:00
Zhihong Yu 7df33f9875 HBASE-4347 addendum that moves CLUSTER_ID_ATTR to Mutation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170025 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 03:56:48 +00:00
Todd Lipcon 71e8db15fb HBASE-4321. Add a more comprehensive region split calculator for future use in hbck.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1170013 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 02:39:41 +00:00
Todd Lipcon 340a3c475c HBASE-4272. Add -metaonly flag to hbck feature to only inspect and try to repair META and ROOT.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1169996 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 01:15:17 +00:00
Michael Stack bcd4846420 HBASE-4325 Improve error message when using STARTROW for meta scans
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1169914 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 20:41:22 +00:00
Gary Helmling c9efe7d495 HBASE-4180 Check isSecurityEnabled before User.login for 0.21 compatibility
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1169902 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 19:59:17 +00:00
Michael Stack eaa40e323e HBASE-4057 Implement HBase version of "show processlist"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1167578 13f79535-47bb-0310-9956-ffa450edef68
2011-09-10 18:44:45 +00:00
Michael Stack 699e15b7a1 HBASE-4347 Remove duplicated code from Put, Delete, Get, Scan, MultiPut
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1167569 13f79535-47bb-0310-9956-ffa450edef68
2011-09-10 17:57:19 +00:00
Michael Stack 9ae2f239bc HBASE-4270 IOE ignored during flush-on-close causes dataloss
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1167566 13f79535-47bb-0310-9956-ffa450edef68
2011-09-10 17:47:46 +00:00
Zhihong Yu 75bce302e2 HBASE-4340 Hbase can't balance if ServerShutdownHandler encountered
exception (Jinchao Gao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1167452 13f79535-47bb-0310-9956-ffa450edef68
2011-09-10 04:34:54 +00:00
Gary Helmling 1145bc1471 HBASE-4331 Bypassing default actions in prePut fails sometimes with HTable client
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1167407 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 23:55:06 +00:00
Zhihong Yu b723bc4d4d HBASE-4301 META migration from 0.90 to trunk fails (Subbu Iyer)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1167006 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 05:25:24 +00:00
Michael Stack 34f318b625 HBASE-4007 distributed log splitting can get indefinitely stuck
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166989 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 04:05:26 +00:00
Michael Stack 76b123052e HBASE-4350 Fix a Bloom filter bug introduced by HFile v2 and TestMultiColumnScanner that caught it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166982 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 03:47:00 +00:00
Zhihong Yu 221f017b43 HBASE-2195 Support cyclic replication (Lars Hofhansl)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166923 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 22:03:10 +00:00
Michael Stack 18e9b21862 HBASE-4105 HBASE-4015-Making the timeout monitor less racy; third attempt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166857 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:50:26 +00:00
Michael Stack 3aca4bab24 HBASE-4015 Refactor the TimeoutMonitor to make it less racy -- REVERT. Ram says I have applied wrong patch. Redoing. A SECOND TIMEsvn rm --force src/main/java/org/apache/hadoop/hbase/master/TimeOutManagerCallable.javasvn rm --force src/main/java/org/apache/hadoop/hbase/master/TimeOutManagerCallable.java
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166835 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:20:34 +00:00
Michael Stack 9f0a3193d8 HBASE-4015 Refactor the TimeoutMonitor to make it less racy -- reapply with HBASE-4015_reprepared_trunk_2.patch
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166833 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:18:20 +00:00
Michael Stack 053493a967 HBASE-4015 Refactor the TimeoutMonitor to make it less racy -- REVERT. Ram says I have applied wrong patch. Redoing.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166831 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:15:57 +00:00
Michael Stack 625d68ee6a HBASE-4015 Refactor the TimeoutMonitor to make it less racy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166804 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 17:05:09 +00:00
Michael Stack 5b9beaf99e HBASE-4015 Refactor the TimeoutMonitor to make it less racy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166803 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 17:03:46 +00:00
Michael Stack 0f25ac8ad8 HBASE-4015 Refactor the TimeoutMonitor to make it less racy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166800 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 17:00:38 +00:00
Michael Stack a39ce83a18 HBASE-4297 TableMapReduceUtil overwrites user supplied options
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166767 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 15:52:25 +00:00
Michael Stack 52ccf8db35 HBASE-4341 HRS#closeAllRegions should take care of HRS#onlineRegions's weak consistency
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166754 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 15:38:04 +00:00
Gary Helmling 1193bc1df0 HBASE-4271 Clean up coprocessor handling of table operations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166540 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 06:49:35 +00:00
Michael Stack 036404ac88 HBASE-4296 Deprecate HTable[Interface].getRowOrBefore(...)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166527 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 05:06:29 +00:00
Michael Stack 76de714e2b HBASE-4260 Expose a command to manually trigger an HLog roll
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166524 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 04:22:42 +00:00
Michael Stack bc524bbe59 HBASE-4342 Update Thrift to 0.7.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166455 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 22:44:45 +00:00
Michael Stack f86382fa16 HBASE-4309 slow query log metrics spewing warnings
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1166242 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 15:57:25 +00:00
Michael Stack 8f45a0b1da HBASE-4312 Deploy new hbase logo
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1165936 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:42:45 +00:00
Michael Stack c99ec8fb8d HBASE-4312 Deploy new hbase logo
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1165934 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:41:13 +00:00
Gary Helmling 5661aada9b HBASE-3842 Refactor RegionObserver compaction API for easier overriding of policy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1165793 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 19:21:07 +00:00
Michael Stack ab61758985 HBASE-4206 jenkins hash implementation uses longs unnecessarily
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1165127 13f79535-47bb-0310-9956-ffa450edef68
2011-09-04 22:58:11 +00:00
Zhihong Yu f2552ba5fd HBASE-4265 zookeeper.KeeperException$NodeExistsException if HMaster restarts
while table is being disabled (Ming Ma)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164803 13f79535-47bb-0310-9956-ffa450edef68
2011-09-03 05:06:49 +00:00
Nicolas Spiegelberg 236709bcb1 HBASE-1730 Online schema changes for HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164797 13f79535-47bb-0310-9956-ffa450edef68
2011-09-03 02:55:29 +00:00
Todd Lipcon d0e61e30f1 HBASE-4299 Update to Avro 1.5.3 and use Avro Maven plugin to generate Avro classes.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164762 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 23:31:37 +00:00
Todd Lipcon 8efece3ba5 HBASE-4257 Limit the number of regions in transitions displayed on master webpage.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164690 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 20:24:48 +00:00
Michael Stack 7994ce3ea9 HBASE-4027 Off Heap Cache never creates Slabs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164674 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 19:17:04 +00:00
Zhihong Yu 077efb37ef HBASE-4310 SlabCache metrics bugfix (Li Pi)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164349 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 04:20:04 +00:00
Zhihong Yu fa5f75ab0e HBASE-4273 java.lang.NullPointerException when a table is being disabled and
HMaster restarts (Ming Ma)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164347 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 04:14:27 +00:00
Todd Lipcon 5af490cb6b HBASE-4323 Add debug logging when AssignmentManager can't make a plan for a region.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1164277 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 21:14:08 +00:00
Michael Stack 0aa92ed25d HBASE-4263 New config property for user-table only RegionObservers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163908 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 05:37:50 +00:00
Todd Lipcon e6cc54fa4d HBASE-4315 RPC logging too verbose
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163742 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 18:50:50 +00:00
Zhihong Yu 3080fb6f02 HBASE-4283 HBaseAdmin never recovers from restarted cluster (Lars Hofhansl)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163719 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 17:50:33 +00:00
Zhihong Yu 6fbc5260af HBASE-4310 SlabCache metrics bugfix (Li Pi)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163620 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 13:46:01 +00:00
Todd Lipcon 547e9a60a1 HBASE-4303 HRegionInfo.toString has bad quoting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163424 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:57:29 +00:00
Todd Lipcon b89393caf2 HBASE-4276 AssignmentManager debug logs should be at INFO level for META/ROOT regions.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163418 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:51:22 +00:00
Todd Lipcon 261fcbdd87 Revert previous commit of HBASE-4276
Realized after committing that the conditions should check
isMetaTable || isRootRegion, not just isMetaTable. Will recommit
a fixed version.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163408 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:38:47 +00:00
Todd Lipcon 9f5580eba2 Previous commit purported to revert HBASE-4276, but accidentally reverted HBASE-4293.
This commit re-applies HBASE-4293. The next commit will _actually_ revert HBASE-4276


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163407 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:37:13 +00:00
Todd Lipcon 67e634f50a Revert previous commit of HBASE-4276
Realized after committing that the conditions should check
isMetaTable || isRootRegion, not just isMetaTable. Will recommit
a fixed version.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163406 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:34:07 +00:00
Todd Lipcon be00c74833 HBASE-4276 AssignmentManager debug logs should be at INFO level for META/ROOT regions.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163400 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:28:53 +00:00
Todd Lipcon b767480a19 HBASE-4294 HLogSplitter sleeps with 1-second granularity
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163397 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:24:54 +00:00
Todd Lipcon 187db8e624 HBASE-4293 More verbose logging in ServerShutdownHandler for meta/root cases
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163388 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:11:25 +00:00
Todd Lipcon 954b292bbf HBASE-4292 Add a debugging dump servlet to the master and regionserver
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163385 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 21:08:04 +00:00
Todd Lipcon 48560e089c HBASE-4275 RS should communicate fatal "aborts" back to the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163345 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 19:27:24 +00:00
Todd Lipcon 16171a1232 HBASE-4281 Add facility to dump current state of all executors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163343 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 19:24:51 +00:00
Todd Lipcon 9e9d802f45 HBASE-4291 Improve display of regions in transition in UI to be more readable.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163321 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 18:20:06 +00:00
Todd Lipcon 0ad9dacedb HBASE-4290 HLogSplitter doesn't mark its MonitoredTask as complete in non-distributed case
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163318 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 18:10:25 +00:00
Zhihong Yu 7cac21df9c HBASE-4289 Move spinlock to SingleSizeCache rather than the slab allocator
(Li Pi)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163215 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 14:00:58 +00:00
Zhihong Yu 5a7215a451 HBASE-4269 Add tests and restore semantics to TableInputFormat/TableRecordReader
(Jonathan Hsieh)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1163064 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 01:13:04 +00:00
Michael Stack cbb6aac2a7 HBASE-4124 ZK restarted while a region is being assigned, new active HM re-assigns it but the RS warns 'already online on this server'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162919 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 17:51:44 +00:00
Zhihong Yu 53e7f73ab9 HBASE-4278 Race condition in Slab.java that occurs due to spinlock unlocking
early (Li Pi)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162886 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 16:00:47 +00:00
Zhihong Yu 8400452afd HBASE-3900 Addendum 2: try to fix error in readFields()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162465 13f79535-47bb-0310-9956-ffa450edef68
2011-08-28 01:27:09 +00:00
Zhihong Yu a1ede0c560 HBASE-3900 Addendum, correct FIXED_OVERHEAD
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162318 13f79535-47bb-0310-9956-ffa450edef68
2011-08-27 09:57:29 +00:00
Michael Stack 385c3e9b69 HBASE-3900 Expose progress of a major compaction in UI and/or in shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162296 13f79535-47bb-0310-9956-ffa450edef68
2011-08-27 04:26:19 +00:00
Michael Stack 5ccadb10ba HBASE-3900 Expose progress of a major compaction in UI and/or in shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162295 13f79535-47bb-0310-9956-ffa450edef68
2011-08-27 04:26:03 +00:00
Michael Stack 2d25412df7 HBASE-4117 Slow Query Log and Client Operation Fingerprints
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162293 13f79535-47bb-0310-9956-ffa450edef68
2011-08-27 04:01:18 +00:00
Michael Stack 55978ff60b hbase-4248 Enhancements for Filter Language exposing HBase filters through the Thrift API
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162284 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 23:08:05 +00:00
Michael Stack e22c2172a5 hbase-4248 Enhancements for Filter Language exposing HBase filters through the Thrift API
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162210 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 19:03:40 +00:00
Michael Stack cc93cb0298 HBASE-3229 Table creation, though using async call to master, can actually run for a while and cause RPC timeout
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162209 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 18:59:26 +00:00
Michael Stack 2bcc605a3f HBASE-4027 Enable direct byte buffers LruBlockCache
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162207 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 18:53:00 +00:00
Michael Stack 389c621af6 HBASE-4215 RS requestsPerSecond counter seems to be off
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1162198 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 18:27:02 +00:00
Michael Stack 581af1b086 HBASE-4217 HRS.closeRegion should be able to close regions with only the encoded name
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1161658 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 17:29:54 +00:00
Michael Stack 7ede7e9b39 HBASE-4241 Optimize flushing of the Memstore
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1161634 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 16:35:15 +00:00
Gary Helmling 6f00842284 HBASE-4222 Allow HLog to retry log roll on transient write pipeline errors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1161320 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 23:41:07 +00:00
Zhihong Yu 0c02bd374a HBASE-4071 update FIXED_OVERHEAD for minVersions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1161262 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 20:13:17 +00:00
Zhihong Yu 5cae3a6b66 HBASE-4138 Change debug log in ZKUtil.watchAndCheckExists()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1161136 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 14:53:26 +00:00
Zhihong Yu 1c5e23f215 HBASE-4138 Add debug log in ZooKeeperNodeTracker.start()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1161104 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 14:10:57 +00:00
Michael Stack 48bdcd353b HBASE-420 Lots of DNS queries from client
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160981 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 05:37:40 +00:00
Michael Stack cca758c679 HBASE-4071 Data GC: Remove all versions > TTL EXCEPT the last written version
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160978 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 05:15:37 +00:00
Todd Lipcon df360dccde HBASE-4221 Changes necessary to build and run against Hadoop 0.23
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160919 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:47:53 +00:00
Zhihong Yu 27096be10a HBASE-4225 OperationStatus.java was missing in previous checkin
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160916 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:40:18 +00:00
Todd Lipcon 6c16f41064 HBASE-4233 Update protobuf dependency to 2.4.0a
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160912 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:34:23 +00:00
Zhihong Yu c2af155e35 HBASE-4225 NoSuchColumnFamilyException in multi doesn't say which family
is bad (Ramkrishna Vasudevan)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160909 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:32:16 +00:00
Nicolas Spiegelberg 2eec39fa48 HBASE-4244 Refactor bin/hbase help
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160890 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 21:37:32 +00:00
Michael Stack f5105f5085 HBASE-4240 Allow Loadbalancer to be pluggable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160887 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 21:05:38 +00:00
Zhihong Yu d53ddeb142 HBASE-4239 HBASE-4012 introduced duplicate variable Bytes.LONG_BYTES
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160502 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 23:43:13 +00:00
Zhihong Yu 0e152ad9e2 HBASE-4199 blockCache summary - backend (Doug Meil)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160488 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 22:58:39 +00:00
Zhihong Yu d0de098625 HBASE-4167 Potential leak of HTable instances when using HTablePool with
PoolType.ThreadLocal (Karthick Sankarachary)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160437 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 21:09:29 +00:00
Zhihong Yu ecd5fcf0d4 HBASE-4237 Directly remove the call being handled from the map of outstanding RPCs
(Benoit Sigoure)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160435 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 21:03:05 +00:00
Zhihong Yu 8cc16ab55f HBASE-4236 Don't lock the stream while serializing the response (Benoit Sigoure)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160370 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 18:45:20 +00:00
Zhihong Yu 58dfa28fef HBASE-4065 TableOutputFormat ignores failure to create table instance
(Brock Noland)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1160351 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 18:03:34 +00:00
Andrew Kyle Purtell 1c90f10c7f HBASE-4230 Compaction threads need names
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1159915 13f79535-47bb-0310-9956-ffa450edef68
2011-08-20 20:48:19 +00:00
Michael Stack 38a046ea3c HBASE-4229 Replace Jettison JSON encoding with Jackson in HLogPrettyPrinter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1159914 13f79535-47bb-0310-9956-ffa450edef68
2011-08-20 20:27:09 +00:00
Michael Stack 95c39ae2ab HBASE-4227 Modify the webUI so that default values of column families are not shown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1159515 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 06:26:14 +00:00
Michael Stack 4c797e7ba9 HBASE-4095 Hlog may not be rolled in a long time if checkLowReplication's request of LogRoll is blocked
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1159497 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 03:57:48 +00:00
Michael Stack 3910bd4b6d HBASE-4008 Problem while stopping HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1159494 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 03:37:41 +00:00
Zhihong Yu 284c7a38a8 HBASE-4175 Fix FSUtils.createTableDescriptor()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1159375 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 19:41:47 +00:00
Michael Stack 2bf98a61b4 HBASE-4176 Exposing HBase Filters to the Thrift API
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1159067 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:31:24 +00:00
Michael Stack 4e403eb78b HBASE-4211 Do init-sizing of the StringBuilder making a ServerName
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1158518 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 05:13:54 +00:00
Michael Stack 5b4b4c74e8 HBASE-4190 Coprocessors: pull up some cp constants from cp package to o.a.h.h.HConstants
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1158463 13f79535-47bb-0310-9956-ffa450edef68
2011-08-16 22:15:06 +00:00
Michael Stack 9686b3d4ba HBASE-4205 Enhance HTable javadoc
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1158353 13f79535-47bb-0310-9956-ffa450edef68
2011-08-16 16:26:13 +00:00
Zhihong Yu 15fc346077 HBASE-4197 Added check of scanner against null
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1158084 13f79535-47bb-0310-9956-ffa450edef68
2011-08-16 01:41:49 +00:00
Zhihong Yu 4b1b49635a HBASE-2399 Forced splits only act on the first family in a table (Ming Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1158080 13f79535-47bb-0310-9956-ffa450edef68
2011-08-16 01:16:43 +00:00
Zhihong Yu f68b180a9f HBASE-4197 RegionServer expects all scanner to be subclasses of
HRegion.RegionScanner (Lars Hofhansl)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1158058 13f79535-47bb-0310-9956-ffa450edef68
2011-08-15 23:10:12 +00:00
Zhihong Yu 6969402718 HBASE-4194 RegionSplitter: Split on under-loaded region servers first
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1157374 13f79535-47bb-0310-9956-ffa450edef68
2011-08-13 12:48:20 +00:00
Michael Stack 5c8f6d6c9e HBASE-4170 createTable java doc needs to be improved
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1157328 13f79535-47bb-0310-9956-ffa450edef68
2011-08-13 05:36:31 +00:00
Michael Stack 20aef0eaf7 HBASE-4196 TableRecordReader may skip first row of region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1157324 13f79535-47bb-0310-9956-ffa450edef68
2011-08-13 05:21:38 +00:00
Zhihong Yu 738f80c221 HBASE-4150 update to javadoc (Karthick Sankarachary)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1157310 13f79535-47bb-0310-9956-ffa450edef68
2011-08-13 02:42:02 +00:00
Gary Helmling 57672b21a8 HBASE-4193 Enhance RPC debug logging with details on call contents
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1156965 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 04:48:24 +00:00
Zhihong Yu ba8bf53381 HBASE-4186 No region is added to regionsInTransitionInRS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1156774 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 19:45:23 +00:00
Michael Stack 3ab49af40f HBASE-4114 Metrics for HFile HDFS block locality
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1156390 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 22:16:30 +00:00
Michael Stack 03019ced6a HBASE-4168 A client continues to try and connect to a powered down regionserver
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1156378 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 21:45:56 +00:00
Michael Stack 4f253b37c2 HBASE-4184 CatalogJanitor doesn't work properly when fs.default.name isn't set in config file.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1156377 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 21:36:57 +00:00
Michael Stack a0478e5aed HBASE-3807 Fix units in RS UI metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1156336 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 19:42:30 +00:00
Michael Stack e9677da00e HBASE-4156 ZKConfig defaults clientPort improperly
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155971 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 23:31:30 +00:00
Michael Stack 0dfdee6365 HBASE-4156 ZKConfig defaults clientPort improperly; mistakenly overcommitted -- reverting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155970 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 23:30:11 +00:00
Michael Stack f3954f9933 HBASE-4156 ZKConfig defaults clientPort improperly
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155969 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 23:28:56 +00:00
Michael Stack 8fcbc4e91c HBASE-4169 FSUtils LeaseRecovery for non HDFS FileSystems; added 4169-correction.txt correction
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155441 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 17:40:29 +00:00
Michael Stack ac8b6f9e2d HBASE-4181 HConnectionManager can't find cached HRegionInterface and makes clients work very slow
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155424 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 16:22:38 +00:00
Michael Stack b8a46d3862 HBASE-4039 Users should be able to choose custom TableInputFormats without modifying TableMapReduceUtil.initTableMapperJob()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155220 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 06:04:54 +00:00
Zhihong Yu 1185c6c89c HBASE-4152 Rename o.a.h.h.regionserver.wal.WALObserver to o.a.h.h.regionserver.wal.WALActionsListener
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155202 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 04:39:34 +00:00
Michael Stack 4c52d623da HBASE-4179 Failed to run RowCounter on top of Hadoop branch-0.22
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155201 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 04:31:34 +00:00
Michael Stack 42ae686912 HBASE-4169 FSUtils LeaseRecovery for non HDFS FileSystems
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155200 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 03:47:45 +00:00
Michael Stack 22a27b8d28 HBase shell move and online may be unusable if region name or server includes binary-encoded data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155164 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 00:15:41 +00:00
Michael Stack a3292a1a7f HBASE-4169 FSUtils LeaseRecovery for non HDFS FileSystems -- reverted until we address issues raised around class name
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155162 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 00:05:50 +00:00
Michael Stack a2d7e57e71 HBASE-4169 FSUtils LeaseRecovery for non HDFS FileSystems
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1155159 13f79535-47bb-0310-9956-ffa450edef68
2011-08-08 23:49:14 +00:00
Michael Stack 678a53a6d2 HBASE-4162 Fix TestHRegionInfo.testGetSetOfHTD: delete /tmp/hbase-<username> if it already exists.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1154658 13f79535-47bb-0310-9956-ffa450edef68
2011-08-07 05:52:54 +00:00
Zhihong Yu 2961f7dcd4 HBASE-4171 HBase shell broken in trunk (Lars Hofhansl)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1154428 13f79535-47bb-0310-9956-ffa450edef68
2011-08-06 02:15:07 +00:00
Todd Lipcon d8b463d176 HBASE-3899. Add ability for delayed RPC calls to set return value immediately at call return.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1154366 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 20:05:09 +00:00
Andrew Kyle Purtell 143acb2d9d HBASE-4159 HBaseServer - IPC Reader threads are not daemons
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1154067 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 01:44:15 +00:00
Gary Helmling 4b84ea5a0a HBASE-4150 Don't enforce pool size limit with ThreadLocalPool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1154044 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 22:58:43 +00:00
Zhihong Yu 2c772a97ab HBASE-4150 reverse patch
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153954 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 17:53:42 +00:00
Zhihong Yu a9031452f7 HBASE-4150 Potentially too many connections may be opened if ThreadLocalPool
or RoundRobinPool is used


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153938 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 17:24:14 +00:00
Zhihong Yu c30bce0eaa HBASE-3857 New files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153646 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 20:28:18 +00:00
Zhihong Yu 3eadbe11a1 HBASE-3857 more new files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153645 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 20:25:28 +00:00
Zhihong Yu 8e2b477566 HBASE-3857 New files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153640 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 20:18:03 +00:00
Zhihong Yu 121c5b2e47 HBASE-3857 Change the HFile Format (Mikhail & Liyin)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153634 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 19:59:48 +00:00
Zhihong Yu e2f64664a6 HBASE-4003 Cleanup Calls Conservatively On Timeout (Karthick)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153602 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 18:26:30 +00:00
Doug Meil 671c7beca4 HBASE-4086 - make constructors match each other in terms of Javadoc
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153523 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 14:59:07 +00:00
Doug Meil 026b437eff HBASE-4149 - javadoc patch on getRow
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153462 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 12:17:19 +00:00
Zhihong Yu b41f705662 HBASE-3065 don't prepend MAGIC if data is empty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153300 13f79535-47bb-0310-9956-ffa450edef68
2011-08-02 23:01:03 +00:00
Jean-Daniel Cryans c75e396fb6 HBASE-3065 adding a missing removeMetaData in SplitLogWorker.java
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153294 13f79535-47bb-0310-9956-ffa450edef68
2011-08-02 22:35:53 +00:00
Gary Helmling da50b95dd5 HBASE-3810 Relax parsing and add convenience methods for HTableDescriptor coprocessor config
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153040 13f79535-47bb-0310-9956-ffa450edef68
2011-08-02 06:18:07 +00:00
Zhihong Yu 488537b281 Check hris against null in ServerShutdownHandler.process()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1153027 13f79535-47bb-0310-9956-ffa450edef68
2011-08-02 04:54:37 +00:00
Zhihong Yu 0cd2d8d932 HBASE-4148 HFileOutputFormat doesn't fill in TIMERANGE_KEY metadata (Jonathan Hsieh)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152947 13f79535-47bb-0310-9956-ffa450edef68
2011-08-01 21:53:12 +00:00
Zhihong Yu 50e3d546eb HBASE-4032 HBASE-451 improperly breaks public API HRegionInfo#getTableDesc
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152532 13f79535-47bb-0310-9956-ffa450edef68
2011-07-31 01:06:02 +00:00
Zhihong Yu 27daf3e744 HBASE-3845 Addendum: relax lastSeqWritten check in case write to WAL is skipped
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152457 13f79535-47bb-0310-9956-ffa450edef68
2011-07-30 11:36:44 +00:00
Zhihong Yu 5e4f28c289 HBASE-4138 If zookeeper.znode.parent is not specifed explicitly in Client
code then HTable object loops continuously waiting for the root region
               by using /hbase as the base node.(ramkrishna.s.vasudevan)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152220 13f79535-47bb-0310-9956-ffa450edef68
2011-07-29 13:46:11 +00:00
Zhihong Yu 5a8e6ff615 HBASE-3065 Addendum that removes metadata in getDataSetWatchSuccess() (Ramkrishna)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152213 13f79535-47bb-0310-9956-ffa450edef68
2011-07-29 13:28:27 +00:00
Zhihong Yu 996268c26e HBASE-4144 RS does not abort if the initialization of RS fails (ramkrishna.s.vasudevan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152122 13f79535-47bb-0310-9956-ffa450edef68
2011-07-29 06:42:11 +00:00
Zhihong Yu e5bbebc507 HBASE-4143 HTable.doPut(List) should check the writebuffer length every so often
addendum by Gary H


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152057 13f79535-47bb-0310-9956-ffa450edef68
2011-07-29 00:23:56 +00:00
Michael Stack 54e4164ce7 HBASE-3065 Retry all 'retryable' zk operations; e.g. connection loss; addendum... split log zk code url encodes which interacts w/ new naming of znodes that this patch introduces... this commit fixes testslitlogworker
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1152003 13f79535-47bb-0310-9956-ffa450edef68
2011-07-28 21:12:50 +00:00
Michael Stack b11659d679 HBASE-3065 Retry all 'retryable' zk operations; e.g. connection loss
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151751 13f79535-47bb-0310-9956-ffa450edef68
2011-07-28 06:44:27 +00:00
Zhihong Yu 6c838dc0ef HBASE-4143 HTable.doPut(List) should check the writebuffer length every so often
(Doug Meil via Ted Yu)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151689 13f79535-47bb-0310-9956-ffa450edef68
2011-07-28 00:24:11 +00:00
Michael Stack 5148146daf HBASE-1938 Make in-memory table scanning faster ; reverted 20110726_1938_MemStore.patch till we figure why it seems to slow tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151653 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 22:21:28 +00:00
Michael Stack a02c83a1d7 HBASE-1938 Make in-memory table scanning faster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151559 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 17:50:36 +00:00
Michael Stack 5f2aa2fea6 HBASE-4083 If Enable table is not completed and is partial, then scanning of the table is not working
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151341 13f79535-47bb-0310-9956-ffa450edef68
2011-07-27 05:55:43 +00:00
Andrew Kyle Purtell 2485279bfa HBASE-4139 [stargate] Update ScannerModel with support for filter package additions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151262 13f79535-47bb-0310-9956-ffa450edef68
2011-07-26 21:52:30 +00:00
Andrew Kyle Purtell 3e343dcd31 HBASE-4142 Advise against large batches in javadoc for HTable#put(List<Put>)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151257 13f79535-47bb-0310-9956-ffa450edef68
2011-07-26 21:41:17 +00:00
Michael Stack 1f9315ff09 HBASE-3899 enhance HBase RPC to support free-ing up server handler threads even if response is not ready
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151227 13f79535-47bb-0310-9956-ffa450edef68
2011-07-26 20:30:57 +00:00
Michael Stack 4c51d6dc6b HBASE-3845 data loss because lastSeqWritten can miss memstore edits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1151190 13f79535-47bb-0310-9956-ffa450edef68
2011-07-26 18:14:39 +00:00
Michael Stack 5b02ce98a3 HBASE-4129 hbase-3872 added a warn message 'CatalogJanitor: Daughter regiondir does not exist' that is triggered though its often legit that daughter is not present
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1150280 13f79535-47bb-0310-9956-ffa450edef68
2011-07-24 04:03:21 +00:00
Andrew Kyle Purtell 72409650d5 HBASE-4116 [stargate] StringIndexOutOfBoundsException in row spec parse
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1150206 13f79535-47bb-0310-9956-ffa450edef68
2011-07-23 19:50:19 +00:00
Andrew Kyle Purtell 4b21f2e32b HBASE-4105 Stargate does not support json and gzip in parallel
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1150190 13f79535-47bb-0310-9956-ffa450edef68
2011-07-23 19:04:08 +00:00
Nicolas Spiegelberg 81897bd47f HBASE-4127 Don't modify table's name away in HBaseAdmin
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1149764 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 23:38:58 +00:00
Michael Stack 25c43285bd HBASE-4126 Make timeoutmonitor timeout after 30 minutes instead of 3
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1149720 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:18:32 +00:00
Zhihong Yu 5db7f2f127 HBASE-4118 method regionserver.MemStore#updateColumnValue: the check for
qualifier and family is missing (N Keywal via Ted Yu)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148965 13f79535-47bb-0310-9956-ffa450edef68
2011-07-20 23:04:48 +00:00
Zhihong Yu 399462d5d7 HBASE-4095 revert, wait for further investigation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148715 13f79535-47bb-0310-9956-ffa450edef68
2011-07-20 12:15:03 +00:00
Zhihong Yu 77b2ebb530 HBASE-4095 revert to previous way of initializing initialReplication
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148707 13f79535-47bb-0310-9956-ffa450edef68
2011-07-20 11:28:24 +00:00
Zhihong Yu b6fc5b0b80 HBASE-4095 make cacheFlushLock.waittime longer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148691 13f79535-47bb-0310-9956-ffa450edef68
2011-07-20 10:35:22 +00:00
Michael Stack f84529b0ae HBASE-4115 HBase shell assign and unassign unusable if region name includes binary-encoded data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148558 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 21:45:13 +00:00
Michael Stack 820d40d134 HBASE-4101 Regionserver Deadlock
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148373 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 14:52:46 +00:00
Zhihong Yu f2499505de HBASE-4093 When verifyAndAssignRoot throws exception, the deadServers state
cannot be changed (fulin wang via Ted Yu)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148174 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 05:20:02 +00:00
Zhihong Yu 70d8db3673 HBASE-4095 Hlog may not be rolled in a long time if checkLowReplication's
request of LogRoll is blocked (Jieshan via Ted Yu)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148169 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 05:11:34 +00:00
Zhihong Yu d757784cbf HBASE-4112 Creating table may throw NullPointerException (Jinchao via Ted Yu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1148138 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 03:38:53 +00:00
Zhihong Yu 8f2fde07c7 HBASE-451 FSUtils.getTableInfoModtime() should check fs.listStatus() against null return
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1147914 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 15:00:03 +00:00
Zhihong Yu 8ae3106b95 HBASE-4052 reapply code in unassign() which handles NotServingRegionException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1147819 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 11:45:05 +00:00
Zhihong Yu 69bb8b99ec HBASE-4052 Enabling a table after master switch does not allow table scan,
throwing NotServingRegionException (ramkrishna via Ted Yu)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1147353 13f79535-47bb-0310-9956-ffa450edef68
2011-07-16 01:29:31 +00:00
Zhihong Yu 6b55b8dbe6 HBASE-4087 HBaseAdmin should perform validation of connection it holds
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1147352 13f79535-47bb-0310-9956-ffa450edef68
2011-07-16 01:18:36 +00:00
Michael Stack 6f476bfd0e HBASE-4081 Issues with HRegion.compactStores methods
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1147350 13f79535-47bb-0310-9956-ffa450edef68
2011-07-16 00:28:26 +00:00
Zhihong Yu fdd0d9f3e3 HBASE-451 getTableInfoPath() should be called in FSUtils.getTableInfoModtime()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1147043 13f79535-47bb-0310-9956-ffa450edef68
2011-07-15 09:01:41 +00:00
Michael Stack f54803aac2 HBASE-3872 Hole in split transaction rollback; edits to .META. need to be rolled back even if it seems like they didn't make it; fix failing HRegion test -- server passed is null, allow for this in tests when running splits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1146557 13f79535-47bb-0310-9956-ffa450edef68
2011-07-14 05:05:54 +00:00
Michael Stack 0a0ce9f1ae HBASE-3872 Hole in split transaction rollback; edits to .META. need to be rolled back even if it seems like they didn't make it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1146527 13f79535-47bb-0310-9956-ffa450edef68
2011-07-14 00:28:18 +00:00
Michael Stack 7f10f29425 HBASE-3872 Hole in split transaction rollback; edits to .META. need to be rolled back even if it seems like they didn't make it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1146526 13f79535-47bb-0310-9956-ffa450edef68
2011-07-14 00:27:14 +00:00
Michael Stack 53b5b9005e Fix broken TestMasterFailover test -- needed .tableinfo defined before test started... part of the repercussions from hbase-451; I don't this fixes all TestMasterFailover failures but at least a few obvious failures
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1146495 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 21:47:12 +00:00
Zhihong Yu edf2b7901a HBASE-3904 Reapply patch v6 for TRUNK with addendum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1145914 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 08:57:50 +00:00
Zhihong Yu de919df41a HBASE-3904 Revert patch v6 from TRUNK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1145906 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 08:47:41 +00:00
Zhihong Yu 1add4cc5d2 HBASE-3904 info.getTableName() should be used to get table name
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1145905 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 08:33:42 +00:00
Michael Stack 148627fe9c HBASE-4088 npes in server shutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1145855 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 04:18:50 +00:00
Zhihong Yu 1f3a4fefb8 HBASE-3904 Addendum that fixes number of retries (Ita Pai)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1145847 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 03:13:10 +00:00
Zhihong Yu 16a366b5cd HBASE-4003 Cleanup Calls Conservatively On Timeout - revert
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1145766 13f79535-47bb-0310-9956-ffa450edef68
2011-07-12 20:53:06 +00:00
Zhihong Yu d775dc50c1 HBASE-3871 Speedup LoadIncrementalHFiles by parallelizing HFile splitting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1145459 13f79535-47bb-0310-9956-ffa450edef68
2011-07-12 05:15:58 +00:00
Michael Stack 08a2eb0964 HBASE-4017 BlockCache interface should be truly modular
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144588 13f79535-47bb-0310-9956-ffa450edef68
2011-07-09 03:54:01 +00:00
Zhihong Yu a618fea162 HBASE-4079 HTableUtil - helper class for loading data (Doug Meil via Ted Yu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144581 13f79535-47bb-0310-9956-ffa450edef68
2011-07-09 03:15:02 +00:00
Zhihong Yu c08fe0f40e HBASE-4054 extending HTable because HTableInterface does not include
getRegionInfos and setAutoFlush


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144162 13f79535-47bb-0310-9956-ffa450edef68
2011-07-08 05:43:58 +00:00
Zhihong Yu 24c84bd22c Fix javadoc for HTable.setAutoFlush()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144152 13f79535-47bb-0310-9956-ffa450edef68
2011-07-08 04:07:18 +00:00
Zhihong Yu f372f3a411 HBASE-3893 account for new int field for FIXED_OVERHEAD
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144102 13f79535-47bb-0310-9956-ffa450edef68
2011-07-08 00:27:36 +00:00
Michael Stack 6b9b5dbd99 HBASE-4054 Usability improvement to HTablePool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144068 13f79535-47bb-0310-9956-ffa450edef68
2011-07-07 21:58:35 +00:00
Zhihong Yu fe05e91e42 HBASE-3893 HRegion.internalObtainRowLock shouldn't wait forever
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144065 13f79535-47bb-0310-9956-ffa450edef68
2011-07-07 21:52:21 +00:00
Zhihong Yu df02e92592 HBASE-4077 formatting spaces
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144058 13f79535-47bb-0310-9956-ffa450edef68
2011-07-07 21:36:54 +00:00
Zhihong Yu cf5b80c2ee HBASE-4077 Deadlock if WrongRegionException is thrown from getLock in
HRegion.delete (Adam Warrington via Ted Yu)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144054 13f79535-47bb-0310-9956-ffa450edef68
2011-07-07 21:33:11 +00:00
Michael Stack d0e28d0309 HBASE-4033 The shutdown RegionServer could be added to AssignmentManager.servers again
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144009 13f79535-47bb-0310-9956-ffa450edef68
2011-07-07 19:58:27 +00:00
Michael Stack ee97af7842 HBASE-4074 When a RS has hostname with uppercase letter, there are two RS entries in master -- addendum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1144004 13f79535-47bb-0310-9956-ffa450edef68
2011-07-07 19:48:05 +00:00
Zhihong Yu 1e90b73574 HBASE-4074 When a RS has hostname with uppercase letter, there are two
RS entries in master


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1143915 13f79535-47bb-0310-9956-ffa450edef68
2011-07-07 16:44:49 +00:00
Zhihong Yu fef618201f HBASE-3867 when cluster is stopped and server which hosted meta region is
removed from cluster, master breaks down after restarting cluster.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1143586 13f79535-47bb-0310-9956-ffa450edef68
2011-07-06 22:27:37 +00:00
Zhihong Yu a161fad751 HBASE-4061 getTableDirs is missing directories to skip
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1143557 13f79535-47bb-0310-9956-ffa450edef68
2011-07-06 20:43:47 +00:00
Zhihong Yu db0cd694b2 HBASE-4053 Most of the regions were added into AssignmentManager#servers twice
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1143530 13f79535-47bb-0310-9956-ffa450edef68
2011-07-06 19:00:11 +00:00
Zhihong Yu e3f8560143 HBASE-3904 HBA.createTable(final HTableDescriptor desc, byte [][] splitKeys)
should be synchronous



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1143522 13f79535-47bb-0310-9956-ffa450edef68
2011-07-06 18:31:04 +00:00
Zhihong Yu be7cee5901 HBASE-4059 If a region is split during RS shutdown process, the daughter
regions are NOT made online by master



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1143505 13f79535-47bb-0310-9956-ffa450edef68
2011-07-06 17:19:32 +00:00
Todd Lipcon 8b2948bd62 HBASE-3240 Improve documentation of importtsv and bulk loads.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1143232 13f79535-47bb-0310-9956-ffa450edef68
2011-07-06 00:09:55 +00:00
Zhihong Yu 38ee878044 HRegionInfo.toString() doesn't call Bytes.toStringBinary() on tableName
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1142235 13f79535-47bb-0310-9956-ffa450edef68
2011-07-02 15:34:29 +00:00
Michael Stack fb23289cd1 HBASE-4034 HRegionServer should be stopped even if no META regions are hosted by the HRegionServer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1142120 13f79535-47bb-0310-9956-ffa450edef68
2011-07-02 00:03:40 +00:00
Michael Stack b2f0ae7fba HBASE-3968 HLog Pretty Printer -- REDO
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1142103 13f79535-47bb-0310-9956-ffa450edef68
2011-07-01 21:40:16 +00:00
Michael Stack d5858c86a1 HBASE-3968 HLog Pretty Printer -- REVERT: I committed too much
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1142102 13f79535-47bb-0310-9956-ffa450edef68
2011-07-01 21:35:11 +00:00
Michael Stack 090b24fb97 HBASE-3968 HLog Pretty Printer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1142101 13f79535-47bb-0310-9956-ffa450edef68
2011-07-01 21:33:14 +00:00
Andrew Kyle Purtell 9ed65d97c6 HBASE-4048 Support configuration of coprocessor at load time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1142004 13f79535-47bb-0310-9956-ffa450edef68
2011-07-01 17:39:54 +00:00
Andrew Kyle Purtell bca3fcd502 HBASE-4051 Table coprocessor loaded twice when region is initialized
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1141786 13f79535-47bb-0310-9956-ffa450edef68
2011-07-01 03:26:07 +00:00
Jean-Daniel Cryans 1d0975f581 HBASE-4045 [replication] NPE in ReplicationSource when ZK is gone
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1141313 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 23:08:18 +00:00
Jean-Daniel Cryans 70d9045694 HBASE-3984 CT.verifyRegionLocation isn't doing a very good check,
can delay cluster recovery


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1141290 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 22:21:39 +00:00
Michael Stack 71607dc16f HBASE-4036 Implementing a MultipleColumnPrefixFilter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1140953 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 03:37:56 +00:00
Zhihong Yu cd6dc0a80b HBASE-4012 Further optimize byte comparison methods (Ted Yu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1140912 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 23:56:33 +00:00
Michael Stack 95dc02182e HBASE-4016 HRegion.incrementColumnValue() doesn't have a consistent behavior when the field that we are incrementing is less than 8 bytes long
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1140907 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 23:37:03 +00:00
Gary Helmling da9613d75c HBASE-3516 Coprocessors: add test cases for loading coprocessor jars
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1140778 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 18:37:56 +00:00
Zhihong Yu 00a3a5c8f7 HBASE-3534 Action should not store or serialize regionName (Ted Yu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1140435 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 04:49:09 +00:00
Zhihong Yu 9822b89693 HBASE-4024 Major compaction may not be triggered, even though region
server log says it is triggered (Ted Yu)



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1140421 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 03:55:01 +00:00
Zhihong Yu 93b2e8d2bc HBASE-4025 Server startup fails during startup due to failure in loading
all table descriptors. (Subbu Iyer via Ted Yu)



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1139552 13f79535-47bb-0310-9956-ffa450edef68
2011-06-25 15:21:20 +00:00
Zhihong Yu a769d1e10d HBASE-4028 Hmaster crashes caused by splitting log.
(gaojinchao via Ted Yu)



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1139526 13f79535-47bb-0310-9956-ffa450edef68
2011-06-25 11:41:39 +00:00
Zhihong Yu 0b95330166 HBASE-4029 Inappropriate checking of Logging Mode in HRegionServer
(Akash Ashok via Ted Yu)



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1139522 13f79535-47bb-0310-9956-ffa450edef68
2011-06-25 11:19:51 +00:00
Zhihong Yu 51ae4d386c HBASE-4013 Make ZooKeeperListener Abstract (Akash Ashok via Ted Yu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1139154 13f79535-47bb-0310-9956-ffa450edef68
2011-06-24 04:43:35 +00:00
Michael Stack 9460fbb202 HBASE-4003 Cleanup Calls Conservatively On Timeout
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138736 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 05:08:29 +00:00
Michael Stack 7191604865 Fix failing TestHeapSize so it'll pass for 64bit and 32bit jvms
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138734 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 04:04:29 +00:00
Michael Stack a8f9f4d751 HBASE-3969 Outdated data can not be cleaned in time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138730 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 03:49:23 +00:00
Zhihong Yu 1df7e7ac77 HBASE-3506 Ability to disable, drop and enable tables using regex expression
Joey Echeverria via Ted Yu



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138707 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 01:38:53 +00:00
Michael Stack bf9654474c Attempted fix for broken TestHeapSize up on jenkins
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138647 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 21:45:31 +00:00
Michael Stack 7b6f6d6e19 HBASE-451 Remove HTableDescriptor from HRegionInfo -- part 2, some cleanup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138601 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 19:55:40 +00:00
Zhihong Yu 7f2792b11b HBASE-4010 HMaster.createTable could be heavily optimized
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138318 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 06:48:28 +00:00
Michael Stack 425c3f9aa6 HBASE-3986 troubleshooting.xml - adding client long-pause and NotServingRegionException entries -- back out mistaken HRS commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138305 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 05:27:08 +00:00
Michael Stack 950b318877 HBASE-3986 troubleshooting.xml - adding client long-pause and NotServingRegionException entries
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138304 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 05:26:13 +00:00
Michael Stack 7e87980347 HBASE-4005 close_region bugs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138246 13f79535-47bb-0310-9956-ffa450edef68
2011-06-21 23:29:28 +00:00
Jean-Daniel Cryans a6ef251118 HBASE-3994 SplitTransaction has a window where clients can
get RegionOfflineException


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138219 13f79535-47bb-0310-9956-ffa450edef68
2011-06-21 22:22:33 +00:00
Michael Stack 791659b27e HBASE-2077 NullPointerException with an open scanner that expired causing an immediate region server shutdown -- part 2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138180 13f79535-47bb-0310-9956-ffa450edef68
2011-06-21 20:56:14 +00:00
Michael Stack b0439269fe HBASE-451 Remove HTableDescriptor from HRegionInfo -- part 2, some cleanup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1138120 13f79535-47bb-0310-9956-ffa450edef68
2011-06-21 18:31:26 +00:00
Gary Helmling cf25a779aa HBASE-4011 Add MasterObserver hook for post active master initialization
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1137830 13f79535-47bb-0310-9956-ffa450edef68
2011-06-21 00:20:29 +00:00
Michael Stack a3d1ab8df0 HBASE-4000 You can't specify split points when you create a table in the shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1137257 13f79535-47bb-0310-9956-ffa450edef68
2011-06-18 22:12:07 +00:00
Michael Stack 07b0a6d06c HBASE-3988 Infinite loop for secondary master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136698 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 21:55:58 +00:00
Michael Stack ecce7c2cd7 HBASE-3948 Improve split/compact result page for RegionServer status page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136696 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 21:48:49 +00:00
Michael Stack 6f09e358e0 HBASE-3987 Fix a NullPointerException on a failure to load Bloom filter data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136689 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 21:24:57 +00:00
Michael Stack ebb63ef44d HBASE-3927 display total uncompressed byte size of a region in web UI
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136686 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 21:18:08 +00:00
Michael Stack bd7c8e327f HBASE-3889 NPE in Distributed Log Splitting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136659 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 20:43:28 +00:00
Michael Stack 0f15fcac46 HBASE-3985 Same Region could be picked out twice in LoadBalance
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136629 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 19:51:34 +00:00
Michael Stack 8159b37b3e HBASE-3970 Address HMaster crash/failure half way through meta migration
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136587 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 18:28:59 +00:00
Michael Stack e636646e91 HBASE-3946 HBASE-3946 broke TestMasterFailover
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136345 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 09:39:05 +00:00
Jean-Daniel Cryans 0a585ffbc8 HBASE-3789 Cleanup the locking contention in the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136140 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 18:21:14 +00:00
Michael Stack 2aade76735 HBASE-451 Remove HTableDescriptor from HRegionInfo -- fix for TestAdmin
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1136125 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 17:18:13 +00:00
Michael Stack 0c8d19c975 HBASE-3976 Disable Block Cache On Compactions -- REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135855 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 23:47:37 +00:00
Michael Stack a86a4b9dc7 HBASE-3976 Disable Block Cache On Compactions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135849 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 23:23:52 +00:00
Michael Stack 74eb4dd8b3 HBASE-3940 HBase daemons should log version info at startup and possibly periodically
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135800 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 21:20:14 +00:00
Michael Stack 0a48f15c3b doc fix from leif wickland up on mailing list
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135747 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 19:00:27 +00:00
Michael Stack d8f5be74d7 HBASE-451 Remove HTableDescriptor from HRegionInfo
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135385 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 05:40:32 +00:00
Michael Stack 34ddfc126d HBASE-3963 Schedule all log-spliiting at startup all at once -- reverse test for wals with no server (was wrong)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135384 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 05:37:11 +00:00
Todd Lipcon 4c5264d4b3 HBASE-3916. Fix the default bind address of ThriftServer to be wildcard instead of localhost. Contributed by Li Pi
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135358 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 01:56:41 +00:00
Michael Stack 76a743e8f0 HBASE-3793 HBASE-3468 Broke checkAndPut with null value
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135342 13f79535-47bb-0310-9956-ffa450edef68
2011-06-13 23:43:49 +00:00
Michael Stack 9128d4e20e HBASE-3983 list command in shell seems broken -- Changed @mac_width to @max_width -- noticed by Todd
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135341 13f79535-47bb-0310-9956-ffa450edef68
2011-06-13 23:42:04 +00:00
Michael Stack 0f843f5d0a HBASE-3983 list command in shell seems broken
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135337 13f79535-47bb-0310-9956-ffa450edef68
2011-06-13 23:31:28 +00:00
Michael Stack ac2e192ad5 HBASE-3928 Some potential performance improvements to Bytes/KeyValue
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135319 13f79535-47bb-0310-9956-ffa450edef68
2011-06-13 22:15:11 +00:00
Michael Stack 1e5deae9e9 HBASE-3963 Schedule all log-spliiting at startup all at once
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1135317 13f79535-47bb-0310-9956-ffa450edef68
2011-06-13 22:13:03 +00:00
Andrew Kyle Purtell 006b4b189c HBASE-3978 Rowlock lease renew doesn't work when custom coprocessor indicates to bypass default action
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134940 13f79535-47bb-0310-9956-ffa450edef68
2011-06-12 16:07:11 +00:00
Andrew Kyle Purtell d1c070f707 HBASE 3976; Revert
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134925 13f79535-47bb-0310-9956-ffa450edef68
2011-06-12 13:44:30 +00:00
Michael Stack 3fb6a0a7aa HBASE-3923 HBASE-1502 Broke Shell's status 'simple' and 'detailed'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134483 13f79535-47bb-0310-9956-ffa450edef68
2011-06-10 23:40:38 +00:00
Nicolas Spiegelberg af03bb3a99 HBASE-3794 : Ability to Discard Bad HTable Puts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134476 13f79535-47bb-0310-9956-ffa450edef68
2011-06-10 23:24:38 +00:00
Michael Stack c98dc2c4b4 HBASE-3979 Trivial fixes in code, document
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134459 13f79535-47bb-0310-9956-ffa450edef68
2011-06-10 22:07:33 +00:00
Andrew Kyle Purtell 09d3d6bed9 HBASE-3976 Disable block cache on compactions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134430 13f79535-47bb-0310-9956-ffa450edef68
2011-06-10 20:11:32 +00:00
Michael Stack 14bd82872d HBASE-3871 Compression.java uses ClassLoader.getSystemClassLoader() to load codec
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134119 13f79535-47bb-0310-9956-ffa450edef68
2011-06-09 22:34:32 +00:00
Michael Stack f7de6a6b37 HBASE-3973 HBase IRB shell: Don't pretty-print the output when stdout isn't a TTY
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134118 13f79535-47bb-0310-9956-ffa450edef68
2011-06-09 22:29:47 +00:00
Michael Stack 7cd5403b30 HBASE-2233 Support both Hadoop 0.20 and 0.22
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1134089 13f79535-47bb-0310-9956-ffa450edef68
2011-06-09 21:27:41 +00:00
Michael Stack 829f254216 HBASE-3946 The splitted region can be online again while the standby hmaster becomes the active one
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1133459 13f79535-47bb-0310-9956-ffa450edef68
2011-06-08 16:36:53 +00:00
Andrew Kyle Purtell bf14e34145 HBASE-3961 Add Delete.setWriteToWAL functionality
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1133427 13f79535-47bb-0310-9956-ffa450edef68
2011-06-08 15:27:09 +00:00
Michael Stack 9b22cb0f0e HBASE-3941 'hbase version' command line should print version info -- REVERT MISTAKEN COMMIT OF WRONG PATCH
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1133210 13f79535-47bb-0310-9956-ffa450edef68
2011-06-08 00:04:47 +00:00
Michael Stack 7a55ec9a25 HBASE-3941 'hbase version' command line should print version info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1133209 13f79535-47bb-0310-9956-ffa450edef68
2011-06-08 00:03:54 +00:00
Michael Stack 06eba7a579 HBASE-3808 Implement Executor.toString for master handlers at least
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1132466 13f79535-47bb-0310-9956-ffa450edef68
2011-06-05 18:02:34 +00:00
Michael Stack 64f6fb52dc HBASE-3899 enhance HBase RPC to support free-ing up server handler threads even if response is not ready -- BACKED IT OUT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1131480 13f79535-47bb-0310-9956-ffa450edef68
2011-06-04 19:46:00 +00:00
Michael Stack 45fd021b2e HBASE-3592 Guava snuck back in as a dependency via hbase-3777
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1131294 13f79535-47bb-0310-9956-ffa450edef68
2011-06-03 23:49:38 +00:00
Michael Stack f765254568 HBASE-2556 Add convenience method to HBaseAdmin to get a collection of HRegionInfo objects for each table; fix some formatting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1130322 13f79535-47bb-0310-9956-ffa450edef68
2011-06-01 22:10:15 +00:00
Michael Stack ac8a57e93b HBASE-2556 Add convenience method to HBaseAdmin to get a collection of HRegionInfo objects for each table
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1130316 13f79535-47bb-0310-9956-ffa450edef68
2011-06-01 21:51:02 +00:00
Michael Stack fe8dce6636 HBASE-3942 The thrift scannerOpen functions should support row caching
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1130275 13f79535-47bb-0310-9956-ffa450edef68
2011-06-01 19:50:12 +00:00
Michael Stack ce75265812 Removed obsolete hbase.regionserver.thread.splitcompactcheckfrequency
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1130238 13f79535-47bb-0310-9956-ffa450edef68
2011-06-01 17:34:18 +00:00
Gary Helmling 40494a9f23 Trivial log fix -- we report number of offline regions to enable not online regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1129967 13f79535-47bb-0310-9956-ffa450edef68
2011-05-31 23:38:22 +00:00
Michael Stack 13a0e22c4b HBASE-3934 MemStoreFlusher.getMemStoreLimit() doesn't honor defaultLimit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1129469 13f79535-47bb-0310-9956-ffa450edef68
2011-05-31 02:16:22 +00:00
Andrew Kyle Purtell 6bd9abf44d HBASE-3931 Allow adding attributes to Get
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1128978 13f79535-47bb-0310-9956-ffa450edef68
2011-05-30 01:10:01 +00:00
Andrew Kyle Purtell 182ddeac26 HBASE-3921 Allow adding arbitrary blobs to Put; fix accidental commit from wrong working file
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1128906 13f79535-47bb-0310-9956-ffa450edef68
2011-05-29 17:06:32 +00:00
Andrew Kyle Purtell 92845b63c4 HBASE-3921 Allow adding arbitrary blobs to Put; fix TestHeapSize
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1128905 13f79535-47bb-0310-9956-ffa450edef68
2011-05-29 17:02:11 +00:00
Michael Stack 03f55a3e89 HBASE-3921 Allow adding arbitrary blobs to Put
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127782 13f79535-47bb-0310-9956-ffa450edef68
2011-05-26 04:20:42 +00:00
Michael Stack 9d197ae1ce HBASE-2937 Facilitate Timeouts In HBase Client
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127680 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 20:50:32 +00:00
Michael Stack 9f28990e7a HBASE-3841 HTable and HTableInterface docs are inconsistent with one another
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127678 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 20:44:11 +00:00
Michael Stack d3045093c7 HBASE-3811 Allow adding attributes to Scan
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127676 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 20:41:20 +00:00
Michael Stack 81aae08c4a HBASE-3919 More places output binary data to text
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127384 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 05:07:10 +00:00
Michael Stack 147e0054fd HBASE-3920 HLog hbase.regionserver.flushlogentries no longer supported
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127377 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 04:48:39 +00:00
Michael Stack 85a3cf14f9 HBASE-3894 Thread contention over row locks set monitor
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127374 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 04:18:12 +00:00
Michael Stack 06b8461cc5 HBASE-3914 ROOT region appeared in two regionserver's onlineRegions at the same time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1127158 13f79535-47bb-0310-9956-ffa450edef68
2011-05-24 17:25:42 +00:00
Michael Stack b488975ddd HBASE-3195 Binary row keys in hbck and other miscellaneous binary key display issues
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1126872 13f79535-47bb-0310-9956-ffa450edef68
2011-05-24 05:19:20 +00:00
Michael Stack 2fcf225f3e HBASE-3899 HBase RPC to support free-ing up server handler threads even if response is not ready -- fix double application of WritableDelayed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1126863 13f79535-47bb-0310-9956-ffa450edef68
2011-05-24 04:32:59 +00:00
Michael Stack 222f6836df HBASE-3899 HBase RPC to support free-ing up server handler threads even if response is not ready
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1126857 13f79535-47bb-0310-9956-ffa450edef68
2011-05-24 03:47:40 +00:00
Michael Stack 5cff071c38 HBASE-3908 TableSplit not implementing hashCode problem
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1126600 13f79535-47bb-0310-9956-ffa450edef68
2011-05-23 17:13:43 +00:00
Andrew Kyle Purtell 60d7a81833 HBASE-3912 [Stargate] Columns not handle by Scan; fix NPE
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1126556 13f79535-47bb-0310-9956-ffa450edef68
2011-05-23 15:58:55 +00:00
Andrew Kyle Purtell 981f414cd3 HBASE-3912 [Stargate] Columns not handle by Scan
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1126528 13f79535-47bb-0310-9956-ffa450edef68
2011-05-23 15:07:01 +00:00
Michael Stack 2ed476e3dd HBASE-2938 Add Thread-Local Behavior To HTable Pool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125533 13f79535-47bb-0310-9956-ffa450edef68
2011-05-20 20:00:58 +00:00
Michael Stack 2b1f7dbd54 HBASE-3905 HBaseAdmin.createTableAsync() should check for invalid split keys.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125233 13f79535-47bb-0310-9956-ffa450edef68
2011-05-20 04:45:40 +00:00
Michael Stack 55a7d35c2a HBASE-3691 Add compressor support for 'snappy', google's compressor
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125163 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 23:00:47 +00:00
Michael Stack 19402cd814 HBASE-3826 Minor compaction needs to check if still over compactionThreshold after compacting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125140 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 22:00:27 +00:00
Michael Stack 6cc03b35a3 HBASE-3820 Splitlog() executed while the namenode was in safemode may cause data-loss
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125111 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 21:16:58 +00:00
Michael Stack 5fc468c60c HBASE-3902 Add Bytes.toBigDecimal and Bytes.toBytes(BigDecimal)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125098 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 21:02:15 +00:00
Michael Stack d5a6c9d1b1 HBASE-3901 Update documentation for ImportTsv to reflect recent features
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125046 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 18:37:10 +00:00
Michael Stack 557ce312af HBASE-3898 TestSplitTransactionOnCluster broke in TRUNK -- retry
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1125045 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 18:34:32 +00:00
Michael Stack e0ad6f0ed1 HBASE-3880 Make mapper function in ImportTSV plug-able
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1124542 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 05:48:37 +00:00
Michael Stack 31965fe0fb HBASE-3898 TestSplitTransactionOnCluster broke in TRUNK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1124539 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 05:33:38 +00:00
Jean-Daniel Cryans d64c76fe10 HBASE-3874 ServerShutdownHandler fails on NPE if a plan has a random
region assignment


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1124477 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 00:24:18 +00:00
Michael Stack e218325a61 HBASE-3878 Hbase client throws NoSuchElementException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1102416 13f79535-47bb-0310-9956-ffa450edef68
2011-05-12 18:47:06 +00:00
Jean-Daniel Cryans 1bf409f052 Fixing a log message in LoadBalancer, saw by Gaojinchao
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1102386 13f79535-47bb-0310-9956-ffa450edef68
2011-05-12 17:18:45 +00:00
Nicolas Spiegelberg dc2659524a HBASE-3877 Determine Proper Defaults for Compaction ThreadPools
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1102105 13f79535-47bb-0310-9956-ffa450edef68
2011-05-11 21:50:37 +00:00
Michael Stack dedc82a653 Add some clarification to session timeout for zookeeper
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1101693 13f79535-47bb-0310-9956-ffa450edef68
2011-05-11 00:29:32 +00:00
Nicolas Spiegelberg 770b745807 HBASE-1476 Multithreaded Compactions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1101677 13f79535-47bb-0310-9956-ffa450edef68
2011-05-10 23:21:04 +00:00
Nicolas Spiegelberg 1f4eb71478 HBASE-3797 StoreFile Level Compaction Locking
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1101676 13f79535-47bb-0310-9956-ffa450edef68
2011-05-10 23:20:45 +00:00
Michael Stack 7d03a7dbb6 HBASE-3864 Rename of hfile.min.blocksize.size in HBASE-2899 reverted in HBASE-1861
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100404 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 22:12:09 +00:00
Michael Stack 40cb8dffc2 HBASE-3861 MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns; backing it out till figure the TestHCM OOME issue
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100390 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 21:44:31 +00:00
Andrew Kyle Purtell 6fb0428103 HBASE-3855 Performance degradation of memstore because reseek is linear; fix TestHeapSize
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100308 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 18:12:22 +00:00
Andrew Kyle Purtell 93a75bb3eb HBASE-3861 MiniZooKeeperCluster should refer to maxClientCnxns
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100299 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 17:43:02 +00:00
Michael Stack ee4553fc1a HBASE-3855 Performance degradation of memstore because reseek is linear
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100236 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 14:44:07 +00:00
Michael Stack 1bd0e5ff51 HBASE-3863 Fix failing TestHBaseFsck.testHBaseFsckMeta unit test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100095 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 06:25:29 +00:00
Michael Stack f3ebb53efc HBASE-3721 Speedup LoadIncrementalHFiles
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100045 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 04:26:58 +00:00
Michael Stack 3450c962ad HBASE-3862 Race conditions in aggregate calculation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1100043 13f79535-47bb-0310-9956-ffa450edef68
2011-05-06 04:24:28 +00:00
Jean-Daniel Cryans d60cceaff3 HBASE-3860 HLog shouldn't create a new HBC when rolling
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099988 13f79535-47bb-0310-9956-ffa450edef68
2011-05-05 22:48:44 +00:00
Michael Stack 8ffaac2003 HBASE-3813 Change RPC callQueue size from "handlerCount * MAX_QUEUE_SIZE_PER_HANDLER;"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099695 13f79535-47bb-0310-9956-ffa450edef68
2011-05-05 06:07:56 +00:00
Michael Stack 3d6b1485bf HBASE-3695 Some improvements to Hbck to test the entire region chain in Meta and provide better error reporting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099566 13f79535-47bb-0310-9956-ffa450edef68
2011-05-04 19:28:45 +00:00
Michael Stack 81e9be2518 HBASE-3821 'NOT flushing memstore for region' keep on printing for half an hour
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099318 13f79535-47bb-0310-9956-ffa450edef68
2011-05-04 03:51:59 +00:00
Jean-Daniel Cryans 6aa6a4ad8f HBASE-3597 ageOfLastAppliedOp should update after cluster replication
failures


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099302 13f79535-47bb-0310-9956-ffa450edef68
2011-05-04 00:20:31 +00:00
Todd Lipcon 17694cf3bc Fix up bad resolve of trunk conflict from HBASE-3835
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099206 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 19:11:25 +00:00
Todd Lipcon 214f63b6c8 HBASE-3839 Add monitoring of currently running tasks to the master and RS web UIs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099202 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 19:09:20 +00:00
Todd Lipcon 7d5d1fe752 HBASE-3837 Show regions in transition on the master web page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099199 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 19:07:54 +00:00
Todd Lipcon 46d64afcd9 HBASE-3835 Switch master and region server pages to Jamon-based templates
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099198 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 19:07:00 +00:00
Jean-Daniel Cryans 94d77931b3 HBASE-3846 Set RIT timeout higher
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099155 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 17:45:58 +00:00
Michael Stack 59392e209f Fix table.jsp so it shows region locations and counts -- just before we replace all this jsp stuff. Location was broke by 1502
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1099101 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 15:54:08 +00:00
Todd Lipcon ca952ac00b HBASE-3836 Add facility to track currently progressing actions and workflows.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098933 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 06:11:06 +00:00
Michael Stack 8341e4a3be HBASE-3849 Fix master ui; hbase-1502 broke requests/second
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098925 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 05:54:45 +00:00
Michael Stack b6ad337ea1 HBASE-3849 Fix master ui; hbase-1502 broke requests/second
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098919 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 05:48:37 +00:00
Michael Stack 9c1d01e24f HBASE-3777 Redefine Identity Of HBase Configuration
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098901 13f79535-47bb-0310-9956-ffa450edef68
2011-05-03 04:43:53 +00:00
Michael Stack 7e6f56200e HBASE-3847 Turn off DEBUG logging of RPCs in WriteableRPCEngine on TRUNK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098861 13f79535-47bb-0310-9956-ffa450edef68
2011-05-02 23:37:54 +00:00
Michael Stack 2a4f052bcc HBASE-3838 RegionCoprocesorHost.preWALRestore throws npe in case there is no RegionObserver registered
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098705 13f79535-47bb-0310-9956-ffa450edef68
2011-05-02 18:14:05 +00:00
Michael Stack 6c32f36250 HBASE-3670 Fix error handling in get(List<Get> gets)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098702 13f79535-47bb-0310-9956-ffa450edef68
2011-05-02 18:10:36 +00:00
Michael Stack 659da04632 HBASE-3843 splitLogWorker starts too early
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098696 13f79535-47bb-0310-9956-ffa450edef68
2011-05-02 18:04:19 +00:00
Michael Stack 94bd6f7710 HBASE-3796 Per-Store Entries in Compaction Queue; added missing license
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1098150 13f79535-47bb-0310-9956-ffa450edef68
2011-04-30 20:11:42 +00:00