Michael Stack
67ded34626
AggregationClient fails validation for open stoprow scan
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306914 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:29:01 +00:00
Michael Stack
ec4d59770a
HBASE-5564 Bulkload is discarding duplicate records
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306907 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:23:46 +00:00
Michael Stack
8a864815de
HBASE-5671 hbase.metrics.showTableName should be true by default
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306712 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 04:35:48 +00:00
Zhihong Yu
ada9d8d361
HBASE-5544 Add metrics to HRegion.processRow() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306648 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 23:59:17 +00:00
Doug Meil
d5a548e7ca
hbase-5662. ops_mgt.xml, adding entry for HLogPrettyPrinter in tools section.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306037 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 22:44:11 +00:00
Doug Meil
18e7473a53
hbase-5661. adding hbase history section in appendix
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306032 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 22:27:13 +00:00
Doug Meil
528d9ddde1
hbase-5660. Creating Case Studies chapter in RefGuide.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306015 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 20:50:55 +00:00
larsh
16ad2b2898
HBASE-5639 The logic used in waiting for region servers during startup is broken (J-D and NKeyval)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306012 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 20:40:13 +00:00
Doug Meil
83e552c3b3
hbase-5658. Update to pseudo-distributed.xml's first link on page to point to RefGuide
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305990 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 19:48:32 +00:00
Doug Meil
0fa7062d2c
hbase-5657. developer.xml, updating line-width from 80 to 100 in book (and example)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305979 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 19:36:37 +00:00
Michael Stack
46d8f02c3f
HBASE-5610 Add GA to hbase.apache.org
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305970 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 19:26:26 +00:00
larsh
ef65dde6b3
HBASE-5641 decayingSampleTick1 prevents HBase from shutting down.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305722 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 03:34:51 +00:00
Jonathan Hsieh
3fd6997380
HBASE-5596 Few minor bugs from HBASE-5209 (David S. Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 23:06:02 +00:00
larsh
080206de01
HBASE-5623 Race condition when rolling the HLog and hlogFlush (Enis Soztutar and LarsH)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305556 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 20:42:46 +00:00
Michael Stack
8ea1c8ddd6
HBASE-5533 Add more metrics to HBase
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305499 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 19:21:42 +00:00
Zhihong Yu
3c234f13ba
HBASE-5615 the master never does balance because of balancing the parent region (Xufeng)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305171 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 23:22:00 +00:00
larsh
82670f81b8
HBASE-4957 Clean up some log messages, code in RecoverableZooKeeper (Todd)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304940 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 22:02:41 +00:00
Michael Stack
9cfe7cfa3c
HBASE-5633 NPE reading ZK config in HBase
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304924 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:15:40 +00:00
larsh
accf8ee862
HBASE-5434 [REST] Include more metrics in cluster status request (Mubarak Seyed)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304919 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:04:45 +00:00
Zhihong Yu
53712ce495
HBASE-5128 Addendum adds two new files Jon forgot to add
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304702 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 03:58:22 +00:00
Jonathan Hsieh
f2d637ffa5
HBASE-5128 [uber hbck] Online automated repair of table integrity and region consistency problems
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 23:53:55 +00:00
Jean-Daniel Cryans
560173f756
HBASE-5190 Limit the IPC queue size based on calls' payload size
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304634 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:32:31 +00:00
mbautin
86962028dd
[jira] [HBASE-5469] Add baseline compression efficiency to DataBlockEncodingTool
...
Summary:
DataBlockEncodingTool currently does not provide baseline compression
efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if
we are using LZO to compress blocks, we would like to have the following
columns in the report (possibly as percentages of raw data size).
Baseline K+V in blockcache | Baseline K + V on disk (LZO compressed) | K + V
DataBlockEncoded in block cache | K + V DataBlockEncoded + LZOCompressed (on
disk)
Background: we never store compressed blocks in cache, but we always store
encoded data blocks in cache if data block encoding is enabled for the column
family.
This patch also has multiple bugfixes and improvements to DataBlockEncodingTool,
including presentation format, memory requirements (reduced 3x) and fixing the
handling of compression.
Test Plan:
* Run unit tests.
* Run DataBlockEncodingTool on a variety of real-world HFiles.
Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang
Reviewed By: tedyu
Differential Revision: https://reviews.facebook.net/D2409
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:02:53 +00:00
Michael Stack
1e6c227883
HBASE-5616 Make compaction code standalone; ADDENDUM -- ADD LICENSES
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304624 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:52:55 +00:00
Michael Stack
5a9f595e7d
HBASE-5616 Make compaction code standalone
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304616 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:37:01 +00:00
Michael Stack
358dc6e6e6
HBASE-5624 Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:18:41 +00:00
Zhihong Yu
26b2950bc7
HBASE-5613 ThriftServer getTableRegions does not return serverName and port (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:15:50 +00:00
larsh
929113dfab
HBASE-4657 Improve the efficiency of our MR jobs with a few configurations
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304110 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:34:35 +00:00
Zhihong Yu
a379a41e3d
HBASE-5591 ThiftServerRunner.HBaseHandler.toBytes() is identical to Bytes.getBytes() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 20:43:55 +00:00
Jean-Daniel Cryans
fa98df639e
HBASE-5586 [replication] NPE in ReplicationSource when creating a stream
...
to an inexistent cluster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303945 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 18:13:12 +00:00
larsh
536ff21825
HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) part 2
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303920 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:51:37 +00:00
larsh
6fb055da00
HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303915 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:49:32 +00:00
Michael Stack
772ecdd236
HBASE-5328 Small changes to Master to make it more testable
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303648 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 03:40:46 +00:00
Michael Stack
327e2d1f74
HBASE-5328 Small changes to Master to make it more testable
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:02:36 +00:00
larsh
4ba5a9d29e
HBASE-5433 [REST] Add metrics to keep track of success/failure count (Mubarak Seyed)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303536 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:48:11 +00:00
Jonathan Hsieh
865b14133b
HBASE-5589 Add of the offline call to the Master Interface
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303519 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:30:54 +00:00
Zhihong Yu
5b2d6ebfc5
HBASE-5542 revert due to broken trunk build
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303517 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:28:33 +00:00
Michael Stack
250252f400
HBASE-5560 Avoid RegionServer GC caused by timed-out calls
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303512 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:17:59 +00:00
Zhihong Yu
ce36877d30
HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303490 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:25:18 +00:00
larsh
41f31490ff
HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303220 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 23:57:53 +00:00
mbautin
b4dccf9198
HBASE-5605 [jira] compression does not work in Store.java
...
Author: Yongqiang He
Summary: need to pass compression parameter to WriterBuilder
Test Plan: one simple and straightforward change
Reviewers: mbautin
Reviewed By: mbautin
CC: tedyu
Differential Revision: https://reviews.facebook.net/D2391
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303150 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 21:04:38 +00:00
ramkrishna
2f58da0489
HBASE-5520 Support reseek() at RegionScanner (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303005 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 17:10:50 +00:00
Doug Meil
45a15792f0
hbase-5570 ops_mgt.xml - fixed self-reference with compression section
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302658 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 21:14:55 +00:00
mbautin
6be64072e8
HBASE-5521 [jira] Move compression/decompression to an encoder specific encoding
...
context
Author: Yongqiang He
Summary:
https://issues.apache.org/jira/browse/HBASE-5521
As part of working on HBASE-5313, we want to add a new columnar encoder/decoder.
It makes sense to move compression to be part of encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer.
If there is no encoder specified for a writer, the HBlock.Writer will use a
default compression-context to do something very similar to today's code.
Test Plan: existing unit tests verified by mbautin and tedyu. And no new test
added here since this code is just a preparation for columnar encoder. Will add
testcase later in that diff.
Reviewers: dhruba, tedyu, sc, mbautin
Reviewed By: mbautin
Differential Revision: https://reviews.facebook.net/D2097
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 19:12:19 +00:00
Michael Stack
047d209cee
HBASE-5955 Fix NoSuchMethodException in 0.92 when running on local filesystem
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302207 13f79535-47bb-0310-9956-ffa450edef68
2012-03-18 19:40:24 +00:00
Michael Stack
101e6f08ba
Fix flag passed building hbase
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302004 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 20:49:47 +00:00
Jonathan Hsieh
37da60f92f
HBASE-5588 Deprecate/remove AssignmentManager#clearRegionFromTransition
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301885 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 07:34:22 +00:00
larsh
fda76c71cb
Revert HBASE-5569
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301872 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 06:59:31 +00:00
Jonathan Hsieh
f34edd6378
HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301779 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 21:50:05 +00:00
Zhihong Yu
1d24d71821
HBASE-5549 HBASE-5572 Master can fail if ZooKeeper session expires (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301775 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 21:30:47 +00:00
Michael Stack
8a4c928de0
HBASE-5592 Make it easier to get a table from shell
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301715 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 19:45:06 +00:00
Zhihong Yu
458a3ff092
HBASE-5206 Port HBASE-5155 to trunk (Ashutosh Jindal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301709 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 19:14:11 +00:00
Michael Stack
a388bae569
HBASE-5581 Creating a table with invalid syntax does not give an error message when it fails
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301688 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 18:46:53 +00:00
Zhihong Yu
8e84390b37
HBASE-5568 Multi concurrent flushcache() for one region could cause data loss (Chunhui)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301639 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 16:39:44 +00:00
Zhihong Yu
4a5a27eac2
HBASE-5579 A Delete Version could mask other values (Daniel Ferro)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301173 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 20:03:47 +00:00
Michael Stack
273804e658
HBASE-4608 HLog Compression
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301165 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 19:32:01 +00:00
larsh
5055d4cfff
HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301135 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 18:46:31 +00:00
Zhihong Yu
d73aee4f66
HBASE-5206 revert because of test failues in trunk build.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300725 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 21:25:51 +00:00
Zhihong Yu
2ec60a022e
HBASE-5206 port HBASE-5155 to TRUNK (Ashutosh Jindal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300711 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 20:29:54 +00:00
Michael Stack
eebdfb5d65
HBASE-5574 DEFAULT_MAX_FILE_SIZE defaults to a negative value
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300288 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 19:04:41 +00:00
Michael Stack
05423b150b
HBASE-5179 Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300194 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 15:35:54 +00:00
Michael Stack
e4fefa0073
HBASE-5399 Cut the link between the client and the zookeeper ensemble
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299872 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 21:20:33 +00:00
mbautin
be78e3c4ee
[jira] [HBASE-5292] Prevent counting getSize on compactions
...
Author: Zhiqiu Kong
Summary:
Added two separate metrics for both get() and next(). This is done by
refactoring on internal next() API. To be more specific, only Get.get()
and ResultScanner.next() passes the metric name ("getsize" and
"nextsize" repectively) to
HRegion::RegionScanner::next(List<KeyValue>, String)
This will eventually hit StoreScanner()::next((List<KeyValue>,
int, String) where the metrics are counted.
And their call paths are:
1) Get
HTable::get(final Get get)
=> HRegionServer::get(byte [] regionName, Get get)
=> HRegion::get(final Get get, final Integer lockid)
=> HRegion::get(final Get get) [pass METRIC_GETSIZE to the
callee]
=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)
2) Next
HTable::ClientScanner::next()
=> ScannerCallable::call()
=> HRegionServer::next(long scannerId)
=> HRegionServer::next(final long scannerId, int nbRows) [pass
METRIC_NEXTSIZE to the callee]
=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)
Test Plan:
1. Passed unit tests.
2. Created a testcase TestRegionServerMetrics::testGetNextSize to
guarantee:
* Get/Next contributes to getsize/nextsize metrics
* Both getsize/nextsize are per Column Family
* Flush/compaction won't affect these two metrics
Reviewed By: mbautin
Reviewers: Kannan, mbautin, Liyin, JIRA
CC: Kannan, mbautin, Liyin, zhiqiu
Differential Revision: https://reviews.facebook.net/D1617
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299147 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 02:27:05 +00:00
Michael Stack
e4c43d72bf
HBASE-5535 Make the functions in task monitor synchronized
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299088 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 22:47:54 +00:00
Michael Stack
7d34da889e
HBASE-5538 A metric to measure the size of the response queue in the hbase rpc server
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299084 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 22:40:12 +00:00
Michael Stack
293114eb51
HBASE-5555 add a pointer to a dns verification utility in hbase book/dns
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299073 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 22:08:31 +00:00
mbautin
fc08d20ebd
[jira] [HBASE-4542] Add filter info to slow query logging
...
Author: Zhiqiu Kong
Summary:
The original 89-fb diff is: https://reviews.facebook.net/D1263
Slow opertaion log does not provide enough information when a filter is
present. The followings are done to add the filter info:
1) Added toString() method for filters inheriting FilterBase, this
affect 22 filters and their subclasses. The info added includes the
filter's name and its members. For example, for TimestampsFilter, we'll
output its class name as well as the defined timestamps.
2) Added a field 'filter' in Get::toMap() and Scan::toMap() to enable
the logging of filter info.
Task ID: #750975
Blame Rev:
Test Plan:
1. Run and passed unit-tests to make sure it does not break things
2. Run kannan's script to trigger the slow operation logging, checked
for each filter to make sure the filter info was logged. To be more
detailed, the output log are as following (only 'filter' filed is put
here for ease of reading):
"filter":"TimestampsFilter (3/3): [2, 3, 5]"
"filter":"TimestampsFilter (5/6): [2, 3, 5, 7, 11]"
"filter":"ColumnPrefixFilter col2"
"filter":"ColumnRangeFilter [col2a, col2b]"
"filter":"ColumnCountGetFilter 8"
"filter":"ColumnPaginationFilter (4, 4)"
"filter":"InclusiveStopFilter row"
"filter":"PrefixFilter row"
"filter":"PageFilter 1"
"filter":"SkipFilter TimestampsFilter (1/1): [1000]"
"filter":"WhileMatchFilter TimestampsFilter (3/3): [2, 3, 5]"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"MultipleColumnPrefixFilter (3/3): [a, b, c]"
"filter":"DependentColumnFilter (family, qualifier, true, LESS, value)"
"filter":"FamilyFilter (LESS, value)"
"filter":"QualifierFilter (LESS, value)"
"filter":"RowFilter (LESS, value)"
"filter":"ValueFilter (LESS, value)"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"SingleColumnValueFilter (family, qualifier, EQUAL, value)"
"filter":"SingleColumnValueExcludeFilter (family, qualifier, EQUAL,
value)"
"filter":"FilterList AND (2/2): [KeyOnlyFilter, FirstKeyOnlyFilter]"
Please check ~zhiqiu/Codes/scripts/testFilter.rb for the testing script.
3. Added unit test cases to TestOperation to verify the filters'
toString() method works well.
Reviewed By: mbautin
Reviewers: Kannan, madhuvaidya, mbautin, JIRA
CC: Kannan, madhuvaidya, mbautin, zhiqiu, stack
Differential Revision: https://reviews.facebook.net/D1539
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299019 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 20:14:26 +00:00
Michael Stack
cbdf0ca007
HBASE-5552 Clean up our jmx view; its a bit of a mess
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298923 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 16:54:13 +00:00
Zhihong Yu
35a36c2c66
HBASE-5213 "hbase master stop" does not bring down backup masters (Gregory)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298859 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 14:47:16 +00:00
larsh
5d9f98e09d
HBASE-5541 Avoid holding the rowlock during HLog sync in HRegion.mutateRowWithLocks
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298678 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 00:52:25 +00:00
larsh
7ce77fc5d3
HBASE-5526 ^Cnfigurable file and directory based umask (Jesse Yates)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298657 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 23:58:17 +00:00
mbautin
961455cd9d
[jira] [HBASE-5074] Support checksums in HBase block cache
...
Author: Dhruba
Summary:
HFile is enhanced to store a checksum for each block. HDFS checksum verification
is avoided while reading data into the block cache. On a checksum verification
failure, we retry the file system read request with hdfs checksums switched on
(thanks Todd).
I have a benchmark that shows that it reduces iops on the disk by about 40%. In
this experiment, the entire memory on the regionserver is allocated to the
regionserver's jvm and the OS buffer cache size is negligible. I also measured
negligible (<5%) additional cpu usage while using hbase-level checksums.
The salient points of this patch:
1. Each hfile's trailer used to have a 4 byte version number. I enhanced this so
that these 4 bytes can be interpreted as a (major version number, minor
version). Pre-existing hfiles have a minor version of 0. The new hfile format
has a minor version of 1 (thanks Mikhail). The hfile major version remains
unchanged at 2. The reason I did not introduce a new major version number is
because the code changes needed to store/read checksums do not differ much from
existing V2 writers/readers.
2. Introduced a HFileSystem object which is a encapsulates the FileSystem
objects needed to access data from hfiles and hlogs. HDFS FileSystem objects
already had the ability to switch off checksum verifications for reads.
3. The majority of the code changes are located in hbase.io.hfie package. The
retry of a read on an initial checksum failure occurs inside the hbase.io.hfile
package itself. The code changes to hbase.regionserver package are minor.
4. The format of a hfileblock is the header followed by the data followed by the
checksum(s). Each 16 K (configurable) size of data has a 4 byte checksum. The
hfileblock header has two additional fields: a 4 byte value to store the
bytesPerChecksum and a 4 byte value to store the size of the user data
(excluding the checksum data). This is well explained in the associated
javadocs.
5. I added a test to test backward compatibility. I will be writing more unit
tests that triggers checksum verification failures aggressively. I have left a
few redundant log messages in the code (just for easier debugging) and will
remove them in later stage of this patch. I will also be adding metrics on
number of checksum verification failures/success in a later version of this
diff.
6. By default, hbase-level checksums are switched on and hdfs level checksums
are switched off for hfile-reads. No changes to Hlog code path here.
Test Plan: The default setting is to switch on hbase checksums for hfile-reads,
thus all existing tests actually validate the new code pieces. I will be writing
more unit tests for triggering checksum verification failures.
Reviewers: mbautin
Reviewed By: mbautin
CC: JIRA, tedyu, mbautin, dhruba, todd, stack
Differential Revision: https://reviews.facebook.net/D1521
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298641 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 22:55:49 +00:00
Zhihong Yu
c4426b5b79
HBASE-5515 Add a processRow API that supports atomic multiple reads and writes on a row (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298533 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 19:40:27 +00:00
Zhihong Yu
990de61c9b
HBASE-5514 Compile against hadoop 0.24-SNAPSHOT (Mingjie)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298488 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 17:58:08 +00:00
Michael Stack
0f7285a81a
HBASE-4890 fix possible NPE in HConnectionManager
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298272 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 05:00:01 +00:00
Andrew Kyle Purtell
edc6696bc5
HBASE-5480. Fixups to MultithreadedTableMapper for Hadoop 0.23
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298259 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 02:28:39 +00:00
Michael Stack
e4f4022493
HBASE-5519 Incorrect warning in splitlogmanager
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297707 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 20:46:02 +00:00
larsh
723e8559e3
HBASE-5523 Fix Delete Timerange logic for KEEP_DELETED_CELLS
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 06:17:11 +00:00
Zhihong Yu
88115f3d8b
HBASE-5507 ThriftServerRunner.HbaseHandler.getRegionInfo() and getTableRegions() do not use ByteBuffer correctly (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297300 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:00:36 +00:00
Zhihong Yu
44e348ea1b
HBASE-5010 Pass region info in LoadBalancer.randomAssignment(List<ServerName> servers) (Anoop Sam John)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297155 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:41:03 +00:00
Michael Stack
0132176084
HBASE-5286 bin/hbase's logic of adding Hadoop jar files to the classpath is fragile when presented with split packaged Hadoop 0.23 installation
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296663 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 16:46:57 +00:00
Michael Stack
4343a0a00d
HBASE-5486 Warn message in HTable: Stringify the byte[]
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296478 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 21:16:03 +00:00
Zhihong Yu
a2392c913e
HBASE-5506 Add unit test for ThriftServerRunner.HbaseHandler.getRegionInfo() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296365 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 18:30:27 +00:00
Michael Stack
2c37d21a52
HBASE-5511 More doc on maven release process
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296316 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 17:26:34 +00:00
larsh
9ffc748589
HBASE-5489 Addendum
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296011 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 00:26:25 +00:00
Doug Meil
0c4e1dfa75
hbase-5503. performance.xml, troubleshooting.xml - adding Troubleshooting case study
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295915 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 21:40:34 +00:00
Michael Stack
7147bc5424
HBASE-5489 Add HTable accessor to get regions for a key range
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295729 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 18:43:29 +00:00
Michael Stack
dace419238
HBASE-4403 Adopt interface stability/audience classifications from Hadoop AND HBASE-5502 region_mover.rb fails to load regions back to original server for regions only containing empty tables
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295710 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 17:53:03 +00:00
Michael Stack
2b5b8bb4f8
HBASE-4403 Adopt interface stability/audience classifications from Hadoop
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295668 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 16:48:44 +00:00
Michael Stack
324a2cfeb4
HBASE-5454 Refuse operations from Admin before master is initialized
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295433 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 06:59:51 +00:00
Michael Stack
8eab15acf5
HBASE-5491 Remove HBaseConfiguration.create() call from coprocessor.Exec class
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295429 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 06:49:59 +00:00
larsh
6e612849dc
HBASE-5497 Add protobuf as M/R dependency jar (mapred)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295329 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:42:37 +00:00
Doug Meil
4f3da55d25
hbase-5496. ops_mgt.xml - fleshing out HBase Monitoring section.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295321 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:21:20 +00:00
Doug Meil
1ac8c6c0b8
hbase-5495 book.xml - adding an FAQ entry to General section
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295296 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 21:39:10 +00:00
Doug Meil
45e46edb34
hbase-5493. external_apis.xml. adding link to thrift javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295285 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 21:24:48 +00:00
Zhihong Yu
ba56d88d60
HBASE-5441 HRegionThriftServer may not start because of a race-condition (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295192 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 17:58:35 +00:00
Michael Stack
09eaaba6b4
HBASE-5485 LogCleaner refers to non-existant SnapshotLogCleaner
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294799 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 19:39:33 +00:00
Michael Stack
09a8719814
HBASE-5484 Spelling mistake in error message in HMasterCommandLine
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294790 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 19:01:46 +00:00
Michael Stack
91dfa48fd4
HBASE-5477 Cannot build RPM for hbase-0.92.0
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294316 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 20:40:39 +00:00
Michael Stack
4ef6cb8bc9
HBASE-5483 Allow configurable host to bind to for starting REST server from commandline
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294229 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 17:01:04 +00:00
Michael Stack
c176d41582
HBASE-5481 Uncaught UnknownHostException prevents HBase from starting
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294217 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:26 +00:00
Michael Stack
5b61755b0f
HBASE-5473 Metrics does not push pread time
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293532 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 04:22:55 +00:00
Michael Stack
e540751766
HBASE-5350 Fix jamon generated package names
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:59:37 +00:00
Michael Stack
3544e1c5f7
HBASE-5351 hbase completebulkload to a new table fails in a race
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293479 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:40:27 +00:00
larsh
d229b63a28
HBASE-5455 Add test to avoid unintentional reordering of items in HbaseObjectWritable (Michael Drzal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293455 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:29:40 +00:00
Michael Stack
d7050d3541
HBASE-5325 Expose basic information about the master-status through jmx beans
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293416 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:06:12 +00:00
larsh
a54ec1b7cc
HBASE-5440 Allow Import to optionally use HFileOutputFormat
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293101 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:47:29 +00:00
Michael Stack
e531e2595c
HBASE-4365 Add a decent heuristic for region size
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293099 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:41:37 +00:00
Michael Stack
ce71b8a1bc
HBASE-5166 MultiThreaded Table Mapper analogous to MultiThreaded Mapper in hadoop
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293098 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:38:18 +00:00
mbautin
a01166ec92
[jira] [HBASE-5442] Use builder pattern in StoreFile and HFile
...
Summary: Cleaning up the factory method explosion in HFile writer and StoreFile.
Now, adding a new parameter to HFile/StoreFile writer initialization will not
require modifying factory method invocations all over the codebase.
Test Plan:
Run unit tests
Deploy to dev cluster and run a load test
Reviewers: JIRA, stack, tedyu, Kannan, Karthik, Liyin
Reviewed By: stack
Differential Revision: https://reviews.facebook.net/D1893
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293095 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:06:53 +00:00
Michael Stack
bbf0a0074e
HBASE-5464 Log warning message when thrift calls throw exceptions
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293093 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 05:48:13 +00:00
mbautin
85c90d9274
[jira] [HBASE-5470] Make DataBlockEncodingTool work correctly with no native
...
compression codecs loaded
Summary:
DataBlockEncodingTool was fixed as part of porting data block encoding
(HBASE-4218) to 89-fb
(https://reviews.facebook.net/rHBASEEIGHTNINEFBBRANCH1245291 ,
https://reviews.facebook.net/D1659 ). The bug being fixed here appeared when
using GZ as baseline compression codec but not loading native Hadoop libraries,
in which case the compressor instance would be null.
Test Plan:
Run DataBlockEncoding tool with GZ (no native codecs) and LZO (with native
codecs) as baseline (Hadoop-level) compression codecs
Reviewers: JIRA, Kannan, mcorgan, lhofhansl, todd, stack, tedyu
Reviewed By: tedyu
Differential Revision: https://reviews.facebook.net/D1917
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293057 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:03:37 +00:00
Zhihong Yu
398289ce6e
HBASE-5317 Fix TestHFileOutputFormat to work against hadoop 0.23 (Gregory Chanan)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293049 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 01:07:03 +00:00
Zhihong Yu
49904bcf1d
HBASE-5466 Opening a table also opens the metatable and never closes it
...
(Ashley Taylor)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293047 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:55:58 +00:00
Jean-Daniel Cryans
a4a4e97338
HBASE-5415 FSTableDescriptors should handle random folders in
...
hbase.root.dir better
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293042 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:41:31 +00:00
mbautin
b77dca0c7f
[jira] [HBASE-5357] Refactoring: use the builder pattern for HColumnDescriptor
...
Summary: Deprecate three ugly HColumnDescriptor constructors and use a "builder"
pattern instead, e.g. new
HColumnDescriptor(cfName).setMaxVersions(5).setBlockSize(8192), etc. Setters
have now become "builder" methods.
Test Plan: Run unit tests
Reviewers: JIRA, todd, stack, tedyu, Kannan, Karthik, Liyin
Reviewed By: tedyu
Differential Revision: https://reviews.facebook.net/D1851
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293026 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 23:18:27 +00:00
Zhihong Yu
b0d4403059
HBASE-5437 HRegionThriftServer does not start because of a bug in HbaseHandlerMetricsProxy (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293013 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:58:42 +00:00
Doug Meil
2b41fc22b4
hbase-5468 book.xml - updating copyright to 2012
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292998 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:31:57 +00:00
Doug Meil
16014f0448
hbase-5467 - change homepage to refer to 'reference guide'
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292958 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 21:12:07 +00:00
Doug Meil
bea5f9e592
hbase-5465 book.xml, preface.xml - changing "book" to "reference guide"
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292921 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 19:43:37 +00:00
larsh
375d81ab29
HBASE-5460 Add protobuf as M/R dependency jar
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292656 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:44:56 +00:00
Michael Stack
30f21c3ef4
HBASE-5423 Regionserver may block forever on waitOnAllRegionsToClose when aborting
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292647 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:05:30 +00:00
Michael Stack
240d6bc52b
HBASE-5424 HTable meet NPE when call getRegionInfo() -- REVERT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292646 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:01:29 +00:00
Michael Stack
6a80cf5bf9
HBASE-5424 HTable meet NPE when call getRegionInfo()
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 04:43:29 +00:00
Nicolas Spiegelberg
c3575d2eb5
[jira] [HBASE-5332] Deterministic Compaction Jitter
...
Summary:
Changing the jitter in major compactions to be deterministic,
so reboots don't cause a time-based compaction storm. This
implementation seeds a random number generator with HDFS data for
persistence.
Test Plan: - mvn test -Dtest=TestCompaction,TestCompactSelection,TestHeapSize
Reviewers: JIRA, Kannan, aaiyer, stack
Reviewed By: Kannan
Differential Revision: https://reviews.facebook.net/D1785
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292495 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 20:36:39 +00:00
Michael Stack
7b5ec59eda
HBASE-5422 StartupBulkAssigner would cause a lot of timeout on RIT when assigning large numbers of regions (timeout = 3 mins)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292409 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:29:26 +00:00
larsh
0f708f7370
HBASE-5439 Fix some performance findbugs issues (Gregory Chanan)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292141 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 07:00:44 +00:00
Michael Stack
953d89e3a9
HBASE-5189 Add metrics to keep track of region-splits in RS
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292139 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 06:51:02 +00:00
Michael Stack
6da328e0fb
HBASE-5436 Right-size the map when reading attributes.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1291463 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 21:46:04 +00:00
larsh
ad14643d55
HBASE-5431 Improve delete marker handling in Import M/R jobs
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290955 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 05:51:56 +00:00
Michael Stack
145d25dfc2
HBASE-5209 HConnection/HMasterInterface should allow for way to get hostname of currently active master in multi-master HBase setup
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290942 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 04:10:46 +00:00
Michael Stack
d69299dfdc
HBASE-5003 If the master is started with a wrong root dir, it gets stuck and can't be killed
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290882 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 21:32:42 +00:00
Michael Stack
588206f411
HBASE-5200 AM.ProcessRegionInTransition() and AM.handleRegion() race thus leaving the region assignment inconsistent
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290854 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 20:13:54 +00:00
larsh
0e54a5f331
HBASE-3584 Addendum, remove RowMutation
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245876 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 07:25:41 +00:00
Michael Stack
9a7f01e293
HBASE-5294 Make sure javadoc is included in tarball bundle when we release
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245827 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:07:13 +00:00
Michael Stack
f1815cf544
HBASE-5420 TestImportTsv does not shut down MR Cluster correctly (fails against 0.23 hadoop)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245795 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 23:02:37 +00:00
Michael Stack
0d17817fde
HBASE-3584 Rename RowMutation to RowMutations
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245792 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 22:58:01 +00:00
Michael Stack
9684065bec
HBASE-5428 Allow for custom filters to be registered within the Thrift interface
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245774 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:39:30 +00:00
Michael Stack
0dd3c22706
HBASE-5195 [Coprocessors] preGet hook does not allow overriding or wrapping filter on incoming Get -- SECOND HALF OF THIS COMMIT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245773 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:34:46 +00:00
Michael Stack
0caad4616e
HBASE-5279 NPE in Master after upgrading to 0.92.0 -- REVERT OVERCOMMIT TO HREGION
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245768 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:26:23 +00:00
Michael Stack
5994c50143
HBASE-5279 NPE in Master after upgrading to 0.92.0
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245767 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:24:21 +00:00
Michael Stack
aa7a5b2926
HBASE-5120 Timeout monitor races with table disable handler
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245731 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 20:03:57 +00:00
Jean-Daniel Cryans
6fa8f6a042
HBASE-4640 Catch ClosedChannelException and document it
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245730 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:56:54 +00:00
Jean-Daniel Cryans
5b542b7921
HBASE-5393 Consider splitting after flushing
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245727 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:45:45 +00:00
Michael Stack
f45b59aa4d
HBASE-5425 Punt on the timeout doesn't work in BulkEnabler#waitUntilDone (master's EnableTableHandler)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245674 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 17:28:46 +00:00
Michael Stack
0a9ab79730
HBASE-5346 Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245280 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 01:07:01 +00:00
Doug Meil
b45071a8d0
hbase-5397. performance.xml, configuration.xml - correction to ZK config.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245199 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 21:56:57 +00:00
Zhihong Yu
628e5cd9f2
HBASE-5411 Add more metrics for ThriftMetrics (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244977 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 13:56:40 +00:00
Zhihong Yu
fe2a3d022b
HBASE-5400 Some tests does not have annotations for (Small|Medium|Large)Tests (Enis)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244726 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 21:06:15 +00:00
Doug Meil
49ea0d8484
hbase-5409 book.xml - adding section on sort-order in Data Model chapter
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244706 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 20:47:30 +00:00
Doug Meil
b4b62e6d97
hbase-5408. book.xml, moved "column metadata" section to top-level in Data Model chapter.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244681 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:59:28 +00:00
Doug Meil
db6992f96c
hbase-5406 book.xml - adding section to Data Model chapter about column metadata.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244676 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:46:06 +00:00
Doug Meil
87d4ad6980
hbase-5405. index.xml - correcting bigtable link description
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244659 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:20:21 +00:00
Doug Meil
421c120f4a
hbase-5404. book.xml, performance.xml - more info on compression and schema design
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244649 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:08:05 +00:00
Michael Stack
71682997f3
HBASE-5394 Add ability to include Protobufs in HbaseObjectWritable
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244641 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:45:06 +00:00
Michael Stack
caf2c0c67a
HBASE-5398 HBase shell disable_all/enable_all/drop_all promp wrong tables for confirmation
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244169 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:02:13 +00:00
Zhihong Yu
ac0fb8d5ae
HBASE-5388 Tune HConnectionManager#getCachedLocation method (Ronghai Ma)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243994 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 15:28:59 +00:00
Jean-Daniel Cryans
37735435ec
HBASE-5395 CopyTable needs to use GenericOptionsParser
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243759 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 01:13:33 +00:00
Jean-Daniel Cryans
ce3bae0334
HBASE-5197 [replication] Handle socket timeouts in ReplicationSource
...
to prevent DDOS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243733 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 23:12:55 +00:00
mbautin
b50714c043
[jira] [HBASE-5387] Reuse compression streams in HFileBlock.Writer
...
Summary: We need to to reuse compression streams in HFileBlock.Writer instead of
allocating them every time. The motivation is that when using Java's built-in
implementation of Gzip, we allocate a new GZIPOutputStream object and an
associated native data structure any time. This is one suspected cause of recent
TestHFileBlock failures on Hadoop QA:
https://builds.apache.org/job/HBase-TRUNK/2658/testReport/org.apache.hadoop.hbase.io.hfile/TestHFileBlock/testPreviousOffset_1_/ .
Test Plan:
* Run unit tests
* Create a GZIP-compressed CF with new code, load some data, shut down HBase,
deploy old code, restart HBase, and scan the table
Reviewers: tedyu, Liyin, dhruba, JIRA, lhofhansl
Reviewed By: lhofhansl
CC: tedyu, lhofhansl, mbautin
Differential Revision: https://reviews.facebook.net/D1719
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243667 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 19:41:58 +00:00
Zhihong Yu
f2bb12c6bb
HBASE-5327 Print a message when an invalid hbase.rootdir is passed (Jimmy Xiang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243650 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 18:47:04 +00:00
Doug Meil
2c2310c0db
hbase-5392. adding 2 releases to 'news'
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243561 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 15:31:35 +00:00
Doug Meil
d6c736e628
hbase-5391. index.html - adding 'year' to news items
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243552 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 15:05:50 +00:00
Doug Meil
8e35106b38
hbase-5390. book.xml - adding section in Arch/Master about what happens if master dies.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243550 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 15:00:51 +00:00
Doug Meil
0553fbc25b
hbase-5389. book.xml - minor correction of compaction selection example #1
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243532 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 14:24:58 +00:00
Zhihong Yu
0e0394bc35
HBASE-5199 Differential revision 1311 Delete out of TTL store files before compaction selection (Liyin)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243086 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 16:29:36 +00:00
larsh
23b135965f
HBASE-5368 Move PrefixSplitKeyPolicy out of the src/test into src, so it is accessible in HBase installs
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242981 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:32:52 +00:00
Jonathan Hsieh
8bb23aef17
HBASE-5364 Fix source files missing license in 0.92 and trunk (Elliott Clark)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242906 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 20:07:36 +00:00
mbautin
af0612f886
[jira] [HBASE-5382] Test that we always cache index and bloom blocks
...
Summary: This is a unit test that should have been part of HBASE-4683 but was
not committed. The original test was reviewed as part of
https://reviews.facebook.net/D807 . Submitting unit test as a separate JIRA and
patch, and extending the scope of the test to also handle the case when block
cache is enabled for the column family.
Test Plan: Run unit tests
Reviewers: JIRA, jdcryans, lhofhansl, Liyin
Reviewed By: jdcryans
CC: jdcryans
Differential Revision: https://reviews.facebook.net/D1695
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242894 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:27:29 +00:00
Doug Meil
9d7d022ec6
hbase-5380. book.xml, comment about KeyValue instances not being split across blocks
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242878 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:27:42 +00:00
Doug Meil
ac8ccdf477
hbase-5378 book.xml - adding new section for coprocessors in Arch/RegionServer
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242870 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 17:48:16 +00:00
Zhihong Yu
c6519ca4c7
HBASE-5358 HBaseObjectWritable should be able to serialize/deserialize generic arrays
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242649 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 03:37:32 +00:00
Doug Meil
4aebaffe43
hbase-5367 book.xml - this time, really fixing the default compaction.min.size
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242494 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:56:40 +00:00
Doug Meil
25e0f67da7
hbase-5367. book.xml - minor formatting in Arch/Region/Store compaction description
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:45:06 +00:00
Jonathan Hsieh
e0fc9e1382
HBASE-5288 Security source code dirs missing from 0.92.0 release tarballs
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242457 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:56:26 +00:00
Doug Meil
34b24a2ab7
hbase-5330. Update to TestCompactSelection unit test for selection SF assertions.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:13:29 +00:00
Doug Meil
f49e4780dc
hbase-5365. book - Arch/Region/Store adding description of compaction file selection
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242427 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:09:45 +00:00
larsh
ff1f0decc4
HBASE-5229 Provide basic building blocks for 'multi-row' local transactions.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242037 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 18:30:37 +00:00
Zhihong Yu
7ef8f6e307
HBASE-5298 Add thrift metrics to thrift2
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241974 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 17:03:11 +00:00
Zhihong Yu
10f108630f
HBASE-5345 CheckAndPut doesn't work when value is empty byte[] (Evert Arckens)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241972 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 16:55:16 +00:00
Michael Stack
38d28bccc6
HBASE-5348 Constraint configuration loaded with bloat
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241704 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:49:37 +00:00
Zhihong Yu
802d7c8674
HBASE-3850 Log more details when a scanner lease expires (Darren Haas)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241667 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:23:45 +00:00
Zhihong Yu
b4f585e6a3
HBASE-5267 Add a configuration to disable the slab cache by default (Li Pi)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241644 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 21:41:45 +00:00
Michael Stack
e8b6a99539
Added a sponsors page linked from front page
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 19:57:58 +00:00
Zhihong Yu
a2887a9bb7
HBASE-4658 Put attributes are not exposed via the ThriftServer (Dhruba)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1240294 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 19:02:13 +00:00
larsh
df4a9d4ad3
HBASE-5304 Pluggable split key policy
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239909 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 23:00:06 +00:00
Zhihong Yu
4b4904a77c
HBASE-5186 Add metrics to ThriftServer (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239737 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 17:30:13 +00:00
larsh
be722211fd
HBASE-5266 Add documentation for ColumnRangeFilter
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239399 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:27:43 +00:00
Zhihong Yu
8a6d0fbca1
HBASE-5212 Fix test TestTableMapReduce against 0.23 (Ted and Gregory)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:56:34 +00:00
Zhihong Yu
6bed2d07da
HBASE-5295 Improve the Thrift API to switch on/off writing to wal for Mutations (Dhruba)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239241 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:04:06 +00:00
Zhihong Yu
457d51bec5
HBASE-5310 HConnectionManager server cache key enhancement (Jimmy Xiang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239220 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:34:04 +00:00
Zhihong Yu
4b698e776d
HBASE-5283 Request counters may become negative for heavily loaded regions (Mubarak)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239157 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 14:56:20 +00:00
Zhihong Yu
e5a38bed76
HBASE-5256 Use WritableUtils.readVInt() in RegionLoad.readFields() (Mubarak)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238873 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:12:36 +00:00
Michael Stack
11446b1bd6
HBASE-5286 Added pointer to Lars Hofhansl's blog describing his attempt at adding a '...column prefix delete marker'
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238843 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 22:44:20 +00:00
Zhihong Yu
b246e68435
HBASE-5259 Normalize the RegionLocation in TableInputFormat by the reverse DNS lookup (Liyin Tang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238774 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 19:52:58 +00:00
Zhihong Yu
650b321396
HBASE-5290 [FindBugs] Synchronization on boxed primitive (Ben West)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238693 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 16:52:51 +00:00
Zhihong Yu
093c7203e8
HBASE-5297 Update metrics numOpenConnections and callQueueLen directly in HBaseServer (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238114 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 00:37:29 +00:00
Doug Meil
fa1fe609a5
ops_mgt.xml - updating metrics descriptions (block cache, fs latency)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1237994 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 20:46:05 +00:00
mbautin
e06a31d62b
[jira] [HBASE-5274] Filter out expired scanners on compaction as well
...
Summary: This is a followup for D1017 to make it similar to D909 (89-fb). The
fix for 89-fb used the TTL-based scanner filtering logic on both normal scanners
and compactions, while the trunk fix D1017 did not. This is just the delta
between the two diffs that brings filtering expired store files on compaction to
trunk.
Test Plan: Unit tests
Reviewers: Liyin, JIRA, lhofhansl, Kannan
Reviewed By: Liyin
CC: Liyin, tedyu, Kannan, mbautin, lhofhansl
Differential Revision: https://reviews.facebook.net/D1473
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236483 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 01:23:37 +00:00
Jonathan Hsieh
36788d1cc2
HBASE-5282 Possible file handle leak with truncated HLog file
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236445 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:30:47 +00:00
Zhihong Yu
da1443d90a
HBASE-5271 Result.getValue and Result.getColumnLatest return the wrong column (Ghais Issa)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:51:33 +00:00
mbautin
ec1c804fc1
[jira] [HBASE-4218] HFile data block encoding framework and delta encoding
...
implementation (Jacek Midgal, Mikhail Bautin)
Summary:
Adding a framework that allows to "encode" keys in an HFile data block. We
support two modes of encoding: (1) both on disk and in cache, and (2) in cache
only. This is distinct from compression that is already being done in HBase,
e.g. GZ or LZO. When data block encoding is enabled, we store blocks in cache
in an uncompressed but encoded form. This allows to fit more blocks in cache
and reduce the number of disk reads.
The most common example of data block encoding is delta encoding, where we take
advantage of the fact that HFile keys are sorted and share a lot of common
prefixes, and only store the delta between each pair of consecutive keys.
Initial encoding algorithms implemented are DIFF, FAST_DIFF, and PREFIX.
This is based on the delta encoding patch developed by Jacek Midgal during his
2011 summer internship at Facebook. The original patch is available here:
https://reviews.apache.org/r/2308/diff/ .
Test Plan: Unit tests. Distributed load test on a five-node cluster.
Reviewers: JIRA, tedyu, stack, nspiegelberg, Kannan
Reviewed By: Kannan
CC: tedyu, todd, mbautin, stack, Kannan, mcorgan, gqchen
Differential Revision: https://reviews.facebook.net/D447
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236031 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 02:58:57 +00:00
mbautin
07dbe903de
HBASE-5230 : ensure that compactions do not cache-on-write data blocks
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235882 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 19:41:07 +00:00
Michael Stack
6bcf607630
More home page edits and ref to favicon.ico
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235539 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 22:54:05 +00:00
Zhihong Yu
f20083b193
HBASE-4720 revert until agreement is reached on solution
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235388 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:17:23 +00:00
Zhihong Yu
f4872ddd1f
HBASE-4720 Implement atomic update operations (checkAndPut, checkAndDelete) for REST client/server (Mubarak)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235362 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:19:59 +00:00
Michael Stack
5095b451e4
HBASE-5264 Add 0.92.0 upgrade guide
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235062 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 23:27:05 +00:00
Michael Stack
a56613fd71
Add Riley's slow query doc from hbase-4117
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235023 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:06:03 +00:00
Zhihong Yu
59b1b68d12
HBASE-5255 Use singletons for OperationStatus to save memory (Benoit)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235016 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:56:45 +00:00
Doug Meil
de42b015a4
hbase-5260. troubleshooting.xml - fixed incorrect XML tag
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 19:04:10 +00:00
Zhihong Yu
35a60f187d
HBASE-5139 Addendum handles startRow being null for the case where median is in the first region
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234903 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 17:07:45 +00:00
Michael Stack
e453c3c46d
Add hbasecon2012 to news on front page
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234681 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 05:00:28 +00:00
Doug Meil
5e0bc5edb5
hbase-5254 book.xml. Arch/Regions, added link to troubleshooting section on hbase objects on HDFS
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234679 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 03:12:52 +00:00
Doug Meil
927e1eec6d
hbase-5253 book.xml - adding chart of object heirarchy in Arch/Regions
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234677 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 03:03:39 +00:00
Doug Meil
8f90bbef96
hbase-5252. book.xml, added section in Data Model about joins
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234674 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 02:27:54 +00:00
Michael Stack
d8610080d2
Edit of the mailing list/search archive section
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234636 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 22:25:50 +00:00
Michael Stack
3724f4859b
Formatting fix
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234620 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 21:34:56 +00:00
ramkrishna
3331341429
HBASE-5243 LogSyncerThread not getting shutdown waiting for the interrupted flag (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234559 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:43:16 +00:00
ramkrishna
fbf165d347
HBASE-5235 HLogSplitter writer thread's streams not getting closed when any of the writer threads has exceptions.(Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234509 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 13:20:15 +00:00
Zhihong Yu
da0f65de98
HBASE-5246 Regenerate code with thrift 0.8.0 (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234445 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 01:52:49 +00:00
ramkrishna
fc8d2fe645
HBASE-5237 Addendum for HBASE-5160 and HBASE-4397 (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234377 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 17:47:08 +00:00
Andrew Kyle Purtell
7436e93ee9
HBASE-5228. [REST] Rip out transform feature
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 18:06:34 +00:00
Doug Meil
c06edb6808
performance.xml - added another paragraph in "One Hot Region" section.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233610 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:31:16 +00:00
Doug Meil
7e363179c3
hbase-5233. [book] configuration.xml - adding example of /etc/hosts for loopback ip config
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233602 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:15:55 +00:00
Zhihong Yu
8ebcadd679
HBASE-5223 TestMetaReaderEditor is missing call to CatalogTracker.stop()
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233101 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 22:43:55 +00:00
Zhihong Yu
1c8829e0ad
HBASE-5208 Allow setting Scan start/stop row individually in TableInputFormat
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233071 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 21:22:49 +00:00
Doug Meil
c5cea96fbd
hbase-5227. [book] book.xml, troubleshooting.xml - added caution about rowlocks.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 16:55:38 +00:00
Doug Meil
22bc7c8231
hbase-5226. troubleshooting.xml, client section: adding reference to client slowdown due to admin API calls.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232947 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 16:22:02 +00:00
Zhihong Yu
9b1e9d3c29
HBASE-5176 AssignmentManager#getRegion: logging nit adds a redundant '+' (Karthik K)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232567 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 20:40:26 +00:00
Doug Meil
ef4eb46d9f
hbase-5220 troubleshooting.xml - zkcli info
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232559 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 20:07:35 +00:00
larsh
01246cdc99
HBASE-5203 Group atomic put/delete operation into a single WALEdit to handle region server failures. (Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232551 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 19:38:13 +00:00
Doug Meil
25dc6b2530
hbase-5218 book.xml - Arch/HFile, added link to HFile v2 info in appendix from this section.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232547 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 19:29:53 +00:00
Doug Meil
51b31b05da
hbase-5216 book.xml - added detail on Arch "when to use hbase" section
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232524 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 18:29:00 +00:00
Zhihong Yu
c0d127fcb2
HBASE-5201 Add new files
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232506 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:49:34 +00:00
Zhihong Yu
916b3a166c
HBASE-5201 Utilize TThreadedSelectorServer and remove redundant code in ThriftServer and HRegionThriftServer (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232504 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:38:58 +00:00
Zhihong Yu
174248a26f
HBASE-5153 revert due to failed Jenkins builds
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232490 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:15:23 +00:00
Doug Meil
27bf216d9c
[book] book.xml, ops_mgt.xml additional clarification that compaction does not do region merging
...
also, added link to script in HBASE-1621 in Ops Mgt chapter.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232408 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 13:32:33 +00:00
Michael Stack
e04919de09
Update version on hadoop versions to include note on hadoop 1.0.0
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232308 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 05:15:44 +00:00
Zhihong Yu
5ce4d352de
HBASE-5153 Add retry logic in HConnectionImplementation#resetZooKeeperTrackers (Jieshan)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232292 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 04:06:30 +00:00
Michael Stack
e20aa2b3a6
HBASE-5204 Backward compatibility fixes for 0.92
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231985 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 13:08:54 +00:00
larsh
323d17d3ae
HBASE-3584 Allow atomic put/delete in one call (Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231441 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 04:59:44 +00:00
Zhihong Yu
a9c183ff98
HBASE-5150 Failure in a thread may not fail a test, clean up log splitting test (Jimmy Xiang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231364 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:44:03 +00:00
Michael Stack
0876497eb9
HBASE-5193 Use TBoundedThreadPoolServer in HRegionThriftServer
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:23:52 +00:00
Zhihong Yu
ee03d1626d
HBASE-5196 Failure in region split after PONR could cause region hole (Jimmy Xiang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231302 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:17:30 +00:00
Zhihong Yu
8d07130c67
HBASE-5143 Fix config typo in pluggable load balancer factory (Harsh J)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231281 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 20:07:40 +00:00
Michael Stack
240e30c4ab
Meetup at ebay
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231193 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 17:16:09 +00:00
Michael Stack
1962888156
HBASE-5115 Change HBase color from purple to 'International Orange (Engineering)'
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230854 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 01:21:52 +00:00
Doug Meil
31044826da
hbase-5188 - ops_mgt.xml added comments about configuring Scan caching for builtin utilities
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230760 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 20:28:11 +00:00
Doug Meil
67b8b3356d
hbase-5187. [book] configuration.xml, troubleshooting.xml loopback IP config info
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230739 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 20:02:26 +00:00
Zhihong Yu
1df784d11a
HBASE-5177 Differential Revision: 1197 HTable needs a non cached version of getRegionLocation (Pritam Damania)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230725 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:46:32 +00:00
Doug Meil
dfe54a9c92
hbase-5185 book.xml - trivial rename of section heading "Client Filters" to "Client Request Filters"
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230649 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 17:19:53 +00:00
Zhihong Yu
f90f4971bd
HBASE-5033 Differential Revision: 933 Opening/Closing store in parallel to reduce region open/close time (Liyin)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 01:19:26 +00:00
Michael Stack
06ca87ae87
HBASE-5182 TBoundedThreadPoolServer threadKeepAliveTimeSec is not configured properly
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230306 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:52:57 +00:00
Doug Meil
d44d06f48e
hbase-5129 [BOOK] configuration.xml - changed the major compaction disable instruction from Long.MAX_VALUE to 0.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230277 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:06:01 +00:00
Doug Meil
ce09411591
hbase-5180 book.xml - the scanner example wasn't closing the ResultScanner. That's not good practice.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230271 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 21:54:23 +00:00
Zhihong Yu
5ad571ab6c
HBASE-5139 Compute (weighted) median using AggregateProtocol
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230200 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:24:48 +00:00
Zhihong Yu
39a1e07ce4
HBASE-3565 Add metrics to keep track of slow HLog appends (Mubarak)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230188 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:02:28 +00:00
Zhihong Yu
97579d4019
HBASE-5163 TestLogRolling#testLogRollOnDatanodeDeath fails sometimes on Jenkins or hadoop QA ("The directory is already locked.") (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230077 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 14:58:46 +00:00
larsh
15c62ed21a
HBASE-5121 MajorCompaction may affect scan's correctness (chunhui shen and Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229806 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:39:57 +00:00
Michael Stack
9cbf9e9f4e
HBASE-5172 HTableInterface should extend java.io.Closeable
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 19:21:40 +00:00
Michael Stack
94342eea88
HBASE-5134 Remove getRegionServerWithoutRetries and getRegionServerWithRetries from HConnection Interface
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229683 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 18:52:43 +00:00
ramkrishna
e06aaf4ecc
HBASE-5137 MasterFileSystem.splitLog() should abort even if waitOnSafeMode() throws IOException(Ram & Ted)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229649 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 17:33:49 +00:00
Zhihong Yu
296cf139aa
HBASE-5152 Region is on service before completing initialization when doing rollback of split,
...
it will affect read correctness (Chunhui)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229418 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 23:22:37 +00:00
Michael Stack
5b4f692019
add link to cloudera post that describes how hadoop versions relate
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229270 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 17:31:59 +00:00
Todd Lipcon
8c2a573d48
HBASE-3949. Add "Master" link to RegionServer pages. Contributed by Gregory Chanan.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229035 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 05:43:40 +00:00
larsh
dd604d3136
HBASE-5088 addendum
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228761 13f79535-47bb-0310-9956-ffa450edef68
2012-01-08 01:18:53 +00:00
Michael Stack
d821f6fcfc
HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REDO
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228749 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:47:56 +00:00
Michael Stack
45b7b8955b
HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REVERT. OVER-COMMITTED. REVERTING ALL SO CAN REDO COMMIT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228747 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:46:31 +00:00
Michael Stack
25d465426a
HBASE-5052 The path where a dynamically loaded coprocessor jar is copied on the local file system depends on the region name (and implicitly, the start key)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228742 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:20:45 +00:00
Michael Stack
492feb2a53
HBASE-5141 Memory leak in MonitoredRPCHandlerImpl
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228740 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 22:16:11 +00:00
larsh
7624bcba26
HBASE-5088 A concurrency issue on SoftValueSortedMap (Jieshan Bean and Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228539 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 01:40:07 +00:00
Zhihong Yu
28bbeb76c2
HBASE-5041 Major compaction on non existing table does not throw error (Shrijeet)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228507 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 00:10:41 +00:00
Zhihong Yu
30a0a2c6d6
HBASE-4357 Region stayed in transition - in closing state (Ming Ma)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228489 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 22:55:36 +00:00
Zhihong Yu
ff3cf1aeda
HBASE-5081 Distributed log splitting deleteNode races against splitLog retry (Prakash)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227951 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 03:53:58 +00:00
Zhihong Yu
c3d7b8ec19
HBASE-3373 Allow regions to be load-balanced by table
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227873 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 22:22:19 +00:00
Jean-Daniel Cryans
d619a545e0
HBASE-5127 [ref manual] Better block cache documentation
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227425 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:35:37 +00:00
larsh
771022eed9
HBASE-5118 Fix Scan documentation (Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227419 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:17:28 +00:00
larsh
49f35a7756
HBASE-2947 MultiIncrement/MultiAppend (JGray and Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227382 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 23:16:54 +00:00
Zhihong Yu
b549283c78
HBASE-5114 TestMetaReaderEditor can timeout during test execution
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226269 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 17:46:53 +00:00
Zhihong Yu
c0c6500436
HBASE-4822 disabling testAggregation for now
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226262 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 16:51:07 +00:00
Zhihong Yu
41e3540ab2
HBASE-5064 utilize surefire tests parallelization, second attempt
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226255 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 15:22:43 +00:00
ramkrishna
ebc3945450
HBASE-5094 The META can hold an entry for a region with a different server name from the one actually in the AssignmentManager thus making the region inaccessible. (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226165 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 18:37:08 +00:00
Zhihong Yu
453de3a66c
HBASE-4397 -ROOT-, .META. tables stay offline for too long in recovery phase after all RSs
...
are shutdown at the same time (Ming Ma)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226110 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 15:43:19 +00:00
Zhihong Yu
ceafb4aab8
HBASE-5105 TestImportTsv failed with hadoop 0.22 (Ming Ma)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226103 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 15:36:14 +00:00
Zhihong Yu
50d332606d
HBASE-5064 revert - need to figure out which test caused surefire to report timeout
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226101 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 15:25:58 +00:00
Zhihong Yu
497b4e781d
HBASE-5113 TestDrainingServer expects round robin region assignment but misses a
...
config parameter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226087 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 13:41:55 +00:00
Zhihong Yu
d499eedb3c
HBASE-5064 utilize surefire tests parallelization (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226083 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 13:35:28 +00:00
Zhihong Yu
10e6defda5
HBASE-5112 TestReplication#queueFailover flaky due to potentially
...
uninitialized Scan (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226039 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 05:03:49 +00:00
Zhihong Yu
ddd384369f
HBASE-5100 Rollback of split could cause closed region to be opened again (Chunhui)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226029 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 02:45:18 +00:00
Zhihong Yu
a2471aa255
HBASE-5099 ZK event thread waiting for root region assignment may block server
...
shutdown handler for the region sever the root region was on (Jimmy)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225765 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 06:39:07 +00:00
Zhihong Yu
315c91901f
HBASE-5103 Fix improper master znode deserialization (Jonathan Hsieh)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225622 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 19:08:38 +00:00
Zhihong Yu
270122168b
HBASE-5009 Failure of creating split dir if it already exists prevents splits from happening further
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225153 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 10:07:31 +00:00
larsh
2dcc010d36
HBASE-5096 Replication does not handle deletes correctly. (Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224851 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 01:44:14 +00:00
Zhihong Yu
c8ddab6962
HBASE-5010 Filter HFiles based on TTL - add TestScannerSelectionUsingTTL
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224793 13f79535-47bb-0310-9956-ffa450edef68
2011-12-26 19:35:10 +00:00
Zhihong Yu
2fe6ab663c
HBASE-5010 Filter HFiles based on TTL (Mikhail)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224792 13f79535-47bb-0310-9956-ffa450edef68
2011-12-26 19:33:51 +00:00
Zhihong Yu
300f900354
HBASE-4218 Data Block Encoding of KeyValues - revert, problems were uncovered during cluster testing
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223042 13f79535-47bb-0310-9956-ffa450edef68
2011-12-25 02:49:46 +00:00
Zhihong Yu
499d11b741
HBASE-5070 Constraints implementation and javadoc changes (Jesse Yates)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223024 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:42:31 +00:00
Zhihong Yu
73e8383359
HBASE-4218 Data Block Encoding of KeyValues (aka delta encoding / prefix compression) - files used for testing
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223021 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:24:38 +00:00
Zhihong Yu
cd47ea0562
HBASE-4218 Data Block Encoding of KeyValues (aka delta encoding / prefix compression) (Jacek, Mikhail)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223020 13f79535-47bb-0310-9956-ffa450edef68
2011-12-24 21:20:39 +00:00
Zhihong Yu
0c9fad8f6b
HBASE-4938 Create a HRegion.getScanner public method that allows reading from a specified readPoint (Dhruba)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222890 13f79535-47bb-0310-9956-ffa450edef68
2011-12-23 23:57:55 +00:00
larsh
8b4c4f094e
HBASE-4439 Move ClientScanner out of HTable (Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222551 13f79535-47bb-0310-9956-ffa450edef68
2011-12-23 04:16:26 +00:00
Michael Stack
6313293e51
HBASE-5091 [replication] Update replication doc to reflect current znode structure
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222481 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 22:04:09 +00:00
Michael Stack
7569cea558
HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED -- AGAINpatch -p0 -R < x.txt patch -p0 -R < x.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222046 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 05:44:29 +00:00
Michael Stack
6c97552ee1
HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REAPPLY
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222045 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 05:42:05 +00:00
Michael Stack
fa979ebab2
HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221978 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 01:09:03 +00:00
Michael Stack
72c1f6c8c7
HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221977 13f79535-47bb-0310-9956-ffa450edef68
2011-12-22 01:04:00 +00:00
Michael Stack
30f5a95a6a
HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row; REMOVE OVER-COMMIT, STUFF NOT IN 4698 PATCH
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221621 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 06:01:26 +00:00
Michael Stack
df77a4b0b3
HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221620 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 06:00:05 +00:00
Michael Stack
c5b874fff0
HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS -- fix compile error
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221604 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:12:17 +00:00
Michael Stack
04dd71214a
HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221601 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:06:03 +00:00
Michael Stack
f000c951c6
HBASE-5078 DistributedLogSplitter failing to split file because it has edits for lots of regions
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221596 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:00:47 +00:00
Michael Stack
cd508de041
HBASE-5021 Enforce upper bound on timestamp
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221592 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 03:51:42 +00:00
Nicolas Spiegelberg
82e376b3ea
[jira] [HBase-5021] Enforce upper bound on timestamp
...
Summary:
We have been getting hit with performance problems on the ODS
side due to invalid timestamps being inserted by the timestamp. ODS is
working on adding proper checks to app server, but production
performance could be severely impacted with significant recovery time if
something slips past. Therefore, we should also allow the option to
check the upper bound in HBase.
This is the first draft. Probably should allow per-CF customization.
Test Plan: - mvn test -Dtest=TestHRegion#testPutWithTsTooNew
Reviewers: Kannan, Liyin, JIRA
CC: stack, nspiegelberg, tedyu, Kannan, mbautin
Differential Revision: 849
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221532 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 00:02:55 +00:00
Jean-Daniel Cryans
a952738257
Fixing the link for ZK session expiration
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221527 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 23:40:10 +00:00
Nicolas Spiegelberg
9a0eb6f0c2
[jira] [HBASE-5072] Support Max Value for Per-Store Metrics
...
Summary:
We were bit in our multi-tenant cluster because one of our Stores
encountered a bug and grew its StoreFile count. We didn't notice this because
the StoreFile count currently reported by the RegionServer is an average of all
Stores in the region. For the per-Store metrics, we should also record the max
so we can notice outliers.
Test Plan: - mvn test -Dtest=TestRegionServerMetrics
Reviewers: JIRA, mbautin, Kannan
Reviewed By: Kannan
CC: stack, nspiegelberg, mbautin, Kannan
Differential Revision: 945
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221419 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 18:42:11 +00:00
Michael Stack
8fe40ce0e9
HBASE-5063 RegionServers fail to report to backup HMaster after primary goes down
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221121 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 06:46:17 +00:00
Michael Stack
77e16e8027
HBASE-4935 hbase 0.92.0 doesn't work going against 0.20.205.0, its packaged hadoop
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221033 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 00:10:02 +00:00
Michael Stack
1222383f1d
HBASE-5029 TestDistributedLogSplitting fails on occasion; Added catch of NPE and reenabled ignored test
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220991 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 23:04:15 +00:00
larsh
2062ea1d00
HBASE-5058 Allow HBaseAmin to use an existing connection (Lars H)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220989 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 23:01:26 +00:00
Michael Stack
48ccb28e81
HBASE-5029 TestDistributedLogSplitting fails on occasion; disabling failing test -- redo -- forgot to import @Ignore
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220904 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 19:19:17 +00:00
Michael Stack
86a3830175
HBASE-5029 TestDistributedLogSplitting fails on occasion; disabling failing test
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220894 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 18:51:10 +00:00
Michael Stack
1f8021eca9
HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220864 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 17:24:33 +00:00
Zhihong Yu
4e09ea6be8
HBASE-5060 HBase client is blocked forever (Jinchao)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220863 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 17:24:21 +00:00
Michael Stack
a46959a370
HBASE-5062 Missing logons if security is enabled
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220829 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 16:26:22 +00:00
larsh
818adb795b
HBASE-4970 Add a parameter so that keepAliveTime of Htable thread pool can be changed (gaojinchao)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220626 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 06:57:08 +00:00
Michael Stack
d9c8e9954a
HBASE-4934 Display Master server and Regionserver start time on respective info servers
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220304 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 00:04:23 +00:00
Michael Stack
46eef1e255
HBASE-5049 TestHLogSplit.testLogRollAfterSplitStart not working due to HBASE-5006
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215371 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:48:34 +00:00
Michael Stack
3cad85bc77
HBASE-5029 TestDistributedLogSplitting fails on occasion
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215370 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:40:53 +00:00
Michael Stack
324eec9a44
HBASE-5055 Build against hadoop 0.22 broken
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215356 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:13:28 +00:00
Michael Stack
175ef436b6
HBASE-4935 hbase 0.92.0 doesn't work going against 0.20.205.0, its packaged hadoop -- revert from TRUNK though this change was added as part of HBASE-4908
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215353 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:09:02 +00:00
Zhihong Yu
0c5abfccd7
HBASE-5053 HCM Tests leak connections (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215314 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 22:05:02 +00:00
Zhihong Yu
3f016b62fd
HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call - revert
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215307 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 21:55:16 +00:00
Zhihong Yu
15d9af3d42
HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1215236 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 18:17:32 +00:00
Kannan Muthukkaruppan
3772951b9d
HBASE-5014 PutSortReducer should adhere to memory limits
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214968 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 22:09:44 +00:00
Jean-Daniel Cryans
7e095fa615
HBASE-4683 Always cache index and bloom blocks
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214902 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:26:35 +00:00
Michael Stack
e77df774eb
Add note on how to do all tests w/ security profile enabled
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214901 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:22:27 +00:00
Michael Stack
82a4dedeee
Add note on how to do single test w/ security profile enabled
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214900 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:20:48 +00:00
Zhihong Yu
063fa64fd5
HBASE-4605 Constraints, remove .orig files accidentally added in previous commit
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214892 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:52:04 +00:00
Zhihong Yu
5166afddc5
HBASE-4605 Constraints (Jesse Yates)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214889 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:44:59 +00:00
Michael Stack
52dbd69707
HBASE-5027 HConnection.create(final Connection conf) does not clone, it creates a new Configuration reading *.xmls and then does a merge.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214871 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 17:13:34 +00:00
Michael Stack
32490bddce
HBASE-5038 Some tests leak connections
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214839 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 16:20:41 +00:00
Doug Meil
5543c548c4
hbase-5039 book.xml arch chapter fixup for regions, adding FAQ entry for architecture
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214806 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 15:17:20 +00:00
Doug Meil
37cbd5a38e
hbase-5036 book.xml architecture chapter minor mods regarding region-RS assignment
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214614 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 03:56:03 +00:00
Zhihong Yu
6b60585fef
HBASE-5030 Some tests do not close the HFile.Reader they use, leaving some file descriptors open (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214519 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 22:52:45 +00:00
Zhihong Yu
e85d2d45d3
HBASE-5026 Add coprocessor hook to HRegionServer.ScannerListener.leaseExpired()
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214431 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:57:42 +00:00
Michael Stack
bade2361c9
HBASE-4993 Performance regression in minicluster creation
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214419 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:39:23 +00:00
Doug Meil
685284c604
hbase-5028 book.xml - adding info on region assignment and file locality
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214412 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:14:10 +00:00
Zhihong Yu
9ed28b472c
HBASE-5022 Optimize HBaseConfiguration#create (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1214366 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 17:30:44 +00:00
larsh
cd0c4cffa9
HBASE-5001 Improve the performance of block cache keys (Lars H and J-D)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213995 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 00:05:04 +00:00
Jean-Daniel Cryans
69b7530f60
HBASE-5017 Bump the default hfile.block.cache.size because of HFileV2
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1213950 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 21:55:36 +00:00