Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6,709 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

1886 Commits

Author SHA1 Message Date
Michael Stack 3e23493543 HBASE-5665 Repeated split causes HRegionServer failures and breaks table 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308545 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:48:22 +00:00
Michael Stack fe2f84dbb1 HBASE-5693 When creating a region, the master initializes it and creates a memstore within the master server 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308535 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:30:27 +00:00
Michael Stack 6135aa2d5a HBASE-5694 getRowsWithColumnsTs() in Thrift service handles timestamps incorrectly 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308445 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 17:59:48 +00:00
Zhihong Yu 80722e7290 HBASE-5663 HBASE-5636 MultithreadedTableMapper doesn't work (Takuya Ueshin) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308353 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 13:50:03 +00:00
larsh 86f8282bef HBASE-5084 Clow different HTable instances to share one ExecutorService 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307661 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 00:26:22 +00:00
Michael Stack a99bd2c9ec HBASE-5564 Bulkload is discarding duplicate records 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307629 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 21:44:08 +00:00
Michael Stack c7c1dbeb65 HBASE-5443 Create PB protocols for HRegionInterface 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307625 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 21:38:44 +00:00
Zhihong Yu 229cf740b8 HBASE-5667 RegexStringComparator supports java.util.regex.Pattern flags (David Arthur) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307580 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 19:33:27 +00:00
larsh f1a9b5bed1 HBASE-5542 Addendum - accidentally checked in .orig file 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307562 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 18:04:32 +00:00
Zhihong Yu 06e70aa877 HBASE-5573 Replace client ZooKeeper watchers by simple ZooKeeper reads (N Keywal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307549 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 17:45:57 +00:00
Michael Stack 8ecfa1087c HBASE-5673 The OOM problem of IPC client call cause all handle block; REVERT OF V2, A SECOND REVERT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307513 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 16:33:26 +00:00
Michael Stack 277e246110 HBASE-5673 The OOM problem of IPC client call cause all handle block; REAPPLY; V2 OF PATCH 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307277 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 05:33:19 +00:00
Michael Stack 81482cebb8 HBASE-5673 The OOM problem of IPC client call cause all handle block; REVERT -- APPLIED WRONG PATCH 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307270 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 05:30:47 +00:00
Michael Stack b291485220 HBASE-5673 The OOM problem of IPC client call cause all handle block 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307240 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 04:33:12 +00:00
Michael Stack 89ea8af04f HBASE-4398 If HRegionPartitioner is used in MapReduce, client side configurations are overwritten by hbase-site.xml 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307116 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:23:23 +00:00
Jonathan Hsieh fbfe3f29e5 HBASE-5638 Readability improvements on HBASE-5633: NPE reading ZK config in HBase (Matteo Bertozzi) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307085 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 20:04:49 +00:00
ramkrishna 26de676dea HBASE-5097 RegionObserver implementation whose preScannerOpen and postScannerOpen Impl return null can stall the system initialization through NPE (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307036 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 18:34:02 +00:00
larsh ea77247c82 HBASE-5670 Have Mutation implement the Row interface. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306959 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 16:21:41 +00:00
Michael Stack 67ded34626 AggregationClient fails validation for open stoprow scan 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306914 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:29:01 +00:00
Michael Stack ec4d59770a HBASE-5564 Bulkload is discarding duplicate records 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306907 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:23:46 +00:00
Michael Stack 8a864815de HBASE-5671 hbase.metrics.showTableName should be true by default 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306712 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 04:35:48 +00:00
Zhihong Yu ada9d8d361 HBASE-5544 Add metrics to HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306648 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 23:59:17 +00:00
larsh 16ad2b2898 HBASE-5639 The logic used in waiting for region servers during startup is broken (J-D and NKeyval) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306012 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 20:40:13 +00:00
larsh ef65dde6b3 HBASE-5641 decayingSampleTick1 prevents HBase from shutting down. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305722 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 03:34:51 +00:00
Jonathan Hsieh 3fd6997380 HBASE-5596 Few minor bugs from HBASE-5209 (David S. Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305661 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 23:06:02 +00:00
larsh 080206de01 HBASE-5623 Race condition when rolling the HLog and hlogFlush (Enis Soztutar and LarsH) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305556 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 20:42:46 +00:00
Michael Stack 8ea1c8ddd6 HBASE-5533 Add more metrics to HBase 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305499 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 19:21:42 +00:00
Zhihong Yu 3c234f13ba HBASE-5615 the master never does balance because of balancing the parent region (Xufeng) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305171 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-25 23:22:00 +00:00
larsh 82670f81b8 HBASE-4957 Clean up some log messages, code in RecoverableZooKeeper (Todd) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304940 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 22:02:41 +00:00
Michael Stack 9cfe7cfa3c HBASE-5633 NPE reading ZK config in HBase 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304924 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 21:15:40 +00:00
larsh accf8ee862 HBASE-5434 [REST] Include more metrics in cluster status request (Mubarak Seyed) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304919 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 21:04:45 +00:00
Zhihong Yu 53712ce495 HBASE-5128 Addendum adds two new files Jon forgot to add 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304702 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 03:58:22 +00:00
Jonathan Hsieh f2d637ffa5 HBASE-5128 [uber hbck] Online automated repair of table integrity and region consistency problems 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 23:53:55 +00:00
Jean-Daniel Cryans 560173f756 HBASE-5190 Limit the IPC queue size based on calls' payload size 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304634 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 22:32:31 +00:00
mbautin 86962028dd [jira] [HBASE-5469] Add baseline compression efficiency to DataBlockEncodingTool 
Summary:
DataBlockEncodingTool currently does not provide baseline compression
efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if
we are using LZO to compress blocks, we would like to have the following
columns in the report (possibly as percentages of raw data size).

Baseline K+V in blockcache | Baseline K + V on disk (LZO compressed) | K + V
DataBlockEncoded in block cache | K + V DataBlockEncoded + LZOCompressed (on
disk)

Background: we never store compressed blocks in cache, but we always store
encoded data blocks in cache if data block encoding is enabled for the column
family.

This patch also has multiple bugfixes and improvements to DataBlockEncodingTool,
including presentation format, memory requirements (reduced 3x) and fixing the
handling of compression.

Test Plan:
* Run unit tests.
* Run DataBlockEncodingTool on a variety of real-world HFiles.

Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2409

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304626 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 22:02:53 +00:00
Michael Stack 1e6c227883 HBASE-5616 Make compaction code standalone; ADDENDUM -- ADD LICENSES 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304624 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:52:55 +00:00
Michael Stack 5a9f595e7d HBASE-5616 Make compaction code standalone 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304616 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:37:01 +00:00
Michael Stack 358dc6e6e6 HBASE-5624 Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304603 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:18:41 +00:00
Zhihong Yu 26b2950bc7 HBASE-5613 ThriftServer getTableRegions does not return serverName and port (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304602 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:15:50 +00:00
larsh 929113dfab HBASE-4657 Improve the efficiency of our MR jobs with a few configurations 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304110 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 22:34:35 +00:00
Zhihong Yu a379a41e3d HBASE-5591 ThiftServerRunner.HBaseHandler.toBytes() is identical to Bytes.getBytes() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304047 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 20:43:55 +00:00
Jean-Daniel Cryans fa98df639e HBASE-5586 [replication] NPE in ReplicationSource when creating a stream 
to an inexistent cluster


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303945 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 18:13:12 +00:00
larsh 536ff21825 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) part 2 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303920 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 17:51:37 +00:00
larsh 6fb055da00 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303915 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 17:49:32 +00:00
Michael Stack 772ecdd236 HBASE-5328 Small changes to Master to make it more testable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303648 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 03:40:46 +00:00
Michael Stack 327e2d1f74 HBASE-5328 Small changes to Master to make it more testable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303626 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:02:36 +00:00
larsh 4ba5a9d29e HBASE-5433 [REST] Add metrics to keep track of success/failure count (Mubarak Seyed) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303536 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:48:11 +00:00
Jonathan Hsieh 865b14133b HBASE-5589 Add of the offline call to the Master Interface 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303519 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:30:54 +00:00
Zhihong Yu 5b2d6ebfc5 HBASE-5542 revert due to broken trunk build 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303517 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:28:33 +00:00
Michael Stack 250252f400 HBASE-5560 Avoid RegionServer GC caused by timed-out calls 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303512 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:17:59 +00:00
Zhihong Yu ce36877d30 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303490 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 18:25:18 +00:00
larsh 41f31490ff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303220 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 23:57:53 +00:00
mbautin b4dccf9198 HBASE-5605 [jira] compression does not work in Store.java 
Author: Yongqiang He

Summary: need to pass compression parameter to WriterBuilder

Test Plan: one simple and straightforward change

Reviewers: mbautin

Reviewed By: mbautin

CC: tedyu

Differential Revision: https://reviews.facebook.net/D2391

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303150 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 21:04:38 +00:00
ramkrishna 2f58da0489 HBASE-5520 Support reseek() at RegionScanner (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303005 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 17:10:50 +00:00
mbautin 6be64072e8 HBASE-5521 [jira] Move compression/decompression to an encoder specific encoding 
context

Author: Yongqiang He

Summary:
https://issues.apache.org/jira/browse/HBASE-5521

As part of working on HBASE-5313, we want to add a new columnar encoder/decoder.
It makes sense to move compression to be part of encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer.

If there is no encoder specified for a writer, the HBlock.Writer will use a
default compression-context to do something very similar to today's code.

Test Plan: existing unit tests verified by mbautin and tedyu. And no new test
added here since this code is just a preparation for columnar encoder. Will add
testcase later in that diff.

Reviewers: dhruba, tedyu, sc, mbautin

Reviewed By: mbautin

Differential Revision: https://reviews.facebook.net/D2097

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302602 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:12:19 +00:00
Michael Stack 047d209cee HBASE-5955 Fix NoSuchMethodException in 0.92 when running on local filesystem 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302207 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-18 19:40:24 +00:00
Jonathan Hsieh 37da60f92f HBASE-5588 Deprecate/remove AssignmentManager#clearRegionFromTransition 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301885 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 07:34:22 +00:00
larsh fda76c71cb Revert HBASE-5569 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301872 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 06:59:31 +00:00
Jonathan Hsieh f34edd6378 HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301779 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 21:50:05 +00:00
Zhihong Yu 1d24d71821 HBASE-5549 HBASE-5572 Master can fail if ZooKeeper session expires (N Keywal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301775 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 21:30:47 +00:00
Michael Stack 8a4c928de0 HBASE-5592 Make it easier to get a table from shell 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301715 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 19:45:06 +00:00
Zhihong Yu 458a3ff092 HBASE-5206 Port HBASE-5155 to trunk (Ashutosh Jindal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301709 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 19:14:11 +00:00
Michael Stack a388bae569 HBASE-5581 Creating a table with invalid syntax does not give an error message when it fails 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301688 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 18:46:53 +00:00
Zhihong Yu 8e84390b37 HBASE-5568 Multi concurrent flushcache() for one region could cause data loss (Chunhui) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301639 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 16:39:44 +00:00
Zhihong Yu 4a5a27eac2 HBASE-5579 A Delete Version could mask other values (Daniel Ferro) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301173 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 20:03:47 +00:00
Michael Stack 273804e658 HBASE-4608 HLog Compression 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301165 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 19:32:01 +00:00
larsh 5055d4cfff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301135 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 18:46:31 +00:00
Zhihong Yu d73aee4f66 HBASE-5206 revert because of test failues in trunk build. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300725 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 21:25:51 +00:00
Zhihong Yu 2ec60a022e HBASE-5206 port HBASE-5155 to TRUNK (Ashutosh Jindal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300711 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 20:29:54 +00:00
Michael Stack eebdfb5d65 HBASE-5574 DEFAULT_MAX_FILE_SIZE defaults to a negative value 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300288 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 19:04:41 +00:00
Michael Stack 05423b150b HBASE-5179 Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300194 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 15:35:54 +00:00
Michael Stack e4fefa0073 HBASE-5399 Cut the link between the client and the zookeeper ensemble 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299872 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 21:20:33 +00:00
mbautin be78e3c4ee [jira] [HBASE-5292] Prevent counting getSize on compactions 
Author: Zhiqiu Kong

Summary:
Added two separate metrics for both get() and next(). This is done by
refactoring on internal next() API. To be more specific, only Get.get()
and ResultScanner.next() passes the metric name ("getsize" and
"nextsize" repectively) to
  HRegion::RegionScanner::next(List<KeyValue>, String)

This will eventually hit StoreScanner()::next((List<KeyValue>,
int, String) where the metrics are counted.

And their call paths are:

1) Get

HTable::get(final Get get)
=> HRegionServer::get(byte [] regionName, Get get)
=> HRegion::get(final Get get, final Integer lockid)
=> HRegion::get(final Get get)      [pass METRIC_GETSIZE to the
callee]

=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)

2) Next

HTable::ClientScanner::next()
=> ScannerCallable::call()
=> HRegionServer::next(long scannerId)
=> HRegionServer::next(final long scannerId, int nbRows)  [pass
METRIC_NEXTSIZE to the callee]

=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)

Test Plan:
1. Passed unit tests.
2. Created a testcase TestRegionServerMetrics::testGetNextSize to
guarantee:
 * Get/Next contributes to getsize/nextsize metrics
 * Both getsize/nextsize are per Column Family
 * Flush/compaction won't affect these two metrics

Reviewed By: mbautin

Reviewers: Kannan, mbautin, Liyin, JIRA

CC: Kannan, mbautin, Liyin, zhiqiu

Differential Revision: https://reviews.facebook.net/D1617

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299147 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-10 02:27:05 +00:00
Michael Stack e4c43d72bf HBASE-5535 Make the functions in task monitor synchronized 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299088 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 22:47:54 +00:00
Michael Stack 7d34da889e HBASE-5538 A metric to measure the size of the response queue in the hbase rpc server 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299084 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 22:40:12 +00:00
mbautin fc08d20ebd [jira] [HBASE-4542] Add filter info to slow query logging 
Author: Zhiqiu Kong

Summary:
The original 89-fb diff is: https://reviews.facebook.net/D1263

Slow opertaion log does not provide enough information when a filter is
present. The followings are done to add the filter info:

1) Added toString() method for filters inheriting FilterBase, this
affect 22 filters and their subclasses. The info added includes the
filter's name and its members. For example, for TimestampsFilter, we'll
output its class name as well as the defined timestamps.

2) Added a field 'filter' in Get::toMap() and Scan::toMap() to enable
the logging of filter info.

Task ID: #750975

Blame Rev:

Test Plan:
1. Run and passed unit-tests to make sure it does not break things

2. Run kannan's script to trigger the slow operation logging, checked
for each filter to make sure the filter info was logged. To be more
detailed, the output log are as following (only 'filter' filed is put
here for ease of reading):

"filter":"TimestampsFilter (3/3): [2, 3, 5]"
"filter":"TimestampsFilter (5/6): [2, 3, 5, 7, 11]"
"filter":"ColumnPrefixFilter col2"
"filter":"ColumnRangeFilter [col2a, col2b]"
"filter":"ColumnCountGetFilter 8"
"filter":"ColumnPaginationFilter (4, 4)"
"filter":"InclusiveStopFilter row"
"filter":"PrefixFilter row"
"filter":"PageFilter 1"
"filter":"SkipFilter TimestampsFilter (1/1): [1000]"
"filter":"WhileMatchFilter TimestampsFilter (3/3): [2, 3, 5]"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"MultipleColumnPrefixFilter (3/3): [a, b, c]"
"filter":"DependentColumnFilter (family, qualifier, true, LESS, value)"
"filter":"FamilyFilter (LESS, value)"
"filter":"QualifierFilter (LESS, value)"
"filter":"RowFilter (LESS, value)"
"filter":"ValueFilter (LESS, value)"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"SingleColumnValueFilter (family, qualifier, EQUAL, value)"
"filter":"SingleColumnValueExcludeFilter (family, qualifier, EQUAL,
value)"
"filter":"FilterList AND (2/2): [KeyOnlyFilter, FirstKeyOnlyFilter]"
Please check ~zhiqiu/Codes/scripts/testFilter.rb for the testing script.

3. Added unit test cases to TestOperation to verify the filters'
toString() method works well.

Reviewed By: mbautin

Reviewers: Kannan, madhuvaidya, mbautin, JIRA

CC: Kannan, madhuvaidya, mbautin, zhiqiu, stack

Differential Revision: https://reviews.facebook.net/D1539

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299019 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 20:14:26 +00:00
Michael Stack cbdf0ca007 HBASE-5552 Clean up our jmx view; its a bit of a mess 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298923 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 16:54:13 +00:00
Zhihong Yu 35a36c2c66 HBASE-5213 "hbase master stop" does not bring down backup masters (Gregory) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298859 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 14:47:16 +00:00
larsh 5d9f98e09d HBASE-5541 Avoid holding the rowlock during HLog sync in HRegion.mutateRowWithLocks 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298678 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 00:52:25 +00:00
larsh 7ce77fc5d3 HBASE-5526 ^Cnfigurable file and directory based umask (Jesse Yates) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298657 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 23:58:17 +00:00
mbautin 961455cd9d [jira] [HBASE-5074] Support checksums in HBase block cache 
Author: Dhruba

Summary:
HFile is enhanced to store a checksum for each block. HDFS checksum verification
is avoided while reading data into the block cache. On a checksum verification
failure, we retry the file system read request with hdfs checksums switched on
(thanks Todd).

I have a benchmark that shows that it reduces iops on the disk by about 40%. In
this experiment, the entire memory on the regionserver is allocated to the
regionserver's jvm and the OS buffer cache size is negligible. I also measured
negligible (<5%) additional cpu usage while using hbase-level checksums.

The salient points of this patch:

1. Each hfile's trailer used to have a 4 byte version number. I enhanced this so
that these 4 bytes can be interpreted as a (major version number, minor
version). Pre-existing hfiles have a minor version of 0. The new hfile format
has a minor version of 1 (thanks Mikhail). The hfile major version remains
unchanged at 2. The reason I did not introduce a new major version number is
because the code changes needed to store/read checksums do not differ much from
existing V2 writers/readers.

2. Introduced a HFileSystem object which is a encapsulates the FileSystem
objects needed to access data from hfiles and hlogs.  HDFS FileSystem objects
already had the ability to switch off checksum verifications for reads.

3. The majority of the code changes are located in hbase.io.hfie package. The
retry of a read on an initial checksum failure occurs inside the hbase.io.hfile
package itself.  The code changes to hbase.regionserver package are minor.

4. The format of a hfileblock is the header followed by the data followed by the
checksum(s). Each 16 K (configurable) size of data has a 4 byte checksum.  The
hfileblock header has two additional fields: a 4 byte value to store the
bytesPerChecksum and a 4 byte value to store the size of the user data
(excluding the checksum data). This is well explained in the associated
javadocs.

5. I added a test to test backward compatibility. I will be writing more unit
tests that triggers checksum verification failures aggressively. I have left a
few redundant log messages in the code (just for easier debugging) and will
remove them in later stage of this patch. I will also be adding metrics on
number of checksum verification failures/success in a later version of this
diff.

6. By default, hbase-level checksums are switched on and hdfs level checksums
are switched off for hfile-reads. No changes to Hlog code path here.

Test Plan: The default setting is to switch on hbase checksums for hfile-reads,
thus all existing tests actually validate the new code pieces. I will be writing
more unit tests for triggering checksum verification failures.

Reviewers: mbautin

Reviewed By: mbautin

CC: JIRA, tedyu, mbautin, dhruba, todd, stack

Differential Revision: https://reviews.facebook.net/D1521

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298641 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 22:55:49 +00:00
Zhihong Yu c4426b5b79 HBASE-5515 Add a processRow API that supports atomic multiple reads and writes on a row (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298533 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 19:40:27 +00:00
Michael Stack 0f7285a81a HBASE-4890 fix possible NPE in HConnectionManager 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298272 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 05:00:01 +00:00
Andrew Kyle Purtell edc6696bc5 HBASE-5480. Fixups to MultithreadedTableMapper for Hadoop 0.23 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298259 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 02:28:39 +00:00
Michael Stack e4f4022493 HBASE-5519 Incorrect warning in splitlogmanager 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297707 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 20:46:02 +00:00
larsh 723e8559e3 HBASE-5523 Fix Delete Timerange logic for KEEP_DELETED_CELLS 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297343 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 06:17:11 +00:00
Zhihong Yu 88115f3d8b HBASE-5507 ThriftServerRunner.HbaseHandler.getRegionInfo() and getTableRegions() do not use ByteBuffer correctly (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297300 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 00:00:36 +00:00
Zhihong Yu 44e348ea1b HBASE-5010 Pass region info in LoadBalancer.randomAssignment(List<ServerName> servers) (Anoop Sam John) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297155 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-05 18:41:03 +00:00
Michael Stack 0132176084 HBASE-5286 bin/hbase's logic of adding Hadoop jar files to the classpath is fragile when presented with split packaged Hadoop 0.23 installation 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296663 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 16:46:57 +00:00
Michael Stack 4343a0a00d HBASE-5486 Warn message in HTable: Stringify the byte[] 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296478 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 21:16:03 +00:00
Zhihong Yu a2392c913e HBASE-5506 Add unit test for ThriftServerRunner.HbaseHandler.getRegionInfo() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296365 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 18:30:27 +00:00
larsh 9ffc748589 HBASE-5489 Addendum 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296011 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 00:26:25 +00:00
Michael Stack 7147bc5424 HBASE-5489 Add HTable accessor to get regions for a key range 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295729 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 18:43:29 +00:00
Michael Stack dace419238 HBASE-4403 Adopt interface stability/audience classifications from Hadoop AND HBASE-5502 region_mover.rb fails to load regions back to original server for regions only containing empty tables 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295710 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 17:53:03 +00:00
Michael Stack 324a2cfeb4 HBASE-5454 Refuse operations from Admin before master is initialized 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295433 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 06:59:51 +00:00
Michael Stack 8eab15acf5 HBASE-5491 Remove HBaseConfiguration.create() call from coprocessor.Exec class 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295429 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 06:49:59 +00:00
larsh 6e612849dc HBASE-5497 Add protobuf as M/R dependency jar (mapred) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295329 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 22:42:37 +00:00
Zhihong Yu ba56d88d60 HBASE-5441 HRegionThriftServer may not start because of a race-condition (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295192 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 17:58:35 +00:00
Michael Stack 09eaaba6b4 HBASE-5485 LogCleaner refers to non-existant SnapshotLogCleaner 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294799 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 19:39:33 +00:00
Michael Stack 09a8719814 HBASE-5484 Spelling mistake in error message in HMasterCommandLine 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294790 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 19:01:46 +00:00
Michael Stack 4ef6cb8bc9 HBASE-5483 Allow configurable host to bind to for starting REST server from commandline 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294229 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-27 17:01:04 +00:00
Michael Stack c176d41582 HBASE-5481 Uncaught UnknownHostException prevents HBase from starting 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1294217 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-27 16:51:26 +00:00
Michael Stack 5b61755b0f HBASE-5473 Metrics does not push pread time 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293532 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 04:22:55 +00:00
Michael Stack e540751766 HBASE-5350 Fix jamon generated package names 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293485 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 23:59:37 +00:00
Michael Stack 3544e1c5f7 HBASE-5351 hbase completebulkload to a new table fails in a race 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293479 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 23:40:27 +00:00
larsh d229b63a28 HBASE-5455 Add test to avoid unintentional reordering of items in HbaseObjectWritable (Michael Drzal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293455 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 22:29:40 +00:00
Michael Stack d7050d3541 HBASE-5325 Expose basic information about the master-status through jmx beans 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293416 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 21:06:12 +00:00
larsh a54ec1b7cc HBASE-5440 Allow Import to optionally use HFileOutputFormat 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293101 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 06:47:29 +00:00
Michael Stack e531e2595c HBASE-4365 Add a decent heuristic for region size 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293099 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 06:41:37 +00:00
Michael Stack ce71b8a1bc HBASE-5166 MultiThreaded Table Mapper analogous to MultiThreaded Mapper in hadoop 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293098 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 06:38:18 +00:00
mbautin a01166ec92 [jira] [HBASE-5442] Use builder pattern in StoreFile and HFile 
Summary: Cleaning up the factory method explosion in HFile writer and StoreFile.
Now, adding a new parameter to HFile/StoreFile writer initialization will not
require modifying factory method invocations all over the codebase.

Test Plan:
Run unit tests
Deploy to dev cluster and run a load test

Reviewers: JIRA, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: stack

Differential Revision: https://reviews.facebook.net/D1893

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293095 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 06:06:53 +00:00
Michael Stack bbf0a0074e HBASE-5464 Log warning message when thrift calls throw exceptions 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293093 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 05:48:13 +00:00
Zhihong Yu 398289ce6e HBASE-5317 Fix TestHFileOutputFormat to work against hadoop 0.23 (Gregory Chanan) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293049 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 01:07:03 +00:00
Zhihong Yu 49904bcf1d HBASE-5466 Opening a table also opens the metatable and never closes it 
(Ashley Taylor)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293047 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 00:55:58 +00:00
Jean-Daniel Cryans a4a4e97338 HBASE-5415 FSTableDescriptors should handle random folders in 
hbase.root.dir better


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293042 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 00:41:31 +00:00
mbautin b77dca0c7f [jira] [HBASE-5357] Refactoring: use the builder pattern for HColumnDescriptor 
Summary: Deprecate three ugly HColumnDescriptor constructors and use a "builder"
pattern instead, e.g. new
HColumnDescriptor(cfName).setMaxVersions(5).setBlockSize(8192), etc. Setters
have now become "builder" methods.

Test Plan: Run unit tests

Reviewers: JIRA, todd, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D1851

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293026 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 23:18:27 +00:00
Zhihong Yu b0d4403059 HBASE-5437 HRegionThriftServer does not start because of a bug in HbaseHandlerMetricsProxy (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293013 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 22:58:42 +00:00
larsh 375d81ab29 HBASE-5460 Add protobuf as M/R dependency jar 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292656 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 05:44:56 +00:00
Michael Stack 30f21c3ef4 HBASE-5423 Regionserver may block forever on waitOnAllRegionsToClose when aborting 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292647 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 05:05:30 +00:00
Michael Stack 240d6bc52b HBASE-5424 HTable meet NPE when call getRegionInfo() -- REVERT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292646 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 05:01:29 +00:00
Michael Stack 6a80cf5bf9 HBASE-5424 HTable meet NPE when call getRegionInfo() 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292645 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 04:43:29 +00:00
Nicolas Spiegelberg c3575d2eb5 [jira] [HBASE-5332] Deterministic Compaction Jitter 
Summary:
Changing the jitter in major compactions to be deterministic,
so reboots don't cause a time-based compaction storm.  This
implementation seeds a random number generator with HDFS data for
persistence.

Test Plan: - mvn test -Dtest=TestCompaction,TestCompactSelection,TestHeapSize

Reviewers: JIRA, Kannan, aaiyer, stack

Reviewed By: Kannan

Differential Revision: https://reviews.facebook.net/D1785

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292495 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 20:36:39 +00:00
Michael Stack 7b5ec59eda HBASE-5422 StartupBulkAssigner would cause a lot of timeout on RIT when assigning large numbers of regions (timeout = 3 mins) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292409 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 17:29:26 +00:00
larsh 0f708f7370 HBASE-5439 Fix some performance findbugs issues (Gregory Chanan) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292141 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 07:00:44 +00:00
Michael Stack 953d89e3a9 HBASE-5189 Add metrics to keep track of region-splits in RS 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292139 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-22 06:51:02 +00:00
Michael Stack 6da328e0fb HBASE-5436 Right-size the map when reading attributes. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1291463 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 21:46:04 +00:00
larsh ad14643d55 HBASE-5431 Improve delete marker handling in Import M/R jobs 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290955 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-19 05:51:56 +00:00
Michael Stack 145d25dfc2 HBASE-5209 HConnection/HMasterInterface should allow for way to get hostname of currently active master in multi-master HBase setup 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290942 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-19 04:10:46 +00:00
Michael Stack d69299dfdc HBASE-5003 If the master is started with a wrong root dir, it gets stuck and can't be killed 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290882 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 21:32:42 +00:00
Michael Stack 588206f411 HBASE-5200 AM.ProcessRegionInTransition() and AM.handleRegion() race thus leaving the region assignment inconsistent 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290854 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 20:13:54 +00:00
larsh 0e54a5f331 HBASE-3584 Addendum, remove RowMutation 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245876 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 07:25:41 +00:00
Michael Stack 0d17817fde HBASE-3584 Rename RowMutation to RowMutations 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245792 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 22:58:01 +00:00
Michael Stack 9684065bec HBASE-5428 Allow for custom filters to be registered within the Thrift interface 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245774 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:39:30 +00:00
Michael Stack 0dd3c22706 HBASE-5195 [Coprocessors] preGet hook does not allow overriding or wrapping filter on incoming Get -- SECOND HALF OF THIS COMMIT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245773 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:34:46 +00:00
Michael Stack 0caad4616e HBASE-5279 NPE in Master after upgrading to 0.92.0 -- REVERT OVERCOMMIT TO HREGION 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245768 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:26:23 +00:00
Michael Stack 5994c50143 HBASE-5279 NPE in Master after upgrading to 0.92.0 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245767 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:24:21 +00:00
Michael Stack aa7a5b2926 HBASE-5120 Timeout monitor races with table disable handler 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245731 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 20:03:57 +00:00
Jean-Daniel Cryans 6fa8f6a042 HBASE-4640 Catch ClosedChannelException and document it 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245730 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 19:56:54 +00:00
Jean-Daniel Cryans 5b542b7921 HBASE-5393 Consider splitting after flushing 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245727 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 19:45:45 +00:00
Michael Stack f45b59aa4d HBASE-5425 Punt on the timeout doesn't work in BulkEnabler#waitUntilDone (master's EnableTableHandler) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245674 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 17:28:46 +00:00
Zhihong Yu 628e5cd9f2 HBASE-5411 Add more metrics for ThriftMetrics (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244977 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 13:56:40 +00:00
Michael Stack 71682997f3 HBASE-5394 Add ability to include Protobufs in HbaseObjectWritable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244641 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:45:06 +00:00
Michael Stack caf2c0c67a HBASE-5398 HBase shell disable_all/enable_all/drop_all promp wrong tables for confirmation 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244169 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:02:13 +00:00
Zhihong Yu ac0fb8d5ae HBASE-5388 Tune HConnectionManager#getCachedLocation method (Ronghai Ma) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243994 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 15:28:59 +00:00
Jean-Daniel Cryans 37735435ec HBASE-5395 CopyTable needs to use GenericOptionsParser 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243759 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 01:13:33 +00:00
Jean-Daniel Cryans ce3bae0334 HBASE-5197 [replication] Handle socket timeouts in ReplicationSource 
to prevent DDOS


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243733 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 23:12:55 +00:00
mbautin b50714c043 [jira] [HBASE-5387] Reuse compression streams in HFileBlock.Writer 
Summary: We need to to reuse compression streams in HFileBlock.Writer instead of
allocating them every time. The motivation is that when using Java's built-in
implementation of Gzip, we allocate a new GZIPOutputStream object and an
associated native data structure any time. This is one suspected cause of recent
TestHFileBlock failures on Hadoop QA:
https://builds.apache.org/job/HBase-TRUNK/2658/testReport/org.apache.hadoop.hbase.io.hfile/TestHFileBlock/testPreviousOffset_1_/.

Test Plan:
* Run unit tests
* Create a GZIP-compressed CF with new code, load some data, shut down HBase,
deploy old code, restart HBase, and scan the table

Reviewers: tedyu, Liyin, dhruba, JIRA, lhofhansl

Reviewed By: lhofhansl

CC: tedyu, lhofhansl, mbautin

Differential Revision: https://reviews.facebook.net/D1719

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243667 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 19:41:58 +00:00
Zhihong Yu f2bb12c6bb HBASE-5327 Print a message when an invalid hbase.rootdir is passed (Jimmy Xiang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243650 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 18:47:04 +00:00
Zhihong Yu 0e0394bc35 HBASE-5199 Differential revision 1311 Delete out of TTL store files before compaction selection (Liyin) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243086 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-11 16:29:36 +00:00
larsh 23b135965f HBASE-5368 Move PrefixSplitKeyPolicy out of the src/test into src, so it is accessible in HBase installs 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242981 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 23:32:52 +00:00
Jonathan Hsieh 8bb23aef17 HBASE-5364 Fix source files missing license in 0.92 and trunk (Elliott Clark) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242906 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 20:07:36 +00:00
Zhihong Yu c6519ca4c7 HBASE-5358 HBaseObjectWritable should be able to serialize/deserialize generic arrays 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242649 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 03:37:32 +00:00
larsh ff1f0decc4 HBASE-5229 Provide basic building blocks for 'multi-row' local transactions. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242037 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 18:30:37 +00:00
Zhihong Yu 7ef8f6e307 HBASE-5298 Add thrift metrics to thrift2 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241974 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 17:03:11 +00:00
Zhihong Yu 10f108630f HBASE-5345 CheckAndPut doesn't work when value is empty byte[] (Evert Arckens) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241972 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 16:55:16 +00:00
Michael Stack 38d28bccc6 HBASE-5348 Constraint configuration loaded with bloat 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241704 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 23:49:37 +00:00
Zhihong Yu 802d7c8674 HBASE-3850 Log more details when a scanner lease expires (Darren Haas) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241667 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 22:23:45 +00:00
Zhihong Yu b4f585e6a3 HBASE-5267 Add a configuration to disable the slab cache by default (Li Pi) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241644 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 21:41:45 +00:00
Zhihong Yu a2887a9bb7 HBASE-4658 Put attributes are not exposed via the ThriftServer (Dhruba) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1240294 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 19:02:13 +00:00
larsh df4a9d4ad3 HBASE-5304 Pluggable split key policy 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239909 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 23:00:06 +00:00
Zhihong Yu 4b4904a77c HBASE-5186 Add metrics to ThriftServer (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239737 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 17:30:13 +00:00
Zhihong Yu 8a6d0fbca1 HBASE-5212 Fix test TestTableMapReduce against 0.23 (Ted and Gregory) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239264 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 18:56:34 +00:00
Zhihong Yu 6bed2d07da HBASE-5295 Improve the Thrift API to switch on/off writing to wal for Mutations (Dhruba) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239241 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 18:04:06 +00:00
Zhihong Yu 457d51bec5 HBASE-5310 HConnectionManager server cache key enhancement (Jimmy Xiang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239220 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 17:34:04 +00:00
Zhihong Yu 4b698e776d HBASE-5283 Request counters may become negative for heavily loaded regions (Mubarak) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239157 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 14:56:20 +00:00
Zhihong Yu e5a38bed76 HBASE-5256 Use WritableUtils.readVInt() in RegionLoad.readFields() (Mubarak) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238873 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 00:12:36 +00:00
Zhihong Yu b246e68435 HBASE-5259 Normalize the RegionLocation in TableInputFormat by the reverse DNS lookup (Liyin Tang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238774 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 19:52:58 +00:00
Zhihong Yu 650b321396 HBASE-5290 [FindBugs] Synchronization on boxed primitive (Ben West) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238693 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 16:52:51 +00:00
Zhihong Yu 093c7203e8 HBASE-5297 Update metrics numOpenConnections and callQueueLen directly in HBaseServer (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238114 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 00:37:29 +00:00
mbautin e06a31d62b [jira] [HBASE-5274] Filter out expired scanners on compaction as well 
Summary: This is a followup for D1017 to make it similar to D909 (89-fb). The
fix for 89-fb used the TTL-based scanner filtering logic on both normal scanners
and compactions, while the trunk fix D1017 did not. This is just the delta
between the two diffs that brings filtering expired store files on compaction to
trunk.

Test Plan: Unit tests

Reviewers: Liyin, JIRA, lhofhansl, Kannan

Reviewed By: Liyin

CC: Liyin, tedyu, Kannan, mbautin, lhofhansl

Differential Revision: https://reviews.facebook.net/D1473

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236483 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 01:23:37 +00:00
Jonathan Hsieh 36788d1cc2 HBASE-5282 Possible file handle leak with truncated HLog file 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236445 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 23:30:47 +00:00
Zhihong Yu da1443d90a HBASE-5271 Result.getValue and Result.getColumnLatest return the wrong column (Ghais Issa) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236347 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 18:51:33 +00:00
mbautin ec1c804fc1 [jira] [HBASE-4218] HFile data block encoding framework and delta encoding 
implementation (Jacek Midgal, Mikhail Bautin)

Summary:

Adding a framework that allows to "encode" keys in an HFile data block. We
support two modes of encoding: (1) both on disk and in cache, and (2) in cache
only. This is distinct from compression that is already being done in HBase,
e.g. GZ or LZO. When data block encoding is enabled, we store blocks in cache
in an uncompressed but encoded form. This allows to fit more blocks in cache
and reduce the number of disk reads.

The most common example of data block encoding is delta encoding, where we take
advantage of the fact that HFile keys are sorted and share a lot of common
prefixes, and only store the delta between each pair of consecutive keys.
Initial encoding algorithms implemented are DIFF, FAST_DIFF, and PREFIX.

This is based on the delta encoding patch developed by Jacek Midgal during his
2011 summer internship at Facebook. The original patch is available here:
https://reviews.apache.org/r/2308/diff/.

Test Plan: Unit tests. Distributed load test on a five-node cluster.

Reviewers: JIRA, tedyu, stack, nspiegelberg, Kannan

Reviewed By: Kannan

CC: tedyu, todd, mbautin, stack, Kannan, mcorgan, gqchen

Differential Revision: https://reviews.facebook.net/D447



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236031 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 02:58:57 +00:00
mbautin 07dbe903de HBASE-5230 : ensure that compactions do not cache-on-write data blocks 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235882 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-25 19:41:07 +00:00
Zhihong Yu f20083b193 HBASE-4720 revert until agreement is reached on solution 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235388 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 18:17:23 +00:00
Zhihong Yu f4872ddd1f HBASE-4720 Implement atomic update operations (checkAndPut, checkAndDelete) for REST client/server (Mubarak) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235362 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 17:19:59 +00:00
Michael Stack 5095b451e4 HBASE-5264 Add 0.92.0 upgrade guide 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235062 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 23:27:05 +00:00
Zhihong Yu 59b1b68d12 HBASE-5255 Use singletons for OperationStatus to save memory (Benoit) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235016 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 21:56:45 +00:00
Zhihong Yu 35a60f187d HBASE-5139 Addendum handles startRow being null for the case where median is in the first region 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234903 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 17:07:45 +00:00
ramkrishna 3331341429 HBASE-5243 LogSyncerThread not getting shutdown waiting for the interrupted flag (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234559 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-22 17:43:16 +00:00
ramkrishna fbf165d347 HBASE-5235 HLogSplitter writer thread's streams not getting closed when any of the writer threads has exceptions.(Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234509 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-22 13:20:15 +00:00
Zhihong Yu da0f65de98 HBASE-5246 Regenerate code with thrift 0.8.0 (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234445 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-22 01:52:49 +00:00
ramkrishna fc8d2fe645 HBASE-5237 Addendum for HBASE-5160 and HBASE-4397 (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234377 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-21 17:47:08 +00:00
Andrew Kyle Purtell 7436e93ee9 HBASE-5228. [REST] Rip out transform feature 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1234045 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 18:06:34 +00:00
Zhihong Yu 1c8829e0ad HBASE-5208 Allow setting Scan start/stop row individually in TableInputFormat 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1233071 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-18 21:22:49 +00:00
Zhihong Yu 9b1e9d3c29 HBASE-5176 AssignmentManager#getRegion: logging nit adds a redundant '+' (Karthik K) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232567 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 20:40:26 +00:00
larsh 01246cdc99 HBASE-5203 Group atomic put/delete operation into a single WALEdit to handle region server failures. (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232551 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 19:38:13 +00:00
Zhihong Yu c0d127fcb2 HBASE-5201 Add new files 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232506 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 17:49:34 +00:00
Zhihong Yu 916b3a166c HBASE-5201 Utilize TThreadedSelectorServer and remove redundant code in ThriftServer and HRegionThriftServer (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232504 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 17:38:58 +00:00
Zhihong Yu 174248a26f HBASE-5153 revert due to failed Jenkins builds 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232490 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 17:15:23 +00:00
Zhihong Yu 5ce4d352de HBASE-5153 Add retry logic in HConnectionImplementation#resetZooKeeperTrackers (Jieshan) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1232292 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 04:06:30 +00:00
Michael Stack e20aa2b3a6 HBASE-5204 Backward compatibility fixes for 0.92 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231985 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 13:08:54 +00:00
larsh 323d17d3ae HBASE-3584 Allow atomic put/delete in one call (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231441 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 04:59:44 +00:00
Zhihong Yu a9c183ff98 HBASE-5150 Failure in a thread may not fail a test, clean up log splitting test (Jimmy Xiang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231364 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 22:44:03 +00:00
Michael Stack 0876497eb9 HBASE-5193 Use TBoundedThreadPoolServer in HRegionThriftServer 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231347 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 22:23:52 +00:00
Zhihong Yu ee03d1626d HBASE-5196 Failure in region split after PONR could cause region hole (Jimmy Xiang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231302 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 21:17:30 +00:00
Zhihong Yu 8d07130c67 HBASE-5143 Fix config typo in pluggable load balancer factory (Harsh J) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1231281 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 20:07:40 +00:00
Michael Stack 1962888156 HBASE-5115 Change HBase color from purple to 'International Orange (Engineering)' 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230854 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 01:21:52 +00:00
Zhihong Yu 1df784d11a HBASE-5177 Differential Revision: 1197 HTable needs a non cached version of getRegionLocation (Pritam Damania) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230725 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 19:46:32 +00:00
Zhihong Yu f90f4971bd HBASE-5033 Differential Revision: 933 Opening/Closing store in parallel to reduce region open/close time (Liyin) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230347 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 01:19:26 +00:00
Michael Stack 06ca87ae87 HBASE-5182 TBoundedThreadPoolServer threadKeepAliveTimeSec is not configured properly 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230306 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 22:52:57 +00:00
Zhihong Yu 5ad571ab6c HBASE-5139 Compute (weighted) median using AggregateProtocol 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230200 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 19:24:48 +00:00
Zhihong Yu 39a1e07ce4 HBASE-3565 Add metrics to keep track of slow HLog appends (Mubarak) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1230188 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 19:02:28 +00:00
larsh 15c62ed21a HBASE-5121 MajorCompaction may affect scan's correctness (chunhui shen and Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229806 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 23:39:57 +00:00
Michael Stack 9cbf9e9f4e HBASE-5172 HTableInterface should extend java.io.Closeable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229696 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 19:21:40 +00:00
Michael Stack 94342eea88 HBASE-5134 Remove getRegionServerWithoutRetries and getRegionServerWithRetries from HConnection Interface 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229683 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 18:52:43 +00:00
ramkrishna e06aaf4ecc HBASE-5137 MasterFileSystem.splitLog() should abort even if waitOnSafeMode() throws IOException(Ram & Ted) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229649 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 17:33:49 +00:00
Zhihong Yu 296cf139aa HBASE-5152 Region is on service before completing initialization when doing rollback of split, 
it will affect read correctness (Chunhui)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229418 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 23:22:37 +00:00
Todd Lipcon 8c2a573d48 HBASE-3949. Add "Master" link to RegionServer pages. Contributed by Gregory Chanan. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1229035 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 05:43:40 +00:00
larsh dd604d3136 HBASE-5088 addendum 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228761 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-08 01:18:53 +00:00
Michael Stack d821f6fcfc HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REDO 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228749 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 22:47:56 +00:00
Michael Stack 45b7b8955b HBASE-5141 Memory leak in MonitoredRPCHandlerImpl -- REVERT. OVER-COMMITTED. REVERTING ALL SO CAN REDO COMMIT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228747 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 22:46:31 +00:00
Michael Stack 25d465426a HBASE-5052 The path where a dynamically loaded coprocessor jar is copied on the local file system depends on the region name (and implicitly, the start key) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228742 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 22:20:45 +00:00
Michael Stack 492feb2a53 HBASE-5141 Memory leak in MonitoredRPCHandlerImpl 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228740 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 22:16:11 +00:00
larsh 7624bcba26 HBASE-5088 A concurrency issue on SoftValueSortedMap (Jieshan Bean and Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228539 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 01:40:07 +00:00
Zhihong Yu 28bbeb76c2 HBASE-5041 Major compaction on non existing table does not throw error (Shrijeet) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228507 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 00:10:41 +00:00
Zhihong Yu 30a0a2c6d6 HBASE-4357 Region stayed in transition - in closing state (Ming Ma) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1228489 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 22:55:36 +00:00
Zhihong Yu ff3cf1aeda HBASE-5081 Distributed log splitting deleteNode races against splitLog retry (Prakash) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227951 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 03:53:58 +00:00
Zhihong Yu c3d7b8ec19 HBASE-3373 Allow regions to be load-balanced by table 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227873 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 22:22:19 +00:00
larsh 771022eed9 HBASE-5118 Fix Scan documentation (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227419 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:17:28 +00:00
larsh 49f35a7756 HBASE-2947 MultiIncrement/MultiAppend (JGray and Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1227382 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 23:16:54 +00:00
ramkrishna ebc3945450 HBASE-5094 The META can hold an entry for a region with a different server name from the one actually in the AssignmentManager thus making the region inaccessible. (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226165 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-31 18:37:08 +00:00
Zhihong Yu 453de3a66c HBASE-4397 -ROOT-, .META. tables stay offline for too long in recovery phase after all RSs 
are shutdown at the same time (Ming Ma)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226110 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-31 15:43:19 +00:00
Zhihong Yu ddd384369f HBASE-5100 Rollback of split could cause closed region to be opened again (Chunhui) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1226029 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-31 02:45:18 +00:00
Zhihong Yu a2471aa255 HBASE-5099 ZK event thread waiting for root region assignment may block server 
shutdown handler for the region sever the root region was on (Jimmy)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225765 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-30 06:39:07 +00:00
Zhihong Yu 315c91901f HBASE-5103 Fix improper master znode deserialization (Jonathan Hsieh) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225622 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 19:08:38 +00:00
Zhihong Yu 270122168b HBASE-5009 Failure of creating split dir if it already exists prevents splits from happening further 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1225153 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 10:07:31 +00:00
larsh 2dcc010d36 HBASE-5096 Replication does not handle deletes correctly. (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224851 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 01:44:14 +00:00
Zhihong Yu 2fe6ab663c HBASE-5010 Filter HFiles based on TTL (Mikhail) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1224792 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-26 19:33:51 +00:00
Zhihong Yu 300f900354 HBASE-4218 Data Block Encoding of KeyValues - revert, problems were uncovered during cluster testing 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223042 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-25 02:49:46 +00:00
Zhihong Yu 499d11b741 HBASE-5070 Constraints implementation and javadoc changes (Jesse Yates) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223024 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-24 21:42:31 +00:00
Zhihong Yu cd47ea0562 HBASE-4218 Data Block Encoding of KeyValues (aka delta encoding / prefix compression) (Jacek, Mikhail) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1223020 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-24 21:20:39 +00:00
Zhihong Yu 0c9fad8f6b HBASE-4938 Create a HRegion.getScanner public method that allows reading from a specified readPoint (Dhruba) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222890 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-23 23:57:55 +00:00
larsh 8b4c4f094e HBASE-4439 Move ClientScanner out of HTable (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222551 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-23 04:16:26 +00:00
Michael Stack 7569cea558 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED -- AGAINpatch -p0 -R < x.txt patch -p0 -R < x.txt 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222046 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-22 05:44:29 +00:00
Michael Stack 6c97552ee1 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REAPPLY 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1222045 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-22 05:42:05 +00:00
Michael Stack fa979ebab2 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry; REVERT -- COMMITTED BEFORE REVIEW FINISHED 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221978 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-22 01:09:03 +00:00
Michael Stack 72c1f6c8c7 HBASE-5081 Distributed log splitting deleteNode races againsth splitLog retry 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221977 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-22 01:04:00 +00:00
Michael Stack 30f5a95a6a HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row; REMOVE OVER-COMMIT, STUFF NOT IN 4698 PATCH 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221621 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 06:01:26 +00:00
Michael Stack df77a4b0b3 HBASE-4698 Let the HFile Pretty Printer print all the key values for a specific row 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221620 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 06:00:05 +00:00
Michael Stack c5b874fff0 HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS -- fix compile error 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221604 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 04:12:17 +00:00
Michael Stack 04dd71214a HBASE-5077 SplitLogWorker fails to let go of a task, kills the RS 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221601 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 04:06:03 +00:00
Michael Stack f000c951c6 HBASE-5078 DistributedLogSplitter failing to split file because it has edits for lots of regions 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221596 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 04:00:47 +00:00
Michael Stack cd508de041 HBASE-5021 Enforce upper bound on timestamp 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221592 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 03:51:42 +00:00
Nicolas Spiegelberg 82e376b3ea [jira] [HBase-5021] Enforce upper bound on timestamp 
Summary:
We have been getting hit with performance problems on the ODS
side due to invalid timestamps being inserted by the timestamp.  ODS is
working on adding proper checks to app server, but production
performance could be severely impacted with significant recovery time if
something slips past.  Therefore, we should also allow the option to
check the upper bound in HBase.

This is the first draft.  Probably should allow per-CF customization.

Test Plan:  - mvn test -Dtest=TestHRegion#testPutWithTsTooNew

Reviewers: Kannan, Liyin, JIRA

CC: stack, nspiegelberg, tedyu, Kannan, mbautin

Differential Revision: 849

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221532 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 00:02:55 +00:00
Jean-Daniel Cryans a952738257 Fixing the link for ZK session expiration 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221527 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 23:40:10 +00:00
Nicolas Spiegelberg 9a0eb6f0c2 [jira] [HBASE-5072] Support Max Value for Per-Store Metrics 
Summary:
We were bit in our multi-tenant cluster because one of our Stores
encountered a bug and grew its StoreFile count. We didn't notice this because
the StoreFile count currently reported by the RegionServer is an average of all
Stores in the region. For the per-Store metrics, we should also record the max
so we can notice outliers.

Test Plan: - mvn test -Dtest=TestRegionServerMetrics

Reviewers: JIRA, mbautin, Kannan

Reviewed By: Kannan

CC: stack, nspiegelberg, mbautin, Kannan

Differential Revision: 945

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221419 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 18:42:11 +00:00
Michael Stack 8fe40ce0e9 HBASE-5063 RegionServers fail to report to backup HMaster after primary goes down 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221121 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 06:46:17 +00:00
Michael Stack 77e16e8027 HBASE-4935 hbase 0.92.0 doesn't work going against 0.20.205.0, its packaged hadoop 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1221033 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 00:10:02 +00:00
Michael Stack 1222383f1d HBASE-5029 TestDistributedLogSplitting fails on occasion; Added catch of NPE and reenabled ignored test 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1220991 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 23:04:15 +00:00