Commit Graph

5004 Commits

Author SHA1 Message Date
Michael Stack ec4d59770a HBASE-5564 Bulkload is discarding duplicate records
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306907 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:23:46 +00:00
Michael Stack 8a864815de HBASE-5671 hbase.metrics.showTableName should be true by default
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306712 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 04:35:48 +00:00
Zhihong Yu ada9d8d361 HBASE-5544 Add metrics to HRegion.processRow() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306648 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 23:59:17 +00:00
Jonathan Hsieh 4d5ca12a0f HBASE-5642 [findbugs] Exclude Thrift and Protobuf warnings (Uma Maheswara Rao G)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306428 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 15:33:28 +00:00
Doug Meil d5a548e7ca hbase-5662. ops_mgt.xml, adding entry for HLogPrettyPrinter in tools section.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306037 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 22:44:11 +00:00
Doug Meil 18e7473a53 hbase-5661. adding hbase history section in appendix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306032 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 22:27:13 +00:00
Doug Meil 528d9ddde1 hbase-5660. Creating Case Studies chapter in RefGuide.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306015 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 20:50:55 +00:00
larsh 16ad2b2898 HBASE-5639 The logic used in waiting for region servers during startup is broken (J-D and NKeyval)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306012 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 20:40:13 +00:00
Doug Meil 83e552c3b3 hbase-5658. Update to pseudo-distributed.xml's first link on page to point to RefGuide
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305990 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 19:48:32 +00:00
Doug Meil 0fa7062d2c hbase-5657. developer.xml, updating line-width from 80 to 100 in book (and example)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305979 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 19:36:37 +00:00
Michael Stack 46d8f02c3f HBASE-5610 Add GA to hbase.apache.org
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305970 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 19:26:26 +00:00
larsh ef65dde6b3 HBASE-5641 decayingSampleTick1 prevents HBase from shutting down.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305722 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 03:34:51 +00:00
Jonathan Hsieh 3fd6997380 HBASE-5596 Few minor bugs from HBASE-5209 (David S. Wang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 23:06:02 +00:00
larsh 080206de01 HBASE-5623 Race condition when rolling the HLog and hlogFlush (Enis Soztutar and LarsH)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305556 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 20:42:46 +00:00
Michael Stack 8ea1c8ddd6 HBASE-5533 Add more metrics to HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305499 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 19:21:42 +00:00
Jean-Daniel Cryans 1692dde435 HBASE-5190 Limit the IPC queue size based on calls' payload size
(Ted's addendum)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305468 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:39:36 +00:00
Zhihong Yu 3c234f13ba HBASE-5615 the master never does balance because of balancing the parent region (Xufeng)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305171 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 23:22:00 +00:00
larsh 82670f81b8 HBASE-4957 Clean up some log messages, code in RecoverableZooKeeper (Todd)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304940 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 22:02:41 +00:00
Michael Stack 9cfe7cfa3c HBASE-5633 NPE reading ZK config in HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304924 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:15:40 +00:00
larsh accf8ee862 HBASE-5434 [REST] Include more metrics in cluster status request (Mubarak Seyed)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304919 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:04:45 +00:00
Zhihong Yu 53712ce495 HBASE-5128 Addendum adds two new files Jon forgot to add
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304702 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 03:58:22 +00:00
Jonathan Hsieh f2d637ffa5 HBASE-5128 [uber hbck] Online automated repair of table integrity and region consistency problems
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 23:53:55 +00:00
Jean-Daniel Cryans 560173f756 HBASE-5190 Limit the IPC queue size based on calls' payload size
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304634 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:32:31 +00:00
mbautin 86962028dd [jira] [HBASE-5469] Add baseline compression efficiency to DataBlockEncodingTool
Summary:
DataBlockEncodingTool currently does not provide baseline compression
efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if
we are using LZO to compress blocks, we would like to have the following
columns in the report (possibly as percentages of raw data size).

Baseline K+V in blockcache | Baseline K + V on disk (LZO compressed) | K + V
DataBlockEncoded in block cache | K + V DataBlockEncoded + LZOCompressed (on
disk)

Background: we never store compressed blocks in cache, but we always store
encoded data blocks in cache if data block encoding is enabled for the column
family.

This patch also has multiple bugfixes and improvements to DataBlockEncodingTool,
including presentation format, memory requirements (reduced 3x) and fixing the
handling of compression.

Test Plan:
* Run unit tests.
* Run DataBlockEncodingTool on a variety of real-world HFiles.

Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2409

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:02:53 +00:00
Michael Stack 1e6c227883 HBASE-5616 Make compaction code standalone; ADDENDUM -- ADD LICENSES
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304624 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:52:55 +00:00
Michael Stack 5a9f595e7d HBASE-5616 Make compaction code standalone
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304616 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:37:01 +00:00
Michael Stack 358dc6e6e6 HBASE-5624 Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:18:41 +00:00
Zhihong Yu 26b2950bc7 HBASE-5613 ThriftServer getTableRegions does not return serverName and port (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:15:50 +00:00
larsh 929113dfab HBASE-4657 Improve the efficiency of our MR jobs with a few configurations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304110 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:34:35 +00:00
Zhihong Yu a379a41e3d HBASE-5591 ThiftServerRunner.HBaseHandler.toBytes() is identical to Bytes.getBytes() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 20:43:55 +00:00
Jean-Daniel Cryans fa98df639e HBASE-5586 [replication] NPE in ReplicationSource when creating a stream
to an inexistent cluster


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303945 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 18:13:12 +00:00
larsh 536ff21825 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) part 2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303920 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:51:37 +00:00
larsh 6fb055da00 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303915 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:49:32 +00:00
Michael Stack 772ecdd236 HBASE-5328 Small changes to Master to make it more testable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303648 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 03:40:46 +00:00
Michael Stack 327e2d1f74 HBASE-5328 Small changes to Master to make it more testable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:02:36 +00:00
larsh 8105f90937 HBASE-4940 hadoop-metrics.properties can include configuration of the rest context for ganglia (Mubarak Seyed)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303553 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 20:16:27 +00:00
larsh 4ba5a9d29e HBASE-5433 [REST] Add metrics to keep track of success/failure count (Mubarak Seyed)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303536 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:48:11 +00:00
Jonathan Hsieh 865b14133b HBASE-5589 Add of the offline call to the Master Interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303519 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:30:54 +00:00
Zhihong Yu 5b2d6ebfc5 HBASE-5542 revert due to broken trunk build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303517 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:28:33 +00:00
Michael Stack 250252f400 HBASE-5560 Avoid RegionServer GC caused by timed-out calls
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303512 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:17:59 +00:00
Zhihong Yu ce36877d30 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303490 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:25:18 +00:00
larsh 41f31490ff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303220 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 23:57:53 +00:00
Michael Stack 5856e90720 HBASE-5597 Findbugs check in test-patch.sh always fails
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303196 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 23:08:12 +00:00
Jonathan Hsieh c38f889627 HBASE-5603 rolling-restart.sh script hangs when attempting to detect expiration of /hbase/master znode
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303184 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 22:46:54 +00:00
mbautin b4dccf9198 HBASE-5605 [jira] compression does not work in Store.java
Author: Yongqiang He

Summary: need to pass compression parameter to WriterBuilder

Test Plan: one simple and straightforward change

Reviewers: mbautin

Reviewed By: mbautin

CC: tedyu

Differential Revision: https://reviews.facebook.net/D2391

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303150 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 21:04:38 +00:00
ramkrishna 2f58da0489 HBASE-5520 Support reseek() at RegionScanner (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303005 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 17:10:50 +00:00
Doug Meil 45a15792f0 hbase-5570 ops_mgt.xml - fixed self-reference with compression section
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302658 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 21:14:55 +00:00
mbautin 6be64072e8 HBASE-5521 [jira] Move compression/decompression to an encoder specific encoding
context

Author: Yongqiang He

Summary:
https://issues.apache.org/jira/browse/HBASE-5521

As part of working on HBASE-5313, we want to add a new columnar encoder/decoder.
It makes sense to move compression to be part of encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer.

If there is no encoder specified for a writer, the HBlock.Writer will use a
default compression-context to do something very similar to today's code.

Test Plan: existing unit tests verified by mbautin and tedyu. And no new test
added here since this code is just a preparation for columnar encoder. Will add
testcase later in that diff.

Reviewers: dhruba, tedyu, sc, mbautin

Reviewed By: mbautin

Differential Revision: https://reviews.facebook.net/D2097

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 19:12:19 +00:00
Michael Stack 047d209cee HBASE-5955 Fix NoSuchMethodException in 0.92 when running on local filesystem
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302207 13f79535-47bb-0310-9956-ffa450edef68
2012-03-18 19:40:24 +00:00
Michael Stack 101e6f08ba Fix flag passed building hbase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302004 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 20:49:47 +00:00