Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,733 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

4733 Commits

Author SHA1 Message Date
Jonathan Hsieh f2d637ffa5 HBASE-5128 [uber hbck] Online automated repair of table integrity and region consistency problems 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 23:53:55 +00:00
Jean-Daniel Cryans 560173f756 HBASE-5190 Limit the IPC queue size based on calls' payload size 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304634 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 22:32:31 +00:00
mbautin 86962028dd [jira] [HBASE-5469] Add baseline compression efficiency to DataBlockEncodingTool 
Summary:
DataBlockEncodingTool currently does not provide baseline compression
efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if
we are using LZO to compress blocks, we would like to have the following
columns in the report (possibly as percentages of raw data size).

Baseline K+V in blockcache | Baseline K + V on disk (LZO compressed) | K + V
DataBlockEncoded in block cache | K + V DataBlockEncoded + LZOCompressed (on
disk)

Background: we never store compressed blocks in cache, but we always store
encoded data blocks in cache if data block encoding is enabled for the column
family.

This patch also has multiple bugfixes and improvements to DataBlockEncodingTool,
including presentation format, memory requirements (reduced 3x) and fixing the
handling of compression.

Test Plan:
* Run unit tests.
* Run DataBlockEncodingTool on a variety of real-world HFiles.

Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2409

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304626 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 22:02:53 +00:00
Michael Stack 1e6c227883 HBASE-5616 Make compaction code standalone; ADDENDUM -- ADD LICENSES 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304624 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:52:55 +00:00
Michael Stack 5a9f595e7d HBASE-5616 Make compaction code standalone 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304616 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:37:01 +00:00
Michael Stack 358dc6e6e6 HBASE-5624 Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304603 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:18:41 +00:00
Zhihong Yu 26b2950bc7 HBASE-5613 ThriftServer getTableRegions does not return serverName and port (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304602 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:15:50 +00:00
larsh 929113dfab HBASE-4657 Improve the efficiency of our MR jobs with a few configurations 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304110 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 22:34:35 +00:00
Zhihong Yu a379a41e3d HBASE-5591 ThiftServerRunner.HBaseHandler.toBytes() is identical to Bytes.getBytes() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304047 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 20:43:55 +00:00
Jean-Daniel Cryans fa98df639e HBASE-5586 [replication] NPE in ReplicationSource when creating a stream 
to an inexistent cluster


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303945 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 18:13:12 +00:00
larsh 536ff21825 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) part 2 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303920 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 17:51:37 +00:00
larsh 6fb055da00 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303915 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 17:49:32 +00:00
Michael Stack 772ecdd236 HBASE-5328 Small changes to Master to make it more testable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303648 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 03:40:46 +00:00
Michael Stack 327e2d1f74 HBASE-5328 Small changes to Master to make it more testable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303626 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:02:36 +00:00
larsh 8105f90937 HBASE-4940 hadoop-metrics.properties can include configuration of the rest context for ganglia (Mubarak Seyed) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303553 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 20:16:27 +00:00
larsh 4ba5a9d29e HBASE-5433 [REST] Add metrics to keep track of success/failure count (Mubarak Seyed) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303536 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:48:11 +00:00
Jonathan Hsieh 865b14133b HBASE-5589 Add of the offline call to the Master Interface 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303519 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:30:54 +00:00
Zhihong Yu 5b2d6ebfc5 HBASE-5542 revert due to broken trunk build 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303517 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:28:33 +00:00
Michael Stack 250252f400 HBASE-5560 Avoid RegionServer GC caused by timed-out calls 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303512 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:17:59 +00:00
Zhihong Yu ce36877d30 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303490 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 18:25:18 +00:00
larsh 41f31490ff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303220 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 23:57:53 +00:00
Michael Stack 5856e90720 HBASE-5597 Findbugs check in test-patch.sh always fails 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303196 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 23:08:12 +00:00
Jonathan Hsieh c38f889627 HBASE-5603 rolling-restart.sh script hangs when attempting to detect expiration of /hbase/master znode 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303184 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 22:46:54 +00:00
mbautin b4dccf9198 HBASE-5605 [jira] compression does not work in Store.java 
Author: Yongqiang He

Summary: need to pass compression parameter to WriterBuilder

Test Plan: one simple and straightforward change

Reviewers: mbautin

Reviewed By: mbautin

CC: tedyu

Differential Revision: https://reviews.facebook.net/D2391

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303150 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 21:04:38 +00:00
ramkrishna 2f58da0489 HBASE-5520 Support reseek() at RegionScanner (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303005 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 17:10:50 +00:00
Doug Meil 45a15792f0 hbase-5570 ops_mgt.xml - fixed self-reference with compression section 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302658 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 21:14:55 +00:00
mbautin 6be64072e8 HBASE-5521 [jira] Move compression/decompression to an encoder specific encoding 
context

Author: Yongqiang He

Summary:
https://issues.apache.org/jira/browse/HBASE-5521

As part of working on HBASE-5313, we want to add a new columnar encoder/decoder.
It makes sense to move compression to be part of encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer.

If there is no encoder specified for a writer, the HBlock.Writer will use a
default compression-context to do something very similar to today's code.

Test Plan: existing unit tests verified by mbautin and tedyu. And no new test
added here since this code is just a preparation for columnar encoder. Will add
testcase later in that diff.

Reviewers: dhruba, tedyu, sc, mbautin

Reviewed By: mbautin

Differential Revision: https://reviews.facebook.net/D2097

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302602 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:12:19 +00:00
Michael Stack 047d209cee HBASE-5955 Fix NoSuchMethodException in 0.92 when running on local filesystem 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302207 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-18 19:40:24 +00:00
Michael Stack 101e6f08ba Fix flag passed building hbase 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302004 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 20:49:47 +00:00
Jonathan Hsieh 37da60f92f HBASE-5588 Deprecate/remove AssignmentManager#clearRegionFromTransition 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301885 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 07:34:22 +00:00
larsh fda76c71cb Revert HBASE-5569 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301872 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 06:59:31 +00:00
Jonathan Hsieh f34edd6378 HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301779 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 21:50:05 +00:00
Zhihong Yu 1d24d71821 HBASE-5549 HBASE-5572 Master can fail if ZooKeeper session expires (N Keywal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301775 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 21:30:47 +00:00
mbautin 0ad4e32993 [jira] [HBASE-5575] Configure Arcanist lint engine for HBase 
Summary: Adding Java lint engine to HBase's .arcconfig. The lint engine itself
is part of the arc-jira repository that lives at
https://github.com/facebook/arc-jira/. There are some changes to be made there
to prevent lint from reporting errors for unmodified lines.

Test Plan: arc lint

Reviewers: nspiegelberg, Kannan, Karthik, JIRA, Liyin

Reviewed By: Liyin

Differential Revision: https://reviews.facebook.net/D2289

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301751 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 20:42:24 +00:00
Michael Stack 8a4c928de0 HBASE-5592 Make it easier to get a table from shell 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301715 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 19:45:06 +00:00
Zhihong Yu 458a3ff092 HBASE-5206 Port HBASE-5155 to trunk (Ashutosh Jindal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301709 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 19:14:11 +00:00
Michael Stack a388bae569 HBASE-5581 Creating a table with invalid syntax does not give an error message when it fails 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301688 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 18:46:53 +00:00
Zhihong Yu 8e84390b37 HBASE-5568 Multi concurrent flushcache() for one region could cause data loss (Chunhui) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301639 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 16:39:44 +00:00
Zhihong Yu 4a5a27eac2 HBASE-5579 A Delete Version could mask other values (Daniel Ferro) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301173 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 20:03:47 +00:00
Michael Stack 273804e658 HBASE-4608 HLog Compression 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301165 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 19:32:01 +00:00
larsh 5055d4cfff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301135 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 18:46:31 +00:00
Zhihong Yu d73aee4f66 HBASE-5206 revert because of test failues in trunk build. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300725 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 21:25:51 +00:00
Zhihong Yu 2ec60a022e HBASE-5206 port HBASE-5155 to TRUNK (Ashutosh Jindal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300711 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 20:29:54 +00:00
Michael Stack eebdfb5d65 HBASE-5574 DEFAULT_MAX_FILE_SIZE defaults to a negative value 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300288 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 19:04:41 +00:00
Michael Stack 05423b150b HBASE-5179 Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300194 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 15:35:54 +00:00
Michael Stack a728f94079 HBASE-5314 racefully rolling restart region servers in rolling-restart.sh 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299983 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 06:30:15 +00:00
Michael Stack 624b0a51b2 HBASE-5499 dev-support/test-patch.sh does not have execute perms 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299976 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 05:05:18 +00:00
Michael Stack 2314945b8b HBASE-5567 test-patch.sh has logic error in findbugs check 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299892 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 21:49:37 +00:00
Michael Stack e4fefa0073 HBASE-5399 Cut the link between the client and the zookeeper ensemble 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299872 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 21:20:33 +00:00
Michael Stack d04201683a HBASE-5562 test-patch.sh reports a javadoc warning when there are no new javadoc warnings 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299824 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 20:19:25 +00:00