Commit Graph

4770 Commits

Author SHA1 Message Date
Doug Meil 8e35106b38 hbase-5390. book.xml - adding section in Arch/Master about what happens if master dies.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243550 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 15:00:51 +00:00
Doug Meil 0553fbc25b hbase-5389. book.xml - minor correction of compaction selection example #1
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243532 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 14:24:58 +00:00
Michael Stack f49e1b1f9a HBASE-5363 Automatically run rat check on mvn release builds
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243164 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 22:12:23 +00:00
Zhihong Yu 0e0394bc35 HBASE-5199 Differential revision 1311 Delete out of TTL store files before compaction selection (Liyin)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1243086 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 16:29:36 +00:00
Michael Stack 9793537b80 HBASE-5384 Up heap used by hadoopqa
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242986 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:53:08 +00:00
larsh 23b135965f HBASE-5368 Move PrefixSplitKeyPolicy out of the src/test into src, so it is accessible in HBase installs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242981 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:32:52 +00:00
Jonathan Hsieh 8bb23aef17 HBASE-5364 Fix source files missing license in 0.92 and trunk (Elliott Clark)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242906 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 20:07:36 +00:00
mbautin af0612f886 [jira] [HBASE-5382] Test that we always cache index and bloom blocks
Summary: This is a unit test that should have been part of HBASE-4683 but was
not committed. The original test was reviewed as part of
https://reviews.facebook.net/D807. Submitting unit test as a separate JIRA and
patch, and extending the scope of the test to also handle the case when block
cache is enabled for the column family.

Test Plan: Run unit tests

Reviewers: JIRA, jdcryans, lhofhansl, Liyin

Reviewed By: jdcryans

CC: jdcryans

Differential Revision: https://reviews.facebook.net/D1695

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242894 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:27:29 +00:00
Doug Meil 9d7d022ec6 hbase-5380. book.xml, comment about KeyValue instances not being split across blocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242878 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:27:42 +00:00
Doug Meil ac8ccdf477 hbase-5378 book.xml - adding new section for coprocessors in Arch/RegionServer
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242870 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 17:48:16 +00:00
Zhihong Yu c6519ca4c7 HBASE-5358 HBaseObjectWritable should be able to serialize/deserialize generic arrays
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242649 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 03:37:32 +00:00
Doug Meil 4aebaffe43 hbase-5367 book.xml - this time, really fixing the default compaction.min.size
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242494 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:56:40 +00:00
Doug Meil 25e0f67da7 hbase-5367. book.xml - minor formatting in Arch/Region/Store compaction description
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:45:06 +00:00
Jonathan Hsieh e0fc9e1382 HBASE-5288 Security source code dirs missing from 0.92.0 release tarballs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242457 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:56:26 +00:00
Doug Meil 34b24a2ab7 hbase-5330. Update to TestCompactSelection unit test for selection SF assertions.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:13:29 +00:00
Doug Meil f49e4780dc hbase-5365. book - Arch/Region/Store adding description of compaction file selection
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242427 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:09:45 +00:00
larsh ff1f0decc4 HBASE-5229 Provide basic building blocks for 'multi-row' local transactions.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242037 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 18:30:37 +00:00
Michael Stack ec7daf9413 HBASE-5221 bin/hbase script doesn't look for Hadoop jars in the right place in trunk layout -- REVERTED
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242027 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 18:11:08 +00:00
Zhihong Yu 7ef8f6e307 HBASE-5298 Add thrift metrics to thrift2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241974 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 17:03:11 +00:00
Zhihong Yu 10f108630f HBASE-5345 CheckAndPut doesn't work when value is empty byte[] (Evert Arckens)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241972 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 16:55:16 +00:00
Michael Stack 50f3e412a9 HBASE-5221 bin/hbase script doesn't look for Hadoop jars in the right place in trunk layout
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241952 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 15:56:48 +00:00
Michael Stack 38d28bccc6 HBASE-5348 Constraint configuration loaded with bloat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241704 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:49:37 +00:00
Zhihong Yu 802d7c8674 HBASE-3850 Log more details when a scanner lease expires (Darren Haas)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241667 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:23:45 +00:00
Zhihong Yu b4f585e6a3 HBASE-5267 Add a configuration to disable the slab cache by default (Li Pi)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241644 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 21:41:45 +00:00
Michael Stack e8b6a99539 Added a sponsors page linked from front page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1241587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 19:57:58 +00:00
Zhihong Yu a374cc120a HBASE-5318 Support Eclipse Indigo (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1240446 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 02:59:39 +00:00
larsh 8117cee5e8 REVERT HBASE-5318 Support Eclipse Indigo
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1240328 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 20:08:53 +00:00
Zhihong Yu a2887a9bb7 HBASE-4658 Put attributes are not exposed via the ThriftServer (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1240294 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 19:02:13 +00:00
larsh bd390004fb HBASE-5318 Support Eclipse Indigo (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239940 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 23:52:28 +00:00
larsh df4a9d4ad3 HBASE-5304 Pluggable split key policy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239909 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 23:00:06 +00:00
Zhihong Yu 4b4904a77c HBASE-5186 Add metrics to ThriftServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239737 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 17:30:13 +00:00
larsh be722211fd HBASE-5266 Add documentation for ColumnRangeFilter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239399 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:27:43 +00:00
Zhihong Yu 8a6d0fbca1 HBASE-5212 Fix test TestTableMapReduce against 0.23 (Ted and Gregory)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:56:34 +00:00
Zhihong Yu 6bed2d07da HBASE-5295 Improve the Thrift API to switch on/off writing to wal for Mutations (Dhruba)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239241 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 18:04:06 +00:00
Zhihong Yu 457d51bec5 HBASE-5310 HConnectionManager server cache key enhancement (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239220 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:34:04 +00:00
Zhihong Yu 4b698e776d HBASE-5283 Request counters may become negative for heavily loaded regions (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1239157 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 14:56:20 +00:00
Michael Stack a87e1ad952 HBASE-5307 Unable to gracefully decommission a node because of script error
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238878 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:28:46 +00:00
Zhihong Yu e5a38bed76 HBASE-5256 Use WritableUtils.readVInt() in RegionLoad.readFields() (Mubarak)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238873 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:12:36 +00:00
Michael Stack 11446b1bd6 HBASE-5286 Added pointer to Lars Hofhansl's blog describing his attempt at adding a '...column prefix delete marker'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238843 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 22:44:20 +00:00
Zhihong Yu b246e68435 HBASE-5259 Normalize the RegionLocation in TableInputFormat by the reverse DNS lookup (Liyin Tang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238774 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 19:52:58 +00:00
Zhihong Yu 650b321396 HBASE-5290 [FindBugs] Synchronization on boxed primitive (Ben West)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238693 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 16:52:51 +00:00
Zhihong Yu 093c7203e8 HBASE-5297 Update metrics numOpenConnections and callQueueLen directly in HBaseServer (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1238114 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 00:37:29 +00:00
Doug Meil fa1fe609a5 ops_mgt.xml - updating metrics descriptions (block cache, fs latency)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1237994 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 20:46:05 +00:00
mbautin e06a31d62b [jira] [HBASE-5274] Filter out expired scanners on compaction as well
Summary: This is a followup for D1017 to make it similar to D909 (89-fb). The
fix for 89-fb used the TTL-based scanner filtering logic on both normal scanners
and compactions, while the trunk fix D1017 did not. This is just the delta
between the two diffs that brings filtering expired store files on compaction to
trunk.

Test Plan: Unit tests

Reviewers: Liyin, JIRA, lhofhansl, Kannan

Reviewed By: Liyin

CC: Liyin, tedyu, Kannan, mbautin, lhofhansl

Differential Revision: https://reviews.facebook.net/D1473

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236483 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 01:23:37 +00:00
Jonathan Hsieh 36788d1cc2 HBASE-5282 Possible file handle leak with truncated HLog file
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236445 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:30:47 +00:00
Zhihong Yu da1443d90a HBASE-5271 Result.getValue and Result.getColumnLatest return the wrong column (Ghais Issa)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:51:33 +00:00
mbautin ec1c804fc1 [jira] [HBASE-4218] HFile data block encoding framework and delta encoding
implementation (Jacek Midgal, Mikhail Bautin)

Summary:

Adding a framework that allows to "encode" keys in an HFile data block. We
support two modes of encoding: (1) both on disk and in cache, and (2) in cache
only. This is distinct from compression that is already being done in HBase,
e.g. GZ or LZO. When data block encoding is enabled, we store blocks in cache
in an uncompressed but encoded form. This allows to fit more blocks in cache
and reduce the number of disk reads.

The most common example of data block encoding is delta encoding, where we take
advantage of the fact that HFile keys are sorted and share a lot of common
prefixes, and only store the delta between each pair of consecutive keys.
Initial encoding algorithms implemented are DIFF, FAST_DIFF, and PREFIX.

This is based on the delta encoding patch developed by Jacek Midgal during his
2011 summer internship at Facebook. The original patch is available here:
https://reviews.apache.org/r/2308/diff/.

Test Plan: Unit tests. Distributed load test on a five-node cluster.

Reviewers: JIRA, tedyu, stack, nspiegelberg, Kannan

Reviewed By: Kannan

CC: tedyu, todd, mbautin, stack, Kannan, mcorgan, gqchen

Differential Revision: https://reviews.facebook.net/D447



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1236031 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 02:58:57 +00:00
mbautin 0d0b5b4dcc adding mbautin as a developer to pom.xml
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235922 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 20:35:02 +00:00
Michael Stack 4a8b0e9059 HBASE-5278 HBase shell script refers to removed 'migrate' functionality
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235884 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 19:47:13 +00:00
mbautin 07dbe903de HBASE-5230 : ensure that compactions do not cache-on-write data blocks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1235882 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 19:41:07 +00:00