Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,200 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

4200 Commits

Author SHA1 Message Date
larsh a9253a7104 HBASE-4805 Allow better control of resource consumption in HTable (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203428 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 23:58:57 +00:00
Kannan Muthukkaruppan 3039d61014 HBASE-4628 [jira] Enhance Table Create Presplit Functionality within the HBase 
Shell

Summary:
HBase shell can algorithmically split a new table at creation

This change adds optional arguments to the HBase shell's create command
to split a table into a specified number of regions using a specified
splitting algorithm as defined by RegionSplitter.

Currently, we allow the user to presplit in the HBase shell by explicitly
listing the startkey of all the region shards that they want.  Instead, we
should provide the RegionSplitter functionality of choosing a split algorithm,
followed by the number of splits that they want.

Test Plan:
Created tables with and without splits using the shell; also attampted
to give incorrect arguments to shell create command.

Reviewers: nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, lhofhansl

Differential Revision: 429

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203413 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 23:01:59 +00:00
Kannan Muthukkaruppan 7dbde6f932 HBASE-4761 Add Developer Debug Options to HBase Config 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203409 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 22:53:42 +00:00
karthik 685fe23a00 [jira] [HBASE-4771] List HBase Region availability 
Summary:
One critical feature necessary to completely automate
production pushes is the ability to recognize when HBase has
successfully made all regions available for reads/writes (step prior to
HBCK).  Created script to display region availability status and stall
until all onlined regions are actually available.

Test Plan: - bin/hbase org.jruby.Main bin/region_status.rb wait

Reviewers: stack, Kannan, JIRA

Reviewed By: stack

CC: stack

Differential Revision: 399

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203396 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 22:20:41 +00:00
Michael Stack c9d5a838d0 HBASE-4799 Catalog Janitor logic bug causes region leackage 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203308 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 18:16:30 +00:00
Todd Lipcon 9c6b3b375d HBASE-4806 Fix logging message in HbaseObjectWritable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203284 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 17:18:03 +00:00
Zhihong Yu ac6e9a1125 HBASE-4796 Race between SplitRegionHandlers for the same region kills the master 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202935 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 23:40:29 +00:00
Michael Stack f67a900446 HBASE-4804 Minor Dyslexia in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202933 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 23:24:17 +00:00
Michael Stack e84b62cbb0 HBASE-4801 alter_status shell prints sensible message at completion 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202914 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 22:46:14 +00:00
larsh 99724ae460 HBASE-4800 Result.compareResults is incorrect (James Taylor and Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202827 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 18:38:12 +00:00
Michael Stack 207ca9895f HBASE-4795 Fix TestHFileBlock when running on a 32-bit JVM 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202518 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 03:04:10 +00:00
Jean-Daniel Cryans 7c14e465ec Adding the 0.92 entry for HBASE-4792 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202498 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 01:17:35 +00:00
Zhihong Yu 1ae05e5dd3 HBASE-4793 HBase shell still using deprecated methods removed in HBASE-4436 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202493 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 01:04:45 +00:00
Jean-Daniel Cryans eb5e28e4e1 HBASE-4792 SplitRegionHandler doesn't care if it deletes the znode or not, 
leaves the parent region stuck offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202487 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 00:42:52 +00:00
Zhihong Yu 0ab2272833 HBASE-4768 Addendum removes unnecessary assertion 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202419 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 20:57:35 +00:00
Gary Helmling 3f423daca0 HBASE-4784 Handle void return types in CoprocessorProtocol methods 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202336 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 17:55:48 +00:00
Zhihong Yu 48c16d1d66 HBASE-4790 Occasional TestDistributedLogSplitting failure (Jinchao) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202312 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 17:15:04 +00:00
Zhihong Yu ed36c7cbda HBASE-4764 Addendum add HLogUtilsForTests.java 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202124 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 11:00:38 +00:00
Michael Stack dd9c07f1c9 HBASE-4764 naming errors for TestHLogUtils and SoftValueSortedMapTest 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202046 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 05:18:19 +00:00
Doug Meil eaada4b531 HBASE-4788. Adding MR to file example. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202031 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 04:10:38 +00:00
Nicolas Spiegelberg 548a74e9b4 HBASE-4768 Per-(table, columnFamily) metrics with configurable table name inclusion 
Summary: This is an initial version of an HBase trunk diff for per-table/CF
metrics (see JIRA for details). Unit tests mostly pass -- need to look into
TestDistributedLogSplitting. Also still doing cluster testing.

Test Plan: Unit tests, single-node cluster, dev cluster. Need to try bulk-load
map-reduce jobs as well. Observe metrics through JMX.

Reviewers: jgray, nspiegelberg, stack, tedyu, todd, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, Liyin, mbautin, tedyu

Differential Revision: 363

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201994 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 01:26:05 +00:00
Doug Meil dab526e492 HBASE-4786 book.xml,performance.xml adding and reorg of schema info 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201992 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 01:14:10 +00:00
Michael Stack 1c9f356fca HBASE-4780 Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201954 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 22:50:10 +00:00
Nicolas Spiegelberg 6ebf318735 HBASE-4778 Don't ignore corrupt StoreFiles when opening a region 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201940 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 22:29:03 +00:00
Zhihong Yu 4664a4bab7 HBASE-4704 Differential Revision: #117 A JRuby script for identifying active master 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201828 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 19:10:06 +00:00
Zhihong Yu 7d23c9afb1 HBASE-4752 Don't create an unnecessary LinkedList when evicting from the BlockCache 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201516 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-13 21:17:35 +00:00
Michael Stack 87c500ccf3 HBASE-4775 Remove -ea from all but tests; enable it if you need it testing 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201501 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-13 20:14:34 +00:00
Zhihong Yu 9cdde5ab68 HBASE-4779 TestHTablePool, TestScanWithBloomError, TestRegionSplitCalculator are 
not tagged and TestPoolMap should not use TestSuite (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201442 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-13 15:46:44 +00:00
Michael Stack 94a06fb391 HBASE-4777 Write back to client 'incompatible' if we show up with wrong version 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201400 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-13 04:56:26 +00:00
Zhihong Yu 62b5c04786 HBASE-4478 Improve AssignmentManager.handleRegion so that it can process certain ZK state 
in the case of RS offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201186 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-12 04:40:41 +00:00
Michael Stack 3e37baa9f3 HBASE-4577 Region server reports storefileSizeMB bigger than storefileUncompressedSizeMB 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201106 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 23:40:29 +00:00
Michael Stack 902cd7e192 HBASE-4511 There is data loss when master failovers 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201104 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 23:36:47 +00:00
Michael Stack 7671b5d49d HBASE-4723 Loads of NotAllMetaRegionsOnlineException traces when starting the master 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201097 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 23:21:07 +00:00
larsh 571e8f8520 HBASE-3433 Remove the KV copy of every KV in Scan; introduced by HBASE-3232 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201094 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 23:19:28 +00:00
Michael Stack a51931de2d HBASE-4734 [bulk load] Warn if bulk load directory contained no files 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200958 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 17:09:12 +00:00
Nicolas Spiegelberg 4206b1e860 [debug] Have NSFRE messages also display the row associated with the region request. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200691 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 02:11:03 +00:00
Nicolas Spiegelberg b45fd73378 HBASE-4769 Abort RegionServer Immediately on OOME 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200662 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 00:33:46 +00:00
Michael Stack 45a629cd76 HBASE-4741 Online schema change doesn't return errors 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200660 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 00:24:04 +00:00
Michael Stack 274e7c2743 HBASE-4288 "Server not running" exception during meta verification causes RS abort 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200648 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 23:58:06 +00:00
Nicolas Spiegelberg 04afdf9633 HBASE-3690 Option to Exclude Bulk Import Files from Minor Compaction 
Summary:
We ran an incremental scrape with HFileOutputFormat and
encountered major compaction storms. This is caused by the bug in
HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We
realized that a quicker solution for avoiding these compaction storms is
to simply exclude bulk import files from minor compactions and let them
only be handled by time-based major compactions. Add with functionality
along with a config option to enable it.

Rewrote this feature to be done on a per-bulkload basis.

Test Plan:
 - mvn test -Dtest=TestHFileOutputFormat

DiffCamp Revision:

Reviewers: stack, Kannan, JIRA, dhruba

Reviewed By: stack

CC: dhruba, lhofhansl, nspiegelberg, stack

Differential Revision: 357

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200621 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 23:31:13 +00:00
Nicolas Spiegelberg 6c57076f7e HBASE-4765 Enhance HLog Metrics 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200619 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 23:29:16 +00:00
Andrew Kyle Purtell 373c98b0df HBASE-4554 Allow set/unset coprocessor table attributes from shell (Mingjie Lai) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200436 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 17:15:20 +00:00
Zhihong Yu 076030550f HBASE-4737 Addendum removes unnecessary print 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200138 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 04:18:42 +00:00
Zhihong Yu f5944d1a72 HBASE-4737 Addendum tags SmallTests 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200012 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 22:37:32 +00:00
Nicolas Spiegelberg e896f6d400 Upgrade nextKeyValue() error message from debug to info to highlight MR generation failures 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199605 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 03:48:11 +00:00
Zhihong Yu 1f2aadb80d HBASE-4737 Categorize the tests into small/medium/large; allow small tests to be run 
in parallel within a single JVM (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199604 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 03:38:10 +00:00
Michael Stack 007e7dc183 HBASE-4759 Migrate from JUnit 4.8.2 to JUnit 4.10 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199476 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 21:51:51 +00:00
Michael Stack ea5f9bf29a HBASE-4756 Enable tab-completion in HBase shell 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199102 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 04:37:27 +00:00
Zhihong Yu 78ebe94d05 HBASE-4740 [bulk load] the HBASE-4552 API can't tell if errors on region server are recoverable 
(Jonathan Hsieh)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199017 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 23:51:56 +00:00
Zhihong Yu d54b1fdee7 HBASE-4754 FSTableDescriptors.getTableInfoPath() should handle FileNotFoundException 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198953 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 21:40:28 +00:00