Commit Graph

4298 Commits

Author SHA1 Message Date
Kannan Muthukkaruppan 7dbde6f932 HBASE-4761 Add Developer Debug Options to HBase Config
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203409 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 22:53:42 +00:00
karthik 685fe23a00 [jira] [HBASE-4771] List HBase Region availability
Summary:
One critical feature necessary to completely automate
production pushes is the ability to recognize when HBase has
successfully made all regions available for reads/writes (step prior to
HBCK).  Created script to display region availability status and stall
until all onlined regions are actually available.

Test Plan: - bin/hbase org.jruby.Main bin/region_status.rb wait

Reviewers: stack, Kannan, JIRA

Reviewed By: stack

CC: stack

Differential Revision: 399

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203396 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 22:20:41 +00:00
Michael Stack c9d5a838d0 HBASE-4799 Catalog Janitor logic bug causes region leackage
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203308 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 18:16:30 +00:00
Todd Lipcon 9c6b3b375d HBASE-4806 Fix logging message in HbaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203284 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 17:18:03 +00:00
Zhihong Yu ac6e9a1125 HBASE-4796 Race between SplitRegionHandlers for the same region kills the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202935 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 23:40:29 +00:00
Michael Stack f67a900446 HBASE-4804 Minor Dyslexia in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202933 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 23:24:17 +00:00
Michael Stack e84b62cbb0 HBASE-4801 alter_status shell prints sensible message at completion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202914 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 22:46:14 +00:00
larsh 99724ae460 HBASE-4800 Result.compareResults is incorrect (James Taylor and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202827 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 18:38:12 +00:00
Michael Stack 207ca9895f HBASE-4795 Fix TestHFileBlock when running on a 32-bit JVM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202518 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 03:04:10 +00:00
Jean-Daniel Cryans 7c14e465ec Adding the 0.92 entry for HBASE-4792
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202498 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 01:17:35 +00:00
Zhihong Yu 1ae05e5dd3 HBASE-4793 HBase shell still using deprecated methods removed in HBASE-4436
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202493 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 01:04:45 +00:00
Jean-Daniel Cryans eb5e28e4e1 HBASE-4792 SplitRegionHandler doesn't care if it deletes the znode or not,
leaves the parent region stuck offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202487 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 00:42:52 +00:00
Zhihong Yu 0ab2272833 HBASE-4768 Addendum removes unnecessary assertion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202419 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 20:57:35 +00:00
Gary Helmling 3f423daca0 HBASE-4784 Handle void return types in CoprocessorProtocol methods
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202336 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 17:55:48 +00:00
Zhihong Yu 48c16d1d66 HBASE-4790 Occasional TestDistributedLogSplitting failure (Jinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202312 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 17:15:04 +00:00
Zhihong Yu ed36c7cbda HBASE-4764 Addendum add HLogUtilsForTests.java
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202124 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 11:00:38 +00:00
Michael Stack dd9c07f1c9 HBASE-4764 naming errors for TestHLogUtils and SoftValueSortedMapTest
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202046 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 05:18:19 +00:00
Doug Meil eaada4b531 HBASE-4788. Adding MR to file example.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202031 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 04:10:38 +00:00
Nicolas Spiegelberg 548a74e9b4 HBASE-4768 Per-(table, columnFamily) metrics with configurable table name inclusion
Summary: This is an initial version of an HBase trunk diff for per-table/CF
metrics (see JIRA for details). Unit tests mostly pass -- need to look into
TestDistributedLogSplitting. Also still doing cluster testing.

Test Plan: Unit tests, single-node cluster, dev cluster. Need to try bulk-load
map-reduce jobs as well. Observe metrics through JMX.

Reviewers: jgray, nspiegelberg, stack, tedyu, todd, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, Liyin, mbautin, tedyu

Differential Revision: 363

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201994 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:26:05 +00:00
Doug Meil dab526e492 HBASE-4786 book.xml,performance.xml adding and reorg of schema info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201992 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:14:10 +00:00
Michael Stack 1c9f356fca HBASE-4780 Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201954 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:50:10 +00:00
Nicolas Spiegelberg 6ebf318735 HBASE-4778 Don't ignore corrupt StoreFiles when opening a region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201940 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:29:03 +00:00
Zhihong Yu 4664a4bab7 HBASE-4704 Differential Revision: #117 A JRuby script for identifying active master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201828 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 19:10:06 +00:00
Zhihong Yu 7d23c9afb1 HBASE-4752 Don't create an unnecessary LinkedList when evicting from the BlockCache
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201516 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 21:17:35 +00:00
Michael Stack 87c500ccf3 HBASE-4775 Remove -ea from all but tests; enable it if you need it testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201501 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 20:14:34 +00:00
Zhihong Yu 9cdde5ab68 HBASE-4779 TestHTablePool, TestScanWithBloomError, TestRegionSplitCalculator are
not tagged and TestPoolMap should not use TestSuite (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201442 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 15:46:44 +00:00
Michael Stack 94a06fb391 HBASE-4777 Write back to client 'incompatible' if we show up with wrong version
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201400 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 04:56:26 +00:00
Zhihong Yu 62b5c04786 HBASE-4478 Improve AssignmentManager.handleRegion so that it can process certain ZK state
in the case of RS offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201186 13f79535-47bb-0310-9956-ffa450edef68
2011-11-12 04:40:41 +00:00
Michael Stack 3e37baa9f3 HBASE-4577 Region server reports storefileSizeMB bigger than storefileUncompressedSizeMB
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201106 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:40:29 +00:00
Michael Stack 902cd7e192 HBASE-4511 There is data loss when master failovers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201104 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:36:47 +00:00
Michael Stack 7671b5d49d HBASE-4723 Loads of NotAllMetaRegionsOnlineException traces when starting the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201097 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:21:07 +00:00
larsh 571e8f8520 HBASE-3433 Remove the KV copy of every KV in Scan; introduced by HBASE-3232
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201094 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:19:28 +00:00
Michael Stack a51931de2d HBASE-4734 [bulk load] Warn if bulk load directory contained no files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200958 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 17:09:12 +00:00
Nicolas Spiegelberg 4206b1e860 [debug] Have NSFRE messages also display the row associated with the region request.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200691 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 02:11:03 +00:00
Nicolas Spiegelberg b45fd73378 HBASE-4769 Abort RegionServer Immediately on OOME
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200662 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:33:46 +00:00
Michael Stack 45a629cd76 HBASE-4741 Online schema change doesn't return errors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200660 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:24:04 +00:00
Michael Stack 274e7c2743 HBASE-4288 "Server not running" exception during meta verification causes RS abort
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200648 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:58:06 +00:00
Nicolas Spiegelberg 04afdf9633 HBASE-3690 Option to Exclude Bulk Import Files from Minor Compaction
Summary:
We ran an incremental scrape with HFileOutputFormat and
encountered major compaction storms. This is caused by the bug in
HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We
realized that a quicker solution for avoiding these compaction storms is
to simply exclude bulk import files from minor compactions and let them
only be handled by time-based major compactions. Add with functionality
along with a config option to enable it.

Rewrote this feature to be done on a per-bulkload basis.

Test Plan:
 - mvn test -Dtest=TestHFileOutputFormat

DiffCamp Revision:

Reviewers: stack, Kannan, JIRA, dhruba

Reviewed By: stack

CC: dhruba, lhofhansl, nspiegelberg, stack

Differential Revision: 357

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200621 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:31:13 +00:00
Nicolas Spiegelberg 6c57076f7e HBASE-4765 Enhance HLog Metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200619 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:29:16 +00:00
Andrew Kyle Purtell 373c98b0df HBASE-4554 Allow set/unset coprocessor table attributes from shell (Mingjie Lai)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200436 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 17:15:20 +00:00
Zhihong Yu 076030550f HBASE-4737 Addendum removes unnecessary print
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200138 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 04:18:42 +00:00
Zhihong Yu f5944d1a72 HBASE-4737 Addendum tags SmallTests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200012 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 22:37:32 +00:00
Nicolas Spiegelberg e896f6d400 Upgrade nextKeyValue() error message from debug to info to highlight MR generation failures
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199605 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 03:48:11 +00:00
Zhihong Yu 1f2aadb80d HBASE-4737 Categorize the tests into small/medium/large; allow small tests to be run
in parallel within a single JVM (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199604 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 03:38:10 +00:00
Michael Stack 007e7dc183 HBASE-4759 Migrate from JUnit 4.8.2 to JUnit 4.10
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199476 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 21:51:51 +00:00
Michael Stack ea5f9bf29a HBASE-4756 Enable tab-completion in HBase shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199102 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 04:37:27 +00:00
Zhihong Yu 78ebe94d05 HBASE-4740 [bulk load] the HBASE-4552 API can't tell if errors on region server are recoverable
(Jonathan Hsieh)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199017 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 23:51:56 +00:00
Zhihong Yu d54b1fdee7 HBASE-4754 FSTableDescriptors.getTableInfoPath() should handle FileNotFoundException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198953 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 21:40:28 +00:00
Zhihong Yu f7e925c8d3 HBASE-4746 Use a random ZK client port in unit tests so we can run them in parallel
(Mikhail Bautin)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198856 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 18:22:57 +00:00
Michael Stack 02f6104dc2 HBASE-4753 org.apache.hadoop.hbase.regionserver.TestHRegionInfo#testGetSetOfHTD throws NPE on trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198581 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 22:47:17 +00:00