Commit Graph

4480 Commits

Author SHA1 Message Date
Nicolas Spiegelberg 548a74e9b4 HBASE-4768 Per-(table, columnFamily) metrics with configurable table name inclusion
Summary: This is an initial version of an HBase trunk diff for per-table/CF
metrics (see JIRA for details). Unit tests mostly pass -- need to look into
TestDistributedLogSplitting. Also still doing cluster testing.

Test Plan: Unit tests, single-node cluster, dev cluster. Need to try bulk-load
map-reduce jobs as well. Observe metrics through JMX.

Reviewers: jgray, nspiegelberg, stack, tedyu, todd, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, Liyin, mbautin, tedyu

Differential Revision: 363

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201994 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:26:05 +00:00
Doug Meil dab526e492 HBASE-4786 book.xml,performance.xml adding and reorg of schema info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201992 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:14:10 +00:00
Michael Stack 1c9f356fca HBASE-4780 Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201954 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:50:10 +00:00
Nicolas Spiegelberg 6ebf318735 HBASE-4778 Don't ignore corrupt StoreFiles when opening a region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201940 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:29:03 +00:00
Zhihong Yu 4664a4bab7 HBASE-4704 Differential Revision: #117 A JRuby script for identifying active master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201828 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 19:10:06 +00:00
Zhihong Yu 7d23c9afb1 HBASE-4752 Don't create an unnecessary LinkedList when evicting from the BlockCache
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201516 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 21:17:35 +00:00
Michael Stack 87c500ccf3 HBASE-4775 Remove -ea from all but tests; enable it if you need it testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201501 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 20:14:34 +00:00
Zhihong Yu 9cdde5ab68 HBASE-4779 TestHTablePool, TestScanWithBloomError, TestRegionSplitCalculator are
not tagged and TestPoolMap should not use TestSuite (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201442 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 15:46:44 +00:00
Michael Stack 94a06fb391 HBASE-4777 Write back to client 'incompatible' if we show up with wrong version
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201400 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 04:56:26 +00:00
Zhihong Yu 62b5c04786 HBASE-4478 Improve AssignmentManager.handleRegion so that it can process certain ZK state
in the case of RS offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201186 13f79535-47bb-0310-9956-ffa450edef68
2011-11-12 04:40:41 +00:00
Michael Stack 3e37baa9f3 HBASE-4577 Region server reports storefileSizeMB bigger than storefileUncompressedSizeMB
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201106 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:40:29 +00:00
Michael Stack 902cd7e192 HBASE-4511 There is data loss when master failovers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201104 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:36:47 +00:00
Michael Stack 7671b5d49d HBASE-4723 Loads of NotAllMetaRegionsOnlineException traces when starting the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201097 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:21:07 +00:00
larsh 571e8f8520 HBASE-3433 Remove the KV copy of every KV in Scan; introduced by HBASE-3232
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201094 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:19:28 +00:00
Michael Stack a51931de2d HBASE-4734 [bulk load] Warn if bulk load directory contained no files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200958 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 17:09:12 +00:00
Nicolas Spiegelberg 4206b1e860 [debug] Have NSFRE messages also display the row associated with the region request.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200691 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 02:11:03 +00:00
Nicolas Spiegelberg b45fd73378 HBASE-4769 Abort RegionServer Immediately on OOME
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200662 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:33:46 +00:00
Michael Stack 45a629cd76 HBASE-4741 Online schema change doesn't return errors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200660 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:24:04 +00:00
Michael Stack 274e7c2743 HBASE-4288 "Server not running" exception during meta verification causes RS abort
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200648 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:58:06 +00:00
Nicolas Spiegelberg 04afdf9633 HBASE-3690 Option to Exclude Bulk Import Files from Minor Compaction
Summary:
We ran an incremental scrape with HFileOutputFormat and
encountered major compaction storms. This is caused by the bug in
HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We
realized that a quicker solution for avoiding these compaction storms is
to simply exclude bulk import files from minor compactions and let them
only be handled by time-based major compactions. Add with functionality
along with a config option to enable it.

Rewrote this feature to be done on a per-bulkload basis.

Test Plan:
 - mvn test -Dtest=TestHFileOutputFormat

DiffCamp Revision:

Reviewers: stack, Kannan, JIRA, dhruba

Reviewed By: stack

CC: dhruba, lhofhansl, nspiegelberg, stack

Differential Revision: 357

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200621 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:31:13 +00:00
Nicolas Spiegelberg 6c57076f7e HBASE-4765 Enhance HLog Metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200619 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:29:16 +00:00
Andrew Kyle Purtell 373c98b0df HBASE-4554 Allow set/unset coprocessor table attributes from shell (Mingjie Lai)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200436 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 17:15:20 +00:00
Zhihong Yu 076030550f HBASE-4737 Addendum removes unnecessary print
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200138 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 04:18:42 +00:00
Zhihong Yu f5944d1a72 HBASE-4737 Addendum tags SmallTests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200012 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 22:37:32 +00:00
Nicolas Spiegelberg e896f6d400 Upgrade nextKeyValue() error message from debug to info to highlight MR generation failures
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199605 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 03:48:11 +00:00
Zhihong Yu 1f2aadb80d HBASE-4737 Categorize the tests into small/medium/large; allow small tests to be run
in parallel within a single JVM (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199604 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 03:38:10 +00:00
Michael Stack 007e7dc183 HBASE-4759 Migrate from JUnit 4.8.2 to JUnit 4.10
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199476 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 21:51:51 +00:00
Michael Stack ea5f9bf29a HBASE-4756 Enable tab-completion in HBase shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199102 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 04:37:27 +00:00
Zhihong Yu 78ebe94d05 HBASE-4740 [bulk load] the HBASE-4552 API can't tell if errors on region server are recoverable
(Jonathan Hsieh)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1199017 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 23:51:56 +00:00
Zhihong Yu d54b1fdee7 HBASE-4754 FSTableDescriptors.getTableInfoPath() should handle FileNotFoundException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198953 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 21:40:28 +00:00
Zhihong Yu f7e925c8d3 HBASE-4746 Use a random ZK client port in unit tests so we can run them in parallel
(Mikhail Bautin)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198856 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 18:22:57 +00:00
Michael Stack 02f6104dc2 HBASE-4753 org.apache.hadoop.hbase.regionserver.TestHRegionInfo#testGetSetOfHTD throws NPE on trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198581 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 22:47:17 +00:00
Michael Stack 7d8d42d01b HBASE-3939 Some crossports of Hadoop IPC fixes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198573 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 21:48:31 +00:00
Michael Stack b508f52998 HBASE-4751 Make TestAdmin#testEnableTableRoundRobinAssignment friendly to concurrent tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198013 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 18:53:49 +00:00
Michael Stack 7052e59b38 HBASE-4749 TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS occasionally fails
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1198007 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 18:45:24 +00:00
Zhihong Yu 2ee75203ed HBASE-4747 Addendum upgrade maven failsafe
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197972 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 15:38:31 +00:00
Andrew Kyle Purtell c775d60de6 HBASE-4745 LRU statistics thread should be a daemon
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197864 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 01:48:45 +00:00
Michael Stack 56e19a72dc HBASE-4725 NPE in AM#updateTimers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197815 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 23:10:08 +00:00
Michael Stack bb0c9a11d8 HBASE-4553 The update of .tableinfo is not atomic; we remove then rename
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197812 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 23:03:29 +00:00
Zhihong Yu c824695af9 HBASE-4747 Upgrade maven surefire plugin to 2.10
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197785 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 21:22:55 +00:00
Michael Stack 2ce1d7c97c HBASE-4722 TestGlobalMemStoreSize has started failing; ADDENDUM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197349 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 23:39:48 +00:00
Doug Meil ae6af9e630 HBASE-4743 book.xml, performance.xml, troubleshooting.xml scan info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197315 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 21:22:57 +00:00
Michael Stack 92b57170e9 HBASE-4298 Support to drain RS nodes through ZK
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1197256 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 18:34:41 +00:00
Gary Helmling a9992a53c4 HBASE-4518 TestServerCustomProtocol fails intermittently
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196952 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 05:57:36 +00:00
Michael Stack 09225cf9b6 HBASE-4480 Testing script to simplify local testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196939 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 04:11:46 +00:00
Michael Stack 0c07e905a2 HBASE-4480 Testing script to simplify local testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196938 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 04:08:42 +00:00
Michael Stack f24e30f5e7 HBASE-4719 HBase script assumes pre-Hadoop 0.21 layout of jar files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196936 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 04:05:37 +00:00
Doug Meil 5eaea899e3 HBASE-4736 troubleshooting.xml, xrefs to Arch chapter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196925 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 03:05:37 +00:00
Zhihong Yu 76060691bb HBASE-4609 ThriftServer.getRegionInfo() is expecting old ServerName format, need to
use new Addressing class instead (Jonathan Gray)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196873 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 23:48:22 +00:00
Doug Meil c61f0f296f HBASE-4735 book.xml, schema design keysize code example
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1196860 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 23:26:30 +00:00