Commit Graph

4510 Commits

Author SHA1 Message Date
Michael Stack c42e7e1028 HBASE-4815 Disable online altering by default, create a config for it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203916 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 00:26:59 +00:00
Gary Helmling cc7e469310 HBASE-3025 Security: coprocessor based access control
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203909 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 00:15:27 +00:00
Gary Helmling a2de91f85b Amend HBASE-2742 Fix intermittent TestZKLeaderManager failure
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203841 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 21:08:38 +00:00
Michael Stack b5f5e2aeeb HBASE-4816 Regionserver wouldn't go down because split happened exactly at same time we issued bulk user region close call on our way out
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203814 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 20:01:30 +00:00
Michael Stack 8df0e84cf7 HBASE-4819 TestShell broke in trunk; typo
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203788 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 18:45:51 +00:00
Gary Helmling e0e0d94f97 HBASE-2742 Provide strong authentication with a secure RPC engine
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203515 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 07:34:43 +00:00
Nicolas Spiegelberg e7fb30c371 HBASE-4544 change RWCC to MVCC
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203468 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:37 +00:00
Nicolas Spiegelberg 1e68440431 HBASE-4594 Fix maxVersions when scanning a file with a TS > read point
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203467 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:33 +00:00
Nicolas Spiegelberg 619d1a327e HBASE-4485 Eliminate window of missing Data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203466 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:28 +00:00
Nicolas Spiegelberg d116edef93 HBASE-2856 Cross Column Family Read Atomicity
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203465 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 02:19:24 +00:00
larsh a9253a7104 HBASE-4805 Allow better control of resource consumption in HTable (Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203428 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 23:58:57 +00:00
Kannan Muthukkaruppan 3039d61014 HBASE-4628 [jira] Enhance Table Create Presplit Functionality within the HBase
Shell

Summary:
HBase shell can algorithmically split a new table at creation

This change adds optional arguments to the HBase shell's create command
to split a table into a specified number of regions using a specified
splitting algorithm as defined by RegionSplitter.

Currently, we allow the user to presplit in the HBase shell by explicitly
listing the startkey of all the region shards that they want.  Instead, we
should provide the RegionSplitter functionality of choosing a split algorithm,
followed by the number of splits that they want.

Test Plan:
Created tables with and without splits using the shell; also attampted
to give incorrect arguments to shell create command.

Reviewers: nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, lhofhansl

Differential Revision: 429

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203413 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 23:01:59 +00:00
Kannan Muthukkaruppan 7dbde6f932 HBASE-4761 Add Developer Debug Options to HBase Config
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203409 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 22:53:42 +00:00
karthik 685fe23a00 [jira] [HBASE-4771] List HBase Region availability
Summary:
One critical feature necessary to completely automate
production pushes is the ability to recognize when HBase has
successfully made all regions available for reads/writes (step prior to
HBCK).  Created script to display region availability status and stall
until all onlined regions are actually available.

Test Plan: - bin/hbase org.jruby.Main bin/region_status.rb wait

Reviewers: stack, Kannan, JIRA

Reviewed By: stack

CC: stack

Differential Revision: 399

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203396 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 22:20:41 +00:00
Michael Stack c9d5a838d0 HBASE-4799 Catalog Janitor logic bug causes region leackage
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203308 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 18:16:30 +00:00
Todd Lipcon 9c6b3b375d HBASE-4806 Fix logging message in HbaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203284 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 17:18:03 +00:00
Zhihong Yu ac6e9a1125 HBASE-4796 Race between SplitRegionHandlers for the same region kills the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202935 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 23:40:29 +00:00
Michael Stack f67a900446 HBASE-4804 Minor Dyslexia in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202933 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 23:24:17 +00:00
Michael Stack e84b62cbb0 HBASE-4801 alter_status shell prints sensible message at completion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202914 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 22:46:14 +00:00
larsh 99724ae460 HBASE-4800 Result.compareResults is incorrect (James Taylor and Lars H)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202827 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 18:38:12 +00:00
Michael Stack 207ca9895f HBASE-4795 Fix TestHFileBlock when running on a 32-bit JVM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202518 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 03:04:10 +00:00
Jean-Daniel Cryans 7c14e465ec Adding the 0.92 entry for HBASE-4792
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202498 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 01:17:35 +00:00
Zhihong Yu 1ae05e5dd3 HBASE-4793 HBase shell still using deprecated methods removed in HBASE-4436
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202493 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 01:04:45 +00:00
Jean-Daniel Cryans eb5e28e4e1 HBASE-4792 SplitRegionHandler doesn't care if it deletes the znode or not,
leaves the parent region stuck offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202487 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 00:42:52 +00:00
Zhihong Yu 0ab2272833 HBASE-4768 Addendum removes unnecessary assertion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202419 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 20:57:35 +00:00
Gary Helmling 3f423daca0 HBASE-4784 Handle void return types in CoprocessorProtocol methods
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202336 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 17:55:48 +00:00
Zhihong Yu 48c16d1d66 HBASE-4790 Occasional TestDistributedLogSplitting failure (Jinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202312 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 17:15:04 +00:00
Zhihong Yu ed36c7cbda HBASE-4764 Addendum add HLogUtilsForTests.java
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202124 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 11:00:38 +00:00
Michael Stack dd9c07f1c9 HBASE-4764 naming errors for TestHLogUtils and SoftValueSortedMapTest
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202046 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 05:18:19 +00:00
Doug Meil eaada4b531 HBASE-4788. Adding MR to file example.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1202031 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 04:10:38 +00:00
Nicolas Spiegelberg 548a74e9b4 HBASE-4768 Per-(table, columnFamily) metrics with configurable table name inclusion
Summary: This is an initial version of an HBase trunk diff for per-table/CF
metrics (see JIRA for details). Unit tests mostly pass -- need to look into
TestDistributedLogSplitting. Also still doing cluster testing.

Test Plan: Unit tests, single-node cluster, dev cluster. Need to try bulk-load
map-reduce jobs as well. Observe metrics through JMX.

Reviewers: jgray, nspiegelberg, stack, tedyu, todd, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, Liyin, mbautin, tedyu

Differential Revision: 363

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201994 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:26:05 +00:00
Doug Meil dab526e492 HBASE-4786 book.xml,performance.xml adding and reorg of schema info
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201992 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:14:10 +00:00
Michael Stack 1c9f356fca HBASE-4780 Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201954 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:50:10 +00:00
Nicolas Spiegelberg 6ebf318735 HBASE-4778 Don't ignore corrupt StoreFiles when opening a region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201940 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:29:03 +00:00
Zhihong Yu 4664a4bab7 HBASE-4704 Differential Revision: #117 A JRuby script for identifying active master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201828 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 19:10:06 +00:00
Zhihong Yu 7d23c9afb1 HBASE-4752 Don't create an unnecessary LinkedList when evicting from the BlockCache
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201516 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 21:17:35 +00:00
Michael Stack 87c500ccf3 HBASE-4775 Remove -ea from all but tests; enable it if you need it testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201501 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 20:14:34 +00:00
Zhihong Yu 9cdde5ab68 HBASE-4779 TestHTablePool, TestScanWithBloomError, TestRegionSplitCalculator are
not tagged and TestPoolMap should not use TestSuite (N Keywal)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201442 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 15:46:44 +00:00
Michael Stack 94a06fb391 HBASE-4777 Write back to client 'incompatible' if we show up with wrong version
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201400 13f79535-47bb-0310-9956-ffa450edef68
2011-11-13 04:56:26 +00:00
Zhihong Yu 62b5c04786 HBASE-4478 Improve AssignmentManager.handleRegion so that it can process certain ZK state
in the case of RS offline


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201186 13f79535-47bb-0310-9956-ffa450edef68
2011-11-12 04:40:41 +00:00
Michael Stack 3e37baa9f3 HBASE-4577 Region server reports storefileSizeMB bigger than storefileUncompressedSizeMB
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201106 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:40:29 +00:00
Michael Stack 902cd7e192 HBASE-4511 There is data loss when master failovers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201104 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:36:47 +00:00
Michael Stack 7671b5d49d HBASE-4723 Loads of NotAllMetaRegionsOnlineException traces when starting the master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201097 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:21:07 +00:00
larsh 571e8f8520 HBASE-3433 Remove the KV copy of every KV in Scan; introduced by HBASE-3232
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1201094 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 23:19:28 +00:00
Michael Stack a51931de2d HBASE-4734 [bulk load] Warn if bulk load directory contained no files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200958 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 17:09:12 +00:00
Nicolas Spiegelberg 4206b1e860 [debug] Have NSFRE messages also display the row associated with the region request.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200691 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 02:11:03 +00:00
Nicolas Spiegelberg b45fd73378 HBASE-4769 Abort RegionServer Immediately on OOME
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200662 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:33:46 +00:00
Michael Stack 45a629cd76 HBASE-4741 Online schema change doesn't return errors
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200660 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 00:24:04 +00:00
Michael Stack 274e7c2743 HBASE-4288 "Server not running" exception during meta verification causes RS abort
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200648 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:58:06 +00:00
Nicolas Spiegelberg 04afdf9633 HBASE-3690 Option to Exclude Bulk Import Files from Minor Compaction
Summary:
We ran an incremental scrape with HFileOutputFormat and
encountered major compaction storms. This is caused by the bug in
HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We
realized that a quicker solution for avoiding these compaction storms is
to simply exclude bulk import files from minor compactions and let them
only be handled by time-based major compactions. Add with functionality
along with a config option to enable it.

Rewrote this feature to be done on a per-bulkload basis.

Test Plan:
 - mvn test -Dtest=TestHFileOutputFormat

DiffCamp Revision:

Reviewers: stack, Kannan, JIRA, dhruba

Reviewed By: stack

CC: dhruba, lhofhansl, nspiegelberg, stack

Differential Revision: 357

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1200621 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 23:31:13 +00:00