Commit Graph

2453 Commits

Author SHA1 Message Date
Michael Stack dff733cd3a HBASE-2692 Master rewrite and cleanup for 0.90
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991421 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 03:16:23 +00:00
Jonathan Gray 04afcd034c HBASE-2944 cannot alter bloomfilter setting for a column family from hbase shell (kannan via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991408 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 00:31:37 +00:00
Michael Stack f521309532 HBASE-2692 Master rewrite and cleanup for 0.90
Patch brought over from 0.90_master_rewrite branch.

Replication test is broke as are some of the rest tests.
Others should be passing.

Some of the changes made in this fat patch:

+ In HLogKey, we now use encoded region name instead of full region name.
+ On split, daughters are opened on the parent's regionserver; let the new balancer
sort them out later when it cuts in.
+ Added move region from one server to another as well as enable/disable balancer.
+ All .META. and -ROOT- edits go via new *Editor and *Reader classes -- no more
do we have 5 different ways of reading and editing .META.
+ Rather than 3 different listeners to hlog each w/ own way of listening, instead
we only have WALObserver now.
+ New Server Interface that has whats common to HMaster and RegionServer. Also
new Services Interface.  This should make test writing cleaner making it so
less need of full cluster context testing anything -- e.g. the new
Interfaces are good w/ Mockito.
+ New balacner that runs on a period and takes into consideration all load
across cluster.
+ Table online/offline is now a flag in ZK; the offline flag on a region is
just used splitting from here on out.
+ Moved fixup of failed add of daughter edits to .META. into shutdown server
recover code (It used to be in basescanner).
+ The heartbeat now sends master the regionserver load and is used sending
shutdown message from master to regionserver ONLY; all other messages are
via zk (HMsg is pretty bare now).
+ No more Worker in RS and ToDoQueue in master.  Both in master and regionserver
we use handlers instead run out of Executors.
+ Client can not send split, flush, compact direct to RS; no longer does
it go via master.
+ Server shutdown runs differently now. All are watching a flag in zk.
When RS notices its gone, it closes all user-space regions. If thats all
it was carrying, then it goes down.  Otherwise, waits on master to send
the shutdown msg via heartbeat.



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991397 13f79535-47bb-0310-9956-ffa450edef68
2010-08-31 23:51:44 +00:00
Ryan Rawson 8586a6238a HBASE-1845 MultiGet, MultiDelete, and MultiPut - batched to the
appropriate region servers (Marc Limotte via Ryan)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991289 13f79535-47bb-0310-9956-ffa450edef68
2010-08-31 18:53:32 +00:00
Jean-Daniel Cryans 7abfcbc22c HBASE-2920 HTable.checkAndPut/Delete doesn't handle null values
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@989296 13f79535-47bb-0310-9956-ffa450edef68
2010-08-25 18:58:43 +00:00
Jean-Daniel Cryans 6e72b3cef3 HBASE-2897 The test wasn't passing because the family wasn't parsed correctly
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@988746 13f79535-47bb-0310-9956-ffa450edef68
2010-08-24 22:32:29 +00:00
Jean-Daniel Cryans bdc56078d4 HBASE-2915 Deadlock between HRegion.ICV and HRegion.close
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@988343 13f79535-47bb-0310-9956-ffa450edef68
2010-08-23 22:47:36 +00:00
Michael Stack 8d91604bc8 HBASE-1660 need a rolling restart script -- forgot to add scripts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@988342 13f79535-47bb-0310-9956-ffa450edef68
2010-08-23 22:36:47 +00:00
Michael Stack 88eb9c5281 HBASE-2931 Do not throw RuntimeExceptions in RPC/HbaseObjectWritable code, ensure we log and rethrow as IOE
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@987952 13f79535-47bb-0310-9956-ffa450edef68
2010-08-22 22:20:16 +00:00
Jean-Daniel Cryans 461c835fc9 HBASE-2922 HLog preparation and cleanup are done under the updateLock,
major slowdown


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@987675 13f79535-47bb-0310-9956-ffa450edef68
2010-08-20 23:44:23 +00:00
Jean-Daniel Cryans 831afacddf HBASE-2924 TestLogRolling doesn't use the right HLog half the time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@987310 13f79535-47bb-0310-9956-ffa450edef68
2010-08-19 20:57:05 +00:00
Jonathan Gray 5e9f6d1528 HBASE-2928 Fault in logic in BinaryPrefixComparator leads to ArrayIndexOutOfBoundsException (pranav via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986969 13f79535-47bb-0310-9956-ffa450edef68
2010-08-18 22:27:58 +00:00
Jean-Daniel Cryans 0e481c64e8 HBASE-2927 BaseScanner gets stale HRegionInfo in some race cases
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986887 13f79535-47bb-0310-9956-ffa450edef68
2010-08-18 19:40:49 +00:00
Jean-Daniel Cryans 625a079b73 HBASE-2923 Deadlock between HRegion.internalFlushCache and close
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986448 13f79535-47bb-0310-9956-ffa450edef68
2010-08-17 18:44:35 +00:00
Michael Stack 4dbf0c9b69 HBASE-2919 initTableReducerJob: Unused method parameter.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986058 13f79535-47bb-0310-9956-ffa450edef68
2010-08-16 17:21:17 +00:00
Ryan Rawson 81df7e7598 Fix build, damn you hudson for not being unicode compatible!
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@985422 13f79535-47bb-0310-9956-ffa450edef68
2010-08-14 01:38:35 +00:00
Ryan Rawson 4784ec1b57 HBASE-1517 Implement inexpensive seek operations in HFile (Pranav via Ryan)
HBASE-2903  ColumnPrefix filtering (Pranav via Ryan)
HBASE-2904  Smart seeking using filters (Pranav via Ryan)



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@985412 13f79535-47bb-0310-9956-ffa450edef68
2010-08-14 00:30:20 +00:00
Jean-Daniel Cryans d80de85a69 HBASE-2909 SoftValueSortedMap is broken, can generate NPEs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@985383 13f79535-47bb-0310-9956-ffa450edef68
2010-08-13 22:09:42 +00:00
Michael Stack b3baa8aca7 HBASE-1660: script to handle rolling restarts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@985084 13f79535-47bb-0310-9956-ffa450edef68
2010-08-13 04:12:09 +00:00
Michael Stack 92ffa8580c HBASE-2868 Do some small cleanups in org.apache.hadoop.hbase.regionserver.wal
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@984433 13f79535-47bb-0310-9956-ffa450edef68
2010-08-11 15:03:21 +00:00
Michael Stack 8b5d7dbb1c HBASE-2908 Wrong order of null-check [in TIF]
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@984423 13f79535-47bb-0310-9956-ffa450edef68
2010-08-11 14:43:15 +00:00
Michael Stack e30ddb01aa HBASE-2870: Add Backup CLI Option to HMaster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@984116 13f79535-47bb-0310-9956-ffa450edef68
2010-08-10 16:54:40 +00:00
Michael Stack 2569d61c80 Fix downloads page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@983837 13f79535-47bb-0310-9956-ffa450edef68
2010-08-09 22:51:22 +00:00
Andrew Kyle Purtell a95f1ed4f6 HBASE-2905 NPE when inserting mass data via REST interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@983699 13f79535-47bb-0310-9956-ffa450edef68
2010-08-09 15:55:19 +00:00
Andrew Kyle Purtell af09891840 HBASE-2897 RowResultGenerator should handle NoSuchColumnFamilyException; add hunk missed from last commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@983667 13f79535-47bb-0310-9956-ffa450edef68
2010-08-09 14:56:38 +00:00
Andrew Kyle Purtell 0530905854 HBASE-2897 RowResultGenerator should handle NoSuchColumnFamilyException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@983493 13f79535-47bb-0310-9956-ffa450edef68
2010-08-08 23:29:53 +00:00
Michael Stack f4ed3cd699 HBASE-2844 Capping the number of regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@983442 13f79535-47bb-0310-9956-ffa450edef68
2010-08-08 15:59:46 +00:00
Michael Stack 25ffbc5f11 HBASE-2823 Entire Row Deletes not stored in Row+Col Bloom
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@982472 13f79535-47bb-0310-9956-ffa450edef68
2010-08-05 05:16:10 +00:00
Michael Stack 37af9aab2e HBASE-2901 HBASE-2461 broke build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@982461 13f79535-47bb-0310-9956-ffa450edef68
2010-08-05 03:58:32 +00:00
Michael Stack 2db593c8c6 HBASE-2871 Make 'start|stop' commands symmetric for Master & Cluster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@982123 13f79535-47bb-0310-9956-ffa450edef68
2010-08-04 05:27:09 +00:00
Michael Stack 094197a180 HBASE-2461 Split doesn't handle IOExceptions when creating new region reference files; forgot to svn add new files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@982122 13f79535-47bb-0310-9956-ffa450edef68
2010-08-04 05:08:38 +00:00
Michael Stack f7b8d9cf7a HBASE-2461 Split doesn't handle IOExceptions when creating new region reference files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@982089 13f79535-47bb-0310-9956-ffa450edef68
2010-08-04 00:00:51 +00:00
Jean-Daniel Cryans 77aef8f799 HBASE-2892 Replication metrics aren't updated
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980993 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 23:37:19 +00:00
Michael Stack b3db1e976e HBASE-2792 Create a better way to chain log cleaners
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980901 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 18:10:04 +00:00
Michael Stack d0890ff453 HBASE-2868 Do some small cleanups in org.apache.hadoop.hbase.regionserver.wal -- REVERT... broke build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980891 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 17:18:31 +00:00
Michael Stack 2d214ccc52 HBASE-2755 Duplicate assignment of a region after region server recovery
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980649 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 04:57:44 +00:00
Michael Stack 3f2942ae4e HBASE-2890 (HBASE-2890) Initialize RPC JMX metrics on startup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980640 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 03:26:31 +00:00
Michael Stack 26ebe0c583 HBASE-2890 init per-method RPC metrics on startup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980638 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 03:22:08 +00:00
Todd Lipcon d4d88f1ce3 HBASE-2884. TestHFileOutputFormat flaky when map tasks generate identical data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980621 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 00:47:21 +00:00
Todd Lipcon 852f3cf9a0 HBASE-2820 hbck throws an error if HBase root dir isn't on the default FS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980264 13f79535-47bb-0310-9956-ffa450edef68
2010-07-28 23:14:12 +00:00
Michael Stack 1280130acc HBASE-2868 Do some small cleanups in org.apache.hadoop.hbase.regionserver.wal
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980250 13f79535-47bb-0310-9956-ffa450edef68
2010-07-28 22:21:13 +00:00
Michael Stack 8f5e996795 HBASE-2886 Add search box to site
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@980135 13f79535-47bb-0310-9956-ffa450edef68
2010-07-28 17:33:53 +00:00
Michael Stack b0e56b5cfa HBASE-2879 Offer ZK CLI outside of HBase Shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979881 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 21:50:05 +00:00
Michael Stack b9f99f7c51 Don't run tests when we do 'mvn site' -- we don't even show the produced surefire report in our site; it makes no sense showing test results as part of our site at least
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979874 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 21:06:30 +00:00
Michael Stack 5215e49df0 HBASE-1729 Move cache stats out of RS log and into metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979834 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 19:59:01 +00:00
Michael Stack 24ced568ac Setting write buffer to 12MB in PE is dumb. Causes OOMEs when running w/ a 1G heap. If HDFS slow, handlers get backed up carrying 10MB plus and this memory consumption is outside of our general memory accounting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979796 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 18:27:46 +00:00
Michael Stack b88794651b HBASE-2856 TestAcidGuarantee broken on trunk ; disabling for the moment
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979751 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 15:33:09 +00:00
Jean-Daniel Cryans ea63f24c5d HBASE-2838 Replication metrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979532 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 04:58:31 +00:00
Jonathan Gray 90908553e9 HBASE-2852 Bloom filter NPE (pranav via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979491 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 01:31:04 +00:00
Michael Stack 55e8b201e6 HBASE-2650 Consolidate user guide style documentation -- experiment with docbkx mvn plugin
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@979124 13f79535-47bb-0310-9956-ffa450edef68
2010-07-25 21:34:46 +00:00