Commit Graph

147 Commits

Author SHA1 Message Date
Michael Stack f521309532 HBASE-2692 Master rewrite and cleanup for 0.90
Patch brought over from 0.90_master_rewrite branch.

Replication test is broke as are some of the rest tests.
Others should be passing.

Some of the changes made in this fat patch:

+ In HLogKey, we now use encoded region name instead of full region name.
+ On split, daughters are opened on the parent's regionserver; let the new balancer
sort them out later when it cuts in.
+ Added move region from one server to another as well as enable/disable balancer.
+ All .META. and -ROOT- edits go via new *Editor and *Reader classes -- no more
do we have 5 different ways of reading and editing .META.
+ Rather than 3 different listeners to hlog each w/ own way of listening, instead
we only have WALObserver now.
+ New Server Interface that has whats common to HMaster and RegionServer. Also
new Services Interface.  This should make test writing cleaner making it so
less need of full cluster context testing anything -- e.g. the new
Interfaces are good w/ Mockito.
+ New balacner that runs on a period and takes into consideration all load
across cluster.
+ Table online/offline is now a flag in ZK; the offline flag on a region is
just used splitting from here on out.
+ Moved fixup of failed add of daughter edits to .META. into shutdown server
recover code (It used to be in basescanner).
+ The heartbeat now sends master the regionserver load and is used sending
shutdown message from master to regionserver ONLY; all other messages are
via zk (HMsg is pretty bare now).
+ No more Worker in RS and ToDoQueue in master.  Both in master and regionserver
we use handlers instead run out of Executors.
+ Client can not send split, flush, compact direct to RS; no longer does
it go via master.
+ Server shutdown runs differently now. All are watching a flag in zk.
When RS notices its gone, it closes all user-space regions. If thats all
it was carrying, then it goes down.  Otherwise, waits on master to send
the shutdown msg via heartbeat.



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991397 13f79535-47bb-0310-9956-ffa450edef68
2010-08-31 23:51:44 +00:00
Michael Stack b6282f5508 HBASE-1511 Pseudo distributed mode in LocalHBaseCluster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@965672 13f79535-47bb-0310-9956-ffa450edef68
2010-07-19 22:59:51 +00:00
Andrew Kyle Purtell 0a047240c6 fix minor nit in commented HBASE_OPTS
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@916886 13f79535-47bb-0310-9956-ffa450edef68
2010-02-27 00:35:13 +00:00
Michael Stack 7bc5c1e301 HBASE-2099 Move build to Maven
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@915116 13f79535-47bb-0310-9956-ffa450edef68
2010-02-22 23:49:24 +00:00
Michael Stack ecb8ecae3f HBASE-2241 Change balancer sloppyness from 0.1 to 0.3
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@911960 13f79535-47bb-0310-9956-ffa450edef68
2010-02-19 20:06:02 +00:00
Jean-Daniel Cryans 4c7414ec20 HBASE-2070 Collect HLogs and delete them after a period of time
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@911233 13f79535-47bb-0310-9956-ffa450edef68
2010-02-18 00:08:19 +00:00
Michael Stack 94fdc559e7 HBASE-2177 Add timestamping to gc logging option
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@909185 13f79535-47bb-0310-9956-ffa450edef68
2010-02-12 00:14:39 +00:00
Michael Stack d227aee3cf HBASE-2185 Add html version of default hbase-site.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@908175 13f79535-47bb-0310-9956-ffa450edef68
2010-02-09 19:41:43 +00:00
Michael Stack 1bce5eb1d7 HBASE-2149 hbase.regionserver.global.memstore.lowerLimit is too low
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@902212 13f79535-47bb-0310-9956-ffa450edef68
2010-01-22 18:38:59 +00:00
Michael Stack c40524be57 HBASE-2152 Add default jmxremote.{access|password} files into conf
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@902195 13f79535-47bb-0310-9956-ffa450edef68
2010-01-22 17:59:58 +00:00
Andrew Kyle Purtell ff9dfa44b7 HBASE-2133 Increase default number of client handlers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@899863 13f79535-47bb-0310-9956-ffa450edef68
2010-01-16 01:02:41 +00:00
Jean-Daniel Cryans dfd0303cd7 HBASE-2068 MetricsRate is missing "registry" parameter (Lars George via JD)
HBASE-2078  Add JMX settings as commented out lines to hbase-env.sh
            (Lars George via JD)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@894689 13f79535-47bb-0310-9956-ffa450edef68
2009-12-30 18:27:44 +00:00
Andrew Kyle Purtell 23cbf39343 HBASE-2059 Break out WAL reader and writer impl from HLog
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@892451 13f79535-47bb-0310-9956-ffa450edef68
2009-12-19 08:10:45 +00:00
Jean-Daniel Cryans 3e11daa7c0 HBASE-2052 Make hbase more 'live' when comes to noticing table creation,
splits, etc., for 0.20.3
            Temporary until master is redone


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@891855 13f79535-47bb-0310-9956-ffa450edef68
2009-12-17 19:28:03 +00:00
Jean-Daniel Cryans cacce6c5f6 HBASE-2041 Change WAL default configuration values
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@890547 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 23:16:05 +00:00
Andrew Kyle Purtell bf32e51013 HBASE-2017 Set configurable max value size check to 10MB
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@885317 13f79535-47bb-0310-9956-ffa450edef68
2009-11-30 02:43:02 +00:00
Andrew Kyle Purtell c09a401202 HBASE-1995 Add configurable max value size check
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@885162 13f79535-47bb-0310-9956-ffa450edef68
2009-11-28 22:59:09 +00:00
Michael Stack e7ee750f6c HBASE-1997 zk tick time bounds maximum zk session time
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@883190 13f79535-47bb-0310-9956-ffa450edef68
2009-11-22 23:39:18 +00:00
Michael Stack d91ee91b89 HBASE-1816 Master rewrite; removed hbase.master.lease.period -- unused since zk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@830779 13f79535-47bb-0310-9956-ffa450edef68
2009-10-28 22:18:14 +00:00
Michael Stack d6adcd04f5 HBASE-1816 Master Rewrite; redo how we check rootdir in HMaster constructor -- was broke when deploying on cluster
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@830768 13f79535-47bb-0310-9956-ffa450edef68
2009-10-28 21:34:23 +00:00
Michael Stack 2929b1bd38 HBASE-1905 Remove unused config. hbase.hstore.blockCache.blockSize
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@824864 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 18:03:23 +00:00
Michael Stack e0bf4fb231 HBASE-1903 Enable DEBUG by default
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@824547 13f79535-47bb-0310-9956-ffa450edef68
2009-10-12 23:58:45 +00:00
Michael Stack 34dd385f1f HBASE-1799 deprecate o.a.h.h.rest in favor of stargate -- reverse mistaken commit of config changes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@808500 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 16:28:47 +00:00
Michael Stack d86a13dade HBASE-1799 deprecate o.a.h.h.rest in favor of stargate
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@808469 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 15:50:23 +00:00
Michael Stack aed74376f8 HBASE-1772 Up the default ZK session timeout from 30seconds to 60seconds
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@805228 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 23:54:47 +00:00
Jonathan Gray cff34ea9a4 HBASE-1771 PE sequentialWrite is 7x slower because of MemStoreFlusher#checkStoreFileCount
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@805221 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 23:49:33 +00:00
Nitay Joffe 002e9e8bdc HBASE-1551 HBase should manage multiple node ZooKeeper quorum
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@792636 13f79535-47bb-0310-9956-ffa450edef68
2009-07-09 19:04:43 +00:00
Nitay Joffe b015cc7fc1 HBASE-1630 Provide sample config options to enable GC debugging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@792383 13f79535-47bb-0310-9956-ffa450edef68
2009-07-09 03:09:39 +00:00
Nitay Joffe 90366d50f8 HBASE-1606 Remove zoo.cfg, put config options into hbase-site.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@791037 13f79535-47bb-0310-9956-ffa450edef68
2009-07-03 23:33:28 +00:00
Michael Stack 69f71c7d80 Remove mistakenly committed conf/hbase-env.sh changes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@789489 13f79535-47bb-0310-9956-ffa450edef68
2009-06-29 23:17:53 +00:00
Michael Stack 3942b0bfff HBASE-1589 Up zk maxClientCnxns from default of 10 to 20 or 30 or so
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@789431 13f79535-47bb-0310-9956-ffa450edef68
2009-06-29 20:11:27 +00:00
Michael Stack 61970dc11e Part of HBASE-1586 Bring back transactions and indexing for 0.20.. plus hbase-1588 Rig our build to support our new contribs -- stargate and THBase/ITHBase
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@789051 13f79535-47bb-0310-9956-ffa450edef68
2009-06-28 05:47:35 +00:00
Michael Stack 9be89e60cd HBASE-1460 Concurrent LRU Block Cache
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@788888 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 22:16:40 +00:00
Michael Stack 888aeb06cf HBASE-1587 Update ganglia config and doc to account for ganglia 3.1 and hadoop-4675
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@788837 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 19:49:08 +00:00
Michael Stack 7886526f30 HBASE-1578 Change the name of the in-memory updates from 'memcache' to 'memtable' or....
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@788160 13f79535-47bb-0310-9956-ffa450edef68
2009-06-24 19:56:51 +00:00
Michael Stack e121a78192 HBASE-1572 Zookeeper log4j property set to ERROR on default, same output when cluster working and not working
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@787861 13f79535-47bb-0310-9956-ffa450edef68
2009-06-23 22:42:01 +00:00
Nitay Joffe f8046be708 HBASE-1515 Address part of config option hbase.regionserver unnecessary
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@786913 13f79535-47bb-0310-9956-ffa450edef68
2009-06-20 22:03:46 +00:00
Michael Stack 4a65f06f71 HBASE-1538 Up zookeeper timeout from 10 seconds to 30 seconds to cut down on hbase-user traffic
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@785843 13f79535-47bb-0310-9956-ffa450edef68
2009-06-17 22:24:52 +00:00
Michael Stack 23e370c7d9 HBASE-1507 iCMS as default JVM
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@784977 13f79535-47bb-0310-9956-ffa450edef68
2009-06-15 21:07:36 +00:00
Michael Stack d841ab681d HBASE-1507 iCMS as default JVM
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@783990 13f79535-47bb-0310-9956-ffa450edef68
2009-06-12 05:59:54 +00:00
Jean-Daniel Cryans 4c05305695 HBASE-1357 If one sets the hbase.master to 0.0.0.0 non local regionservers
can't find the master
HBASE-1445  Add the ability to start a master from any machine



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@781099 13f79535-47bb-0310-9956-ffa450edef68
2009-06-02 17:52:32 +00:00
Andrew Kyle Purtell 3fbad5236d HBASE-1464 Add hbase.regionserver.logroll.period to hbase-default; fix
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780532 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 23:50:35 +00:00
Michael Stack e7afa8643f HBASE-1192 LRU-style map for the block cache
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780528 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 23:42:00 +00:00
Michael Stack 2b47c15286 HBASE-1192 LRU-style map for the block cache
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780527 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 23:39:39 +00:00
Michael Stack dca4256907 HBASE-1464 Add hbase.regionserver.logroll.period to hbase-default
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780469 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 16:45:02 +00:00
Andrew Kyle Purtell 66c6ee2e99 HBASE-1434 Duplicate property in hbase-default.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@776118 13f79535-47bb-0310-9956-ffa450edef68
2009-05-18 22:26:19 +00:00
Michael Stack cff0b8bb04 HBASE-1394 Uploads sometimes fall to 0 requests/second (Binding up on HLog#append?)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@775418 13f79535-47bb-0310-9956-ffa450edef68
2009-05-16 06:10:44 +00:00
Andrew Kyle Purtell e81f7f3484 HBASE-1413 Fall back to filesystem block size default if HLog blocksize is not specified
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@774242 13f79535-47bb-0310-9956-ffa450edef68
2009-05-13 07:06:01 +00:00
Michael Stack f7add789cd HBASE-???? Remove unused sequencefile and mapfile config. from hbase-default.xml -- will fill in issue number when JIRA db comes back
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@772719 13f79535-47bb-0310-9956-ffa450edef68
2009-05-07 17:34:00 +00:00
Michael Stack 7a66721ea6 Mistaken commit of my hbase-env.sh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@771403 13f79535-47bb-0310-9956-ffa450edef68
2009-05-04 19:04:52 +00:00