Commit Graph

385 Commits

Author SHA1 Message Date
stack 3f1cb3e63b HBASE-12608 region_mover.rb does not log moving region count correctly when loading regions (cuijianwei) 2014-12-27 10:38:11 -08:00
tedyu 1fae34de56 HBASE-12662 region_status.rb is failing with NoMethodError (Ashish Singhi) 2014-12-09 09:35:01 -08:00
Sean Busbey 8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
Patrick White 39c67f6031 HBASE-12569 Update scripts to control MaxDirectMemorySize via env vars
Signed-off-by: stack <stack@apache.org>

Conflicts:
	src/main/docbkx/book.xml
2014-11-25 00:00:53 -08:00
Enis Soztutar 9701845ea7 HBASE-12560 [WINDOWS] Append the classpath from Hadoop to HBase classpath in bin/hbase.cmd 2014-11-21 22:07:54 -08:00
Florin Broasca d3c9425c9b HBASE-12513 Graceful stop script does not restore the balancer state
Signed-off-by: stack <stack@apache.org>
2014-11-18 13:15:14 -08:00
Jesse Yates 4fa23aadc0 HBASE-12428 region_mover.rb script is broken if port is not specified
If the port is not specified, there is an object nil exception.
2014-11-06 13:05:20 -08:00
Enis Soztutar e79572fa1c HBASE-12372 [WINDOWS] Enable log4j configuration in hbase.cmd 2014-10-29 12:02:38 -07:00
stack caa47654bd HBASE-12240 hbase-daemon.sh should remove pid file if process not found running (Ashish Singhi) 2014-10-12 23:09:06 -07:00
Elliott Clark bb1d6ce437 HBASE-11804 Raise default heap size if unspecified 2014-10-01 13:39:37 -07:00
Jimmy Xiang e7c610b94c HBASE-12034 If I kill single RS in branch-1, all regions end up on Master! 2014-09-29 17:12:43 -07:00
Ted Yu e5840e9517 HBASE-11948 graceful_stop.sh should use hbase-daemon.sh when executed on the decomissioned node (Sebastien Barrier) 2014-09-26 15:34:10 +00:00
stack 1fbab729a3 HBASE-10748 hbase-daemon.sh fails to execute with 'sh' command 2014-09-24 09:21:36 -07:00
stack 560e055813 HBASE-12032 Script to stop regionservers via RPC (Patrick White) 2014-09-19 16:50:29 -07:00
stack 73cd983e73 HBASE-12021 Hbase shell does not respect the HBASE_OPTS set by the user in console (Ashish Singhi) 2014-09-19 11:07:19 -07:00
stack e25ca03497 HBASE-12019 hbase-daemon.sh overwrite HBASE_ROOT_LOGGER and HBASE_SECURITY_LOGGER variables (Sebastien Barrier) 2014-09-18 17:01:27 -07:00
Patrick White eec50ff445 HBASE-12013 Support multiple regionservers per host in region_mover.rb
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-09-18 08:54:42 -07:00
Nick Dimiduk 42bc104d0b HBASE-11845 HFile tool should implement Tool, disable blockcache by default
HFileTool now accepts configuration via -D arguments. The blockcache is
disabled by default.
2014-09-11 14:39:18 -07:00
Andrew Purtell 8fe406931c HBASE-11844 region_mover.rb load enters an infinite loop if region already present on target server (Stephen Veiss) 2014-08-28 14:33:34 -07:00
Ted Yu 17c869d543 HBASE-11666 Enforce JDK7 javac for builds on branch-1 and master (Sean Busbey) 2014-08-05 14:59:54 +00:00
Sean Busbey 6a7f923c0d HBASE-11662 shell should properly handle long form --debug.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-08-04 21:31:56 -07:00
Andrew Purtell bd24634707 HBASE-11668 Re-add HBASE_LIBRARY_PATH to bin/hbase (Esteban Gutierrez) 2014-08-04 21:27:57 -07:00
Andrew Purtell a28f048fbf HBASE-11649 Add shortcut commands to bin/hbase for test tools 2014-08-01 10:44:24 -07:00
Jimmy Xiang 147a3521f9 HBASE-11575 Pseudo distributed mode does not work as documented 2014-07-24 10:06:10 -07:00
Andrew Purtell f6fad0a2b9 HBASE-11534 Remove broken JAVA_HOME autodetection in hbase-config.sh (Esteban Gutierrez) 2014-07-18 10:46:30 -07:00
Andrew Purtell 94f767fcc4 HBASE-2217 VM OPTS for shell only 2014-07-16 17:12:12 -07:00
Rajeshbabu Chintaguntla 2b75a0bd63 HBASE-11493 Autorestart option is not working because of stale znode 'shutdown'(Nijel) 2014-07-14 05:35:23 +00:00
Andrew Purtell 3d37252a32 HBASE-11496 HBASE-9745 broke cygwin CLASSPATH translation (Dave Latham) 2014-07-10 17:48:02 -07:00
stack 24a0a2a2bf HBASE-4495 CatalogTracker has an identity crisis; needs to be cut-back in scope (Mikhail Antonov) 2014-07-02 19:02:52 -07:00
Michael Stack aa101ca97e HBASE-9149 javadoc cleanup of to reflect .META. rename to hbase:meta (Misty Stanley-Jones) 2014-05-27 10:36:55 -07:00
Jonathan Hsieh 3e3b9a2f65 HBASE-5697 Audit HBase for usage of deprecated hadoop 0.20.x, 1.x property names (Srikanth Srungarapu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1591045 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 18:19:37 +00:00
nkeywal 4b762ee841 HBASE-10018 Change the location prefetch
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1585518 13f79535-47bb-0310-9956-ffa450edef68
2014-04-07 16:55:45 +00:00
Michael Stack 8b00ce12bf HBASE-10797 Add support for -h and --help to rolling_restart.sh and fix the usage string output
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1579477 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 00:01:35 +00:00
Jonathan Hsieh d0966109f2 HBASE-10769 hbase/bin/hbase-cleanup.sh has wrong usage string (Vamsee Yariagadda)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1578469 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 17:13:57 +00:00
Jonathan Hsieh 04b60809fa HBASE-10731 Fix environment variables typos in scripts (Albert Chu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1576956 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 22:16:28 +00:00
Enis Soztutar 65f6d41851 HBASE-10688 Add a draining_node script to manage nodes in draining mode
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1576856 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 19:00:47 +00:00
mbertozzi 52b775db97 HBASE-10682 region_mover.rb throws "can't convert nil into String" for regions moved
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1574828 13f79535-47bb-0310-9956-ffa450edef68
2014-03-06 10:05:40 +00:00
Jonathan Hsieh 0e0f813e07 HBASE-10639 Unload script displays wrong counts (off by one) when unloading regions (Srikanth Srungarapu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1573678 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 19:06:51 +00:00
Zhihong Yu 397b272901 HBASE-10638 Improve error message when there is no region server available for move
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1573010 13f79535-47bb-0310-9956-ffa450edef68
2014-02-28 17:30:23 +00:00
Michael Stack e09d637d7a HBASE-8803 region_mover.rb should move multiple regions at a time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1572327 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 23:05:50 +00:00
jxiang 147a2304d1 HBASE-5356 region_mover.rb can hang if table region it belongs to is deleted
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1565742 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 17:57:44 +00:00
Jonathan Hsieh 0e47eb67ff HBASE-10123 Change default ports; move them out of linux ephemeral port range
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1559200 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 17:37:25 +00:00
Jonathan Hsieh 92410d57d8 HBASE-10186 region_mover.rb broken because ServerName constructor is changed to private (Samir Ahmic)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1551532 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 13:05:10 +00:00
Enis Soztutar fab098fa47 HBASE-10084 [WINDOWS] bin\hbase.cmd should allow whitespaces in java.library.path and classpath
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1551433 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 01:03:10 +00:00
Zhihong Yu 9b945bc87f HBASE-10164 Allow heapsize of different units to be passed as HBASE_HEAPSIZE
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1550996 13f79535-47bb-0310-9956-ffa450edef68
2013-12-15 02:59:24 +00:00
ndimiduk 33a753c766 HBASE-10120 start-hbase.sh doesn't respect --config in non-distributed mode
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1550038 13f79535-47bb-0310-9956-ffa450edef68
2013-12-11 03:09:15 +00:00
Michael Stack 64f417ab99 HBASE-10056 region_status.rb not adopted to 0.96 api
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1546416 13f79535-47bb-0310-9956-ffa450edef68
2013-11-28 18:00:03 +00:00
Zhihong Yu 2a6407fff4 HBASE-10049 Small improvments in region_mover.rb
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1546393 13f79535-47bb-0310-9956-ffa450edef68
2013-11-28 16:23:26 +00:00
Michael Stack 12f0dce3ae HBASE-10051 rolling-restart.sh have old value of "zookeeper.znode.unassiged" config causing infinite loop
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1546215 13f79535-47bb-0310-9956-ffa450edef68
2013-11-27 22:26:36 +00:00
Michael Stack aa911ebc66 HBASE-10050 graceful_stop.sh syntax error
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1546212 13f79535-47bb-0310-9956-ffa450edef68
2013-11-27 22:21:27 +00:00