519 Commits

Author SHA1 Message Date
stack
af84b746ce HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks (Jonathan Lawlor) 2015-01-30 15:27:08 -08:00
Lars Hofhansl
0b3502f2b1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:57:24 -08:00
Devaraj Das
c66fdf1e83 HBASE-11574. hbase:meta's regions can be replicated 2015-01-29 00:32:21 -08:00
stack
eb9978cc3d HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous) 2015-01-24 18:21:36 -08:00
Enis Soztutar
ea566fc1f5 HBASE-12899 HBase should prefix htrace configuration keys with "hbase.htrace" rather than just "hbase." (Colin Patrick McCabe) 2015-01-22 19:06:13 -08:00
Andrew Purtell
7e1f030f2a HBASE-12731 Heap occupancy based client pushback
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2015-01-22 17:47:59 -08:00
Andrew Purtell
04a003d6a2 HBASE-12730 Backport HBASE-5162 (Basic client pushback mechanism) to branch-1 2015-01-22 14:50:40 -08:00
Nick Dimiduk
05f4e0c715 HBASE-12810 Update to htrace-incubating 2015-01-22 14:32:21 -08:00
Sean Busbey
0bec3a7bf4 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 09:30:05 -06:00
Devaraj Das
d0e4fb6ae3 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas. 2015-01-16 11:49:49 -08:00
tedyu
2e08bb3b47 HBASE-12848 Utilize Flash storage for WAL 2015-01-15 08:53:06 -08:00
Ramkrishna
da2a3827fa HBASE-12845 - ByteBufferOutputStream should grow as direct buffer if the
initial buffer is also direct BB (Ram)
2015-01-15 13:01:20 +05:30
Andrew Purtell
40e9c22ea2 HBASE-12801 Failed to truncate a table while maintaing binary region boundaries (Liu Shaohui) 2015-01-12 19:09:08 -08:00
Nick Dimiduk
240ef12358 HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:11:32 -08:00
Enis Soztutar
ecbdc45d3d HBASE-12028 Abort the RegionServer, when it's handler threads die (Alicia Ying Shu) 2015-01-02 13:27:26 -08:00
tedyu
882f4c9761 HBASE-12716 A bug in RegionSplitter.UniformSplit algorithm (Weichen Ye) 2014-12-28 07:49:12 -08:00
Jurriaan Mous
8eed26fc3c HBASE-12742
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:15:00 -08:00
Enis Soztutar
9b401498f7 HBASE-12744 hbase-default.xml lists hbase.regionserver.global.memstore.size twice (Jerry He) 2014-12-22 18:24:34 -08:00
zhangduo
e55ef7a663 HBASE-10201 Port 'Make flush decisions per column family' to trunk
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2014-12-18 15:58:55 -08:00
Enis Soztutar
d66ae28c07 Update pom.xml version for 1.1.0-SNAPSHOT for branch-1 2014-12-17 23:16:41 -08:00
tedyu
d92e686520 HBASE-12625 Deprecate certain methods in classes annotated with InterfaceAudience.Public in branch-1 2014-12-17 13:43:34 -08:00
stack
36269b6403 HBASE-9431 Set 'hbase.bulkload.retries.number' to 10 as HBASE-8450 claims 2014-12-16 11:11:51 -08:00
Enis Soztutar
88d1ddffd7 HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken 2014-12-15 11:11:50 -08:00
stack
f0afcd2cc2 HBASE-12689 Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT 2014-12-14 20:37:59 -08:00
Enis Soztutar
4f22143dfa HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate 2014-12-14 17:52:05 -08:00
stack
51bbbbaf2b HBASE-12665 When aborting, dump metrics
Add some fixup of checkstyle fails

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/http/jmx/JMXJsonServlet.java
2014-12-09 21:08:10 -08:00
Nick Dimiduk
081ce3f8de HBASE-12163 Move test annotation classes to the same package as in master 2014-12-08 10:38:58 -08:00
Gary Helmling
6c4863f355 HBASE-12493 Make User and TokenUtil public 2014-12-06 02:10:31 -08:00
Andrew Purtell
004e977ba0 HBASE-10560 Per cell TTLs 2014-12-05 11:11:15 -08:00
tedyu
2560875893 HBASE-12632 ThrottledInputStream/ExportSnapshot does not throttle 2014-12-05 06:52:57 -08:00
tedyu
2e47c37b71 HBASE-12204 Backport HBASE-12016 'Reduce number of versions in Meta table. Make it configurable' to branch-1 2014-12-04 12:18:58 -08:00
Enis Soztutar
5f150e49f9 Update pom.xml version for 0.99.2 2014-12-02 20:28:29 -08:00
Sean Busbey
8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
stack
a5169d422b HBASE-12526 Remove unused imports (Varun Saxena) 2014-12-01 14:30:59 -08:00
Enis Soztutar
5610732173 HBASE-12577 Disable distributed log replay by default (Jeffrey Zhong) 2014-12-01 14:17:30 -08:00
Jeffrey Zhong
a184620fb3 HBASE-12600: Remove REPLAY tag dependency in Distributed Replay Mode 2014-12-01 11:30:13 -08:00
Ramkrishna
95de67bd39 HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:24:20 +05:30
stack
b12d57783f HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-29 09:24:08 -08:00
Enis Soztutar
aa343ebcfe HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 14:09:28 -08:00
Sean Busbey
7418bdb623 HBASE-12517 Ensure HConstants members are final.
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
2014-11-18 13:07:38 -08:00
Matteo Bertozzi
1f0d960792 HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu) 2014-11-12 20:33:37 +00:00
tedyu
17e2de3494 HBASE-12442 Bring KeyValue#createFirstOnRow() back to branch-1 as deprecated methods 2014-11-12 11:21:20 -08:00
Srikanth Srungarapu
133c79a391 HBASE-12460 Moving Chore to hbase-common module
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-11-11 23:18:37 +00:00
stack
c99d89fd63 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT --REVERT 2014-11-05 19:15:24 -08:00
Andrew Purtell
bd42fbca6d HBASE-12419 'Partial cell read caused by EOF' ERRORs on replication source 2014-11-05 18:47:04 -08:00
stack
c66a6b02a5 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT 2014-11-04 12:41:38 -08:00
Enis Soztutar
a46425b2a9 HBASE-12390 Change revision style from svn to git 2014-10-31 11:11:12 -07:00
stack
6c39d36b32 HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key
Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellComparator.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellKey.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/TestCellUtil.java
2014-10-29 11:36:47 -07:00
anoopsjohn
e1d1ba564b HBASE-12297 Support DBB usage in Bloom and HFileIndex area. 2014-10-29 14:40:08 +05:30
manukranthk
69c99da70a Implement Preemptive Fast Fail
Summary: This diff ports the Preemptive Fast Fail feature to OSS. In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24177

Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterConnection.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCaller.java
2014-10-28 22:59:20 -07:00