Commit Graph

784 Commits

Author SHA1 Message Date
Sameet Agarwal 2fd6f2a829 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:56:21 -07:00
stack 46e782927d HBASE-13298 Clarify if Table.{set|get}WriteBufferSize() is deprecated or not 2015-03-25 13:10:29 -07:00
Ashish Singhi 01fdafb5ee HBASE-13305 Get(Get get) is not copying the row key
Signed-off-by: stack <stack@apache.org>
2015-03-25 07:39:45 -07:00
Mikhail Antonov ac6fd86d26 HBASE-13273 Make Result.EMPTY_RESULT read-only; currently it can be modified
Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Result.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestResult.java
2015-03-24 13:15:43 -07:00
Matteo Bertozzi 266e883daa HBASE-13314 Fix NPE in HMaster.getClusterStatus() 2015-03-24 09:28:51 +00:00
Nick Dimiduk 7fad7d1a5b HBASE-13315 BufferedMutator should be @InterfaceAudience.Public (addendum) 2015-03-23 16:35:46 -07:00
Nick Dimiduk ebd407dbda HBASE-13315 BufferedMutator should be @InterfaceAudience.Public (Solomon Duskis) 2015-03-23 12:17:28 -07:00
stack b83e3ac770 HBASE-13274 Fix misplaced deprecation in Delete#addXYZ (Mikhail Antonov) 2015-03-20 09:44:38 -07:00
Andrey Stepachev d0af30ea3c HBASE-13093 Local mode HBase instance doesn't shut down. 2015-03-17 14:47:11 +00:00
stack 71f22ebfb8 HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:27:02 -07:00
Josh Elser c3b47f2251 HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-14 00:19:44 -05:00
anoopsjohn 7fdadddfcc HBASE-13232 ConnectionManger : Batch pool threads and metaLookup pool threads should use different name pattern. 2015-03-13 22:55:15 +05:30
tedyu 2d2b9ba283 HBASE-13162 Addendum adds InterfaceAudience annotation to ZkAclReset 2015-03-12 19:09:25 -07:00
Jonathan M Hsieh d899322286 HBASE-13162 Add capability for cleaning hbase acls to hbase cleanup script (Srikanth Srungarapu) 2015-03-12 17:07:25 -07:00
tedyu da9c5ac18c HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 21:41:24 -07:00
Enis Soztutar 0f892c23ec HBASE-13063 Allow to turn off memstore replication for region replicas - ADDENDUM for turning of primary flush tigger when this is enabled 2015-03-11 14:57:15 -07:00
stack 0fb1ad7db4 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer; ADDENDUM 2015-03-10 22:21:01 -07:00
Matteo Bertozzi eb2193afa0 HBASE-13063 Allow to turn off memstore replication for region replicas 2015-03-10 10:17:15 +00:00
zhangduo 5ff108d0e1 HBASE-12405 WAL accounting by Store
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ResponseConverter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-03-10 13:13:40 +08:00
Enis Soztutar 280120ee15 HBASE-13121 Async wal replication for region replicas and dist log replay does not work together
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/coordination/ZkSplitLogWorkerCoordination.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
2015-03-09 16:12:04 -07:00
Enis Soztutar 5619f20e1a HBASE-12706 Support multiple port numbers in ZK quorum string (Stephen Yuan Jiang) 2015-03-06 16:47:44 -08:00
stack 3e3276d7fa HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer 2015-03-06 14:35:49 -08:00
tedyu bd4c6694f2 HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng) 2015-03-05 18:41:52 -08:00
Jonathan Lawlor 0c64a57e52 HBASE-11544: [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Signed-off-by: stack <stack@apache.org>
2015-03-04 18:04:15 -08:00
Lars Hofhansl f5020e9c1a HBASE-13109 Make better SEEK vs SKIP decisions during scanning. 2015-03-04 14:13:41 -08:00
stack 6b1674b31c HBASE-13017 Backport HBASE-12035 Keep table state in Meta to 1.0 branch; REVERT 2015-03-03 13:26:15 -08:00
Enis Soztutar 9e7ad99593 HBASE-11580 Failover handling for secondary region replicas
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
2015-03-03 13:21:01 -08:00
tedyu ad6e1877d5 HBASE-13122 Revert pending answer to Ram's question 2015-03-02 20:59:50 -08:00
Andrew Purtell d4200ab39e HBASE-12995 Document that HConnection#getTable methods do not check table existence since 0.98.1 2015-03-02 16:58:54 -08:00
tedyu e64bd72dcf HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng Zhou) 2015-03-02 07:47:56 -08:00
tedyu c64686e2e1 HBASE-13134 mutateRow and checkAndMutate apis don't throw region level exceptions (Francis Liu) 2015-03-01 20:25:43 -08:00
Sean Busbey 1efd29e343 HBASE-13131 ReplicationAdmin must clean up connections if constructor fails. 2015-03-01 00:24:04 -06:00
zhangduo 95d290bc5e HBASE-13097 addendum use default ByteBufAllocator
Signed-off-by: stack <stack@apache.org>
2015-02-27 17:19:32 -08:00
zhangduo ade44d754d HBASE-13097 Use same EventLoopGroup for different AsyncRpcClients if possible
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestIPC.java
2015-02-27 08:45:29 -08:00
Nick Dimiduk 9446b2cc7e HBASE-13086 Show ZK root node on Master WebUI 2015-02-24 19:05:19 -08:00
Ashish Singhi 9e9a98fdb1 HBASE-13048 Use hbase.crypto.wal.algorithm in SecureProtobufLogReader while decrypting the data
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-24 18:18:31 -08:00
Devaraj Das 8f3fc72b94 HBASE-13067. Fix caching of stubs to allow IP address changes of restarted remote servers. 2015-02-23 22:15:46 -08:00
zhangduo b5590ac722 HBASE-12953 RegionServer is not functionally working with AysncRpcClient in secure mode
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/TestSecureRPC.java
2015-02-23 20:41:45 -08:00
Enis Soztutar 492980d447 HBASE-12561 Replicas of regions can be cached from different instances of the table in MetaCache
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionReplicaUtil.java
2015-02-23 12:01:10 -08:00
tedyu 9d29f3c4f1 HBASE-13057 Provide client utility to easily enable and disable table replication (Ashish Singhi) 2015-02-20 10:27:20 -08:00
Ashish Singhi 41d93323f2 HBASE-13002 Make encryption cipher configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/io/crypto/TestEncryption.java
2015-02-18 11:42:22 -08:00
Devaraj Das e8a34fb384 HBASE-13036. Meta scanner should use its own threadpool 2015-02-18 10:54:31 -08:00
stack f5e2a82328 HBASE-13017 Backport HBASE-12035 Keep table state in Meta to 1.0 branch (Andrey Stepachev) 2015-02-18 09:58:32 -08:00
zhangduo bcb3a587c5 HBASE-13066 Fix typo in AsyncRpcChannel
Signed-off-by: stack <stack@apache.org>
2015-02-18 09:44:02 -08:00
zhangduo ae920d5559 HBASE-13011 TestLoadIncrementalHFiles is flakey when using AsyncRpcClient as client implementation
Added comment to AsyncRpcChannel data members

Signed-off-by: stack <stack@apache.org>
2015-02-16 09:05:06 -08:00
Sean Busbey 9114edece1 HBASE-13027 Ensure extension of TableInputFormatBase works.
* move mapreduce version of TableInputFormat tests out of mapred
* add ability to get runnable job via MR test shims
* correct the javadoc example for current APIs.
* add tests the run a job based on the extending TableInputFormatBase (as given in the javadocs)
* add tests that run jobs based on the javadocs from 0.98
* fall back to our own Connection if ussers of the deprecated table configuration have a managed connection.
2015-02-13 18:43:44 -06:00
stack 1338f0980e HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/ScanPerformanceEvaluation.java
2015-02-13 15:28:51 -08:00
Enis Soztutar 36e76c4be6 HBASE-11569 Flush / Compaction handling from secondary region replicas
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2015-02-13 12:49:08 -08:00
Sean Busbey a1e58c1076 HBASE-13038 addendum for branch-1 2015-02-13 11:40:37 -06:00
Ashish Singhi f5b40200db HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSmallTests.java
2015-02-12 14:16:28 -08:00