Commit Graph

3501 Commits

Author SHA1 Message Date
Elliott Clark 2857b21eaf HBASE-13170 Allow block cache to be external
Summary: Add MemcachedBlockCache

Test Plan: Tested locally with PE and running memcached.

Subscribers: rajesh.nishtala, ndimiduk

Differential Revision: https://reviews.facebook.net/D34635
2015-03-27 13:17:05 -07:00
Sameet Agarwal 2fd6f2a829 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:56:21 -07:00
Elliott Clark 650c9f27fd HBASE-13342 Fix incorrect interface annotations 2015-03-27 00:22:04 -07:00
Andrew Purtell 66af9410b1 HBASE-13332 Fix the usage of doAs/runAs in Visibility Controller tests (Srikanth Srungarapu)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestDefaultScanLabelGeneratorStack.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestEnforcingScanLabelGenerator.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelReplicationWithExpAsString.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabels.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithACL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDefaultVisLabelService.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDeletes.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityWithCheckAuths.java
2015-03-26 21:54:28 -07:00
zhangduo e8059b0dc5 HBASE-13295 TestInfoServers hung
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestInfoServers.java
2015-03-27 11:57:19 +08:00
nke 797eee33ab HBASE-8725 Add total time RPC call metrics
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-26 11:12:29 -07:00
Andrey Stepachev 9df1c244a0 HBASE-13326 Disabled table can't be enabled after HBase is restarted 2015-03-25 22:57:37 +00:00
Andrew Purtell 050028c32e HBASE-13294 Fix the critical ancient loopholes in security testing infrastructure (Srikanth Srungarapu) 2015-03-25 09:28:12 -07:00
Elliott Clark cc750c656a HBASE-13331 Exceptions from DFS client can cause CatalogJanitor to delete referenced files
Summary:
CatalogJanitor#checkDaughterInFs assumes that there are no references
whenever HRegionFileSystem.openRegionFromFileSystem throws IOException.
Well Hadoop and HBase throw IOExceptions whenever someone looks in their general direction.

This patch explicitly checks if the directory exists. If it doesn't then it allows references to be
deleted. All other exceptions cause CatalogJanitor to assume there are references

Test Plan: Unit tests.

Differential Revision: https://reviews.facebook.net/D35829
2015-03-24 19:52:17 -07:00
tedyu 7c2525bf15 HBASE-13327 Use Admin in ConnectionCache (Solomon Duskis) 2015-03-24 18:15:09 -07:00
Mikhail Antonov ac6fd86d26 HBASE-13273 Make Result.EMPTY_RESULT read-only; currently it can be modified
Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Result.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestResult.java
2015-03-24 13:15:43 -07:00
Matteo Bertozzi c305b44362 HBASE-13321 Fix flaky TestHBaseFsck 2015-03-24 16:52:05 +00:00
Matteo Bertozzi 266e883daa HBASE-13314 Fix NPE in HMaster.getClusterStatus() 2015-03-24 09:28:51 +00:00
Matteo Bertozzi f3f42bf7a6 HBASE-13309 Some tests do not reset EnvironmentEdgeManager 2015-03-22 10:43:15 +00:00
zhangduo bbf9a90ff2 HBASE-13308 Fix flaky TestEndToEndSplitTransaction
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestEndToEndSplitTransaction.java
2015-03-21 20:55:49 +08:00
Andrew Purtell e90ac5f812 HBASE-13303 Fix size calculation of results on the region server 2015-03-20 17:25:17 -07:00
Matteo Bertozzi 4230b1ae2e HBASE-13282 Fix the minor issues of running Canary on kerberized environment (Srikanth Srungarapu) 2015-03-20 21:14:07 +00:00
Ashish Singhi 14fa34513e HBASE-13241 Add tests for group level grants 2015-03-19 21:38:47 +00:00
Esteban Gutierrez f6095adea6 TestEnableTableHandler.testDeleteForSureClearsAllTableRowsFromMeta - ADDENDUM 2015-03-19 21:01:38 +00:00
Matteo Bertozzi 1f7b7781a1 HBASE-13285 Fix flaky getRegions() in TestAccessController.setUp() 2015-03-19 18:28:58 +00:00
zhangduo 9e92e33629 HBASE-13280 TestSecureRPC failed 2015-03-19 21:46:15 +08:00
Matteo Bertozzi 6b411b5d00 HBASE-13235 Revisit the security auditing semantics (Srikanth Srungarapu) 2015-03-19 07:01:55 +00:00
Matteo Bertozzi e283a210e6 HBASE-13253 LoadIncrementalHFiles unify hfiles discovery 2015-03-17 19:39:18 +00:00
Andrey Stepachev bee9fb8e7e HBASE-13176 Flakey TestZooKeeper test. 2015-03-17 15:00:10 +00:00
Jonathan M Hsieh 489698d6c0 HBASE-12908 Typos in MemstoreFlusher javadocs (Edvin Malinovskis) 2015-03-17 00:38:54 -07:00
stack 71f22ebfb8 HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:27:02 -07:00
tedyu 9b4d78c33f HBASE-13246 Correct the assertion for namespace permissions in tearDown method of TestAccessController (Ashish Singhi) 2015-03-16 06:46:54 -07:00
zhangduo 663dacca9d HBASE-13244 addendum add InterfaceAudience annotation back for HBaseKerberosUtils 2015-03-16 15:20:17 +08:00
zhangduo 6fb6362e28 HBASE-13244 Test delegation token generation with kerberos enabled 2015-03-15 23:08:25 +08:00
tedyu 189424e6fc HBASE-13239 HBase grant at specific column level does not work for Groups 2015-03-14 20:21:03 -07:00
zhangduo cb4db89bff HBASE-13242 TestPerColumnFamilyFlush.testFlushingWhenLogRolling hung 2015-03-15 08:15:32 +08:00
Josh Elser c3b47f2251 HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-14 00:19:44 -05:00
Matteo Bertozzi 7229a0a47d HBASE-13227 LoadIncrementalHFile should skip non-files inside a possible family-dir 2015-03-13 17:12:11 +00:00
Esteban Gutierrez aa93b176f0 HBASE-13224 Minor formatting issue when logging a namespace scope in AuthResult#toContextString 2015-03-13 10:53:59 +00:00
Enis Soztutar c8999d9def HBASE-13169 ModifyTable increasing the region replica count should also auto-setup RRRE
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/ModifyTableHandler.java
2015-03-12 15:21:31 -07:00
tedyu da9c5ac18c HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 21:41:24 -07:00
Enis Soztutar 0f892c23ec HBASE-13063 Allow to turn off memstore replication for region replicas - ADDENDUM for turning of primary flush tigger when this is enabled 2015-03-11 14:57:15 -07:00
Devaraj Das e864dd0520 HBASE-13192. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures. 2015-03-11 13:55:34 -07:00
Matteo Bertozzi f8dced1e6d HBASE-13206 Fix TableLock tableName log format 2015-03-11 18:27:41 +00:00
stack 0fb1ad7db4 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer; ADDENDUM 2015-03-10 22:21:01 -07:00
tedyu 05aef46d94 HBASE-13168 Backport HBASE-12590 "A solution for data skew in HBase-Mapreduce Job" 2015-03-10 18:47:31 -07:00
stack 619d58f9b5 HBASE-13114 [UNITTEST] TestEnableTableHandler.testDeleteForSureClearsAllTableRowsFromMeta 2015-03-10 14:15:33 -07:00
Matteo Bertozzi c4369d9a90 HBASE-13181 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently 2015-03-10 17:22:07 +00:00
Matteo Bertozzi eb2193afa0 HBASE-13063 Allow to turn off memstore replication for region replicas 2015-03-10 10:17:15 +00:00
Matteo Bertozzi 52ff5485a8 HBASE-13182 TestAccessController create/delete table is flaky 2015-03-10 09:18:33 +00:00
zhangduo ce1a5eeda3 HBASE-12405 addendum fix HRegion heap size 2015-03-10 15:13:53 +08:00
zhangduo 5ff108d0e1 HBASE-12405 WAL accounting by Store
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ResponseConverter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-03-10 13:13:40 +08:00
Andrew Purtell 4afae59cfa HBASE-13183 Make ZK tickTime configurable in standalone HBase (Alex Araujo) 2015-03-09 18:34:48 -07:00
Enis Soztutar 280120ee15 HBASE-13121 Async wal replication for region replicas and dist log replay does not work together
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/coordination/ZkSplitLogWorkerCoordination.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
2015-03-09 16:12:04 -07:00
zhangduo c40d880a3e HBASE-13172 TestDistributedLogSplitting.testThreeRSAbort fails several times on branch-1
Signed-off-by: stack <stack@apache.org>
2015-03-09 14:13:35 -07:00