Commit Graph

3625 Commits

Author SHA1 Message Date
anoopsjohn 8e6353ccd1 HBASE-13520 NullPointerException in TagRewriteCell.(Josh Elser) 2015-04-21 17:39:07 +05:30
tedyu cac134c14a HBASE-13514 Fix test failures in TestScannerHeartbeatMessages caused by incorrect setting of hbase.rpc.timeout (Jonathan Lawlor) 2015-04-20 14:25:17 -07:00
Sean Busbey 83b6f88d5f HBASE-13498 Addendum missed local change from conflict resolution. 2015-04-20 11:21:14 -05:00
Sean Busbey b924c7564f HBASE-13498 Add more docs and a basic check for storage policy handling.
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2015-04-20 10:54:05 -05:00
Devaraj Das 4001492e7f HBASE-13482. Phoenix is failing to scan tables on secure environments. (Alicia Shu) 2015-04-19 22:18:05 -07:00
Tobi Vollebregt 10254b74ae HBASE-13430 HFiles that are in use by a table cloned from a snapshot may be deleted when that snapshot is deleted
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-18 09:53:04 +01:00
Enis Soztutar 60c30c707c HBASE-13491 Issue in FuzzyRowFilter#getNextForFuzzyRule (Anoop Sam John) 2015-04-17 21:56:04 -07:00
Enis Soztutar 49bf9aec8b HBASE-13481 Master should respect master (old) DNS/bind related configurations 2015-04-17 18:13:47 -07:00
tedyu b655a9909e HBASE-13090 Addendum fixes compilation error in TestScannerHeartbeatMessages 2015-04-17 17:04:59 -07:00
Jonathan Lawlor a4f77d49a5 HBASE-13090 Progress heartbeats for long running scanners
Signed-off-by: stack <stack@apache.org>
2015-04-17 15:43:13 -07:00
Elliott Clark 91e09bc0ab HBASE-13477 Create metrics on failed requests
Summary: Add metrics on how many requests are exceptions and what type.

Test Plan: behold unit tests.

Differential Revision: https://reviews.facebook.net/D37167
2015-04-17 15:38:38 -07:00
Jerry He 3c81d656e0 HBASE-13456 Improve HFilePrettyPrinter first hbase:meta region processing (Samir Ahmic) 2015-04-17 11:33:24 -07:00
Nick Dimiduk cf45c8d30a Bump pom version to 1.2.0-SNAPSHOT 2015-04-16 17:30:48 -07:00
stack 8166142b2e HBASE-13291 Making methods under ScannerV2#next inlineable and faster 2015-04-16 14:56:08 -07:00
tedyu 3ca1e46bd9 HBASE-13473 deleted cells come back alive after the stripe compaction (jeongmin kim) 2015-04-16 11:35:53 -07:00
tedyu 8ce7f905d2 HBASE-13463 Quota needs to be updated only in case of successful region merge 2015-04-16 11:08:54 -07:00
Matt Warhaftig a778c38ab4 HBASE-13350 Log warnings for sanity check failures when checks disabled.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-16 10:00:48 +01:00
Josh Elser ffd7bbfd6b HBASE-12987 Pare repeated hbck output and increase verbosity in long-running tasks. 2015-04-15 14:36:27 -07:00
Devaraj Das 65bf10a47f HBASE-13453. Master should not bind to region server ports (Srikanth Srungarapu) 2015-04-15 11:06:43 -07:00
Andrew Purtell c2eeddfb27 HBASE-12006 [JDK 8] KeyStoreTestUtil#generateCertificate fails due to "subject class type invalid"
This is a port of the fix from HADOOP-10847
2015-04-15 09:47:45 -07:00
Matteo Bertozzi ec472fb18a HBASE-13455 Procedure V2 - master truncate table 2015-04-15 11:07:08 +01:00
Matteo Bertozzi 7c5ae63850 HBASE-13290 Procedure v2 - client enable/disable table sync (Stephen Yuan Jiang) 2015-04-15 11:05:49 +01:00
Matteo Bertozzi 2cbb1afe52 HBASE-13211 Procedure V2 - master Enable/Disable table (Stephen Yuan Jiang) 2015-04-15 11:04:58 +01:00
Matteo Bertozzi 4cc464dae1 HBASE-13209 Procedure V2 - master Add/Modify/Delete Column Family (Stephen Yuan Jiang) 2015-04-15 11:04:07 +01:00
Matteo Bertozzi c967595acb HBASE-13210 Procedure V2 - master Modify table (Stephen Yuan Jiang) 2015-04-15 11:03:14 +01:00
Matteo Bertozzi 67149d253b HBASE-13204 Procedure v2 - client create/delete table sync 2015-04-15 11:02:26 +01:00
Matteo Bertozzi 58b1598b44 HBASE-13203 Procedure v2 - master create/delete table 2015-04-15 11:01:36 +01:00
tedyu daa82b9fd9 HBASE-13438 [branch-1] Backport Basic quota support for namespaces (Ashish Singhi) 2015-04-14 04:42:56 -07:00
zhangduo bcd5c4d137 HBASE-13301 Possible memory leak in BucketCache
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/bucket/TestBucketCache.java
2015-04-14 17:43:46 +08:00
Matteo Bertozzi 4fc39fd7c9 HBASE-13457 SnapshotExistsException doesn't honor the DoNotRetry 2015-04-13 23:22:28 +01:00
Srikanth Srungarapu f3b6cc84f2 HBASE-13436 Include user name in ADE for scans 2015-04-10 14:04:30 -07:00
tedyu e831ed0747 HBASE-13381 Expand TestSizeFailures to include small scans (Josh Elser) 2015-04-09 17:57:26 -07:00
stack d1133ced44 HBASE-13118 [PE] Add being able to write many columns 2015-04-09 16:50:02 -07:00
Andrew Purtell 356422e1ae HBASE-13275 Setting hbase.security.authorization to false does not disable authorization
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
2015-04-09 14:43:29 -07:00
Lars Hofhansl 562859f4af HBASE-13362 Set max result size from client only (like scanner caching). 2015-04-08 21:43:22 -07:00
Jonathan M Hsieh c2bfddac13 HBASE-13412 ADDENDUM Region split decisions should have jitter
This corrects the jitter threshold constant in the unit test so that it will pass regularly.
2015-04-08 14:50:03 -07:00
Jonathan Lawlor 408b916175 HBASE-13421 Reduce the number of object creations introduced by HBASE-11544 in scan RPC hot code paths
Signed-off-by: stack <stack@apache.org>
2015-04-08 14:03:38 -07:00
Sean Busbey 7469426d64 HBASE-13414 Removes now-obselete checks for JRE 6 in TestHCM.
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2015-04-08 14:32:27 -05:00
tedyu 3f8780e153 HBASE-11864 Enhance HLogPrettyPrinter to print information from WAL Header (Chuhan Yang) 2015-04-08 06:15:20 -07:00
ramkrishna 3cda2dfcad HBASE-13370 - PE tool could give option for using Explicit Column Tracker
which leads to seeks(Ram)
2015-04-08 10:26:16 +05:30
tedyu c031d8de23 HBASE-13205 [branch-1] Backport HBASE-11598 Add simple rpc throttling (Ashish Singhi) 2015-04-07 18:29:03 -07:00
Elliott Clark bbdd50b9c5 HBASE-13412 Region split decisions should have jitter 2015-04-07 17:20:26 -07:00
Ashish Singhi 15cdd898e3 HBASE-13299 Add setReturnResults() to Increment, like Append has
Signed-off-by: stack <stack@apache.org>
2015-04-07 11:47:48 -07:00
Jonathan Lawlor 30f6d54cc8 HBASE-13374 Small scanners (with particular configurations) do not return all rows
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-04-05 14:29:43 -07:00
Matteo Bertozzi d92ea13362 HBASE-13406 TestAccessController is flaky when create is slow 2015-04-04 10:14:13 +01:00
Apekshit(Appy) Sharma 4d8bcd4629 HBASE-6919 Remove unnecessary throws IOException from Bytes.readVLong.
Added readAsVLong() to deprecate readVLong() which was throwing IOException. Added test for readAsVLong().

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderV2.java
2015-04-03 21:41:39 -05:00
stack e65f430003 Revert "HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:"
Revert because breaking migration tests.

This reverts commit 95893ffebd.
2015-04-03 18:57:53 -07:00
stack 5c19f9eac7 HBASE-13397 Purge duplicate rpc request thread local 2015-04-03 15:44:57 -07:00
stack 95893ffebd HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:
Reapply after fixing missing JIRA number
2015-04-03 15:30:07 -07:00
stack da61928246 Revert "HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc."
Revert because missing JIRA number

This reverts commit 691efc60f7.
2015-04-03 15:26:13 -07:00
stack 691efc60f7 HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc. 2015-04-03 14:25:02 -07:00
zhangduo dd4f8a5e5a HBASE-13385 TestGenerateDelegationToken is broken with hadoop 2.8.0
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/token/TestGenerateDelegationToken.java
2015-04-03 07:54:55 +08:00
stack 7e1e5a60fb HBASE-13216 Add version info in RPC connection header (Liu Shaohui) 2015-04-02 15:50:49 -07:00
Andrew Purtell 6605dda7b4 HBASE-13388 Handling NullPointer in ZKProcedureMemberRpcs while getting ZNode data (Vikas Vishwakarma) 2015-04-02 14:18:07 -07:00
Dave Latham b8e969be7a HBASE-12891 Parallel execution for Hbck checkRegionConsistency
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-04-02 11:24:14 -07:00
Devaraj Das 926aaed113 HBASE-11869. Support snapshot owner (Liu Shaohui). 2015-04-01 23:56:59 -07:00
Srikanth Srungarapu 71c96e353a HBASE-13091 Split ZK Quorum on Master WebUI (Jean-Marc Spaggiari) 2015-04-01 23:21:21 -07:00
Andrew Purtell b75a4c8ef0 HBASE-13384 Fix Javadoc warnings introduced by HBASE-12972 2015-04-01 22:06:51 -07:00
Enis Soztutar b22fcd36ef HBASE-13317 Region server reportForDuty stuck looping if there is a master change - ADDENDUM for branch-1 (Jerry He) 2015-04-01 17:27:01 -07:00
Srikanth Srungarapu a6ddcc8fa2 HBASE-13296 Fix the deletion of acl notify nodes for namespace. 2015-04-01 12:17:00 -07:00
tedyu 39b5ce9470 HBASE-12954 Addendum uses invalid TLD in test 2015-04-01 11:20:16 -07:00
tedyu 4df24b8e6d HBASE-12954 Ability impaired using HBase on multihomed hosts 2015-04-01 06:47:26 -07:00
Enis Soztutar 394b460934 HBASE-13317 Region server reportForDuty stuck looping if there is a master change (Jerry He) 2015-03-31 22:59:34 -07:00
zhangduo 35fdea7d00 HBASE-13371 Fix typo in TestAsyncIPC 2015-04-01 12:15:10 +08:00
Andrew Purtell bf76082f5f HBASE-12975 Supportable SplitTransaction and RegionMergeTransaction interfaces 2015-03-31 16:02:24 -07:00
tedyu c4194f2849 HBASE-13369 Addendum deletes the table at the end of test 2015-03-31 15:43:08 -07:00
tedyu bb65a8664d HBASE-13369 Expose scanNext stats to region server level 2015-03-31 15:27:39 -07:00
tedyu f1601c0d12 HBASE-13213 Split out locality metrics among primary and secondary region 2015-03-31 15:00:56 -07:00
Andrew Purtell af1715933e HBASE-12972 Region, a supportable public/evolving subset of HRegion 2015-03-30 18:01:32 -07:00
tedyu 0f0f3f8493 HBASE-12993 Use HBase 1.0 interfaces in hbase-thrift (Solomon Duskis) 2015-03-29 06:44:50 -07:00
Josh Elser b0116398ff HBASE-13262 Observe ScanResponse.moreResults in ClientScanner.
The RS already returns to the client whether or not it has additional
results to be returned in a subsequent call to scan(), but the ClientScanner
did not use or adhere to this value. Subsequently, this can lead to
bugs around moving to the next region too early. A new method was added
to ClientScanner in the name of testability.

Encapsulate server-state into RegionServerCallable to avoid
modifying parameterization of callable impls.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-28 18:56:50 -07:00
Jonathan Lawlor 7da7a77ff9 Amend HBASE-13303 Fix size calculation of results on the region server
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-27 22:12:07 -07:00
Enis Soztutar 4bda365ab1 HBASE-13328 LoadIncrementalHFile.doBulkLoad(Path,HTable) should handle managed connections 2015-03-27 14:50:23 -07:00
Josh Elser b9a615e739 HBASE-13222 Add isBalancerEnabled method to Master and Admin.
Include some basic tests for the method on a testing cluster.
Also update master page to show an alert when balancer is disabled.

Signed-off-by: Enis Soztutar <enis@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/RequestConverter.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
2015-03-27 14:47:24 -07:00
Elliott Clark 2857b21eaf HBASE-13170 Allow block cache to be external
Summary: Add MemcachedBlockCache

Test Plan: Tested locally with PE and running memcached.

Subscribers: rajesh.nishtala, ndimiduk

Differential Revision: https://reviews.facebook.net/D34635
2015-03-27 13:17:05 -07:00
Sameet Agarwal 2fd6f2a829 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:56:21 -07:00
Elliott Clark 650c9f27fd HBASE-13342 Fix incorrect interface annotations 2015-03-27 00:22:04 -07:00
Andrew Purtell 66af9410b1 HBASE-13332 Fix the usage of doAs/runAs in Visibility Controller tests (Srikanth Srungarapu)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestDefaultScanLabelGeneratorStack.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestEnforcingScanLabelGenerator.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelReplicationWithExpAsString.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabels.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithACL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDefaultVisLabelService.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDeletes.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityWithCheckAuths.java
2015-03-26 21:54:28 -07:00
zhangduo e8059b0dc5 HBASE-13295 TestInfoServers hung
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestInfoServers.java
2015-03-27 11:57:19 +08:00
nke 797eee33ab HBASE-8725 Add total time RPC call metrics
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-26 11:12:29 -07:00
Andrey Stepachev 9df1c244a0 HBASE-13326 Disabled table can't be enabled after HBase is restarted 2015-03-25 22:57:37 +00:00
Andrew Purtell 050028c32e HBASE-13294 Fix the critical ancient loopholes in security testing infrastructure (Srikanth Srungarapu) 2015-03-25 09:28:12 -07:00
Elliott Clark cc750c656a HBASE-13331 Exceptions from DFS client can cause CatalogJanitor to delete referenced files
Summary:
CatalogJanitor#checkDaughterInFs assumes that there are no references
whenever HRegionFileSystem.openRegionFromFileSystem throws IOException.
Well Hadoop and HBase throw IOExceptions whenever someone looks in their general direction.

This patch explicitly checks if the directory exists. If it doesn't then it allows references to be
deleted. All other exceptions cause CatalogJanitor to assume there are references

Test Plan: Unit tests.

Differential Revision: https://reviews.facebook.net/D35829
2015-03-24 19:52:17 -07:00
tedyu 7c2525bf15 HBASE-13327 Use Admin in ConnectionCache (Solomon Duskis) 2015-03-24 18:15:09 -07:00
Mikhail Antonov ac6fd86d26 HBASE-13273 Make Result.EMPTY_RESULT read-only; currently it can be modified
Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Result.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestResult.java
2015-03-24 13:15:43 -07:00
Matteo Bertozzi c305b44362 HBASE-13321 Fix flaky TestHBaseFsck 2015-03-24 16:52:05 +00:00
Matteo Bertozzi 266e883daa HBASE-13314 Fix NPE in HMaster.getClusterStatus() 2015-03-24 09:28:51 +00:00
Matteo Bertozzi f3f42bf7a6 HBASE-13309 Some tests do not reset EnvironmentEdgeManager 2015-03-22 10:43:15 +00:00
zhangduo bbf9a90ff2 HBASE-13308 Fix flaky TestEndToEndSplitTransaction
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestEndToEndSplitTransaction.java
2015-03-21 20:55:49 +08:00
Andrew Purtell e90ac5f812 HBASE-13303 Fix size calculation of results on the region server 2015-03-20 17:25:17 -07:00
Matteo Bertozzi 4230b1ae2e HBASE-13282 Fix the minor issues of running Canary on kerberized environment (Srikanth Srungarapu) 2015-03-20 21:14:07 +00:00
Ashish Singhi 14fa34513e HBASE-13241 Add tests for group level grants 2015-03-19 21:38:47 +00:00
Esteban Gutierrez f6095adea6 TestEnableTableHandler.testDeleteForSureClearsAllTableRowsFromMeta - ADDENDUM 2015-03-19 21:01:38 +00:00
Matteo Bertozzi 1f7b7781a1 HBASE-13285 Fix flaky getRegions() in TestAccessController.setUp() 2015-03-19 18:28:58 +00:00
zhangduo 9e92e33629 HBASE-13280 TestSecureRPC failed 2015-03-19 21:46:15 +08:00
Matteo Bertozzi 6b411b5d00 HBASE-13235 Revisit the security auditing semantics (Srikanth Srungarapu) 2015-03-19 07:01:55 +00:00
Matteo Bertozzi e283a210e6 HBASE-13253 LoadIncrementalHFiles unify hfiles discovery 2015-03-17 19:39:18 +00:00
Andrey Stepachev bee9fb8e7e HBASE-13176 Flakey TestZooKeeper test. 2015-03-17 15:00:10 +00:00
Jonathan M Hsieh 489698d6c0 HBASE-12908 Typos in MemstoreFlusher javadocs (Edvin Malinovskis) 2015-03-17 00:38:54 -07:00
stack 71f22ebfb8 HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:27:02 -07:00