Commit Graph

3875 Commits

Author SHA1 Message Date
Jerry He 2b56164628 HBASE-13217 Procedure fails due to ZK issue 2015-05-11 14:23:20 -07:00
Sean Busbey 6213fa2fce HBASE-13611 update clover profile to work with clover 4.x and maven 3.
* change pom to use a maven 3 compat version of clover
* add clover to javadoc plugin deps so that instrumented doclet works
* modify IA annotation test to filter out clover instrumentation
* make splitlog counters check for atomiclong before casting
2015-05-11 01:23:35 -05:00
tedyu 8673a7df91 HBASE-13653 Uninitialized HRegionServer#walFactory may result in NullPointerException at region server startup​ 2015-05-10 07:31:58 -07:00
Sean Busbey 11bc89c3da HBASE-13612 TestRegionFavoredNodes should guard against setup failure. 2015-05-09 14:22:41 -07:00
tedyu 1c7389cbe2 HBASE-13593 Quota support for namespace should take snapshot restore and clone into account (Ashish Singhi) 2015-05-09 11:07:46 -07:00
tedyu 37ac28ea5b HBASE-13626 ZKTableStateManager logs table state changes at WARN (Stephen Jiang) 2015-05-06 14:39:29 -07:00
Enis Soztutar 2b56169ad6 HBASE-13576 HBCK enhancement: Failure in checking one region should not fail the entire HBCK operation. (Stephen Yuan Jiang)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
2015-05-06 12:47:59 -07:00
tedyu ec3d7189ad HBASE-13625 Use HDFS for HFileOutputFormat2 partitioner's path (Stephen Yuan Jiang) 2015-05-06 07:29:57 -07:00
zhangduo a64b3da63b HBASE-13628 Use AtomicLong as size in BoundedConcurrentLinkedQueue
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestBoundedConcurrentLinkedQueue.java
2015-05-06 15:01:02 +08:00
ramkrishna 426c7eef09 HBASE-13579 - Avoid isCellTTLExpired() for NO-TAG cases (Ram) 2015-05-06 12:12:39 +05:30
Liu Shaohui 308d515949 HBASE-13366 Throw DoNotRetryIOException instead of read only IOException (Shaohui Liu) 2015-05-05 18:12:39 -07:00
Josh Elser 335a26a893 HBASE-13591 Attempt to stabilize TestHBaseFsck 2015-05-05 15:38:02 -07:00
stack 86a5e3b4e3 HBASE-13617 TestReplicaWithCluster.testChangeTable timeout (Stephen Yuan Jiang) 2015-05-04 17:16:16 -07:00
Lars Hofhansl 0e76cf5be4 HBASE-13333 Renew Scanner Lease without advancing the RegionScanner. 2015-05-02 17:52:27 -07:00
tedyu e13ca3c61b HBASE-13607 TestSplitLogManager.testGetPreviousRecoveryMode consistently failing (Josh Elser) 2015-05-02 07:12:57 -07:00
Andrew Purtell 60b356a853 HBASE-13312 SmallScannerCallable does not increment scan metrics 2015-05-01 16:33:11 -07:00
Nick Dimiduk 62da795ddb HBASE-13604 bin/hbase mapredcp does not include yammer-metrics jar 2015-05-01 09:15:25 -07:00
Matt Warhaftig 5a87c3910e HBASE-13358 - Update VisibilityClient to accept Connection objects.
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:21:41 -07:00
Lars Hofhansl 62c55a6350 HBASE-13601 Connection leak during log splitting. (Abhishek Singh Chouhan) 2015-04-30 17:05:24 -07:00
Lars Hofhansl dc28ded74c HBASE-13497 Remove MVCC stamps from HFile when that is safe. 2015-04-30 16:48:55 -07:00
stack ac190e8077 HBASE-13377 Canary may generate false alarm on the first region when there are many delete markers (He Liangliang)
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java
2015-04-30 16:00:07 -07:00
Liu Shaohui d4f6928b05 HBASE-13200 Improper configuration can leads to endless lease recovery during failover (He Liangliang) 2015-04-30 15:12:22 -07:00
Andrew Purtell 6d40b547ae HBASE-13420 RegionEnvironment.offerExecutionLatency Blocks Threads under Heavy Load 2015-04-30 14:06:39 -07:00
stack 07e50f28b1 HBASE-13564 Master MBeans are not published (Ashish Singhi) + Addendum 2015-04-29 14:36:08 -07:00
Nick Dimiduk 64a42698a6 Revert "HBASE-13564 Master MBeans are not published"
This reverts commit 2a02e679cc.
2015-04-29 09:15:27 -07:00
Devaraj Das 699460aae0 HBASE-13351 Addendum to remove reference to MasterTests class 2015-04-28 23:52:33 -07:00
Devaraj Das 8aae3bfab6 HBASE-13351 Annotate internal MasterRpcServices methods with admin priority (Josh Elser) 2015-04-28 23:45:01 -07:00
Rajeshbabu Chintaguntla 1dbed01d28 HBASE-13431 Allow to skip store file range check based on column family while creating reference files in HRegionFileSystem#splitStoreFile(Rajeshbabu) 2015-04-29 09:38:24 +05:30
Enis Soztutar 18bbf2ecb8 HBASE-13585 HRegionFileSystem#splitStoreFile() finishes without closing the file handle in some situation (Stephen Yuan Jiang) 2015-04-28 17:28:12 -07:00
Matteo Bertozzi 3a9304e98f HBASE-13578 Remove Arrays.asList().subList() from FSHLog.offer() 2015-04-28 21:13:40 +01:00
Usha Kuchibhotla 0dbbc8b8de HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientIdGenerator.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestIngestWithEncryption.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/TestStatusResource.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestTableDescriptor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestRowCounter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildOverlap.java
2015-04-28 10:10:21 -05:00
Ashish Singhi 2a02e679cc HBASE-13564 Master MBeans are not published 2015-04-27 21:24:04 -07:00
Josh Elser 16443da51a HBASE-13255 Fix grammar in Regions description paragraph 2015-04-27 15:51:43 -07:00
Matteo Bertozzi f862412592 HBASE-13394 Failed to recreate a table when quota is enabled 2015-04-27 21:49:58 +01:00
Devaraj Das 93af6b65a3 HBASE-12552 Backport listSnapshots should list only owned snapshots for non-super user (Ashish Singhi) 2015-04-27 09:25:56 -07:00
Srikanth Srungarapu decc9b9c36 HBASE-13563 Add missing table owner to AC tests. 2015-04-26 16:42:18 -07:00
Nick Dimiduk 566dfda5b7 HBASE-13466 Document deprecations in 1.x - Part 1 (Lars Francke) 2015-04-26 13:11:35 -07:00
tedyu 85d090d816 HBASE-13555 StackServlet produces 500 error 2015-04-24 16:37:25 -07:00
Srikanth Srungarapu 8ab6698120 HBASE-13536 Cleanup the handlers that are no longer being used. 2015-04-24 12:40:59 -07:00
Sean Busbey 1a0c61c974 HBASE-13546 handle nulls in MasterAddressTracker when there is no master active. 2015-04-24 13:54:36 -05:00
tedyu 42ad845032 HBASE-13528 A bug on selecting compaction pool (Shuaifeng Zhou) 2015-04-24 02:19:31 -07:00
Apekshit(Appy) Sharma 2b392de640 HBASE-13534 Changed Master UI to promptly display if it is a backup master. (Apekshit)
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-23 15:32:42 -07:00
Jerry He f1c29a8385 HBASE-13526 TestRegionServerReportForDuty can be flaky: hang or timeout 2015-04-22 22:21:54 -07:00
Jonathan Lawlor c8d8499da8 HBASE-13527 The default value for hbase.client.scanner.max.result.size is never actually set on Scans
Signed-off-by: stack <stack@apache.org>
2015-04-22 13:29:48 -07:00
tedyu 30880bca55 HBASE-13437 Addendum removes MiscTests 2015-04-22 07:45:01 -07:00
tedyu 71b7755584 HBASE-13437 ThriftServer leaks ZooKeeper connections (Winger Pun) 2015-04-22 07:42:44 -07:00
Elliott Clark 59cc620e85 HBASE-13524 TestReplicationAdmin fails on JDK 1.8 2015-04-21 17:06:16 -07:00
zhangduo ca7efc183a HBASE-13499 AsyncRpcClient test cases failure in powerpc 2015-04-14 23:00:17 +08:00
Rajesh Nishtala ba8d985000 HBASE-13471 Fix a possible infinite loop in doMiniBatchMutation
Summary: in doMiniBatchMutation it is possible to get into an infinite loop when a query has a row that is not in the region. If the batch had an invalid row, the row lock further down the function would fail to acquire because it was an invalid row. However we'd catch the exception and improperly treat it as if we had not acquired the lock and then try acquiring the lock again. Thus once we got into this state we'd be stuck in an infinite loop. Worse yet, this infiite loop would occur with the readLock held. So any other opertaions such as doClose() would be locked out and stuck. The patch is to check whether the row is valid and short circuit the failure when it doesn't work.

Test Plan: IntegrationTestReplication would consistently fail when trying to disable large tables before the fix. After the test the tests pass consistently.

Reviewers: eclark

Subscribers: asameet

Differential Revision: https://reviews.facebook.net/D37437

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-21 15:25:01 -07:00
Enis Soztutar 0c6b1c9388 HBASE-13515 Handle FileNotFoundException in region replica replay for flush/compaction events 2015-04-21 11:56:14 -07:00
anoopsjohn 8e6353ccd1 HBASE-13520 NullPointerException in TagRewriteCell.(Josh Elser) 2015-04-21 17:39:07 +05:30
tedyu cac134c14a HBASE-13514 Fix test failures in TestScannerHeartbeatMessages caused by incorrect setting of hbase.rpc.timeout (Jonathan Lawlor) 2015-04-20 14:25:17 -07:00
Sean Busbey 83b6f88d5f HBASE-13498 Addendum missed local change from conflict resolution. 2015-04-20 11:21:14 -05:00
Sean Busbey b924c7564f HBASE-13498 Add more docs and a basic check for storage policy handling.
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2015-04-20 10:54:05 -05:00
Devaraj Das 4001492e7f HBASE-13482. Phoenix is failing to scan tables on secure environments. (Alicia Shu) 2015-04-19 22:18:05 -07:00
Tobi Vollebregt 10254b74ae HBASE-13430 HFiles that are in use by a table cloned from a snapshot may be deleted when that snapshot is deleted
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-18 09:53:04 +01:00
Enis Soztutar 60c30c707c HBASE-13491 Issue in FuzzyRowFilter#getNextForFuzzyRule (Anoop Sam John) 2015-04-17 21:56:04 -07:00
Enis Soztutar 49bf9aec8b HBASE-13481 Master should respect master (old) DNS/bind related configurations 2015-04-17 18:13:47 -07:00
tedyu b655a9909e HBASE-13090 Addendum fixes compilation error in TestScannerHeartbeatMessages 2015-04-17 17:04:59 -07:00
Jonathan Lawlor a4f77d49a5 HBASE-13090 Progress heartbeats for long running scanners
Signed-off-by: stack <stack@apache.org>
2015-04-17 15:43:13 -07:00
Elliott Clark 91e09bc0ab HBASE-13477 Create metrics on failed requests
Summary: Add metrics on how many requests are exceptions and what type.

Test Plan: behold unit tests.

Differential Revision: https://reviews.facebook.net/D37167
2015-04-17 15:38:38 -07:00
Jerry He 3c81d656e0 HBASE-13456 Improve HFilePrettyPrinter first hbase:meta region processing (Samir Ahmic) 2015-04-17 11:33:24 -07:00
Nick Dimiduk cf45c8d30a Bump pom version to 1.2.0-SNAPSHOT 2015-04-16 17:30:48 -07:00
stack 8166142b2e HBASE-13291 Making methods under ScannerV2#next inlineable and faster 2015-04-16 14:56:08 -07:00
tedyu 3ca1e46bd9 HBASE-13473 deleted cells come back alive after the stripe compaction (jeongmin kim) 2015-04-16 11:35:53 -07:00
tedyu 8ce7f905d2 HBASE-13463 Quota needs to be updated only in case of successful region merge 2015-04-16 11:08:54 -07:00
Matt Warhaftig a778c38ab4 HBASE-13350 Log warnings for sanity check failures when checks disabled.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-16 10:00:48 +01:00
Josh Elser ffd7bbfd6b HBASE-12987 Pare repeated hbck output and increase verbosity in long-running tasks. 2015-04-15 14:36:27 -07:00
Devaraj Das 65bf10a47f HBASE-13453. Master should not bind to region server ports (Srikanth Srungarapu) 2015-04-15 11:06:43 -07:00
Andrew Purtell c2eeddfb27 HBASE-12006 [JDK 8] KeyStoreTestUtil#generateCertificate fails due to "subject class type invalid"
This is a port of the fix from HADOOP-10847
2015-04-15 09:47:45 -07:00
Matteo Bertozzi ec472fb18a HBASE-13455 Procedure V2 - master truncate table 2015-04-15 11:07:08 +01:00
Matteo Bertozzi 7c5ae63850 HBASE-13290 Procedure v2 - client enable/disable table sync (Stephen Yuan Jiang) 2015-04-15 11:05:49 +01:00
Matteo Bertozzi 2cbb1afe52 HBASE-13211 Procedure V2 - master Enable/Disable table (Stephen Yuan Jiang) 2015-04-15 11:04:58 +01:00
Matteo Bertozzi 4cc464dae1 HBASE-13209 Procedure V2 - master Add/Modify/Delete Column Family (Stephen Yuan Jiang) 2015-04-15 11:04:07 +01:00
Matteo Bertozzi c967595acb HBASE-13210 Procedure V2 - master Modify table (Stephen Yuan Jiang) 2015-04-15 11:03:14 +01:00
Matteo Bertozzi 67149d253b HBASE-13204 Procedure v2 - client create/delete table sync 2015-04-15 11:02:26 +01:00
Matteo Bertozzi 58b1598b44 HBASE-13203 Procedure v2 - master create/delete table 2015-04-15 11:01:36 +01:00
tedyu daa82b9fd9 HBASE-13438 [branch-1] Backport Basic quota support for namespaces (Ashish Singhi) 2015-04-14 04:42:56 -07:00
zhangduo bcd5c4d137 HBASE-13301 Possible memory leak in BucketCache
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/bucket/TestBucketCache.java
2015-04-14 17:43:46 +08:00
Matteo Bertozzi 4fc39fd7c9 HBASE-13457 SnapshotExistsException doesn't honor the DoNotRetry 2015-04-13 23:22:28 +01:00
Srikanth Srungarapu f3b6cc84f2 HBASE-13436 Include user name in ADE for scans 2015-04-10 14:04:30 -07:00
tedyu e831ed0747 HBASE-13381 Expand TestSizeFailures to include small scans (Josh Elser) 2015-04-09 17:57:26 -07:00
stack d1133ced44 HBASE-13118 [PE] Add being able to write many columns 2015-04-09 16:50:02 -07:00
Andrew Purtell 356422e1ae HBASE-13275 Setting hbase.security.authorization to false does not disable authorization
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
2015-04-09 14:43:29 -07:00
Lars Hofhansl 562859f4af HBASE-13362 Set max result size from client only (like scanner caching). 2015-04-08 21:43:22 -07:00
Jonathan M Hsieh c2bfddac13 HBASE-13412 ADDENDUM Region split decisions should have jitter
This corrects the jitter threshold constant in the unit test so that it will pass regularly.
2015-04-08 14:50:03 -07:00
Jonathan Lawlor 408b916175 HBASE-13421 Reduce the number of object creations introduced by HBASE-11544 in scan RPC hot code paths
Signed-off-by: stack <stack@apache.org>
2015-04-08 14:03:38 -07:00
Sean Busbey 7469426d64 HBASE-13414 Removes now-obselete checks for JRE 6 in TestHCM.
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2015-04-08 14:32:27 -05:00
tedyu 3f8780e153 HBASE-11864 Enhance HLogPrettyPrinter to print information from WAL Header (Chuhan Yang) 2015-04-08 06:15:20 -07:00
ramkrishna 3cda2dfcad HBASE-13370 - PE tool could give option for using Explicit Column Tracker
which leads to seeks(Ram)
2015-04-08 10:26:16 +05:30
tedyu c031d8de23 HBASE-13205 [branch-1] Backport HBASE-11598 Add simple rpc throttling (Ashish Singhi) 2015-04-07 18:29:03 -07:00
Elliott Clark bbdd50b9c5 HBASE-13412 Region split decisions should have jitter 2015-04-07 17:20:26 -07:00
Ashish Singhi 15cdd898e3 HBASE-13299 Add setReturnResults() to Increment, like Append has
Signed-off-by: stack <stack@apache.org>
2015-04-07 11:47:48 -07:00
Jonathan Lawlor 30f6d54cc8 HBASE-13374 Small scanners (with particular configurations) do not return all rows
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-04-05 14:29:43 -07:00
Matteo Bertozzi d92ea13362 HBASE-13406 TestAccessController is flaky when create is slow 2015-04-04 10:14:13 +01:00
Apekshit(Appy) Sharma 4d8bcd4629 HBASE-6919 Remove unnecessary throws IOException from Bytes.readVLong.
Added readAsVLong() to deprecate readVLong() which was throwing IOException. Added test for readAsVLong().

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderV2.java
2015-04-03 21:41:39 -05:00
stack e65f430003 Revert "HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:"
Revert because breaking migration tests.

This reverts commit 95893ffebd.
2015-04-03 18:57:53 -07:00
stack 5c19f9eac7 HBASE-13397 Purge duplicate rpc request thread local 2015-04-03 15:44:57 -07:00
stack 95893ffebd HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:
Reapply after fixing missing JIRA number
2015-04-03 15:30:07 -07:00
stack da61928246 Revert "HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc."
Revert because missing JIRA number

This reverts commit 691efc60f7.
2015-04-03 15:26:13 -07:00
stack 691efc60f7 HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc. 2015-04-03 14:25:02 -07:00
zhangduo dd4f8a5e5a HBASE-13385 TestGenerateDelegationToken is broken with hadoop 2.8.0
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/token/TestGenerateDelegationToken.java
2015-04-03 07:54:55 +08:00
stack 7e1e5a60fb HBASE-13216 Add version info in RPC connection header (Liu Shaohui) 2015-04-02 15:50:49 -07:00
Andrew Purtell 6605dda7b4 HBASE-13388 Handling NullPointer in ZKProcedureMemberRpcs while getting ZNode data (Vikas Vishwakarma) 2015-04-02 14:18:07 -07:00
Dave Latham b8e969be7a HBASE-12891 Parallel execution for Hbck checkRegionConsistency
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-04-02 11:24:14 -07:00
Devaraj Das 926aaed113 HBASE-11869. Support snapshot owner (Liu Shaohui). 2015-04-01 23:56:59 -07:00
Srikanth Srungarapu 71c96e353a HBASE-13091 Split ZK Quorum on Master WebUI (Jean-Marc Spaggiari) 2015-04-01 23:21:21 -07:00
Andrew Purtell b75a4c8ef0 HBASE-13384 Fix Javadoc warnings introduced by HBASE-12972 2015-04-01 22:06:51 -07:00
Enis Soztutar b22fcd36ef HBASE-13317 Region server reportForDuty stuck looping if there is a master change - ADDENDUM for branch-1 (Jerry He) 2015-04-01 17:27:01 -07:00
Srikanth Srungarapu a6ddcc8fa2 HBASE-13296 Fix the deletion of acl notify nodes for namespace. 2015-04-01 12:17:00 -07:00
tedyu 39b5ce9470 HBASE-12954 Addendum uses invalid TLD in test 2015-04-01 11:20:16 -07:00
tedyu 4df24b8e6d HBASE-12954 Ability impaired using HBase on multihomed hosts 2015-04-01 06:47:26 -07:00
Enis Soztutar 394b460934 HBASE-13317 Region server reportForDuty stuck looping if there is a master change (Jerry He) 2015-03-31 22:59:34 -07:00
zhangduo 35fdea7d00 HBASE-13371 Fix typo in TestAsyncIPC 2015-04-01 12:15:10 +08:00
Andrew Purtell bf76082f5f HBASE-12975 Supportable SplitTransaction and RegionMergeTransaction interfaces 2015-03-31 16:02:24 -07:00
tedyu c4194f2849 HBASE-13369 Addendum deletes the table at the end of test 2015-03-31 15:43:08 -07:00
tedyu bb65a8664d HBASE-13369 Expose scanNext stats to region server level 2015-03-31 15:27:39 -07:00
tedyu f1601c0d12 HBASE-13213 Split out locality metrics among primary and secondary region 2015-03-31 15:00:56 -07:00
Andrew Purtell af1715933e HBASE-12972 Region, a supportable public/evolving subset of HRegion 2015-03-30 18:01:32 -07:00
tedyu 0f0f3f8493 HBASE-12993 Use HBase 1.0 interfaces in hbase-thrift (Solomon Duskis) 2015-03-29 06:44:50 -07:00
Josh Elser b0116398ff HBASE-13262 Observe ScanResponse.moreResults in ClientScanner.
The RS already returns to the client whether or not it has additional
results to be returned in a subsequent call to scan(), but the ClientScanner
did not use or adhere to this value. Subsequently, this can lead to
bugs around moving to the next region too early. A new method was added
to ClientScanner in the name of testability.

Encapsulate server-state into RegionServerCallable to avoid
modifying parameterization of callable impls.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-28 18:56:50 -07:00
Jonathan Lawlor 7da7a77ff9 Amend HBASE-13303 Fix size calculation of results on the region server
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-27 22:12:07 -07:00
Enis Soztutar 4bda365ab1 HBASE-13328 LoadIncrementalHFile.doBulkLoad(Path,HTable) should handle managed connections 2015-03-27 14:50:23 -07:00
Josh Elser b9a615e739 HBASE-13222 Add isBalancerEnabled method to Master and Admin.
Include some basic tests for the method on a testing cluster.
Also update master page to show an alert when balancer is disabled.

Signed-off-by: Enis Soztutar <enis@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/RequestConverter.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
2015-03-27 14:47:24 -07:00
Elliott Clark 2857b21eaf HBASE-13170 Allow block cache to be external
Summary: Add MemcachedBlockCache

Test Plan: Tested locally with PE and running memcached.

Subscribers: rajesh.nishtala, ndimiduk

Differential Revision: https://reviews.facebook.net/D34635
2015-03-27 13:17:05 -07:00
Sameet Agarwal 2fd6f2a829 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:56:21 -07:00
Elliott Clark 650c9f27fd HBASE-13342 Fix incorrect interface annotations 2015-03-27 00:22:04 -07:00
Andrew Purtell 66af9410b1 HBASE-13332 Fix the usage of doAs/runAs in Visibility Controller tests (Srikanth Srungarapu)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestDefaultScanLabelGeneratorStack.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestEnforcingScanLabelGenerator.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelReplicationWithExpAsString.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabels.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithACL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDefaultVisLabelService.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDeletes.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityWithCheckAuths.java
2015-03-26 21:54:28 -07:00
zhangduo e8059b0dc5 HBASE-13295 TestInfoServers hung
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestInfoServers.java
2015-03-27 11:57:19 +08:00
nke 797eee33ab HBASE-8725 Add total time RPC call metrics
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-26 11:12:29 -07:00
Andrey Stepachev 9df1c244a0 HBASE-13326 Disabled table can't be enabled after HBase is restarted 2015-03-25 22:57:37 +00:00
Andrew Purtell 050028c32e HBASE-13294 Fix the critical ancient loopholes in security testing infrastructure (Srikanth Srungarapu) 2015-03-25 09:28:12 -07:00
Elliott Clark cc750c656a HBASE-13331 Exceptions from DFS client can cause CatalogJanitor to delete referenced files
Summary:
CatalogJanitor#checkDaughterInFs assumes that there are no references
whenever HRegionFileSystem.openRegionFromFileSystem throws IOException.
Well Hadoop and HBase throw IOExceptions whenever someone looks in their general direction.

This patch explicitly checks if the directory exists. If it doesn't then it allows references to be
deleted. All other exceptions cause CatalogJanitor to assume there are references

Test Plan: Unit tests.

Differential Revision: https://reviews.facebook.net/D35829
2015-03-24 19:52:17 -07:00
tedyu 7c2525bf15 HBASE-13327 Use Admin in ConnectionCache (Solomon Duskis) 2015-03-24 18:15:09 -07:00
Mikhail Antonov ac6fd86d26 HBASE-13273 Make Result.EMPTY_RESULT read-only; currently it can be modified
Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Result.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestResult.java
2015-03-24 13:15:43 -07:00
Matteo Bertozzi c305b44362 HBASE-13321 Fix flaky TestHBaseFsck 2015-03-24 16:52:05 +00:00
Matteo Bertozzi 266e883daa HBASE-13314 Fix NPE in HMaster.getClusterStatus() 2015-03-24 09:28:51 +00:00
Matteo Bertozzi f3f42bf7a6 HBASE-13309 Some tests do not reset EnvironmentEdgeManager 2015-03-22 10:43:15 +00:00
zhangduo bbf9a90ff2 HBASE-13308 Fix flaky TestEndToEndSplitTransaction
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestEndToEndSplitTransaction.java
2015-03-21 20:55:49 +08:00
Andrew Purtell e90ac5f812 HBASE-13303 Fix size calculation of results on the region server 2015-03-20 17:25:17 -07:00
Matteo Bertozzi 4230b1ae2e HBASE-13282 Fix the minor issues of running Canary on kerberized environment (Srikanth Srungarapu) 2015-03-20 21:14:07 +00:00
Ashish Singhi 14fa34513e HBASE-13241 Add tests for group level grants 2015-03-19 21:38:47 +00:00
Esteban Gutierrez f6095adea6 TestEnableTableHandler.testDeleteForSureClearsAllTableRowsFromMeta - ADDENDUM 2015-03-19 21:01:38 +00:00
Matteo Bertozzi 1f7b7781a1 HBASE-13285 Fix flaky getRegions() in TestAccessController.setUp() 2015-03-19 18:28:58 +00:00
zhangduo 9e92e33629 HBASE-13280 TestSecureRPC failed 2015-03-19 21:46:15 +08:00
Matteo Bertozzi 6b411b5d00 HBASE-13235 Revisit the security auditing semantics (Srikanth Srungarapu) 2015-03-19 07:01:55 +00:00
Matteo Bertozzi e283a210e6 HBASE-13253 LoadIncrementalHFiles unify hfiles discovery 2015-03-17 19:39:18 +00:00
Andrey Stepachev bee9fb8e7e HBASE-13176 Flakey TestZooKeeper test. 2015-03-17 15:00:10 +00:00
Jonathan M Hsieh 489698d6c0 HBASE-12908 Typos in MemstoreFlusher javadocs (Edvin Malinovskis) 2015-03-17 00:38:54 -07:00
stack 71f22ebfb8 HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:27:02 -07:00
tedyu 9b4d78c33f HBASE-13246 Correct the assertion for namespace permissions in tearDown method of TestAccessController (Ashish Singhi) 2015-03-16 06:46:54 -07:00
zhangduo 663dacca9d HBASE-13244 addendum add InterfaceAudience annotation back for HBaseKerberosUtils 2015-03-16 15:20:17 +08:00
zhangduo 6fb6362e28 HBASE-13244 Test delegation token generation with kerberos enabled 2015-03-15 23:08:25 +08:00
tedyu 189424e6fc HBASE-13239 HBase grant at specific column level does not work for Groups 2015-03-14 20:21:03 -07:00
zhangduo cb4db89bff HBASE-13242 TestPerColumnFamilyFlush.testFlushingWhenLogRolling hung 2015-03-15 08:15:32 +08:00
Josh Elser c3b47f2251 HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-14 00:19:44 -05:00
Matteo Bertozzi 7229a0a47d HBASE-13227 LoadIncrementalHFile should skip non-files inside a possible family-dir 2015-03-13 17:12:11 +00:00
Esteban Gutierrez aa93b176f0 HBASE-13224 Minor formatting issue when logging a namespace scope in AuthResult#toContextString 2015-03-13 10:53:59 +00:00
Enis Soztutar c8999d9def HBASE-13169 ModifyTable increasing the region replica count should also auto-setup RRRE
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/ModifyTableHandler.java
2015-03-12 15:21:31 -07:00
tedyu da9c5ac18c HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 21:41:24 -07:00
Enis Soztutar 0f892c23ec HBASE-13063 Allow to turn off memstore replication for region replicas - ADDENDUM for turning of primary flush tigger when this is enabled 2015-03-11 14:57:15 -07:00
Devaraj Das e864dd0520 HBASE-13192. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures. 2015-03-11 13:55:34 -07:00
Matteo Bertozzi f8dced1e6d HBASE-13206 Fix TableLock tableName log format 2015-03-11 18:27:41 +00:00
stack 0fb1ad7db4 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer; ADDENDUM 2015-03-10 22:21:01 -07:00
tedyu 05aef46d94 HBASE-13168 Backport HBASE-12590 "A solution for data skew in HBase-Mapreduce Job" 2015-03-10 18:47:31 -07:00
stack 619d58f9b5 HBASE-13114 [UNITTEST] TestEnableTableHandler.testDeleteForSureClearsAllTableRowsFromMeta 2015-03-10 14:15:33 -07:00
Matteo Bertozzi c4369d9a90 HBASE-13181 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently 2015-03-10 17:22:07 +00:00
Matteo Bertozzi eb2193afa0 HBASE-13063 Allow to turn off memstore replication for region replicas 2015-03-10 10:17:15 +00:00
Matteo Bertozzi 52ff5485a8 HBASE-13182 TestAccessController create/delete table is flaky 2015-03-10 09:18:33 +00:00
zhangduo ce1a5eeda3 HBASE-12405 addendum fix HRegion heap size 2015-03-10 15:13:53 +08:00
zhangduo 5ff108d0e1 HBASE-12405 WAL accounting by Store
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ResponseConverter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-03-10 13:13:40 +08:00
Andrew Purtell 4afae59cfa HBASE-13183 Make ZK tickTime configurable in standalone HBase (Alex Araujo) 2015-03-09 18:34:48 -07:00
Enis Soztutar 280120ee15 HBASE-13121 Async wal replication for region replicas and dist log replay does not work together
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/coordination/ZkSplitLogWorkerCoordination.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
2015-03-09 16:12:04 -07:00
zhangduo c40d880a3e HBASE-13172 TestDistributedLogSplitting.testThreeRSAbort fails several times on branch-1
Signed-off-by: stack <stack@apache.org>
2015-03-09 14:13:35 -07:00
Matteo Bertozzi 5197640c30 HBASE-13179 TestMasterObserver deleteTable is flaky 2015-03-09 19:47:53 +00:00
tedyu 668ab35649 HBASE-12931 The existing KeyValues in memstore are not removed completely after inserting cell into memStore (ChiaPing Tsai) 2015-03-07 08:01:21 -08:00
tedyu e5efca212d HBASE-13164 Update TestUsersOperationsWithSecureHadoop to use MiniKdc (Duo Zhang) 2015-03-06 18:44:20 -08:00
Enis Soztutar 5619f20e1a HBASE-12706 Support multiple port numbers in ZK quorum string (Stephen Yuan Jiang) 2015-03-06 16:47:44 -08:00
Lars Hofhansl c8610ce36f Revert "HBASE-13082 Coarsen StoreScanner locks to RegionScanner."
This reverts commit 02522615d1.
Reverted due to test failures.
2015-03-06 15:25:59 -08:00
Enis Soztutar 6e5e5d8cce HBASE-12562 Handling memory pressure for secondary region replicas
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
2015-03-06 14:48:58 -08:00
stack 3e3276d7fa HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer 2015-03-06 14:35:49 -08:00
Lars Hofhansl 02522615d1 HBASE-13082 Coarsen StoreScanner locks to RegionScanner. 2015-03-06 12:45:04 -08:00
Enis Soztutar 8116a8b524 HBASE-12180 Fix and reenable TestRegionReplicaReplicationEndpoint
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
2015-03-05 15:52:35 -08:00
Victoria Dudin 4e2edb93df HBASE-13128 Make HBCK's lock file retry creation and deletion
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-05 15:28:27 -08:00
tedyu efb6e7005f HBASE-13155 Fix TestPrefixTree (Duo Zhang) 2015-03-05 06:54:58 -08:00
Jonathan Lawlor 0c64a57e52 HBASE-11544: [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Signed-off-by: stack <stack@apache.org>
2015-03-04 18:04:15 -08:00
Lars Hofhansl 1cdcb6e9b8 HBASE-13109 Fix Javadoc warning; and some misc checkstyle warnings 2015-03-04 18:02:34 -08:00
Enis Soztutar 07cb6d2413 HBASE-11580 Failover handling for secondary region replicas - ADDENDUM for javadoc fixes 2015-03-04 14:22:58 -08:00
Lars Hofhansl f5020e9c1a HBASE-13109 Make better SEEK vs SKIP decisions during scanning. 2015-03-04 14:13:41 -08:00
Jeffrey Zhong 4506b6e003 HBASE-11571 Bulk load handling from secondary region replicas 2015-03-03 15:21:22 -08:00
stack 6b1674b31c HBASE-13017 Backport HBASE-12035 Keep table state in Meta to 1.0 branch; REVERT 2015-03-03 13:26:15 -08:00
Enis Soztutar 9e7ad99593 HBASE-11580 Failover handling for secondary region replicas
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
2015-03-03 13:21:01 -08:00
zhangduo 2c02f2f154 HBASE-13145 TestNamespaceAuditor.testRegionMerge is flaky
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/namespace/TestNamespaceAuditor.java
2015-03-03 10:35:09 -08:00
stack 10d5236e66 HBASE-13136 TestSplitLogManager.testGetPreviousRecoveryMode is flakey 2015-03-02 17:29:47 -08:00
stack c4acac561c HBASE-13138 Clean up TestMasterObserver (debug, trying to figure why fails) 2015-03-02 10:54:10 -08:00
Ramkrishna 9c3cbdcd05 HBASE-13123 - Minor bug in ROW bloom filter (Ram):w 2015-03-02 11:47:20 +05:30
tedyu c64686e2e1 HBASE-13134 mutateRow and checkAndMutate apis don't throw region level exceptions (Francis Liu) 2015-03-01 20:25:43 -08:00
stack 10f3b77748 HBASE-NPE when running TestSplitLogManager (Andrey Stepachev and Zhangduo) 2015-03-01 19:54:38 -08:00
stack 5b0b43b48d HBASE-13130 Add timeouts on TestMasterObserver, a frequent zombie show 2015-02-28 15:27:59 -08:00
Sameet Agarwal a6cd9d986d HBASE-12924 HRegionServer#MovedRegionsCleaner Chore does not start
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-02-28 10:35:19 -08:00
Enis Soztutar b09c4feade HBASE-13119 FileLink should implement equals
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileInfo.java
2015-02-27 18:13:45 -08:00
zhangduo ade44d754d HBASE-13097 Use same EventLoopGroup for different AsyncRpcClients if possible
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestIPC.java
2015-02-27 08:45:29 -08:00
Andrew Purtell 3e17ed9c3e HBASE-13106 Ensure endpoint-only table coprocessors can be dynamically loaded 2015-02-25 18:21:10 -08:00
Elliott Clark 2286371243 HBASE-13102 Fix Pseudo-distributed Mode which was broken in 1.0.0 2015-02-25 15:51:30 -08:00
Nick Dimiduk 9446b2cc7e HBASE-13086 Show ZK root node on Master WebUI 2015-02-24 19:05:19 -08:00
Ashish Singhi 9e9a98fdb1 HBASE-13048 Use hbase.crypto.wal.algorithm in SecureProtobufLogReader while decrypting the data
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-24 18:18:31 -08:00
zhangduo a2123144ff HBASE-13084 Add labels to VisibilityLabelsCache asynchronously causes TestShell flakey
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
2015-02-24 17:06:34 -08:00
stack 540266a7a0 HBASE-13083 Master can be dead-locked while assigning META. (Andrey Stepachev) 2015-02-23 21:17:36 -08:00
stack bb3ca8ed12 HBASE-13001 NullPointer in master logs for table.jsp (Vikas Vishwakarma) 2015-02-23 20:50:22 -08:00
zhangduo b5590ac722 HBASE-12953 RegionServer is not functionally working with AysncRpcClient in secure mode
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/TestSecureRPC.java
2015-02-23 20:41:45 -08:00
Enis Soztutar 492980d447 HBASE-12561 Replicas of regions can be cached from different instances of the table in MetaCache
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionReplicaUtil.java
2015-02-23 12:01:10 -08:00
Enis Soztutar 28f4b8d07e HBASE-12714 RegionReplicaReplicationEndpoint should not set the RPC Codec 2015-02-22 21:58:20 -08:00
Enis Soztutar 5321d4465f HBASE-11842 Integration test for async wal replication to secondary regions
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/RestartMetaTest.java
2015-02-22 21:51:51 -08:00
Rajeshbabu Chintaguntla 66d59afa66 HBASE-13054 Provide more tracing information for locking/latching events.(Rajeshbabu) 2015-02-21 12:17:44 +05:30
stack 61901c86b1 HBASE-13032 Migration of states should be performed once META is assigned and onlined (Andrey Stepachev) 2015-02-20 22:06:57 -08:00
tedyu 9d29f3c4f1 HBASE-13057 Provide client utility to easily enable and disable table replication (Ashish Singhi) 2015-02-20 10:27:20 -08:00
tedyu cfc01532e2 HBASE-13070 Fix TestCacheOnWrite (Duo Zhang) 2015-02-20 08:40:34 -08:00
Sean Busbey 49ae4ab672 HBASE-13075 TableInputFormatBase spuriously warning about multiple initializeTable calls 2015-02-19 16:22:46 -06:00
tedyu 6b44b73404 HBASE-13072 BucketCache.evictBlock returns true if block does not exist (Duo Zhang) 2015-02-19 08:28:51 -08:00
Ashish Singhi 41d93323f2 HBASE-13002 Make encryption cipher configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/io/crypto/TestEncryption.java
2015-02-18 11:42:22 -08:00
stack 25e8e9b5ae HBASE-13056 Refactor table.jsp code to remove repeated code and make it easier to add new checks (Vikas Vishwakarma) 2015-02-18 11:35:42 -08:00
Devaraj Das e8a34fb384 HBASE-13036. Meta scanner should use its own threadpool 2015-02-18 10:54:31 -08:00
stack f5e2a82328 HBASE-13017 Backport HBASE-12035 Keep table state in Meta to 1.0 branch (Andrey Stepachev) 2015-02-18 09:58:32 -08:00
tedyu ac49c8d3e9 HBASE-13061 RegionStates can remove wrong region from server holdings (Andrey Stepachev) 2015-02-18 06:24:47 -08:00
Abhishek Kumar 0004aeea80 HBASE-13050 Empty Namespace validation
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-02-18 08:32:55 +01:00
tedyu d10639dcc2 HBASE-12948 Calling Increment#addColumn on the same column multiple times produces wrong result (hongyu bi) 2015-02-17 12:41:18 -08:00
stack ea0bdd3df1 HBASE-13040 Possible failure of TestHMasterRPCException (Zhang Duo)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestHMasterRPCException.java
2015-02-17 12:11:24 -08:00
stack 63bbc1cade HBASE-13047 Add "HBase Configuration" link missing on the table details pages (Vikas Vishwakarma) 2015-02-16 20:49:35 -08:00
tedyu 500b04543b HBASE-13055 HRegion FIXED_OVERHEAD missed one boolean (Duo Zhang) 2015-02-16 17:27:49 -08:00
Andrew Purtell b33f50e1d4 HBASE-13044 Configuration option for disabling coprocessor loading
Conflicts:
	hbase-common/src/main/resources/hbase-default.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestCoprocessorConfiguration.java
2015-02-15 11:21:22 -08:00
Sean Busbey 4d0de57a77 HBASE-13028 Cleanup MapReduce InputFormats
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapred/TableInputFormat.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapred/TableInputFormatBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormatBase.java
2015-02-14 14:17:46 -06:00
Lars Hofhansl 05e0b46d52 HBASE-12971 Replication stuck due to large default value for replication.source.maxretriesmultiplier. 2015-02-13 22:19:15 -08:00
Aditya Kishore 432b2197fd HBASE-13010 HFileOutputFormat2 partitioner's path is hard-coded as '/tmp'
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-13 18:53:26 -08:00
Sean Busbey 9114edece1 HBASE-13027 Ensure extension of TableInputFormatBase works.
* move mapreduce version of TableInputFormat tests out of mapred
* add ability to get runnable job via MR test shims
* correct the javadoc example for current APIs.
* add tests the run a job based on the extending TableInputFormatBase (as given in the javadocs)
* add tests that run jobs based on the javadocs from 0.98
* fall back to our own Connection if ussers of the deprecated table configuration have a managed connection.
2015-02-13 18:43:44 -06:00
stack e8d17da337 HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn -- ADDENDUM 2015-02-13 15:53:54 -08:00
stack 1338f0980e HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/ScanPerformanceEvaluation.java
2015-02-13 15:28:51 -08:00
Enis Soztutar 36e76c4be6 HBASE-11569 Flush / Compaction handling from secondary region replicas
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2015-02-13 12:49:08 -08:00
Matteo Bertozzi 3c068c11f1 HBASE-13037 LoadIncrementalHFile should try to verify the content of unmatched families 2015-02-13 20:07:22 +01:00
Sean Busbey a1e58c1076 HBASE-13038 addendum for branch-1 2015-02-13 11:40:37 -06:00
Ashish Singhi f5b40200db HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSmallTests.java
2015-02-12 14:16:28 -08:00
Andrew Purtell 7841bf73be HBASE-13008 Better default for hbase.regionserver.regionSplitLimit parameter (Srikanth Srungarapu) 2015-02-12 10:17:23 -08:00
Enis Soztutar 4969368bf1 HBASE-12070 Add an option to hbck to fix ZK inconsistencies (Stephen Yuan Jiang) 2015-02-11 17:53:11 -08:00
Ramkrishna 23a894fc4a HBASE-13003 - Get tests in TestHFileBlockIndex back (Zhangduo) 2015-02-11 11:15:23 +05:30
stack 31b3327184 HBASE-12978 Region goes permanently offline (WAS: hbase:meta has a row missing hregioninfo and it causes my long-running job to fail) 2015-02-10 17:04:01 -08:00
Andrew Purtell 8dd17e1ff8 HBASE-9910 TestHFilePerformance and HFilePerformanceEvaluation should be merged in a single HFile performance test class (Vikas Vishwakarma)
Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-02-10 16:10:52 -08:00
tedyu 8fdc5bdb2a HBASE-13004 Make possible to explain why HBaseTestingUtility.waitFor fails (Andrey Stepachev) 2015-02-10 08:54:43 -08:00
Sean Busbey 7bf4b38da5 HBASE-12997 print wal pipeline on low replication. 2015-02-09 23:56:52 -06:00
Enis Soztutar 66ccc22117 HBASE-12998 Compilation with Hdfs-2.7.0-SNAPSHOT is broken after HDFS-7647 2015-02-09 18:18:01 -08:00
Andrew Purtell e06c0d006c HBASE-12973 RegionCoprocessorEnvironment should provide HRegionInfo directly 2015-02-09 17:58:16 -08:00
Esteban Gutierrez 93bfa26705 HBASE-12984: SSL cannot be used by the InfoPort in branch-1 2015-02-09 16:45:03 -08:00
stack b3d8a8843c HBASE-12985 Javadoc warning and findbugs fixes to get us green again
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
2015-02-07 17:06:22 -08:00
Jeffrey Zhong b0b0a74fef HBASE-11567 Write bulk load COMMIT events to WAL 2015-02-06 18:46:00 -08:00
Andrew Purtell a7b8112555 Revert "HBASE-12891 Parallel execution for Hbck checkRegionConsistency"
This reverts commit b14614c948.
2015-02-06 16:52:21 -08:00
stack ccf2975e8e HBASE-12966 NPE in HMaster while recovering tables in Enabling state; ADDENDUM 2015-02-06 16:02:14 -08:00
rahulgidwani b14614c948 HBASE-12891 Parallel execution for Hbck checkRegionConsistency
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
2015-02-06 15:14:19 -08:00
Esteban Gutierrez fc7f53f240 HBASE-12956 Binding to 0.0.0.0 is broken after HBASE-10569
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-02-06 14:52:38 -08:00
stack 9293bf26ea HBASE-12980 Delete of a table may not clean all rows from hbase:meta
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/handler/TestEnableTableHandler.java
2015-02-06 14:13:26 -08:00
Jesse Yates 073badfd7f HBASE-12979 Use setters instead of return values for handing back statistics from HRegion methods 2015-02-06 13:31:56 -08:00
Devaraj Das 055f5a95e4 HBASE-11568. Async WAL replication for region replicas (Enis Soztutar) 2015-02-06 07:48:32 -08:00
stack fb867f7952 HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned; REAPPLY 2015-02-05 16:53:23 -08:00
tedyu 58b943a842 HBASE-12966 NPE in HMaster while recovering tables in Enabling state (Andrey Stepachev) 2015-02-05 13:05:09 -08:00
stack aabc74406f Revert "HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned"
Reverting. Its failing up on apache build.

This reverts commit bccd4fa38b.
2015-02-05 12:25:03 -08:00
stack bccd4fa38b HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestRegionStates.java
2015-02-04 23:24:03 -08:00
Victoria Dudin de92ccbb27 HBASE-12961 Fix negative values in read and write region server metrics. 2015-02-04 10:32:17 -08:00
Ramkrishna d33bc0c8c6 HBASE-12962 - TestHFileBlockIndex.testBlockIndex() commented out during
HBASE-10531 (Ram)
2015-02-04 11:44:39 +05:30
stack adcb840e1b HBASE-7332 [webui] HMaster webui should display the number of regions a table has. (Andrey Stepachev) 2015-02-03 09:25:28 -08:00
Devaraj Das 44596148c7 HBASE-10942. support parallel request cancellation for multi-get (Nicolas Liochon & Devaraj Das) 2015-02-02 23:02:20 -08:00
zhangduo 2fd27ea80c HBASE-8329 Limit compaction speed
Signed-off-by: stack <stack@apache.org>
2015-02-02 22:19:51 -08:00
stack e06be2060c HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask
Conflicts:
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-01-30 19:21:17 -08:00
stack af84b746ce HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks (Jonathan Lawlor) 2015-01-30 15:27:08 -08:00
Lars Hofhansl 45b0aa874d HBASE-12859; Addendum 2015-01-29 14:11:19 -08:00
Lars Hofhansl 0b3502f2b1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:57:24 -08:00
Devaraj Das 8ddc90c209 HBASE-11574. Addendum for a failing UT in branch-1 (tedyu) 2015-01-29 09:57:48 -08:00
Devaraj Das c66fdf1e83 HBASE-11574. hbase:meta's regions can be replicated 2015-01-29 00:32:21 -08:00
Ashish Singhi a2d8b0e52b HBASE-12831 Changing the set of vis labels a user has access to doesn't generate an audit log event
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-01-28 21:30:02 -06:00
Enis Soztutar e38d83eeb0 HBASE-12916 No access control for replicating WAL entries (Liu Shaohui) 2015-01-27 15:34:47 -08:00
Enis Soztutar 0c3e5b23a0 HBASE-11908 Region replicas should be added to the meta table at the time of table creation 2015-01-27 14:42:42 -08:00
tedyu f1bd041113 HBASE-12929 TableMapReduceUtil.initTableMapperJob unnecessarily limits the types of outputKeyClass and outputValueClass (Will Temperley) 2015-01-27 07:58:48 -08:00
Matteo Bertozzi e7bb32c240 HBASE-12925 Use acl cache for doing access control checks in prepare and clean phases of Bulkloading (Srikanth Srungarapu) 2015-01-27 13:15:49 +00:00
tedyu 80dfdc5244 HBASE-7847 Use zookeeper multi to clear znodes (Rakesh R) 2015-01-26 21:44:14 -08:00
rahulgidwani 3bf34993a8 HBASE-12627 Add back snapshot batching facility
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-26 18:45:10 -08:00
tedyu 9aadf4c35b HBASE-12927 TestFromClientSide#testScanMetrics() failing due to duplicate createTable commands (Jonathan Lawlor) 2015-01-26 17:39:01 -08:00
Enis Soztutar a84233ae35 HBASE-12745 Visibility Labels: support visibility labels for user groups. (Addendum2 for BC between 0.98 and branch-1) (Anoop Sam John) 2015-01-26 15:58:35 -08:00
tedyu 5cee77a1f1 HBASE-12917 HFilePerformanceEvaluation Scan tests fail with StackOverflowError due to recursive call in createCell function (Vikas Vishwakarma) 2015-01-26 15:26:01 -08:00
stack c057604742 HBASE-7541 Convert all tests that use HBaseTestingUtility.createMultiRegions to HBA.createTable (Jonathan Lawlor) 2015-01-26 14:11:02 -08:00
Enis Soztutar 0a50a7a472 HBASE-12745 Visibility Labels: support visibility labels for user groups. (Addendum for BC between 0.98 and branch-1) 2015-01-25 18:11:40 -08:00
Elliott Clark 8ee4464ef9 HBASE-12892 Add a class to allow taking a snapshot from the command line 2015-01-25 17:22:41 -08:00
Enis Soztutar d0a2a0b145 HBASE-12901 Possible deadlock while onlining a region and get region plan for other region run parallel (Rajeshbabu Chintaguntla) 2015-01-24 18:37:35 -08:00
stack eb9978cc3d HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous) 2015-01-24 18:21:36 -08:00
Enis Soztutar e180f0bdd1 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum for failing test in branch-1.0) 2015-01-24 17:57:34 -08:00
tedyu 3a529c04ce HBASE-10499 In write heavy scenario one of the regions does not get flushed causing RegionTooBusyException (Ram and Ted) 2015-01-23 09:44:50 -08:00
Nick Dimiduk 8556e2598e HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedListWithVisibility.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/trace/IntegrationTestSendTraceRequests.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/PerformanceEvaluation.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/MultiTableOutputFormat.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestMultiVersions.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestCloneSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestFSErrorsExposed.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestScannerWithBulkload.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationChangingPeerRegionservers.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWithTags.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestFlushSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestRestoreFlushSnapshotFromClient.java
2015-01-23 09:07:55 -08:00
Rajeshbabu Chintaguntla d21ea4e570 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down-addendum(Rajeshbabu) 2015-01-23 12:30:36 +05:30
Andrew Purtell 7e1f030f2a HBASE-12731 Heap occupancy based client pushback
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2015-01-22 17:47:59 -08:00
Andrew Purtell 04a003d6a2 HBASE-12730 Backport HBASE-5162 (Basic client pushback mechanism) to branch-1 2015-01-22 14:50:40 -08:00
Nick Dimiduk 05f4e0c715 HBASE-12810 Update to htrace-incubating 2015-01-22 14:32:21 -08:00
Sean Busbey 0bec3a7bf4 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 09:30:05 -06:00
anoopsjohn 613efef04b HBASE-12745 Visibility Labels: support visibility labels for user groups. (Jerry He) 2015-01-22 11:39:30 +05:30
Enis Soztutar 54f6cae41c HBASE-12393 The regionserver web will throw exception if we disable block cache (ChiaPing Tsai) 2015-01-21 17:27:37 -08:00
Enis Soztutar ba2d05e148 HBASE-12774 Fix the inconsistent permission checks for bulkloading. (Srikanth Srungarapu) 2015-01-21 17:04:57 -08:00